Swift Examples - Groq
Step 1
Add the AIProxySwift package to your Xcode project
- Open your Xcode project
- Select File > Add Package Dependencies
- Paste github.com/lzell/aiproxyswift into the package URL bar
- Click Add Package
Step 2
Initialize
Import AIProxy and initialize using the following code:
import AIProxy
let groqService = AIProxy.groqService(
partialKey: "partial-key-from-your-developer-dashboard",
serviceURL: "service-url-from-your-developer-dashboard"
)
Step 3
Setup DeviceCheck
Before adding the DeviceCheck ENV variable check these three things: 1) in Xcode check that your Apple developer team is selected under the 'Signing & Capabilities' tab 2) make sure the bundle ID of your app is explicit (i.e. it can't contain a wildcard) 3) make sure the bundle ID in Xcode matches a bundle ID listed on the Identifers page in the Apple Developer dashboard.
Add the AIPROXY_DEVICE_CHECK_BYPASS env variable to your Xcode project:
- Type cmd-shift-comma to open up the "Edit Schemes" menu
- Select Run in the sidebar
- Add to the "Environment Variables" section (not the "Arguments Passed on Launch" section) an env variable with name AIPROXY_DEVICE_CHECK_BYPASS and value that we provided you in the AIProxy dashboard.
How to generate a non-streaming chat completion using Groq
import AIProxy
let groqService = AIProxy.groqService(
partialKey: "partial-key-from-your-developer-dashboard",
serviceURL: "service-url-from-your-developer-dashboard"
)
do {
let response = try await groqService.chatCompletionRequest(body: .init(
messages: [.assistant(content: "hello world")],
model: "mixtral-8x7b-32768"
))
print(response.choices.first?.message.content ?? "")
} catch AIProxyError.unsuccessfulRequest(let statusCode, let responseBody) {
print("Received non-200 status code: \(statusCode) with response body: \(responseBody)")
} catch {
print(error.localizedDescription)
}
How to generate a streaming chat completion using Groq
import AIProxy
let groqService = AIProxy.groqService(
partialKey: "partial-key-from-your-developer-dashboard",
serviceURL: "service-url-from-your-developer-dashboard"
)
do {
let stream = try await groqService.streamingChatCompletionRequest(body: .init(
messages: [.assistant(content: "hello world")],
model: "mixtral-8x7b-32768"
)
)
for try await chunk in stream {
print(chunk.choices.first?.delta.content ?? "")
}
} catch AIProxyError.unsuccessfulRequest(let statusCode, let responseBody) {
print("Received \(statusCode) status code with response body: \(responseBody)")
} catch {
print(error.localizedDescription)
}
How to transcribe audio with Groq
- Record an audio file in quicktime and save it as "helloworld.m4a"
- Add the audio file to your Xcode project. Make sure it's included in your target: select your audio file in the project tree, type cmd-opt-0 to open the inspect panel, and view Target Membership
- Run this snippet:
import AIProxy
let groqService = AIProxy.groqService(
partialKey: "partial-key-from-your-developer-dashboard",
serviceURL: "service-url-from-your-developer-dashboard"
)
do {
let url = Bundle.main.url(forResource: "helloworld", withExtension: "m4a")!
let requestBody = GroqTranscriptionRequestBody(
file: try Data(contentsOf: url),
model: "whisper-large-v3",
responseFormat: "json"
)
let response = try await groqService.createTranscriptionRequest(body: requestBody)
let transcript = response.text ?? "None"
print("Groq transcribed: \(transcript)")
} catch AIProxyError.unsuccessfulRequest(let statusCode, let responseBody) {
print("Received non-200 status code: \(statusCode) with response body: \(responseBody)")
} catch {
print("Could not get audio transcription from Groq: \(error.localizedDescription)")
}