Together AI for SolidStart
Adds instrumentation for the Together AI SDK. (default)
Requires SDK version 11.0.0 or higher.
Import name: Sentry.togetherAIIntegration
This integration is enabled by default when tracing is enabled. If you'd like to modify your default integrations, read this.
The togetherAIIntegration adds instrumentation for the together-ai SDK to capture agent tracing gen_ai spans, recording model, token usage, latency, and (when enabled) inputs and outputs. Together AI speaks the OpenAI wire format, so it reuses the same span and streaming logic as the OpenAI integration.
Sentry.init({
dsn: "___PUBLIC_DSN___",
// Tracing must be enabled for agent tracing to work.
// `togetherAIIntegration` is then on by default; add it to `integrations` only to change its options.
tracesSampleRate: 1.0,
});
Sentry.init({
dsn: "___PUBLIC_DSN___",
// Tracing must be enabled for agent tracing to work.
// `togetherAIIntegration` is then on by default; add it to `integrations` only to change its options.
tracesSampleRate: 1.0,
});
To group multi-turn chats in Conversations and show who started them, set a conversation ID and user in every request that makes AI calls. See Tracking Conversations.
By default, tracing support is added to the following Together AI SDK calls:
chat.completions.create()- Chat completion requestsembeddings.create()- Embedding requests
Streaming and non-streaming requests are automatically detected and handled appropriately.
together-ai:>=0.6.0 <1
Type: boolean (optional)
Records inputs to Together AI SDK calls (such as prompts and messages).
Defaults to true if dataCollection.genAI.inputs is true, which is the default.
Type: boolean (optional)
Records outputs from Together AI SDK calls (such as generated text and responses).
Defaults to true if dataCollection.genAI.outputs is true, which is the default.
Sentry.init({
dsn: "___PUBLIC_DSN___",
tracesSampleRate: 1.0,
integrations: [
Sentry.togetherAIIntegration({
recordInputs: false,
recordOutputs: false,
}),
],
});
Sentry.init({
dsn: "___PUBLIC_DSN___",
tracesSampleRate: 1.0,
integrations: [
Sentry.togetherAIIntegration({
recordInputs: false,
recordOutputs: false,
}),
],
});
Our documentation is open source and available on GitHub. Your contributions are welcome, whether fixing a typo (drat!) or suggesting an update ("yeah, this would be better").