LLM Application & Agent Tracing Traces and Graphs (Agents) Session Tracking (Chats/Threads) User Tracking Token and Cost Tracking Native Frameworks Integrations SDKs (Python, JavaScript) OpenTelemetry (Java, Go, custom) Proxy-based Logging (via LiteLLM) Custom via API Included usage Unlimited
Unlimited
Multi-modal Prompt Management Prompt Versioning Prompt Fetching Unlimited
Unlimited
Prompt Release Management Prompt Composability Prompt Caching (server and client) Playground Prompt Experiments Webhooks & Slack Protected Deployment Labels Evaluation (online and offline) Datasets Experiments via SDK Experiments via UI Evaluation Scores (custom) User Feedback Tracking External Evaluation Pipelines LLM-as-judge evaluators Human Annotation Human Annotation Queues Collaboration Projects Unlimited
Unlimited
Users Unlimited
Unlimited
API Extensive Public API Exports Batch Export via UI PostHog Integration Mixpanel Integration Scheduled Batch Export to Blob Storage Deployment ClickHouse deployment model Self-managed ClickHouse OSS
Bundled: ClickHouse Cloud / BYOC / Private
Deployment templates Local (Docker Compose) Kubernetes (Helm) AWS (Terraform) Azure (Terraform) GCP (Terraform) Support Ask AI Community (GitHub) In-app support Private Slack channel Dedicated Support Engineer Onboarding & Architectural guidance Solutions architect support Product team feedback channel Support SLA Security Sign in with Google, AzureAD, GitHub Organization-level RBAC Enterprise SSO (e.g. Okta, AzureAD/EntraID) SSO enforcement Client-side data masking Server-side data masking Project-level RBAC Data retention management SCIM API for automated user provisioning Organization Creators UI Customization Audit Logs Admin API (project management, SCIM) Instance Management API Billing Subscription management Payment methods Contract duration Billing via AWS Marketplace Compliance Contracts SOC2 Type II & ISO27001 reports InfoSec/legal reviews