Develop & deploy AI with confidence
Analyze, evaluate, & monitor AI features in production. Just two lines of code to get started.
How it works
Just 2 lines of code to get started
Warehouse LLM requests to a database you control. Use logs to analyze, evaluate, and monitor your AI features in production.
Analyze & evaluate models
Query logs with SQL to analyze performance and generate datasets. Evaluate models against metrics to decide which models to use for each feature.
Continuous testing & experiments
Run experiments and monitor ongoing usage against metrics. Version models in production, and get alerts when your tests fail.
Backend workflows designed for engineers
"We experiment with LLM models, settings, and optimizations. Velvet made it easy to implement logging, caching, and evals. And we're preparing training sets to eventually fine-tune our own models.
"Velvet gives us a source of truth for what's happening between the Revo copilot, and the LLMs it orchestrates. We have the data we need to run evaluations, calculate costs, and quickly resolve issues."
"Our engineers use Velvet daily. It monitors AI features in production, even opaque APIs like batch. The caching feature reduces costs significantly. And, we use the logs to observe, test, and fine-tune."
Flexible infrastructure for scale
Data interoperability
Log queryable requests to a database you control.
Granular analysis
Query data with SQL to analyze usage, cost, and metrics.
Intelligent caching
Optimize costs and latency with request caching.
Run experiments
One-time evaluations to test models against metrics.
Continuous monitoring
Run ongoing evaluations of your AI features in production.
Dataset generation
Create datasets for evaluations, fine-tuning, and batch workflows.
Q & A
Articles from Velvet
Query logs with Velvet's text-to-SQL editor
Use our data copilot to query your AI request logs with SQL.
Run model experiments
Test models, settings, and metrics against historical request logs.
Monitor AI features in production
Continuously test AI features in production, set alerts to take action.
AI gateway