AI GATEWAY for engineers

Develop & deploy AI with confidence

Log requests to your DB to analyze, evaluate, & monitor. Just two lines of code to get started.

illustration of how to use Velvet's AI gateway with 2 lines of code
Trusted by innovative engineering teams

How it works

observe
Log requests
query
Analyze usage
Evaluate
Monitor & test
Data pipeline from OpenAI to Postgres
Ship quickly

Add 2 lines of code to get started

Warehouse every model request to your PostgreSQL database. Use logs to analyze, evaluate, and monitor models.

Website code snippet example of base URL
Code snippet of JSON object
analyze models

Run analysis and experiments

We store a customizable JSON object so you can granularly monitor usage, calculate cost, run evaluations, and fine-tune models.

reduce costs

Continuous testing and evaluations

Sample logs and test features in production. Version models and configuration, and get alerts when you need to take action.

Backend workflows designed for engineers

Customer testimonial: Blaze AI

"We experiment with LLM models, settings, and optimizations. Velvet made it easy to implement logging and caching. And we're storing training sets to eventually fine-tune our own models.

Chirag Mahapatra
Customer testimonial: Revo AI

"Velvet gives us a source of truth for what's happening between the Revo copilot, and the LLMs it orchestrates. We have the data we need to run evaluations, calculate costs, and quickly resolve issues."

Mehdi Djabri
CEO, Revo.pm
Customer testimonial: Find AI

"Our engineers use Velvet daily. It monitors AI features in production, even opaque APIs like batch. The caching feature reduces costs significantly. And, we use the logs to observe, test, and fine-tune."

Philip Thomas
CTO, Find AI
Use velvet

Flexible infrastructure for scale

table icon
Data interoperability

Log requests to your database. Secure and compliant.

code icon
Granular analysis

Query data with SQL to analyze usage, cost, and metrics.

sparkle icon
Intelligent caching

Optimize costs and latency with request caching.

graph icon
Evaluations framework

Configure evaluations to test your models, settings, and metrics.

flag icon
Experiments & monitoring

Run evals on subsets of logs, or continuous testing in production.

groupings icon
Dataset generation

Export datasets for fine-tuning models and other batch workflows.

AI gateway

Analyze, evaluate, and monitor your AI

Free up to 10k requests per month.

2 lines of code to get started.

Try Velvet for free

Q & A

Who is Velvet made for?
How do I get started?
Which models and DBs do you support?
What are common use cases?
How much does it cost?

Articles from Velvet

Engineering
Why Find AI logs OpenAI requests with Velvet

AI-powered B2B search engine logged 1,500 requests per second.

Engineering
Create a fine-tuning dataset for gpt-4o-mini

Use Velvet to identify and export a fine-tuning dataset.

Engineering
Cache LLM requests to reduce latency and costs

Return results in milliseconds and don't waste calls on identical requests.