B 
Braintrust
Evaluation, prompt playground and logging for AI products.
NOT REALLY
why this verdict
Keep it — OpenAI has not replaced it
OpenAI's version overlaps, but does not finish the dev tools job, so this one is still worth keeping open.
- A named launch, not a vibe named, unlinked
- Labs ship built-in evaluation tools with their APIs. OpenAI, February 1, 2025 — no announcement link recorded yet.
- How much of the job it covers not the job editorial call
- Parts of it. The job still needs the tool to get finished.
- Is there a free way to do it? yes
- 1 of 2 listed replacements have a usable free tier: Langfuse.
- What the call is worth nothing to cancel
- No paid entry tier tracked, so there is no subscription to cancel.
Reason composed from the fields above missing: announcement linked recorded: free replacement listed recorded: two or more escape hatches
- Threatened by
- OpenAI
- Since
- February 1, 2025
- List price
- free
- Per year
- —
The backstory
Braintrust bet that shipping AI features is an evaluation problem, not a prompting one: you need datasets, scorers and a way to prove a change was an improvement. That discipline is what separates demos from products, and vendor-native eval tools stop at their own model.
Escape hatches
L 
Langfuse Open source, self-hostable.
langfuse.com open_in_new L 
LangSmith Tied to the LangChain ecosystem.
smith.langchain.com open_in_new1 of 2 replacements have a usable free tier.
