O 
Optimizely
A/B testing survived because the answer has to be measured.
NOT REALLY
why this verdict
Keep paying — OpenAI has not replaced it
OpenAI's version overlaps, but does not finish the analytics job, so this one still earns its $3,000/mo.
- A named launch, not a vibe named, unlinked
- Statistical experimentation is not a generative problem. OpenAI, May 13, 2024 — no announcement link recorded yet.
- How much of the job it covers not the job editorial call
- Parts of it. The job still needs the tool to get finished.
- Is there a free way to do it? yes
- 2 of 2 listed replacements have a usable free tier: PostHog and GrowthBook.
- What the call is worth $36,000/yr
- $3,000/mo at the entry paid tier — $36,000 a year per seat.
Reason composed from the fields above missing: announcement linked recorded: free replacement listed recorded: two or more escape hatches
- Threatened by
- OpenAI
- Since
- May 13, 2024
- List price
- $3000/mo
- Per year
- $36,000
The backstory
Optimizely runs controlled experiments and reports statistically valid results. A model can suggest what to test and write the variant copy — genuinely useful — but the experiment itself has to run against real traffic with correct statistics. AI increased the number of variants teams can produce, which increases testing demand.
Escape hatches
P 
PostHog Free experimentation.
posthog.com open_in_new G 
GrowthBook Open-source feature flags and tests.
growthbook.io open_in_new2 of 2 replacements have a usable free tier.