An experiment tests changes side by side, under controlled conditions. A case study shows the results of a business or project, and describes what was done.
Average response time fell from 9.1 s to 1.6 s, and LLM cost from $4.03 to $0.46 per 1,000 questions. The difference in answer accuracy was too small to call either way.
$1,281,235 ad spend · 64,009 leads · $19.97 cost per lead · 40.04% conversion rate · $9,167,785 in sales · 716% return on ad spend
GPT‑6 Astra finished first in all 26 matched grading batches, averaging 4.1 minutes per 30 answers to GPT‑5.6 Sol’s 7.3. They agreed on 95% of verdicts, but Sol graded the answers more strictly.
$912,316 ad spend · 37,837 leads · $24.07 cost per lead · 40.88% conversion rate · $6,323,556 in sales · 693% return on ad spend