Show HN: TTFT benchmark: LLM Gateway vs. OpenRouter (Claude-haiku-4.5, 150 runs) (llmgateway.io via hn)
model roundup
Haiku 4.5
-
We measured AI gateway performance with an open-source TTFT benchmark: 75 cold + 75 warm interleaved runs of claude-haiku-4.5 against LLM Gateway and OpenRouter, with phase-by-phase timings and raw data published. LLM Gateway reached first…
-
I benchmarked Claude Haiku 4.5 against 8 free/alt models (NVIDIA NIM plus a second free-tier provider) on a real task: writing outreach proposals from actual job postings, not a synthetic prompt. Same production prompts, same 3 real jobs,…