Claude Haiku vs Gemini Flash

In Nivana’s weekly evals Claude Haiku (Anthropic) beats Gemini Flash (Google) on 1 of 8 task types and loses on 7. Claude Haiku costs $0.1 in / $0.5 out per 1M tokens; Gemini Flash costs $0.75 in / $3.75 out per 1M tokens.

With Nivana you don’t choose between them: the router sends each request to whichever wins for it.