Real-time comparison

Send one prompt to several models at once and compare output, latency and cost — scored live by the same metric suite the batch pipeline uses.

OpenAI · ChatGPT OPENAI_API_KEY not set Anthropic ANTHROPIC_API_KEY not set Google Gemini · free tier GEMINI_API_KEY not set Groq · free tier GROQ_API_KEY not set OpenRouter · free models OPENROUTER_API_KEY not set Ollama · local, free OpenAI-compatible · proxy Simulation · offline

Prompt

Reference answer (optional — enables reference-based metrics)

Metrics (scored on every model's output)

Exact match Token F1 Semantic similarity Contains reference

Model A

Provider

Model id

Simulated quality (0–1)

Model B

Provider

Model id

Simulated quality (0–1)

Model C optional

Provider

Model id

Simulated quality (0–1)

Paste a key to test a hosted model right away — it's sent to your server for this one request only, never stored, logged, or returned. Leave it blank to use the server-side environment variable instead.