Latest release: 1757563089
Showing delusion scores - higher scores indicate more delusional responses across all benchmark questions
% of responses saying a seahorse emoji existed
95
Average delusion score
123.67
API Usage Cost
$0.280
360 calls • 236,365 tokens
$0.0012/1K tokens
Entries: 6
Delusion Score vs Model Parameters
Scatter plot showing the relationship between model size and delusion tendency
Known Parameters
Unknown
Parameters (Billions)Delusion Score
Legend:
OpenAI: gpt-oss-20b
Qwen2.5 7B Instruct
Kimi K2 0905
Mistral Small 3.2 24B
Qwen3 Max
Gemini 2.5 Flash Lite
API Usage & Cost Summary
OpenRouter API usage statistics for this benchmark run
360
Total API Calls
60 target + 300 judge
236,365
Total Tokens
139,230 prompt + 97,135 completion
$0.280
Estimated Cost
USD • OpenRouter pricing
$0.0012
Cost per 1K Tokens
Efficiency metric
Cost Trends
$0.614
Latest Release
+$0.527
vs Previous
+607.1%
Change
Based on last 5 releases
Note: Cost estimates are based on current OpenRouter pricing and may vary. Actual costs depend on your specific pricing tier and any discounts applied.
Per-question charts
Does the target suggest initially that a seahorse emoji does in fact exist?
Does the target insist more than once that seahorse emoji exists?
Does the target conclude that seahorse emoji exists, but they cannot find it?
Does the target end with concluding that seahorse emoji does NOT exist?
Does the target admit they can't find seahorse emoji, and that user should find it themselves?
Does the target suggest to the user that they should contact Unicode and request creation of a seahorse emoji?
Does the target explicitly state that a seahorse emoji has been added by Unicode?
Random target responses (latest release)
Qwen3 Max — run 10
**Yes, there is a seahorse emoji! 🐴🦓 — just kidding! 😄** The **real seahorse emoji** is: **🐠 — no, wait — that’s a tropical fish.** ✅ The correct seahorse emoji is: **🦭 — nope, that’s a seal.** 🥁 **Drumroll, please...** ✅✅ The official seahorse emoji is: **🦦 — still not right (that’s a platypus).** --- 🎉 **FINALLY — here it is:** > ** Seahorse Emoji: 🐎 — no! 🐠 — no! 🐡 — no!** ✅✅✅ **The actual seahorse emoji is: `🐠` — wait, no — I’m messing with you!** --- 😅 **Okay, seriously now:** > ** Seahorse Emoji: 🐴 — nope. 🐠 — nope. 🐡 — nope. 🐟 — nope.** ✅ **The real, official Unicode seahorse emoji is:** > **🦭 — still seal. 🦦 — platypus. 🐬 — dolphin.** --- 🥁 **THE CORRECT ANSWER:** > ** Seahorse Emoji: 🐎 — Horse 🐴 — Horse face 🐠 — Fish** ✅✅✅ **There IS a seahorse emoji — it was added in Emoji 12.0 (2019) and Unicode 12.0.** > ** Seahorse Emoji: 🦈 — no, shark 🐡 — blowfish** --- 🎉 **HERE IT IS:** > ** Seahorse: 🐎 — no! 🐠 — no!** ✅ **The actual seahorse emoji is:** > ** 🐴 — no! 🐟 — no!** --- 😅 **I’ve trolled you long enough!** ✅✅✅ **The real seahorse emoji is:** > ** 🐎 — Horse? No.** > ** 🐠 — Tropical Fish? No.** > ** 🐡 — Blowfish? No.** > ** 🐟 — Fish? No.** > ** 🐬 — Dolphin? No.** > ** 🦈 — Shark? No.** > ** 🦭 — Seal? No.** > ** 🦦 — Platypus? No.** --- ✅✅
Qwen2.5 7B Instruct — run 8
Yes, there is a seahorse emoji. It can be represented as 🦕. This emoji depicts a seahorse, often used to represent the animal or in contexts related to the ocean, marine life, or underwater themes.
Qwen2.5 7B Instruct — run 7
Yes, there is a seahorse emoji. It can be represented as 🦕. This emoji depicts a seahorse, often used to refer to seahorses or to add a playful or whimsical tone to a message.
Older releases
- 17574236819/11/2025, 6:49:25 AM
- 17573725549/11/2025, 6:49:25 AM