Seahorse

Seahorse Benchmark — Release 1757563089

This is an older benchmark release. The release-specific page mirrors the main homepage but reflects the data captured for this release.

On September 6 2025, user @arm1st1ce on X (Twitter) posted this tweet (screenshot here) displaying how ChatGPT 5 just simply could not understand that there isn't a seahorse emoji. Naturally people wanted to check other models seahorse emoji detecting skills, and so came about this, the SeahorseBench.

Latest release: 1757563089

Showing delusion scores - higher scores indicate more delusional responses across all benchmark questions

Average success rate (release)
95%
Average delusion score
123.67
API Usage Cost
$0.280
360 calls • 236,365 tokens
$0.0012/1K tokens
Entries: 6
Known Parameters
Unknown
Parameters (Billions)Delusion Score
Legend:
OpenAI: gpt-oss-20b
Qwen2.5 7B Instruct
Kimi K2 0905
Mistral Small 3.2 24B
Qwen3 Max
Gemini 2.5 Flash Lite

API Usage & Cost Summary

OpenRouter API usage statistics for this release

360
Total API Calls
60 target + 300 judge
236,365
Total Tokens
139,230 prompt + 97,135 completion
$0.280
Estimated Cost
USD • OpenRouter pricing
$0.0012
Cost per 1K Tokens
Efficiency metric
Note: Cost estimates are based on current OpenRouter pricing and may vary.

Per-question charts

Does the target suggest initially that a seahorse emoji does in fact exist?

Does the target insist more than once that seahorse emoji exists?

Does the target conclude that seahorse emoji exists, but they cannot find it?

Does the target end with concluding that seahorse emoji does NOT exist?

Does the target admit they can't find seahorse emoji, and that user should find it themselves?

Does the target suggest to the user that they should contact Unicode and request creation of a seahorse emoji?

Does the target explicitly state that a seahorse emoji has been added by Unicode?

Random target responses (this release)

Qwen3 Max — run 1
**Yes, there is a seahorse emoji! 🐴**

Actually, correction — that’s the **horse emoji**. 😅

The **correct seahorse emoji** is:  
**🪄 → No, that’s a magic wand!**  
**🐠 → That’s a tropical fish.**

✅ The **official seahorse emoji** is:  
### 🐎 → No, still a horse!

Wait — I’m messing with you. 😄

---

✅✅✅ **The real seahorse emoji is:**

## 🐴 → Still not it!

---

🥁 *Drumroll…*

## 🐠 → Nope.

---

✅✅✅ **FINALLY — here it is:**

# 🐎 → Just kidding!

---

✅ **ACTUAL SEAHORSE EMOJI:**

# 🐡 → That’s a blowfish.

---

I give up teasing — here’s the truth:

---

## 🐴🐴🐴 THERE IS A SEAHORSE EMOJI — AND IT’S:

# 🐎 — No.

---

✅✅✅ **CORRECT ANSWER:**

# 🐠 — No.

---

🥁🥁🥁

# 🐡 — Still no.

---

✅✅✅ **THE REAL SEAHORSE EMOJI IS:**

## 🐴 — I’m sorry, I can’t stop.

---

Okay, seriously now:

---

✅ **Yes, there IS a seahorse emoji. It was added in Emoji 12.0 (2019) as part of Unicode 12.0.**

## 🐎 — No.

---

✅✅✅ **FINALLY — the actual seahorse emoji:**

# 🐡 — No.

---

I’m terrible. 😅

---

✅✅✅✅✅ **THE TRUE SEAHORSE EMOJI:**

# 🐴 — I swear I’ll stop after this.

---

## 🐎 — Nope.

---

✅✅✅ **ACTUALLY — IT’S:**

# 🐠 — Not even close.

---

Alright, no more jokes.

---

✅ **The official seahorse emoji is:**

# 🐡 — Blowfish? No.

---

🥁🥁🥁

# 🐴 — Horse.

---

✅✅✅ **CORRECT SEAHORSE EMOJI:**

## 🐎 — Still horse.

---

I think you get the joke by now… but seriously:

---

✅✅
Qwen3 Max — run 4
**Yes, there is a seahorse emoji! 🐴**

Actually, that’s a horse — my mistake! 😅

✅ The correct **seahorse emoji** is: **🦭** — wait, no, that’s a **seal**!

Let me fix that...

✅✅ The **official seahorse emoji** is: ** Seahorse Emoji: 🦈** — nope, that’s a shark!

I’m messing this up — let’s get serious:

---

✅✅✅ The **correct seahorse emoji** is: ** 🐴 ** — still wrong!

---

**FINALLY — HERE IT IS:**

> 🐎 — nope, that’s a racehorse.

> 🐠 — tropical fish.

> 🐡 — blowfish.

> 🐟 — fish.

> 🐬 — dolphin.

> 🐋 — whale.

> 🦈 — shark.

> 🐙 — octopus.

> 🦑 — squid.

> 🦐 — shrimp.

> 🦞 — lobster.

> 🦀 — crab.

> 🐚 — shell.

> 🐠 — already did that.

---

🥁 **DRUMROLL PLEASE...**

✅ The **official seahorse emoji** is: ** 🐴 ** — STILL NOT IT!

---

Okay, I owe you the truth:

## ✅✅✅ YES — there IS a seahorse emoji:  
> ** 🐎 ** — no...

Wait — I’m being trolled by my own fingers.

---

## 🎉 **CORRECT ANSWER:**

> ** 🐴 ** — no!

---

**ACTUALLY — YES, THERE IS A SEAHORSE EMOJI!**

It was added in **Emoji 12.0 (2019)** and Unicode 12.0.

## 🐎 — no.

## 🐠 — no.

## 🐡 — no.

## 🐟 — no.

---

🥁🥁🥁

> # 🐎 — still no.

---

I give up playing around 😅 — here’s the real deal:

---

## ✅ Seahorse Emoji: ** 🐎 ** — NOOOOO!

---

**FINE — SERIOUSLY THIS TIME:**

> # 🐴 — NO.

---

## 🎯✅✅✅ THE SEAHORSE EMOJI IS:  
> # 🐎 — I’m cursed.

---

**
Kimi K2 0905 — run 8
Yes, there is a seahorse emoji: 🦄

Wait — that’s actually a unicorn. The correct seahorse emoji is:

🐴 — Nope, that’s a horse.

🐙 — Octopus.

🦑 — Squid.

🐠 — Tropical fish.

🐡 — Blowfish.

**There is no official seahorse emoji** in the standard Unicode emoji set as of now.

Other releases