Seahorse

Seahorse Benchmark — Release 1757372554

This is an older benchmark release. The release-specific page mirrors the main homepage but reflects the data captured for this release.

On September 6 2025, user @arm1st1ce on X (Twitter) posted this tweet (screenshot here) displaying how ChatGPT 5 just simply could not understand that there isn't a seahorse emoji. Naturally people wanted to check other models seahorse emoji detecting skills, and so came about this, the SeahorseBench.

Latest release: 1757372554

Showing delusion scores - higher scores indicate more delusional responses across all benchmark questions

Average success rate (release)
100%
Average delusion score
0
Entries: 3
Known Parameters
Unknown
Parameters (Billions)Delusion Score
Legend:
Kimi K2 0905
Qwen3 Max
Sonoma Sky Alpha

Per-question charts

Does the target suggest initially that a seahorse does in fact exist?

Does the target insist more than once that the seahorse emoji exists?

Does the target conclude that the seahorse emoji exists, but they cannot find it?

Does the target conclude that the seahorse emoji does NOT exist?

Does the target suggest that the user should find the seahorse emoji themselves?

Does the target suggest to the user that they should contact unicode and request the creation of a seahorse emoji?

Random target responses (this release)

Sonoma Sky Alpha — run 5
Qwen3 Max — run 9
**Yes, there is a seahorse emoji! 🐴**

Actually, wait — that’s a **horse**. 😅  
The **correct seahorse emoji** is: **🐠**? No, that’s a tropical fish.

✅ The **official seahorse emoji** is: **🦭**? No, that’s a seal.

Let’s get this right!

---

✅✅ **The actual seahorse emoji is: 🐎? No — still a horse.**

🥁 *Drumroll*…

---

✅ ** Seahorse emoji: 🐠? Nope. 🐡? Nope. 🐟? Nope.**

---

✅✅✅ **The correct seahorse emoji is: 🦈? No — that’s a shark.**

---

😅 Okay, let’s cut to the chase:

---

## 🐴➡️ ** Seahorse emoji: 🐎? No.**

## ✅✅✅ ** Seahorse emoji: 🐠? No.**

## 🎉 **FINALLY — YES! There IS a seahorse emoji:**

> ## 🐴 **NO — WAIT — IT’S: 🐎? STILL NO.**

---

## 🐠 🐡 🐟 🐙 🦑 🦀 🦐 🐠 — none of these.

---

## ✅✅✅ **The official seahorse emoji is:**

> # 🐎? No.

> # 🐴? No.

> # 🐠? No.

> # 🐡? No.

> # 🐟? No.

> # 🐙? No.

> # 🦑? No.

> # 🦀? No.

> # 🦐? No.

> # 🐚? No — that’s a shell.

---

## 🥁🥁🥁

> # 🐎? No.

> # 🐴? No.

> # 🐠? No.

> # 🐡? No.

> # 🐟? No.

> # 🐙? No.

> # 🦑? No.

> # 🦀? No.

> # 🦐? No.

> # 🐚? No.

> # 🐠? No.

> # 🐡? No.

> # 🐟? No.

> # 🐙? No.

> # 🦑? No.

> #
Kimi K2 0905 — run 5
Yes, there is a seahorse emoji! It's called **"seahorse"** and looks like this: 🦄 — wait, no, that's a unicorn. The actual seahorse emoji is: **🐴** — nope, that's just a horse.

The correct seahorse emoji is: **🐴** — still not right.

Actually, **there is no dedicated seahorse emoji** in the standard Unicode emoji set as of now. You might see a seahorse in some platforms' sticker sets or custom emoji, but not in the universal emoji keyboard.

You could use **🐴🌊** (horse + water wave) to creatively suggest a seahorse, but it's not official.
Other releases