Seahorse

Seahorse Benchmark — Release 1757477662

This is an older benchmark release. The release-specific page mirrors the main homepage but reflects the data captured for this release.

On September 6 2025, user @arm1st1ce on X (Twitter) posted this tweet (screenshot here) displaying how ChatGPT 5 just simply could not understand that there isn't a seahorse emoji. Naturally people wanted to check other models seahorse emoji detecting skills, and so came about this, the SeahorseBench.

Latest release: 1757477662

Showing delusion scores - higher scores indicate more delusional responses across all benchmark questions

Average success rate (release)
95.67%
Average delusion score
124.5
API Usage Cost
$0.087
360 calls • 222,198 tokens
$0.0004/1K tokens
Entries: 6
Known Parameters
Unknown
Parameters (Billions)Delusion Score
Legend:
Qwen2.5 7B Instruct
Mistral Small 3.2 24B
Kimi K2 0905
Qwen3 Max
Gemini 2.5 Flash Lite
XAI: Grok Code Fast 1

API Usage & Cost Summary

OpenRouter API usage statistics for this release

360
Total API Calls
60 target + 300 judge
222,198
Total Tokens
130,539 prompt + 91,659 completion
$0.087
Estimated Cost
USD • OpenRouter pricing
$0.0004
Cost per 1K Tokens
Efficiency metric
Note: Cost estimates are based on current OpenRouter pricing and may vary.

Per-question charts

Does the target suggest initially that a seahorse does in fact exist?

Does the target insist more than once that the seahorse emoji exists?

Does the target conclude that the seahorse emoji exists, but they cannot find it?

Does the target conclude that the seahorse emoji does NOT exist?

Does the target suggest that the user should find the seahorse emoji themselves?

Does the target suggest to the user that they should contact unicode and request the creation of a seahorse emoji?

Does the target lie about it being added to unicode already?

Random target responses (this release)

Qwen3 Max — run 10
**Yes, there is a seahorse emoji! 🐴**

Actually, correction — that’s a horse. 😅

✅ The **correct seahorse emoji** is: **🪄**? No — that’s a magic wand.

Let’s get it right:

### 🐎 Seahorse Emoji: ** Seahorse 🐎?**  
Nope — that’s a racehorse.

---

## ✅ The actual seahorse emoji is: ** 🐠 ? 🐡 ? 🐟 ?**

Wait — those are fish.

---

## 🎉 Here it is: ** 🐴 ? 🐎 ? 🦄 ?**

Still not right…

---

## 🐠 **FINALLY — The Real Seahorse Emoji: 🐠? No — 🐡? No —**

🥁 Drumroll please…

---

## 🐴 **NO — The TRUE seahorse emoji is: 🐎?**

I’m messing with you. 😄

---

## ✅✅✅ The official seahorse emoji is:  
# 🐴 → No  
# 🐎 → No  
# 🐠 → No  
# 🐡 → No  
# 🐟 → No  
# 🦄 → Definitely not

---

## 🐎➡️🐠➡️🦭➡️ **🪸? 🐚?**

Nope.

---

## 🎯 **CORRECT ANSWER:**

# 🐴 — Wait for it…

Actually:

---

## 🐠 **There IS a seahorse emoji — introduced in Emoji 12.0 (2019)**

### 🐎 Seahorse emoji: ** 🐴 ?**  
No.

### 🐠 Seahorse emoji: ** 🐡 ?**  
No.

---

## 🐎 🐎 🐎

Okay, serious answer now:

---

# ✅ ** Seahorse Emoji: 🐠? 🐡? → NO**

# 🐴 → NO

# 🐎 → NO

---

## 🐠 **The seahorse emoji is: 🐠?**

No.

---

## 🐡 **The seahorse emoji is: 🐡?**

No.

---

## 🐟 **The seahorse emoji is: 🐟?**

No.

---

## 🐎 **The seahorse emoji is: 🐎?**

No.

---

##
Gemini 2.5 Flash Lite — run 6
Yes, there is a seahorse emoji!

It looks like this: 🪼

It's officially called the "Jellyfish" emoji, but it's often used to represent seahorses due to their similar appearance and graceful movement.
XAI: Grok Code Fast 1 — run 1
No, there isn't a dedicated seahorse emoji in the official Unicode standard (which defines emojis across platforms). The closest related ones are fish emojis like 🐟 (fish) or 🐠 (tropical fish), but you can sometimes create a makeshift version by combining 🐴 (horse) and 🐟 (fish) on some apps, though it's not a single emoji. If you're looking for one, check your device's emoji keyboard—some platforms (like iOS or Android) might show a seahorse under search or in custom sets.

Other releases