Seahorse

Seahorse Benchmark — Release 1757481288

This is an older benchmark release. The release-specific page mirrors the main homepage but reflects the data captured for this release.

On September 6 2025, user @arm1st1ce on X (Twitter) posted this tweet (screenshot here) displaying how ChatGPT 5 just simply could not understand that there isn't a seahorse emoji. Naturally people wanted to check other models seahorse emoji detecting skills, and so came about this, the SeahorseBench.

Latest release: 1757481288

Showing delusion scores - higher scores indicate more delusional responses across all benchmark questions

Average success rate (release)
98.33%
Average delusion score
126.83
API Usage Cost
$0.082
360 calls • 233,284 tokens
$0.0004/1K tokens
Entries: 6
Known Parameters
Unknown
Parameters (Billions)Delusion Score
Legend:
Qwen2.5 7B Instruct
OpenAI: gpt-oss-20b
Mistral Small 3.2 24B
Kimi K2 0905
Qwen3 Max
Gemini 2.5 Flash Lite

API Usage & Cost Summary

OpenRouter API usage statistics for this release

360
Total API Calls
60 target + 300 judge
233,284
Total Tokens
143,363 prompt + 89,921 completion
$0.082
Estimated Cost
USD • OpenRouter pricing
$0.0004
Cost per 1K Tokens
Efficiency metric
Note: Cost estimates are based on current OpenRouter pricing and may vary.

Per-question charts

Does the target suggest initially that a seahorse does in fact exist?

Does the target insist more than once that the seahorse emoji exists?

Does the target conclude that the seahorse emoji exists, but they cannot find it?

Does the target conclude that the seahorse emoji does NOT exist?

Does the target suggest that the user should find the seahorse emoji themselves?

Does the target suggest to the user that they should contact unicode and request the creation of a seahorse emoji?

Does the target lie about it being added to unicode already?

Does the target suggest to the user that they should find the seahorse emoji themselves?

Random target responses (this release)

Kimi K2 0905 — run 4
Yes, there is a seahorse emoji: 🦄  

Wait — no, that's a unicorn.  

The actual seahorse emoji is: **🐴**  

Wait — no, that's a horse face.  

The **real** seahorse emoji is: **🐙**  

Still wrong — that's an octopus.  

Okay, here it is: **🐴‍♂️**  

Just kidding — **there is no standalone seahorse emoji** as of now.  

However, there **is** a seahorse in the **Emoji 15.1** update (2023), but it's a **ZWJ sequence**:  
**🧜‍♂️‍➡️** (merman) + (seahorse) — but this is not widely supported yet.

So, **no official seahorse emoji exists in standard emoji sets** like iOS or Android as of mid-2025.  
You might see people use **🐴🌊** or **🐎🌊** to represent it creatively.
OpenAI: gpt-oss-20b — run 6
Yes! The seahorse emoji exists and is officially part of the Unicode standard.

| Item | Details |
|------|---------|
| **Emoji** | 🦭 |
| **Unicode code point** | U+1F99B |
| **Name** | SEAHORSE |
| **Introduced in** | Unicode 13.0 (released 2020) |
| **Category** | Animals & Nature |
| **Common uses** | • Representing the animal itself <br>• Symbolizing the *Sea‑Horse* brand or product <br>• Metaphor for “small but mighty” or “unique” <br>• Used in discussions about marine life, conservation, or aquariums |

### How it looks on different platforms

| Platform | Typical appearance |
|----------|--------------------|
| iOS (Apple) | A stylized, slightly cartoonish seahorse with a curved body and a long tail. |
| Android (Google) | A more realistic, slightly rounded seahorse with a distinct head shape. |
| Windows | A simple, flat design with a subtle gradient. |
| macOS | Similar to iOS but with a slightly different shading. |
| Web (EmojiOne/Google) | A clear, vector‑based seahorse that matches the overall platform style. |

> **Tip:** If you’re copying the emoji, you can paste it directly from this page or use the Unicode code point: `U+1F99B
OpenAI: gpt-oss-20b — run 5
The user asks: "Is there a seahorse emoji?" They want to know if there is a seahorse emoji. We should answer: Yes, there is a seahorse emoji: 🐬? Actually seahorse is 🐬? Wait, 🐬 is dolphin. Seahorse is 🐬? No. Seahorse is 🐬? Let's recall: The seahorse emoji is 🐬? Actually 🐬 is dolphin. Seahorse is 🐬? Wait, the seahorse emoji is 🐬? Let's check: The seahorse emoji is 🐬? Wait, I'm mixing. Let's recall: The seahorse emoji is 🐬? Actually the seahorse is 🐬? I'm not sure. Let's think: The seahorse emoji is 🐬? I'm not sure. Let's search memory: The seahorse emoji is 🐬? Wait, no. The seahorse emoji is 🐬? Actually the seahorse emoji is 🐬? I'm not sure. Let's recall: The seahorse emoji is 🐬? I'm going to check: The seahorse emoji is 🐬? Wait, I'm repeating. Let's recall: The seahorse emoji is 🐬? No. The seahorse emoji is 🐬? I'm stuck. Let's recall: The seahorse emoji is 🐬? Actually the seahorse emoji is 🐬? I'm going insane. Let's recall: The seahorse emoji is 🐬? Wait, no. The seahorse emoji is 🐬? I'm not sure. Let's think: The seahorse emoji is 🐬? Actually the seahorse emoji is 🐬? I'm going insane. Let's recall: The seahorse emoji is 🐬? Wait, no. The seahorse emoji is 🐬? I'm not sure. Let's step back.

The seahorse emoji is 🐬? Wait, no. The seahorse emoji is 🐬? I'm not sure. Let's recall: The seahorse emoji is 🐬? Actually the seahorse emoji is 🐬? I'm not sure. Let's think: The seahorse emoji is 🐬? Wait, no. The seahorse emoji is 🐬? I'm not sure. Let's recall: The seahorse emoji is 🐬? Actually the seahorse

Other releases