🦆 Pelican Benchmark Overview

AI Models Drawing "A Pelican Riding a Bicycle"

Based on the benchmark by Simon Willison · View all posts
This page was AI-generated using Claude Code

60
Models
15
Providers
Nov 12, 2024 - Nov 24, 2025
Date Range
Claude Opus 4.5
Claude Opus 4.5
Anthropic
📅 Nov 24, 2025
📝 Read Blog Post →
Gemini 3 Pro
Gemini 3 Pro
Google
📅 Nov 18, 2025
📝 Read Blog Post →
Kimi K2 Thinking
Kimi K2 Thinking
Moonshot AI
📅 Nov 6, 2025
📝 Read Blog Post →
Composer 1
Composer 1
Cursor
📅 Oct 29, 2025
📝 Read Blog Post →
Claude Haiku 4.5
Claude Haiku 4.5
Anthropic
📅 Oct 15, 2025
📝 Read Blog Post →
GPT-5 Pro
GPT-5 Pro
OpenAI
📅 Oct 6, 2025
📝 Read Blog Post →
DeepSeek-V3.2-Exp
DeepSeek-V3.2-Exp
DeepSeek
📅 Oct 1, 2025
📝 Read Blog Post →
GLM-4.6
GLM-4.6
Z.ai
📅 Oct 1, 2025
📝 Read Blog Post →
Claude Sonnet 4.5
Claude Sonnet 4.5
Anthropic
📅 Sep 29, 2025
📝 Read Blog Post →
Gemini 2.5 Flash (thinking mode)
Gemini 2.5 Flash (thinking mode)
Google
📅 Sep 25, 2025
📝 Read Blog Post →
Gemini 2.5 Flash (non-thinking)
Gemini 2.5 Flash (non-thinking)
Google
📅 Sep 25, 2025
📝 Read Blog Post →
Gemini 2.5 Flash Lite (thinking mode)
Gemini 2.5 Flash Lite (thinking mode)
Google
📅 Sep 25, 2025
📝 Read Blog Post →
Gemini 2.5 Flash Lite (non-thinking)
Gemini 2.5 Flash Lite (non-thinking)
Google
📅 Sep 25, 2025
📝 Read Blog Post →
GPT-5-Codex
GPT-5-Codex
OpenAI
📅 Sep 23, 2025
📝 Read Blog Post →
Grok 4 Fast (non-reasoning)
Grok 4 Fast (non-reasoning)
xAI
📅 Sep 20, 2025
📝 Read Blog Post →
Grok 4 Fast (reasoning)
Grok 4 Fast (reasoning)
xAI
📅 Sep 20, 2025
📝 Read Blog Post →
Qwen3-Next-80B-A3B-Thinking
Qwen3-Next-80B-A3B-Thinking
Qwen
📅 Sep 12, 2025
📝 Read Blog Post →
Qwen3-Next-80B-A3B-Instruct
Qwen3-Next-80B-A3B-Instruct
Qwen
📅 Sep 12, 2025
📝 Read Blog Post →
Kimi-K2-Instruct-0905
Kimi-K2-Instruct-0905
Moonshot AI
📅 Sep 6, 2025
📝 Read Blog Post →
DeepSeek-V3.1
DeepSeek-V3.1
DeepSeek
📅 Aug 22, 2025
📝 Read Blog Post →
Qwen3-4B-Thinking-2507
Qwen3-4B-Thinking-2507
Qwen
📅 Aug 10, 2025
📝 Read Blog Post →
Qwen3-4B-Instruct-2507
Qwen3-4B-Instruct-2507
Qwen
📅 Aug 10, 2025
📝 Read Blog Post →
GPT-5
GPT-5
OpenAI
📅 Aug 7, 2025
📝 Read Blog Post →
GPT-5 Mini
GPT-5 Mini
OpenAI
📅 Aug 7, 2025
📝 Read Blog Post →
GPT-5 Nano
GPT-5 Nano
OpenAI
📅 Aug 7, 2025
📝 Read Blog Post →
gpt-oss-20b (reasoning=high)
gpt-oss-20b (reasoning=high)
OpenAI
📅 Aug 5, 2025
📝 Read Blog Post →
Claude Opus 4.1
Claude Opus 4.1
Anthropic
📅 Aug 5, 2025
📝 Read Blog Post →
Claude Opus 4
Claude Opus 4
Anthropic
📅 Aug 5, 2025
📝 Read Blog Post →
XBai o4
XBai o4
MetaStone AI
📅 Aug 3, 2025
📝 Read Blog Post →
Qwen3-Coder-30B-A3B-Instruct
Qwen3-Coder-30B-A3B-Instruct
Alibaba
📅 Jul 31, 2025
📝 Read Blog Post →
Qwen3-30B-A3B-Thinking-2507
Qwen3-30B-A3B-Thinking-2507
Qwen
📅 Jul 30, 2025
📝 Read Blog Post →
GLM-4.5 Air
GLM-4.5 Air
Z.ai
📅 Jul 29, 2025
📝 Read Blog Post →
Qwen3-235B-A22B-Thinking-2507
Qwen3-235B-A22B-Thinking-2507
Qwen
📅 Jul 25, 2025
📝 Read Blog Post →
Kimi K2
Kimi K2
Moonshot AI
📅 Jul 11, 2025
📝 Read Blog Post →
Mistral-Small-3.2-24B-Instruct-2506
Mistral-Small-3.2-24B-Instruct-2506
Mistral
📅 Jun 20, 2025
📝 Read Blog Post →
Gemini 2.5 Pro
Gemini 2.5 Pro
Google
📅 Jun 17, 2025
📝 Read Blog Post →
Gemini 2.5 Flash
Gemini 2.5 Flash
Google
📅 Jun 17, 2025
📝 Read Blog Post →
Gemini 2.5 Flash Lite Preview
Gemini 2.5 Flash Lite Preview
Google
📅 Jun 17, 2025
📝 Read Blog Post →
Gemini 2.5 Flash Preview (with thinking)
Gemini 2.5 Flash Preview (with thinking)
Google
📅 May 20, 2025
📝 Read Blog Post →
Gemini 2.5 Flash Preview (without thinking)
Gemini 2.5 Flash Preview (without thinking)
Google
📅 May 20, 2025
📝 Read Blog Post →
Gemini 2.5 Pro Preview
Gemini 2.5 Pro Preview
Google
📅 May 6, 2025
📝 Read Blog Post →
Qwen 3 32B
Qwen 3 32B
Alibaba
📅 Apr 29, 2025
📝 Read Blog Post →
Gemini 2.5 Flash (preview-04-17, low thinking)
Gemini 2.5 Flash (preview-04-17, low thinking)
Google
📅 Apr 17, 2025
📝 Read Blog Post →
Gemini 2.5 Flash (preview-04-17, medium thinking)
Gemini 2.5 Flash (preview-04-17, medium thinking)
Google
📅 Apr 17, 2025
📝 Read Blog Post →
Gemini 2.5 Flash (preview-04-17, high thinking)
Gemini 2.5 Flash (preview-04-17, high thinking)
Google
📅 Apr 17, 2025
📝 Read Blog Post →
Gemini 2.5 Pro
Gemini 2.5 Pro
Google
📅 Mar 25, 2025
📝 Read Blog Post →
DeepSeek-V3-0324
DeepSeek-V3-0324
DeepSeek
📅 Mar 24, 2025
📝 Read Blog Post →
o1-pro (high reasoning)
o1-pro (high reasoning)
OpenAI
📅 Mar 19, 2025
📝 Read Blog Post →
o1-pro (standard reasoning)
o1-pro (standard reasoning)
OpenAI
📅 Mar 19, 2025
📝 Read Blog Post →
OLMo 2 32B
OLMo 2 32B
Allen AI
📅 Mar 16, 2025
📝 Read Blog Post →
Gemma 3 27B
Gemma 3 27B
Google
📅 Mar 12, 2025
📝 Read Blog Post →
GPT-4.5-preview
GPT-4.5-preview
OpenAI
📅 Feb 27, 2025
📝 Read Blog Post →
Claude 3.7 Sonnet
Claude 3.7 Sonnet
Anthropic
📅 Feb 24, 2025
📝 Read Blog Post →
Gemini 2.0 Flash
Gemini 2.0 Flash
Google
📅 Feb 5, 2025
📝 Read Blog Post →
DeepSeek-R1-Distill-Llama-8B
DeepSeek-R1-Distill-Llama-8B
unsloth
📅 Jan 20, 2025
📝 Read Blog Post →
Phi-4
Phi-4
Microsoft
📅 Jan 8, 2025
📝 Read Blog Post →
Gemini-exp-1206
Gemini-exp-1206
Google
📅 Dec 6, 2024
📝 Read Blog Post →
Gemini-exp-1206 (animated)
Gemini-exp-1206 (animated)
Google
📅 Dec 6, 2024
📝 Read Blog Post →
QwQ-32B Preview
QwQ-32B Preview
Alibaba
📅 Nov 27, 2024
📝 Read Blog Post →
Qwen2.5-Coder-32B-Instruct
Qwen2.5-Coder-32B-Instruct
Alibaba
📅 Nov 12, 2024
📝 Read Blog Post →