AI

Claude vs ChatGPT vs Gemini, October 2026 Scorecard: Benchmarks, Hands-On Tests, Pricing and What Comes Next

A little over three months after we compared GPT-5.6 and Claude Fable 5, the board looks completely different. On September 22, Anthropic shipped Claude Opus 5.5 and OpenAI shipped GPT-6 Sol and Luna on the same day. Google announced Gemini 4 Argon on September 30, and on October 26 OpenAI pushed GPT-6.1 Terra into ChatGPT and Codex.

This piece compares the three labs’ current flagships as of October 27, 2026, using four lenses: vendor-published benchmarks, independent third-party measurements, hands-on tests by developers and media, and price. It ends with what to watch next.

Disclosure: this site and most of its games are built with Claude Code. I use it every day, which gives me first-hand experience but may also tilt my view toward Claude. Every number below is sourced.

The short version

  • On aggregate benchmarks and user votes, Gemini 4 Argon leads. It is outright first on 12 of the 18 benchmarks Google published, and first on the LMArena text leaderboard (1532, preliminary).
  • On real-world coding — especially long-running agentic work in a terminal — Claude Opus 5.5 leads. Claude models take first and second place on the independently run Terminal-Bench 4.0 (Opus 5.5 and Sonnet 5.5).
  • OpenAI competes on “working result in one shot” and on price. GPT-6 Astra most reliably produced a complete, runnable app from a single request, and Sol and 6.1 Terra are cheap.
  • “Gemini is catching up” is no longer accurate. On the benchmark tables, Gemini is now in front. In developers’ hands as a coding agent, though, Claude still gets the better reviews.

The current lineups

LabModelReleasedAPI price (input/output per 1M tokens)
AnthropicClaude Opus 5.5Sep 22$4 / $20
AnthropicClaude Fable 5.1 (previous top tier)September (weeks before Opus 5.5)$10 / $50
AnthropicClaude Sonnet 5.5 · Haiku 5.5Sep 28 · Oct 7Haiku $0.10 / $0.50 (up to 100K context)
OpenAIGPT-6 Astra (top tier)Early September$10 / $50
OpenAIGPT-6 Sol → 6.1 SolSep 22 → Sep 29 (DevDay)$2 / $10
OpenAIGPT-6.1 Terra (mid-size)Oct 2650% cheaper than GPT-5.6 Terra
GoogleGemini 4 ArgonAnnounced Sep 30, GA Oct 13$2 / $10 (until Nov 30) → $4 / $20

A few things stand out.

  • Anthropic made its new top model cheaper. Opus 5.5 is 60% cheaper per token than Fable 5.1, the previous flagship, and Anthropic says it also uses fewer tokens per task, cutting typical workload costs by about 40%.
  • OpenAI now has four tiers. From cheapest up: Luna, Terra, Sol, Astra. The Wall Street Journal reported that GPT-6.1 Astra, planned for October, was cancelled after internal safety testing; there is no date for the next top-tier release.
  • Google came in on price. Argon’s introductory rate is half of Opus 5.5’s, but it doubles on December 1 to match it.

1. Vendor benchmarks: it looks like a Gemini sweep

Google launched Argon with an 18-benchmark comparison table. By VentureBeat’s count, Argon is outright first on 12 and tied on one; GPT-6 Astra is outright first on three, and Opus 5.5 on two.

Benchmark (what it measures)Gemini 4 ArgonGPT-6 AstraClaude Opus 5.5
DeepSWE v1.1 (real software fixes)77.9%74.1%74.2%
GraphWalks (very long-context reasoning)84.2%71.8%66.8%
LVBench (long video understanding)91.7%87.5%83.7%
AutomationBench (business automation)51.3%41.4%42.5%
Vals Finance Agent v265.4%53.5%58.6%
FrontierSWE v2 (hard coding)55.0%65.5%62.3%
Terminal-Bench 4.0 (terminal agents)57.4%58.2%66.4%
PostTrainBench45.3%—49.3%

Source: Google’s published table (via VentureBeat and DataCamp). Opus 5.5’s FrontierSWE v2 and Astra’s Terminal-Bench 4.0 figures are from secondary write-ups (DataCamp, shattered.io).

The pattern is clear. Gemini is strongest at reading a lot and judging — long documents, long video, legal and finance work. Claude leads long-running terminal coding, and GPT leads hard single-shot coding problems.

But Google made this table, and Google chose the settings. On the video benchmark, for example, Argon got the full video at one frame per second, while Astra got 800 frames and Opus 5.5 only 600 because of API limits.

2. Independent measurements: the gaps shrink and the order changes

Vendor numbers are each lab’s best-case run. What happens when a third party measures everyone the same way?

Terminal-Bench 4.0 — Vals.ai (as of October 26)

RankModelScore
1Claude Opus 5.565.15%
2Claude Sonnet 5.564.14%
3Kimi K3.1 Pro (Moonshot, open weights)63.64%
4GPT-6 Astra59.60%
5Claude Fable 5.158.08%
7Gemini 4 Argon57.58%
8GPT-6.1 Sol55.05%
10GPT-6.1 Terra49.49%

Every model ran in the same agent harness (Mini-SWE-agent). Opus 5.5’s self-reported 66.4% and the independent 65.15% are nearly identical, so the vendor number was not inflated. Artificial Analysis’s own run came in lower at 59.6% — differences of that size are normal across harnesses.

The one to watch is #3, Kimi K3.1 Pro: an open-weights model anyone can download now scores above both GPT-6 Astra and Gemini 4 Argon.

User votes — LMArena text leaderboard (October 20)

RankModelScore
1Gemini 4 Argon (High)1532 (preliminary)
2Claude Opus 5.5 (High)1516
3Claude Fable 5.1 (Max)1512
4Claude Opus 5 (Max)1509

People compare two answers and vote for the better one. Argon is first, but with only about 4,900 votes it is still provisional. Claude holds second through fifth. No GPT-6 model is in the top five.

Aggregate intelligence — Artificial Analysis

Reported Artificial Analysis Intelligence Index figures vary slightly by source, but broadly Opus 5.5 leads at 56–58, with Argon and GPT-6 Astra close together around 52–53. GPT-6.1 Terra, added on October 26, reaches 48 at max effort — strong for a mid-size model. Artificial Analysis has announced Index v5 for late October, so the order may shift again.

3. Hands-on tests: the winner depends on the job

After benchmarks, the next question is what it is like to actually use them. YouTube and developer communities are full of same-prompt shoot-outs; I picked the ones that published concrete results.

① 3D kart game and supercar (developer Anass Kartit, October 14) Each model ran in its own lab’s coding tool (Opus 5.5 in Claude Code, Astra in Codex, Argon in opencode).

TaskGemini 4 ArgonGPT-6 AstraClaude Opus 5.5
One-shot 3D kart game220 s · $0.31 · 9.5/10323 s · $0.70 · 10/10308 s · $0.64 · cut off at output limit
Neon-highway supercar~24 min · 2,540 lines · $2.459 min · 193 lines · ~$3.3014 min 39 s · 1,166 lines · ~$14.14
82 short-answer questions82/8282/8281/82 (one formatting miss)

The author’s verdict: Argon produced the best-looking output, Astra most reliably shipped a complete app in one reply, and Opus 5.5 ran in Claude Code with no configuration changes, while Argon needed two tool settings adjusted.

② Robot arm avoiding obstacles (DataCamp, October 14) The test was whether a model keeps a hard constraint — never touch an obstacle — for the whole run. Opus 5.5 never touched one and scored 4.7; Argon clipped through obstacles and scored 3.7. Argon was cheaper ($0.72 vs $1.09), but at high effort it used its whole output budget without writing the file.

③ Gravity-flip Tetris (DataCamp, September 23) A single-file Tetris variant where gravity flips. GPT-6 Sol scored 5.0 to Opus 5.5’s 4.3, at about a third of the cost ($0.26 vs $0.87).

④ 3D scene coding (reported by Korea’s AI Times, September 23) One-shot scenes such as a school of fish, a maelstrom, and a ship in a storm. Opus 5.5 fixed its own errors and won on detail, but cost $4.37 in total — about 13 times GPT-6 Sol’s $0.34. The conclusion: GPT for fast scaffolding and cheap base code, Opus 5.5 for production-grade finish.

Put together, a pattern emerges:

  • Claude: pricier and slower, but the best at holding constraints and fixing its own work through to the end — the one you trust to leave running.
  • GPT: fast, cheap, working results in one shot — the most reliable “first draft that runs.”
  • Gemini: strong visuals and long inputs, cheap during the launch window, but its fit with coding tools is still rough.

Most of these tests were single runs, so treat them as tendencies, not verdicts.

4. So which should you use?

If your work is…Pick
Long-running agentic coding on a large codebaseClaude Opus 5.5 (Claude Code)
One-shot prototypes, high volume at low costGPT-6 Sol / 6.1 Terra
Hundreds of pages, long video, legal or financial analysisGemini 4 Argon
Simple repetitive work where cost matters mostClaude Haiku 5.5, GPT-6.1 Terra, open weights (Kimi etc.)

Gemini is half price until November 30, which makes now a good time to try it. From December 1 it costs the same as Opus 5.5.

Outlook: five things to watch

1) From “who is number one” to “number one at what.” Three months ago one model often swept most of the tables. Now the three labs have split the territory: Claude for long-running coding agents, GPT for one-shot results and price, Gemini for long inputs and multimodal work. Expect more people to switch models by task rather than commit to one — tools like Claude Code, Codex and GitHub Copilot are already moving toward letting you pick models from several labs.

2) The price war has started. Opus 5.5 launched 60% cheaper than the previous flagship, GPT-6.1 Terra is 50% cheaper than its predecessor, and Argon came in at half of Opus’s price. The cost of a given level of capability is halving every few months. The first test is December 1: does Argon’s price really double, or does the introductory rate quietly become permanent?

3) Top models now arrive in stages, not all at once. Argon went first to cyber-defense teams. Claude Mythos 5.1 is available only to approved users. GPT-6.1 Astra was reportedly cancelled after safety testing. The strongest models are increasingly released later and more narrowly after safety review, which opens a gap between the “latest model” most people use and the actual frontier.

4) Open weights are close behind. Kimi K3.1 Pro placed third on independently run Terminal-Bench 4.0, ahead of GPT-6 Astra and Gemini 4 Argon, with full weights due November 4. DeepSeek, MiniMax and Meta’s Muse Spark Open also shipped in October. As the gap between expensive frontier models and good-enough free ones narrows, it puts pressure on all three labs’ pricing.

5) The benchmarks themselves are wobbling. On the same Terminal-Bench 4.0, Opus 5.5 scores anywhere from 59.6% to 66.4% depending on who runs it, because harnesses and effort settings differ. SWE-bench Verified has effectively been retired, and Artificial Analysis is about to move to Index v5. From here on, a published number only means something alongside who measured it and how. The most trustworthy benchmark is still running your own work through it.

Bottom line

The “Gemini is chasing Claude and ChatGPT” storyline ended in October. On paper, Gemini is now in front. But as someone who runs coding agents every day, Claude Opus 5.5 still feels like the leader — it is the model that finishes the job when you leave it alone. How long that edge lasts will be decided by December’s pricing, the open-weights chase, and OpenAI’s next top-tier model.

This article summarizes public information as of October 27, 2026. Benchmark figures vary with who runs them and how; vendor-reported numbers are unverified until independently reproduced.

Sources

This article may contain affiliate links. Nothing here is financial or investment advice.