bix-52-q6 | Current BixBench results

New token-optimization experiment

Three additional GPT-5.6 Sol Galaxy replicates are available separately. Previous results remain unchanged.

View the October 2026 batch and its run records

Question

Which chromosome in the Jackdaw genome shows the highest density of age-related CpG sites?

Accepted answer: Chromosome W
Domain: general

Comparison

Pass counts and token totals across the same three replicates.

Agent	Galaxy-API code	Open-ended code
Codex GPT-5.5	3/3 replicate 1 replicate 2 replicate 3 4.09M total	3/3 replicate 1 replicate 2 replicate 3 224.1K total
Codex GPT-5.6 Sol	3/3 replicate 1 replicate 2 replicate 3 5.12M total	3/3 replicate 1 replicate 2 replicate 3 250.6K total
Codex GPT-5.6 Luna	3/3 replicate 1 replicate 2 replicate 3 13.84M total	3/3 replicate 1 replicate 2 replicate 3 342.7K total
DeepSeek V4 Pro via Codex	3/3 replicate 1 replicate 2 replicate 3 7.82M total	3/3 replicate 1 replicate 2 replicate 3 411.9K total
DeepSeek V4 Pro via Claude Codesuperseded	3/3 replicate 1 replicate 2 replicate 3 6.47M total	3/3 replicate 1 replicate 2 replicate 3 730.3K total

Execution condition

Galaxy-API code with skills

Codex GPT-5.5

3 primary replicates

Codex GPT-5.5

replicate 1

passUDT-only

AnswerW

Workflow

Galaxy UDTCpG filtering and density

Total tokens: 559.3K
Output: 6.5K

Galaxy history Run trace

Codex GPT-5.5

replicate 2

passUDT-only

AnswerW

Workflow

Galaxy UDTCpG filtering and density

Total tokens: 708.3K
Output: 6.1K

Galaxy history Run trace

Codex GPT-5.5

replicate 3

pass

AnswerW

Workflow

Csv To TabularDatamash summaryGroup and aggregatemore stepsTp Sort Header ToolCpG filtering and density

Total tokens: 2.83M
Output: 11.2K

Galaxy history Run trace

Codex GPT-5.6 Sol

3 primary replicates

Codex GPT-5.6 Sol

replicate 1

pass

AnswerW

Workflow

Select columnsRemove headerGroup and aggregatemore stepsSort rowsCpG filtering and density

Total tokens: 1.61M
Output: 6.8K

Galaxy history Run trace

Codex GPT-5.6 Sol

replicate 2

pass

AnswerW

Workflow

Csv To TabularFilter TabularMatch rowsmore stepsTp Sort Header ToolCpG filtering and density

Total tokens: 1.93M
Output: 9.3K

Galaxy history Run trace

Codex GPT-5.6 Sol

replicate 3

pass

AnswerW

Workflow

Csv To TabularRemove headerGroup and aggregateJoin datasetsCpG filtering and density

Total tokens: 1.58M
Output: 6.9K

Galaxy history Run trace

Codex GPT-5.6 Luna

3 primary replicates

Codex GPT-5.6 Luna

replicate 1

pass

AnswerW

Workflow

Csv To TabularDatamash summaryGroup and aggregatemore stepsAdd derived columnCpG filtering and density

Total tokens: 4.27M
Output: 25.0K

Galaxy history Run trace

Codex GPT-5.6 Luna

replicate 2

pass

AnswerW

Workflow

Csv To TabularDatamash summaryGroup and aggregatemore stepsTp Sort Header ToolCpG filtering and density

Total tokens: 4.71M
Output: 25.7K

Galaxy history Run trace

Codex GPT-5.6 Luna

replicate 3

pass

AnswerW

Workflow

Csv To TabularSelect columnsTp Sorted Uniqmore stepsAdd derived columnCpG filtering and density

Total tokens: 4.87M
Output: 22.5K

Galaxy history Run trace

DeepSeek V4 Pro via Codex

3 primary replicates

DeepSeek V4 Pro via Codex

replicate 1

pass

AnswerW

Workflow

Csv To TabularGroup and aggregateRemove headerTp Easyjoin ToolAdd derived columnCpG filtering and density

Total tokens: 3.15M
Output: 20.8K

Galaxy history Run trace

DeepSeek V4 Pro via Codex

replicate 2

pass

AnswerW

Workflow

Csv To TabularRemove headerGroup and aggregateJoin datasetsAdd derived columnCpG filtering and density

Total tokens: 2.38M
Output: 19.5K

Galaxy history Run trace

DeepSeek V4 Pro via Codex

replicate 3

pass

AnswerW

Workflow

Group and aggregateRemove headerJoin datasetsAdd derived columnTp Sort Header ToolCpG filtering and density

Total tokens: 2.28M
Output: 17.7K

Galaxy history Run trace

DeepSeek V4 Pro via Claude CodeSuperseded

3 primary replicates

DeepSeek V4 Pro via Claude Code

replicate 1

pass

AnswerW

Workflow

Group and aggregateJoin datasetsCpG filtering and density

Total tokens: 2.30M
Output: 20.5K

Galaxy history Run trace

DeepSeek V4 Pro via Claude Code

replicate 2

pass

AnswerW

Workflow

Select columnsGroup and aggregateJoin datasetsCompute columnCpG filtering and density

Total tokens: 1.91M
Output: 22.0K

Galaxy history Run trace

DeepSeek V4 Pro via Claude Code

replicate 3

pass

AnswerW

Workflow

Group and aggregateRemove headerMatch rowsJoin datasetsAdd derived columnCpG filtering and density

Total tokens: 2.26M
Output: 18.8K

Galaxy history Run trace

Execution condition

Open-ended code with skills

Codex GPT-5.5

3 primary replicates

Codex GPT-5.5

replicate 1

pass

AnswerW

Workflow

Local analysisCpG filtering and density

Total tokens: 88.2K
Output: 1.8K

Run trace

Codex GPT-5.5

replicate 2

pass

AnswerW

Workflow

Local analysisCpG filtering and density

Total tokens: 68.5K
Output: 1.5K

Run trace

Codex GPT-5.5

replicate 3

pass

AnswerW

Workflow

Local analysisCpG filtering and density

Total tokens: 67.5K
Output: 1.2K

Run trace

Codex GPT-5.6 Sol

3 primary replicates

Codex GPT-5.6 Sol

replicate 1

pass

AnswerW

Workflow

Local analysis

Total tokens: 61.9K
Output: 1.3K

Run trace

Codex GPT-5.6 Sol

replicate 2

pass

AnswerW

Workflow

Local analysis

Total tokens: 94.1K
Output: 1.2K

Run trace

Codex GPT-5.6 Sol

replicate 3

pass

AnswerW

Workflow

Local analysis

Total tokens: 94.5K
Output: 1.3K

Run trace

Codex GPT-5.6 Luna

3 primary replicates

Codex GPT-5.6 Luna

replicate 1

pass

AnswerW

Workflow

Local analysis

Total tokens: 126.3K
Output: 2.8K

Run trace

Codex GPT-5.6 Luna

replicate 2

pass

AnswerW

Workflow

Local analysis

Total tokens: 110.3K
Output: 2.7K

Run trace

Codex GPT-5.6 Luna

replicate 3

pass

AnswerW

Workflow

Local analysis

Total tokens: 106.1K
Output: 2.9K

Run trace

DeepSeek V4 Pro via Codex

3 primary replicates

DeepSeek V4 Pro via Codex

replicate 1

pass

AnswerW

Workflow

Local analysisCpG filtering and density

Total tokens: 102.1K
Output: 3.3K

Run trace

DeepSeek V4 Pro via Codex

replicate 2

pass

AnswerW

Workflow

Local analysisCpG filtering and densitymethylation filtering

Total tokens: 103.3K
Output: 3.2K

Run trace

DeepSeek V4 Pro via Codex

replicate 3

pass

AnswerW

Workflow

Local analysisCpG filtering and density

Total tokens: 206.4K
Output: 5.3K

Run trace

DeepSeek V4 Pro via Claude CodeSuperseded

3 primary replicates

DeepSeek V4 Pro via Claude Code

replicate 1

pass

AnswerW

Workflow

Local analysisCpG filtering and density

Total tokens: 212.1K
Output: 3.5K

Run trace

DeepSeek V4 Pro via Claude Code

replicate 2

pass

AnswerW

Workflow

Local analysisCpG filtering and density

Total tokens: 230.6K
Output: 3.5K

Run trace

DeepSeek V4 Pro via Claude Code

replicate 3

pass

AnswerW

Workflow

Local analysisCpG filtering and density

Total tokens: 287.6K
Output: 3.5K

Run trace

bix-52-q6 · October 2026 · three additional replicates

GPT-5.6 Sol · token optimization

Galaxy-API code, high reasoning, Fast service. Previous runs are retained above.

Galaxy-API code · October 2026

replicate 1

Correct

AnswerW

Total tokens: 1.47M
Input: 1.46M
Cached input: 1.38M
Output: 5.7K

Run trace Final answer Galaxy history

Galaxy-API code · October 2026

replicate 2

Correct

AnswerW

Total tokens: 1.37M
Input: 1.36M
Cached input: 1.24M
Output: 7.5K

Run trace Final answer Galaxy history

Galaxy-API code · October 2026

replicate 3

Correct

AnswerW

Total tokens: 903.5K
Input: 898.0K
Cached input: 854.4K
Output: 5.5K

Run trace Final answer Galaxy history

Open-ended code averaged 0.08M tokens; previous website Galaxy averaged 1.71M; the new Galaxy runs averaged 1.25M, or 14.91× Open-ended code. Each mean covers three replicates of this same task with GPT-5.6 Sol.

Cached input is already included in input tokens. Full nested tool/job evidence is in each HF run's galaxy_execution_records.tar.gz, with an accompanying member index.

Optimization overview and all 150 runs