Back to results

CompBioBench item

borzoi-basic-q1

Question

What is the exact count of the number of parameters in any one of the replicates of the Borzoi model (https://doi.org/10.1038/s41588-024-02053-6). Specifically, report the number of trainable parameters including both the human and mouse heads. Format the number without commas.

Predicted answer
190902667Most likely answer for this question; not uniquely determined from submitted scores.
Domain
Machine Learning
Question style
Tooling

An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.

Galaxy

12/12 terminal item results

UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Matches predictionUDT-only
Answer190902667
Workflow
Borzoi trainable parameter count
Total tokens
1.2M
Output
7.8K
Codex GPT-5.5

Replicate 2

Matches predictionUDT-only
Answer190902667
Workflow
Galaxy dataset inspection
Total tokens
8.7M
Output
24.8K
Codex GPT-5.5

Replicate 3

Matches predictionUDT + standard tools
Answer190902667
Workflow
Borzoi parameter count both headsBorzoi parameter count both heads v2UDT render probe constantDatamash Ops
Total tokens
3.7M
Output
19.0K

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Matches predictionUDT-only
Answer190902667
Workflow
Galaxy UDTborzoi_countBorzoi countBorzoi parameter audit
Codex GPT-5.6 Sol

Replicate 2

Matches predictionUDT-only
Answer190902667
Workflow
Borzoi exact trainable parameter count (human and mouse heads)
Total tokens
920.2K
Output
4.5K
Codex GPT-5.6 Sol

Replicate 3

Matches predictionUDT + standard tools
Answer190902667
Workflow
Extract Borzoi supplementary parameter table textParse Borzoi component parameter rowsDatamash Ops
Total tokens
3.0M
Output
9.6K

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Matches predictionUDT-only
Answer190902667
Workflow
Inspect Borzoi H5Count Borzoi ParametersCount Borzoi Parameters v2Count Borzoi Parameters v3Count Borzoi Parameters v4
Total tokens
1.8M
Output
18.1K
Codex + DeepSeek-v4-pro-0813

Replicate 2

Matches predictionUDT-only
Answer190902667
Workflow
No Galaxy tool job recorded
Total tokens
48.2M
Output
71.6K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Matches predictionUDT-only
Answer190902667
Workflow
Borzoi Parameter Count
Total tokens
1.7M
Output
15.9K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Matches predictionUDT-only
Answer190902667
Workflow
Borzoi runtime probeBorzoi trainable parameter countBorzoi original implementation parameter validation
Total tokens
5.7M
Output
25.1K
Codex GPT-5.6 Luna

Replicate 2

Matches predictionUDT-only
Answer190902667
Workflow
Borzoi trainable parameter count diagnostic
Total tokens
4.1M
Output
26.5K
Codex GPT-5.6 Luna

Replicate 3

Matches predictionUDT-only
Answer190902667
Workflow
Borzoi architecture diagnosticBorzoi trainable parameter count
Total tokens
2.3M
Output
20.3K

Anycode

13/13 terminal item results

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Matches prediction
Answer190902667
Workflow
Local codePython
Codex GPT-5.5

Replicate 2

Matches prediction
Answer190902667
Workflow
Local codePython
Codex GPT-5.5

Replicate 3

Matches prediction
Answer190902667
Workflow
Local codePython

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Matches prediction
Answer190902667
Workflow
Local codePython
Codex GPT-5.6 Sol

Replicate 2

Matches prediction
Answer190902667
Workflow
Local codePythonSciPy
Codex GPT-5.6 Sol

Replicate 3

Matches prediction
Answer190902667
Workflow
Local codePython

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Matches prediction
Answer190902667
Workflow
Local codePython
Total tokens
6.8M
Output
40.2K
Codex + DeepSeek-v4-pro-0813

Replicate 2

RerunMatches prediction
Answer190902667
Workflow
Open-ended code
Total tokens
3.1M
Output
18.2K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Matches prediction
Answer190902667
Workflow
Local codePython
Total tokens
6.0M
Output
21.9K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Matches prediction
Answer190902667
Workflow
Local codePython
Codex GPT-5.6 Luna

Replicate 2

Matches prediction
Answer190902667
Workflow
Local code
Codex GPT-5.6 Luna

Replicate 3

Matches prediction
Answer190902667
Workflow
Local codePython

Codex GPT-6 Astra

1 replicate
Codex GPT-6 Astra

Replicate 1

Matches prediction
Answer190902667
Workflow
Local codePython
Total tokens
318.2K
Output
2.5K