Back to results

CompBioBench item

compute-nonoverlapping-exonic-length-q1

Question

Compute the total non-overlapping exonic length in base pairs for the mouse gene Lepr using the GENCODE mouse release M31 GTF located at https://ftp.ebi.ac.uk/pub/databases/gencode/Gencode_mouse/release_M31/gencode.vM31.annotation.gtf.gz. Output a single non-negative integer.

Predicted answer
7049Most likely answer for this question; not uniquely determined from submitted scores.
Domain
Transcriptomics
Question style
Routine Analysis

An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.

Galaxy

12/12 terminal item results

UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Matches predictionUDT-only
Answer7049
Workflow
Lepr exonic length from GENCODE M31
Codex GPT-5.5

Replicate 2

Matches predictionUDT-only
Answer7049
Workflow
Lepr GENCODE M31 diagnosticLepr GENCODE M31 exonic union length
Total tokens
333.9K
Output
4.2K
Codex GPT-5.5

Replicate 3

Matches predictionUDT + standard tools
Answer7049
Workflow
Lepr GTF DiagnosticLepr GTF Diagnostic v2UDT Path Render Probe
Total tokens
3.5M
Output
17.1K

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Matches predictionStandard tools only
Answer7049
Workflow
Upload1GrepGff2Bed1Bedtools Bed12Tobed6Bedtools Sortbed3 more tools
Codex GPT-5.6 Sol

Replicate 2

Matches predictionStandard tools only
Answer7049
Workflow
GrepConverter Interval To Bed 0Bedtools SortbedBedtools MergebedGops Basecoverage 12 more tools
Total tokens
4.4M
Output
8.2K
Codex GPT-5.6 Sol

Replicate 3

Matches predictionUDT + standard tools
Answer7049
Workflow
GENCODE M31 Lepr exon diagnosticBedtools MergebedGops Basecoverage 1Bedtools CoveragebedDatamash Ops1 more tools
Total tokens
16.4M
Output
26.6K

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Matches predictionStandard tools only
Answer7049
Workflow
Converter Gz To UncompressedGtf Filter By Attribute Values ListGtftobed12Bedtools Bed12Tobed6Bedtools Mergebed4 more tools
Total tokens
2.2M
Output
15.6K
Codex + DeepSeek-v4-pro-0813

Replicate 2

Matches predictionStandard tools only
Answer7049
Workflow
No Galaxy tool job recorded
Total tokens
36.9M
Output
93.8K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Matches predictionStandard tools only
Answer7049
Workflow
Converter Gz To UncompressedGff Filter By AttributeGff2Bed1Bedtools Bed12Tobed6Tp Grep Tool6 more tools
Total tokens
4.2M
Output
23.8K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Matches predictionUDT + standard tools
Answer7049
Workflow
Converter Gz To UncompressedTp Grep ToolExtract Lepr exonic intervalsUDT format probeUDT runtime probe6 more tools
Total tokens
13.8M
Output
32.3K
Codex GPT-5.6 Luna

Replicate 2

Matches predictionUDT-only
Answer7049
Workflow
Upload1Lepr GTF diagnosticLepr non-overlapping exonic unionLepr exonic union independent validation
Total tokens
1.9M
Output
19.3K
Codex GPT-5.6 Luna

Replicate 3

Matches predictionStandard tools only
Answer7049
Workflow
GffreadGff Filter By AttributeGtf Filter By Attribute Values ListExtract Features1Gtftobed125 more tools
Total tokens
5.5M
Output
17.3K

Anycode

13/13 terminal item results

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Matches prediction
Answer7049
Workflow
Local codePython
Codex GPT-5.5

Replicate 2

Matches prediction
Answer7049
Workflow
Local codePython
Codex GPT-5.5

Replicate 3

Matches prediction
Answer7049
Workflow
Local code

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Matches prediction
Answer7049
Workflow
Local codePython
Codex GPT-5.6 Sol

Replicate 2

Matches prediction
Answer7049
Workflow
Local code
Codex GPT-5.6 Sol

Replicate 3

Matches prediction
Answer7049
Workflow
Local codePython

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Matches prediction
Answer7049
Workflow
Local codePythonBedtools
Total tokens
194.7K
Output
4.6K
Codex + DeepSeek-v4-pro-0813

Replicate 2

Matches prediction
Answer7049
Workflow
Local codePython
Total tokens
103.0K
Output
3.3K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Matches prediction
Answer7049
Workflow
Local codePythonBedtools
Total tokens
296.5K
Output
7.2K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Matches prediction
Answer7049
Workflow
Local code
Codex GPT-5.6 Luna

Replicate 2

Matches prediction
Answer7049
Workflow
Local code
Codex GPT-5.6 Luna

Replicate 3

Matches prediction
Answer7049
Workflow
Local code

Codex GPT-6 Astra

1 replicate
Codex GPT-6 Astra

Replicate 1

Matches prediction
Answer7049
Workflow
Local codePython
Total tokens
81.2K
Output
868