Back to results

CompBioBench item

bam-infer-read-length-q1

Question

For the given BAM file mt.sorted.bam, infer if it's paired or single ended reads and the read length. Expected output format: 1x57

Predicted answer
2x101Most likely answer for this question; not uniquely determined from submitted scores.
Domain
Genomics
Question style
Metadata Recovery

An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.

Galaxy

12/12 terminal item results

UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 2

Matches predictionStandard tools only
Answer2x101
Workflow
Samtools Stats
Total tokens
261.0K
Output
1.1K
Codex GPT-5.5

Replicate 3

Matches predictionStandard tools only
Answer2x101
Workflow
Samtools Stats
Total tokens
133.4K
Output
1.1K

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Matches predictionStandard tools only
Answer2x101
Workflow
Samtools StatsSamtools Flagstat
Codex GPT-5.6 Sol

Replicate 2

Matches predictionStandard tools only
Answer2x101
Workflow
Samtools Stats
Total tokens
247.1K
Output
1.0K
Codex GPT-5.6 Sol

Replicate 3

Matches predictionStandard tools only
Answer2x101
Workflow
Samtools Stats
Total tokens
466.4K
Output
1.5K

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Matches predictionStandard tools only
Answer2x101
Workflow
No Galaxy tool job recorded
Total tokens
508.1K
Output
8.4K
Codex + DeepSeek-v4-pro-0813

Replicate 2

Matches predictionStandard tools only
Answer2x101
Workflow
No Galaxy tool job recorded
Total tokens
1.0M
Output
11.2K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Matches predictionStandard tools only
Answer2x101
Workflow
Samtools FlagstatSamtools Stats
Total tokens
168.0K
Output
2.5K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Matches predictionStandard tools only
Answer2x101
Workflow
Samtools FlagstatSamtools Stats
Total tokens
166.1K
Output
2.0K
Codex GPT-5.6 Luna

Replicate 2

Matches predictionStandard tools only
Answer2x101
Workflow
Samtools FlagstatSamtools Stats
Total tokens
135.6K
Output
1.9K
Codex GPT-5.6 Luna

Replicate 3

Matches predictionStandard tools only
Answer2x101
Workflow
Samtools Stats
Total tokens
191.4K
Output
1.9K

Anycode

13/13 terminal item results

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Matches prediction
Answer2x101
Workflow
Local codeSamtools
Codex GPT-5.5

Replicate 2

Matches prediction
Answer2x101
Workflow
Local codeSamtools
Codex GPT-5.5

Replicate 3

Matches prediction
Answer2x101
Workflow
Local codeSamtools

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Matches prediction
Answer2x101
Workflow
Local codeSamtools
Codex GPT-5.6 Sol

Replicate 2

Matches prediction
Answer2x101
Workflow
Local codeSamtools
Codex GPT-5.6 Sol

Replicate 3

Matches prediction
Answer2x101
Workflow
Local codeSamtools

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Matches prediction
Answer2x101
Workflow
Local codeSamtoolsPythonpysam
Total tokens
85.2K
Output
2.2K
Codex + DeepSeek-v4-pro-0813

Replicate 2

Matches prediction
Answer2x101
Workflow
Local codeSamtoolsPythonpysam
Total tokens
124.6K
Output
2.6K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Matches prediction
Answer2x101
Workflow
Local codeSamtoolsPythonpysam
Total tokens
88.8K
Output
2.4K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Matches prediction
Answer2x101
Workflow
Local codeSamtoolsBCFtoolsPython
Codex GPT-5.6 Luna

Replicate 2

Matches prediction
Answer2x101
Workflow
Local codeSamtoolsPython
Codex GPT-5.6 Luna

Replicate 3

Matches prediction
Answer2x101
Workflow
Local codeBedtoolsSamtoolsPythonpysam

Codex GPT-6 Astra

1 replicate
Codex GPT-6 Astra

Replicate 1

Matches prediction
Answer2x101
Workflow
Local codeSamtoolsPython
Total tokens
33.4K
Output
160