Back to results

CompBioBench item

find-amplification-q1

Question

You are given shallow paired-end whole-genome sequencing FASTQ files (find.amplification.R1.fq.gz, find.amplification.R2.fq.gz) simulated from a chromosome of the human genome (hg38) that contains a regional copy-number gain. Identify the approximate coordinates of the amplified region relative to the reference genome and the amplification factor, defined as the mean read-depth in the amplified region divided by the mean read-depth in flanking non-amplified regions. Report the chromosome, the start coordinate, and the end coordinate rounded to the nearest 100,000 bases, followed by a single comma and the amplification factor rounded to nearest multiple of 0.5. Format your answer as chr:start-end factor. For example: chr21:23000000-26000000,2.0

Predicted answer
chr22:36000000-36400000,1.5Most likely answer for this question; not uniquely determined from submitted scores.
Domain
Genomics
Question style
Synthetic/Augmented Data

An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.

Galaxy

12/12 terminal item results

UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Matches predictionUDT + standard tools
Answerchr22:36000000-36400000,1.5
Workflow
Bwa MemBowtie2Samtools Idxstatschr22 amplification scanchr22 amplification scan stream2 more tools
Codex GPT-5.5

Replicate 2

Matches predictionUDT + standard tools
Answerchr22:36000000-36400000,1.5
Workflow
Minimap2Samtools
Total tokens
5.3M
Output
19.3K
Codex GPT-5.5

Replicate 3

Matches predictionUDT + standard tools
Answerchr22:36000000-36400000,1.5
Workflow
Bwa MemSamtools FlagstatSamtools StatsCNV depth callCNV depth call v25 more tools
Total tokens
3.6M
Output
22.3K

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Matches predictionStandard tools only
Answerchr22:36000000-36400000,1.5
Workflow
Bwa MemBwa Mem2FastqcMinimap2Mosdepth2 more tools
Total tokens
6.9M
Output
12.8K
Codex GPT-5.6 Sol

Replicate 2

Matches predictionUDT + standard tools
Answerchr22:36000000-36400000,1.5
Workflow
Bwa MemBowtie2MosdepthFilter TabularCNV ratio summary q1
Total tokens
5.3M
Output
13.1K
Codex GPT-5.6 Sol

Replicate 3

Matches predictionUDT + standard tools
Answerchr22:36000000-36400000,1.5
Workflow
Bwa MemSamtools IdxstatsMosdepthTp Grep ToolFinal amplification summary q1
Total tokens
4.3M
Output
12.4K

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Matches predictionStandard tools only
Answerchr22:36000000-36400000,1.5
Workflow
Bwa MemBwa Mem2BwaSambamba SortSamtools Idxstats8 more tools
Total tokens
10.6M
Output
33.9K
Codex + DeepSeek-v4-pro-0813

Replicate 2

Matches predictionStandard tools only
Answerchr22:36000000-36400000,1.5
Workflow
Bwa MemBowtie2Samtools MergeMosdepthBedtools Intersectbed4 more tools
Total tokens
11.0M
Output
42.2K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Matches predictionStandard tools only
Answerchr22:36000000-36400000,1.5
Workflow
Bwa MemBowtie2MosdepthBedtools CoveragebedSamtools Idxstats
Total tokens
3.3M
Output
26.6K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Matches predictionStandard tools only
Answerchr22:36000000-36400000,1.5
Workflow
Bwa MemSamtools SortSamtools FlagstatSamtools CoverageSamtools Idxstats6 more tools
Total tokens
5.6M
Output
26.0K
Codex GPT-5.6 Luna

Replicate 2

Matches predictionStandard tools only
Answerchr22:36000000-36400000,1.5
Workflow
Bwa MemBwa Mem2Samtools IdxstatsSamtools FlagstatCreateinterval4 more tools
Total tokens
13.2M
Output
47.5K
Codex GPT-5.6 Luna

Replicate 3

Matches predictionUDT + standard tools
Answerchr22:36000000-36400000,1.5
Workflow
Bwa MemBowtie2Samtools FlagstatSamtools IdxstatsDeeptools Bam Coverage3 more tools
Total tokens
7.4M
Output
40.4K

Anycode

13/13 terminal item results

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Matches prediction
Answerchr22:36000000-36400000,1.5
Workflow
Local codeBWA-MEMMinimap2Samtools
Codex GPT-5.5

Replicate 2

Matches prediction
Answerchr22:36000000-36400000,1.5
Workflow
Local codeBWA-MEMMinimap2Bowtie2Samtools2 more tools
Codex GPT-5.5

Replicate 3

Matches prediction
Answerchr22:36000000-36400000,1.5
Workflow
Local codeBWA-MEMMinimap2SamtoolsPython

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Matches prediction
Answerchr22:36000000-36400000,1.5
Workflow
Local codeBWA-MEMMinimap2Samtools
Codex GPT-5.6 Sol

Replicate 2

Matches prediction
Answerchr22:36000000-36400000,1.5
Workflow
Local codeBWA-MEMMinimap2Samtools
Codex GPT-5.6 Sol

Replicate 3

Matches prediction
Answerchr22:36000000-36400000,1.5
Workflow
Local codeMinimap2BWA-MEMSamtoolsBLASTN

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Matches prediction
Answerchr22:36000000-36400000,1.5
Workflow
Local codeBWA-MEMMinimap2SamtoolsBowtie22 more tools
Total tokens
2.0M
Output
19.8K
Codex + DeepSeek-v4-pro-0813

Replicate 2

Matches prediction
Answerchr22:36000000-36400000,1.5
Workflow
Local codeBWA-MEMMinimap2SamtoolsBedtools4 more tools
Total tokens
2.8M
Output
25.5K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Matches prediction
Answerchr22:36000000-36400000,1.5
Workflow
Local codeBWA-MEMMinimap2Bowtie2Samtools3 more tools
Total tokens
1.0M
Output
16.7K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Matches prediction
Answerchr22:36000000-36400000,1.5
Workflow
Local codeBWA-MEMMinimap2SamtoolsBowtie22 more tools
Codex GPT-5.6 Luna

Replicate 2

Matches prediction
Answerchr22:36000000-36400000,1.5
Workflow
Local codeSamtoolsBWA-MEMMinimap2Bowtie24 more tools
Codex GPT-5.6 Luna

Replicate 3

Matches prediction
Answerchr22:36000000-36400000,1.5
Workflow
Local codeMinimap2BWA-MEMSamtoolsBowtie21 more tools

Codex GPT-6 Astra

1 replicate
Codex GPT-6 Astra

Replicate 1

Matches prediction
Answerchr22:36000000-36400000,1.5
Workflow
Local codeMinimap2BWA-MEMSamtoolsBowtie23 more tools
Total tokens
438.6K
Output
4.2K