Back to results

CompBioBench item

find-deletion-q1

Question

You are given shallow paired-end whole genome sequencing FASTQ files (find.deletion.r1.fq.gz, find.deletion.r2.fq.gz) simulated from a chromosome of the human genome hg38 which contains a large deletion. Your task is to identify the approximate coordinates of this deletion relative to the reference genome. Report the chromosome, the start coordinate, and the end coordinate of the deletion, with both coordinates rounded to the nearest 100,000 bases. Format your answer as chr:start-end. For example: chr1:10000000-10300000.

Inferred answer
chr22:20000000-21000000Uniquely inferred from submitted scores.
Domain
Genomics
Question style
Synthetic/Augmented Data

An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.

Galaxy

12/12 terminal item results

UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

CorrectStandard tools only
Answerchr22:20000000-21000000
Workflow
Bwa MemBowtie2Samtools IdxstatsMosdepthGrep
Codex GPT-5.5

Replicate 2

CorrectUDT + standard tools
Answerchr22:20000000-21000000
Workflow
Bwa MemSambamba SortSamtools IdxstatsMosdepthSamtools2 more tools
Total tokens
2.1M
Output
14.7K
Codex GPT-5.5

Replicate 3

CorrectUDT + standard tools
Answerchr22:20000000-21000000
Workflow
Deletion BAM diagnosticUDT command probeMosdepthSamtools View
Total tokens
1.5M
Output
16.2K

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

CorrectStandard tools only
Answerchr22:20000000-21000000
Workflow
Bwa MemSamtools SortMosdepthGrepSamtools View
Total tokens
3.5M
Output
10.6K
Codex GPT-5.6 Sol

Replicate 2

CorrectUDT + standard tools
Answerchr22:20000000-21000000
Workflow
Bwa MemBwa Mem2Minimap2MosdepthFilter Tabular2 more tools
Total tokens
5.1M
Output
10.4K
Codex GPT-5.6 Sol

Replicate 3

CorrectStandard tools only
Answerchr22:20000000-21000000
Workflow
Bwa MemBwa Mem2Minimap2MosdepthFilter Tabular2 more tools
Total tokens
7.7M
Output
13.6K

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

CorrectStandard tools only
Answerchr22:20000000-21000000
Workflow
Bwa MemSamtools DepthSamtools View
Total tokens
8.4M
Output
69.5K
Codex + DeepSeek-v4-pro-0813

Replicate 2

CorrectStandard tools only
Answerchr22:20000000-21000000
Workflow
Bwa MemSambamba SortSamtools IdxstatsSamtools Slice BamBedtools Genomecoveragebed3 more tools
Total tokens
8.3M
Output
32.1K
Codex + DeepSeek-v4-pro-0813

Replicate 3

IncorrectStandard tools only
Answerchr22:13300000-15200000
Workflow
Fastq StatsBwa MemBwa Mem2Bowtie2Samtools Merge11 more tools
Total tokens
16.1M
Output
45.1K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

CorrectStandard tools only
Answerchr22:20000000-21000000
Workflow
Bwa MemBwa Mem2Samtools SortSamtools IdxstatsMosdepth1 more tools
Total tokens
5.8M
Output
27.4K
Codex GPT-5.6 Luna

Replicate 2

CorrectUDT + standard tools
Answerchr22:20000000-21000000
Workflow
Bwa MemSamtools FlagstatSamtools IdxstatsDeeptools Bam CoverageSamtools2 more tools
Total tokens
8.5M
Output
41.9K
Codex GPT-5.6 Luna

Replicate 3

CorrectStandard tools only
Answerchr22:20000000-21000000
Workflow
Bwa MemBwa Mem2Bowtie2Samtools FlagstatBedtools Genomecoveragebed8 more tools
Total tokens
17.0M
Output
44.6K

Anycode

13/13 terminal item results

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Correct
Answerchr22:20000000-21000000
Workflow
Local codeBWA-MEMMinimap2SamtoolsBowtie2
Codex GPT-5.5

Replicate 2

Correct
Answerchr22:20000000-21000000
Workflow
Local codeBWA-MEMMinimap2SamtoolsBedtools
Codex GPT-5.5

Replicate 3

Correct
Answerchr22:20000000-21000000
Workflow
Local codeBWA-MEMMinimap2Bowtie2Samtools1 more tools

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Correct
Answerchr22:20000000-21000000
Workflow
Local codeMinimap2BWA-MEMSamtools
Codex GPT-5.6 Sol

Replicate 2

Correct
Answerchr22:20000000-21000000
Workflow
Local codeMinimap2BWA-MEMSamtoolsBLASTN
Codex GPT-5.6 Sol

Replicate 3

Correct
Answerchr22:20000000-21000000
Workflow
Local codeMinimap2BWA-MEMSamtools

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Correct
Answerchr22:20000000-21000000
Workflow
Local codeBWA-MEMMinimap2SamtoolsBowtie21 more tools
Total tokens
3.7M
Output
34.5K
Codex + DeepSeek-v4-pro-0813

Replicate 2

Correct
Answerchr22:20000000-21000000
Workflow
Local codeSamtoolsMinimap2BWA-MEMBowtie22 more tools
Total tokens
1.5M
Output
20.6K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Correct
Answerchr22:20000000-21000000
Workflow
Local codeBWA-MEMMinimap2SamtoolsBowtie23 more tools
Total tokens
1.8M
Output
20.8K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Correct
Answerchr22:20000000-21000000
Workflow
Local codeMinimap2BWA-MEMSamtoolsBowtie2
Codex GPT-5.6 Luna

Replicate 2

Correct
Answerchr22:20000000-21000000
Workflow
Local codeSamtoolsBWA-MEMMinimap2Bowtie22 more tools
Codex GPT-5.6 Luna

Replicate 3

Correct
Answerchr22:20000000-21000000
Workflow
Local codeSamtoolsMinimap2BWA-MEMBowtie22 more tools

Codex GPT-6 Astra

1 replicate
Codex GPT-6 Astra

Replicate 1

Correct
Answerchr22:20000000-21000000
Workflow
Local codeMinimap2BWA-MEMSamtoolsBowtie22 more tools
Total tokens
342.9K
Output
3.8K