Codex GPT-5.5
Replicate 1
Matches predictionUDT-only
Answer
HG03861Workflow
SamtoolsBCFtoolsMinimap2BWA-MEMBowtie23 more tools
Question
The pair end fastqs (identify.donor.R1.fq.gz, identify.donor.R2.fq.gz) correspond to reads from one of the 1000G donors (2504 high coverage set) from a 5Mb region of the genome. Identify the donor and report the 1000G sample ID, e.g. HG03884
An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.
Galaxy
12/12 terminal item resultsUDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.
Codex GPT-5.5
3 replicatesCodex GPT-5.5
Replicate 2
Matches predictionUDT + standard tools
Answer
HG03861Workflow
Bwa MemSamtools IdxstatsBAM chr22 span diagnosticBcftools MpileupBcftools Call7 more tools
- Total tokens
- 13.1M
- Output
- 47.7K
Codex GPT-5.5
Replicate 3
RerunMatches predictionUDT + standard tools
Answer
HG03861Workflow
Map with BWA-MEMInterval SummaryDonor Match DiagnosticWindow SummarySAM Head Diagnostic1 more tools
- Total tokens
- 3.1M
- Output
- 27.4K
Codex GPT-5.6 Sol
3 replicatesCodex GPT-5.6 Sol
Replicate 1
Matches predictionUDT + standard tools
Answer
HG03861Workflow
Bwa Mem2Bwa MemSamtools IdxstatsFreebayesSnpsift Extractfields5 more tools
- Total tokens
- 24.9M
- Output
- 22.8K
Codex GPT-5.6 Sol
Replicate 2
Matches predictionUDT + standard tools
Answer
HG03861Workflow
Bwa Mem2Bwa MemSamtools CoverageSamtools IdxstatsSamtools Depth4 more tools
- Total tokens
- 6.2M
- Output
- 19.7K
Codex GPT-5.6 Sol
Replicate 3
Matches predictionUDT + standard tools
Answer
HG03861Workflow
Bwa MemSamtools IdxstatsBAM primary alignment interval summaryIdentify 1000 Genomes donor by genotype likelihoodInspect 1000 Genomes high-coverage panel conventions15 more tools
- Total tokens
- 61.5M
- Output
- 63.6K
Codex + DeepSeek-v4-pro-0813
3 replicatesCodex + DeepSeek-v4-pro-0813
Replicate 1
Matches predictionUDT + standard tools
Answer
HG03861Workflow
No Galaxy tool job recorded
- Total tokens
- 16.9M
- Output
- 52.3K
Codex + DeepSeek-v4-pro-0813
Replicate 2
Matches predictionUDT + standard tools
Answer
HG03861Workflow
FastqcBwa MemSamtools IdxstatsBedtools BamtobedBedtools Mergebed7 more tools
- Total tokens
- 26.4M
- Output
- 72.9K
Codex + DeepSeek-v4-pro-0813
Replicate 3
Matches predictionStandard tools only
Answer
HG03861Workflow
Bwa Mem2Bwa MemSamtools IdxstatsBedtools BamtobedBedtools Mergebed9 more tools
- Total tokens
- 14.9M
- Output
- 49.5K
Codex GPT-5.6 Luna
3 replicatesCodex GPT-5.6 Luna
Replicate 1
Matches predictionUDT + standard tools
Answer
HG03861Workflow
Fastq StatsBwa MemSamtools FlagstatSamtools IdxstatsSamtools Coverage22 more tools
- Total tokens
- 78.1M
- Output
- 103.2K
Codex GPT-5.6 Luna
Replicate 2
Matches predictionUDT + standard tools
Answer
HG03861Workflow
Bwa MemSamtools FlagstatSamtools IdxstatsSamtools CoverageConverter Vcf Bgzip To Tabix 022 more tools
- Total tokens
- 67.2M
- Output
- 194.3K
Codex GPT-5.6 Luna
Replicate 3
Matches predictionUDT + standard tools
Answer
HG03861Workflow
Bwa MemSamtools FlagstatSamtools IdxstatsSamtools CoverageMapped interval probe15 more tools
- Total tokens
- 35.0M
- Output
- 97.1K
Anycode
13/13 terminal item resultsCodex GPT-5.5
3 replicatesCodex GPT-5.5
Replicate 1
Matches prediction
Answer
HG03861Workflow
Local codeBWA-MEMMinimap2SamtoolsBCFtools2 more tools
Codex GPT-5.5
Replicate 2
Matches prediction
Answer
HG03861Workflow
Local codeBWA-MEMMinimap2SamtoolsBCFtools1 more tools
Codex GPT-5.5
Replicate 3
Matches prediction
Answer
HG03861Workflow
Local codeBWA-MEMMinimap2SamtoolsBCFtools1 more tools
Codex GPT-5.6 Sol
3 replicatesCodex GPT-5.6 Sol
Replicate 1
Matches prediction
Answer
HG03861Workflow
Local codeSamtoolsBCFtoolsMinimap2BWA-MEM1 more tools
Codex GPT-5.6 Sol
Replicate 2
Matches prediction
Answer
HG03861Workflow
Local codeBWA-MEMMinimap2SamtoolsBCFtools1 more tools
Codex GPT-5.6 Sol
Replicate 3
Matches prediction
Answer
HG03861Workflow
Local codeSamtoolsBCFtoolsBWA-MEMMinimap22 more tools
Codex + DeepSeek-v4-pro-0813
3 replicatesCodex + DeepSeek-v4-pro-0813
Replicate 1
Matches prediction
Answer
HG03861Workflow
Local codeBWA-MEMSamtoolsBCFtoolsMinimap23 more tools
- Total tokens
- 4.1M
- Output
- 26.7K
Codex + DeepSeek-v4-pro-0813
Replicate 2
Matches prediction
Answer
HG03861Workflow
Local codeBWA-MEMSamtoolsBCFtoolsMinimap25 more tools
- Total tokens
- 12.7M
- Output
- 56.0K
Codex + DeepSeek-v4-pro-0813
Replicate 3
Matches prediction
Answer
HG03861Workflow
Local codeBWA-MEMMinimap2SamtoolsBCFtools3 more tools
- Total tokens
- 10.5M
- Output
- 52.2K
Codex GPT-5.6 Luna
3 replicatesCodex GPT-5.6 Luna
Replicate 1
Matches prediction
Answer
HG03861Workflow
Local codeSamtoolsBWA-MEMMinimap2BCFtools3 more tools
Codex GPT-5.6 Luna
Replicate 2
Matches prediction
Answer
HG03861Workflow
Local codeSamtoolsBWA-MEMMinimap2BCFtools2 more tools
Codex GPT-5.6 Luna
Replicate 3
Matches prediction
Answer
HG03861Workflow
Local codeSamtoolsBCFtoolsBWA-MEMMinimap24 more tools
Codex GPT-6 Astra
1 replicateCodex GPT-6 Astra
Replicate 1
Matches prediction
Answer
HG03861Workflow
Local codeBWA-MEMSamtoolsBCFtoolsMinimap22 more tools
- Total tokens
- 866.3K
- Output
- 8.1K