Codex GPT-5.5
Replicate 1
IncorrectUDT-only
Answer
9Workflow
Odd One Out DiagnosticOdd One Out Binned CompareOdd One Out TSS EnrichmentOdd One Out Final Classifier
- Total tokens
- 734.9K
- Output
- 15.7K
Question
odd.one.out.q1.tar.gz contains 10 ENCODE-style tagAlign files (hg38). Each file is a different experiment performed in a unique human cell line. 9 experiments were generated using the same assay, however 1 was generated using a different assay. What is index (1-10) of this outlier?
An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.
Galaxy
12/12 terminal item resultsUDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.
Codex GPT-5.5
3 replicatesCodex GPT-5.5
Replicate 2
CorrectUDT + standard tools
Answer
4Workflow
TagAlign diagnostics q1TagAlign diagnostics q1 v2TagAlign diagnostics q1 v3TagAlign diagnostics q1 v4
- Total tokens
- 5.5M
- Output
- 33.6K
Codex GPT-5.5
Replicate 3
IncorrectUDT + standard tools
Answer
9Workflow
tagAlign diagnostic sampletagAlign diagnostic sample v2UDT render probeUDT static probeConverter Archive To Directory4 more tools
- Total tokens
- 3.2M
- Output
- 47.2K
Codex GPT-5.6 Sol
3 replicatesCodex GPT-5.6 Sol
Replicate 1
IncorrectUDT-only
Answer
1Workflow
TagAlign archive identity and structure diagnosticTagAlign chromosome-normalized spatial validationTagAlign RefSeq gene landmark validationNumPy runtime probe for strand cross-correlationTagAlign strand cross-correlation assay diagnostic3 more tools
- Total tokens
- 13.4M
- Output
- 35.8K
Codex GPT-5.6 Sol
Replicate 2
CorrectUDT-only
Answer
4Workflow
Converter Archive To DirectoryTagAlign assay structural and correlation diagnosticTagAlign assay structural and correlation diagnostic v2TagAlign assay outlier multiscale validationBlacklist-filtered deduplicated TagAlign strand shift6 more tools
- Total tokens
- 14.9M
- Output
- 48.8K
Codex GPT-5.6 Sol
Replicate 3
CorrectUDT-only
Answer
4Workflow
TagAlign assay diagnosticTagAlign assay chemistry signatureFinal tagAlign assay outlier selection
- Total tokens
- 4.8M
- Output
- 17.4K
Codex + DeepSeek-v4-pro-0813
3 replicatesCodex + DeepSeek-v4-pro-0813
Replicate 1
IncorrectStandard tools only
Answer
8Workflow
Converter Archive To DirectoryBedtools GenomecoveragebedBedtools MergebedBedtools IntersectbedFilter Tabular1 more tools
- Total tokens
- 9.6M
- Output
- 53.2K
Codex + DeepSeek-v4-pro-0813
Replicate 2
IncorrectUDT + standard tools
Answer
9Workflow
Converter Archive To DirectoryConverter Gz To UncompressedBedtools GenomecoveragebedGroup and aggregateFilter rows10 more tools
- Total tokens
- 16.6M
- Output
- 91.9K
Codex + DeepSeek-v4-pro-0813
Replicate 3
CorrectStandard tools only
Answer
4Workflow
Converter Archive To DirectoryConverter Gz To UncompressedBedtools GroupbybedBedtools GenomecoveragebedConverter Bedgraph To Bigwig1 more tools
- Total tokens
- 40.2M
- Output
- 82.3K
Codex GPT-5.6 Luna
3 replicatesCodex GPT-5.6 Luna
Replicate 1
IncorrectUDT-only
Answer
9Workflow
Converter Archive To DirectoryTagAlign Assay DiagnosticTagAlign Assay Validation
- Total tokens
- 997.9K
- Output
- 13.6K
Codex GPT-5.6 Luna
Replicate 2
IncorrectUDT + standard tools
Answer
9Workflow
Converter Archive To DirectorySummary Statistics1Bedops Sort BedFilter TabularTagAlign assay diagnostics
- Total tokens
- 9.1M
- Output
- 28.4K
Codex GPT-5.6 Luna
Replicate 3
IncorrectUDT-only
Answer
9Workflow
Converter Archive To DirectoryTagAlign assay diagnosticsTagAlign concentration validation
- Total tokens
- 1.3M
- Output
- 18.9K
Anycode
13/13 terminal item resultsCodex GPT-5.5
3 replicatesCodex GPT-5.5
Replicate 1
Incorrect
Answer
9Workflow
Local codePythonBedtools
Codex GPT-5.5
Replicate 2
Incorrect
Answer
9Workflow
Local codePythonBedtools
Codex GPT-5.5
Replicate 3
Incorrect
Answer
9Workflow
Local codePython
Codex GPT-5.6 Sol
3 replicatesCodex GPT-5.6 Sol
Replicate 1
Correct
Answer
4Workflow
Local codePythonSciPy
Codex GPT-5.6 Sol
Replicate 2
Correct
Answer
4Workflow
Local codePython
Codex GPT-5.6 Sol
Replicate 3
Correct
Answer
4Workflow
Local codePythonSciPy
Codex + DeepSeek-v4-pro-0813
3 replicatesCodex + DeepSeek-v4-pro-0813
Replicate 1
Incorrect
Answer
1Workflow
Local codeBedtoolsSamtoolsPythonSciPy1 more tools
- Total tokens
- 27.9M
- Output
- 109.7K
Codex + DeepSeek-v4-pro-0813
Replicate 2
Incorrect
Answer
8Workflow
Local codeSamtoolsBedtoolsPythonSciPy1 more tools
- Total tokens
- 9.1M
- Output
- 55.8K
Codex + DeepSeek-v4-pro-0813
Replicate 3
Correct
Answer
4Workflow
Local codeBedtoolsSamtoolsRPython1 more tools
- Total tokens
- 11.0M
- Output
- 69.8K
Codex GPT-5.6 Luna
3 replicatesCodex GPT-5.6 Luna
Replicate 1
Incorrect
Answer
9Workflow
Local codeSamtoolsBedtools
Codex GPT-5.6 Luna
Replicate 2
Incorrect
Answer
9Workflow
Local codeSamtoolsBedtoolsPython
Codex GPT-5.6 Luna
Replicate 3
Incorrect
Answer
8Workflow
Local codeBedtoolsSamtoolsRPython2 more tools
Codex GPT-6 Astra
1 replicateCodex GPT-6 Astra
Replicate 1
Correct
Answer
4Workflow
Local codePythonSciPy
- Total tokens
- 396.9K
- Output
- 4.7K