Codex GPT-5.5
Replicate 1
Matches predictionUDT-only
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Disease Q1 sample clustering
- Total tokens
- 234.1K
- Output
- 6.1K
Question
The file disease.samples.q1.tsv contains bulk RNA-seq TPM data for 9 individuals. Metadata is missing, but the samples are known to be a mix of healthy and diseased subjects. Identify the diseased samples and return their IDs as a sorted, comma-separated string (e.g., Sample_2,Sample_8,Sample_9).
An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.
Galaxy
12/12 terminal item resultsUDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.
Codex GPT-5.5
3 replicatesCodex GPT-5.5
Replicate 2
Matches predictionUDT-only
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Disease Sample DiagnosticDisease Final Decision
- Total tokens
- 748.5K
- Output
- 9.2K
Codex GPT-5.5
Replicate 3
Matches predictionUDT + standard tools
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Disease unsupervised diagnosticsUDT render probeDatamash TransposeSklearn PcaSklearn Numeric Clustering1 more tools
- Total tokens
- 2.8M
- Output
- 15.1K
Codex GPT-5.6 Sol
3 replicatesCodex GPT-5.6 Sol
Replicate 1
Matches predictionUDT-only
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Q1 Unsupervised Sample StructureQ1 Disease Signature Validation
- Total tokens
- 1.7M
- Output
- 9.8K
Codex GPT-5.6 Sol
Replicate 2
Matches predictionUDT-only
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
RNA TPM unsupervised PCA diagnosticRNA disease panel validation and final IDs
- Total tokens
- 994.1K
- Output
- 10.9K
Codex GPT-5.6 Sol
Replicate 3
Matches predictionUDT-only
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
RNA Unsupervised Diagnostic Q1RNA Disease Validation Q1
- Total tokens
- 622.1K
- Output
- 6.8K
Codex + DeepSeek-v4-pro-0813
3 replicatesCodex + DeepSeek-v4-pro-0813
Replicate 1
Matches predictionStandard tools only
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Datamash TransposeSklearn Numeric Clustering
- Total tokens
- 11.4M
- Output
- 36.9K
Codex + DeepSeek-v4-pro-0813
Replicate 2
Matches predictionStandard tools only
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Filter rowsDatamash TransposeTable ComputeMultivariate
- Total tokens
- 3.1M
- Output
- 21.2K
Codex + DeepSeek-v4-pro-0813
Replicate 3
Matches predictionUDT + standard tools
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Ggplot2 PcaDatamash TransposeSklearn PcaSklearn Numeric ClusteringTransformation1 more tools
- Total tokens
- 6.4M
- Output
- 37.9K
Codex GPT-5.6 Luna
3 replicatesCodex GPT-5.6 Luna
Replicate 1
Matches predictionStandard tools only
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Datamash TransposeSklearn Numeric ClusteringSelect columnsSklearn PcaSummary Statistics16 more tools
- Total tokens
- 16.5M
- Output
- 42.6K
Codex GPT-5.6 Luna
Replicate 2
Matches predictionUDT + standard tools
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Pca1Filter TabularGrepTransformationAdd A Column13 more tools
- Total tokens
- 3.2M
- Output
- 19.3K
Codex GPT-5.6 Luna
Replicate 3
Matches predictionUDT-only
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Expression Unsupervised DiagnosticExpression Marker Validation
- Total tokens
- 381.5K
- Output
- 10.4K
Anycode
13/13 terminal item resultsCodex GPT-5.5
3 replicatesCodex GPT-5.5
Replicate 1
Matches prediction
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Local codePythonSciPy
Codex GPT-5.5
Replicate 2
Matches prediction
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Local codePythonSciPy
Codex GPT-5.5
Replicate 3
Matches prediction
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Local codePythonSciPy
Codex GPT-5.6 Sol
3 replicatesCodex GPT-5.6 Sol
Replicate 1
Matches prediction
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Local codePython
Codex GPT-5.6 Sol
Replicate 2
Matches prediction
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Local codePythonSciPy
Codex GPT-5.6 Sol
Replicate 3
Matches prediction
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Local codePythonSciPy
Codex + DeepSeek-v4-pro-0813
3 replicatesCodex + DeepSeek-v4-pro-0813
Replicate 1
Matches prediction
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Local codePythonSciPy
- Total tokens
- 369.2K
- Output
- 6.2K
Codex + DeepSeek-v4-pro-0813
Replicate 2
Matches prediction
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Local codePythonSciPy
- Total tokens
- 128.2K
- Output
- 3.0K
Codex + DeepSeek-v4-pro-0813
Replicate 3
Matches prediction
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Local codePythonSciPy
- Total tokens
- 161.3K
- Output
- 5.0K
Codex GPT-5.6 Luna
3 replicatesCodex GPT-5.6 Luna
Replicate 1
Matches prediction
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Local codePythonSciPy
Codex GPT-5.6 Luna
Replicate 2
Matches prediction
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Local codePythonSciPy
Codex GPT-5.6 Luna
Replicate 3
Matches prediction
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Local codePythonSciPy
Codex GPT-6 Astra
1 replicateCodex GPT-6 Astra
Replicate 1
Matches prediction
Answer
Sample_1,Sample_4,Sample_6,Sample_8,Sample_9Workflow
Local codePythonSciPy
- Total tokens
- 197.9K
- Output
- 1.9K