Back to results

CompBioBench item

genome-coords-q1

Question

You are given a dataset (single_cell_dynamics_question.csv) of time-resolved single-cell measurements from 600 cells, each tracked over 250 consecutive time points. Each row corresponds to one cell at one time point and includes: enhancer coordinates: enh_x, enh_y, enh_z (nm), promoter coordinates: prom_x, prom_y, prom_z (nm), transcription - whether nascent transcription was detected at that time point (0/1). Define the enhancer-promoter distance as the 3D Euclidean distance. Define a proximity event (“contact”) deterministically as the distance <= 260nm. Based only on the quantities you computed above, select the single most defensible conclusion. Choose exactly one. A. Enhancer–promoter proximity and transcription are independent processes with no functional relationship. B. Transcriptional activity promotes enhancer–promoter proximity. C. Enhancer–promoter proximity promotes transcriptional activity. D. Contact and transcription share a feedback loop. E. An alternate explanation not covered here. Respond with a single letter (A-E).

Predicted answer
DMost likely answer for this question; not uniquely determined from submitted scores.
Domain
Epigenomics
Question style
Synthetic/Augmented Data

An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.

Galaxy

12/12 terminal item results

UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Matches predictionUDT-only
AnswerD
Workflow
Contact Transcription Lag AnalysisContact Transcription Transition Strata
Total tokens
340.1K
Output
6.9K
Codex GPT-5.5

Replicate 2

Matches predictionUDT + standard tools
AnswerD
Workflow
Single-cell contact diagnosticsSingle cell contact diagnostics v2UDT render probe v1UDT render probe v2Csv To Tabular5 more tools
Total tokens
3.5M
Output
21.9K
Codex GPT-5.5

Replicate 3

Matches predictionUDT + standard tools
AnswerD
Workflow
Contact diagnosticContact diagnostic v2Contact diagnostic v3Contact diagnostic v4Constant probe3 more tools
Total tokens
3.0M
Output
20.3K

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Matches predictionUDT-only
AnswerD
Workflow
Contact transcription temporal diagnosticFinal contact transcription direction analysis
Total tokens
632.0K
Output
6.3K
Codex GPT-5.6 Sol

Replicate 2

Matches predictionUDT + standard tools
AnswerD
Workflow
Contact direction diagnosticCsv To TabularTable ComputePaste1Filter Tabular3 more tools
Total tokens
12.2M
Output
28.1K
Codex GPT-5.6 Sol

Replicate 3

Matches predictionUDT + standard tools
AnswerD
Workflow
Contact transcription temporal diagnosticContact transcription temporal diagnostic v2Contact transcription temporal diagnostic v3Csv To TabularAdd A Column11 more tools
Total tokens
3.3M
Output
15.9K

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Matches predictionUDT + standard tools
AnswerD
Workflow
Single Cell Dynamics DiagnosticSingle Cell Dynamics Diagnostic v2Single Cell Dynamics Lag AnalysisSingle Cell Dynamics Cell Level Analysis
Total tokens
540.9K
Output
18.2K
Codex + DeepSeek-v4-pro-0813

Replicate 2

Matches predictionUDT + standard tools
AnswerD
Workflow
Add A Column1Summary Statistics1Datamash OpsEP lag analysisEP transition analysis
Total tokens
1.6M
Output
20.7K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Matches predictionUDT + standard tools
AnswerD
Workflow
Add A Column1proximity_transcription_analysisevent_centered_analysisstratified_transitions
Total tokens
2.1M
Output
25.2K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Matches predictionUDT + standard tools
AnswerD
Workflow
Add A Column1Single-cell dynamics diagnosticSingle-cell directed transition confirmation
Total tokens
1.1M
Output
21.3K
Codex GPT-5.6 Luna

Replicate 2

Matches predictionUDT-only
AnswerD
Workflow
Single-cell dynamics diagnosticSingle-cell dynamics full analysis
Total tokens
435.7K
Output
17.4K
Codex GPT-5.6 Luna

Replicate 3

Matches predictionUDT + standard tools
AnswerD
Workflow
Csv To TabularAdd A Column1probe_udtsingle_cell_contact_temporal_analysisudt_input_binding_probe6 more tools
Total tokens
4.2M
Output
29.3K

Anycode

13/13 terminal item results

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Matches prediction
AnswerD
Workflow
Local codePython
Codex GPT-5.5

Replicate 2

Matches prediction
AnswerD
Workflow
Local codePython
Codex GPT-5.5

Replicate 3

Matches prediction
AnswerD
Workflow
Local codePython

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Matches prediction
AnswerD
Workflow
Local codePythonSciPy
Codex GPT-5.6 Sol

Replicate 2

Matches prediction
AnswerD
Workflow
Local codePython
Codex GPT-5.6 Sol

Replicate 3

Matches prediction
AnswerD
Workflow
Local codePython

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Matches prediction
AnswerD
Workflow
Local codePythonSciPy
Total tokens
640.3K
Output
21.1K
Codex + DeepSeek-v4-pro-0813

Replicate 2

Matches prediction
AnswerD
Workflow
Local codePythonSciPy
Total tokens
464.1K
Output
18.6K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Matches prediction
AnswerD
Workflow
Local codePython
Total tokens
388.4K
Output
14.1K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Matches prediction
AnswerD
Workflow
Local codePythonSciPy
Codex GPT-5.6 Luna

Replicate 2

Matches prediction
AnswerD
Workflow
Local codePythonSciPy
Codex GPT-5.6 Luna

Replicate 3

Matches prediction
AnswerD
Workflow
Local codePython

Codex GPT-6 Astra

1 replicate
Codex GPT-6 Astra

Replicate 1

Differs from prediction
AnswerE
Workflow
Local codePython
Total tokens
139.6K
Output
1.7K