Back to results

CompBioBench item

bedtools-chromhmm-q1

Question

We wish to find the chromatin states overlapping the peaks in the given ENCODE narrowpeak bed file ENCFF333TAT.bed.gz. We have a ChromHMM annotation bed file E055_15_coreMarks_dense.bed.gz. What percentage of all bases in the peaks overlap with the 14_ReprPCWk annotation? Ignore bases in the peak file that don't have any corresponding annotation in the annotation file. Round to the nearest integer. Output format: "42".

Predicted answer
16Most likely answer for this question; not uniquely determined from submitted scores.
Domain
Epigenomics
Question style
Routine Analysis

An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.

Galaxy

12/12 terminal item results

UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Matches predictionUDT-only
Answer16
Workflow
ChromHMM peak overlap percentage
Total tokens
333.3K
Output
4.7K
Codex GPT-5.5

Replicate 2

Matches predictionUDT-only
Answer16
Workflow
ChromHMM peak overlap exact base counts
Total tokens
550.7K
Output
4.4K
Codex GPT-5.5

Replicate 3

Matches predictionUDT + standard tools
Answer16
Workflow
Bedtools IntersectbedDatamash OpsChromHMM peak overlap summaryChromHMM peak overlap summary v2ChromHMM peak overlap summary v35 more tools
Total tokens
1.4M
Output
12.1K

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Matches predictionStandard tools only
Answer16
Workflow
Bedtools IntersectbedDatamash OpsTp Grep ToolSummary Statistics1
Codex GPT-5.6 Sol

Replicate 2

Matches predictionStandard tools only
Answer16
Workflow
Bedtools IntersectbedTp Grep ToolDatamash OpsSummary Statistics1
Total tokens
1.1M
Output
6.0K
Codex GPT-5.6 Sol

Replicate 3

Matches predictionUDT + standard tools
Answer16
Workflow
Bedtools IntersectbedDatamash OpsGrepBedtools GroupbybedChromHMM peak base percentage
Total tokens
4.3M
Output
8.9K

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Matches predictionStandard tools only
Answer16
Workflow
Bedtools SortbedBedtools MergebedBedtools IntersectbedBedtools GroupbybedDatamash Ops
Total tokens
3.4M
Output
20.5K
Codex + DeepSeek-v4-pro-0813

Replicate 2

Matches predictionStandard tools only
Answer16
Workflow
Bedtools SortbedBedtools MergebedBedtools IntersectbedBedtools GroupbybedFilter rows4 more tools
Total tokens
5.2M
Output
31.8K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Matches predictionStandard tools only
Answer16
Workflow
Bedtools IntersectbedDatamash OpsGrepBedtools JaccardBedops Sort Bed1 more tools
Total tokens
1.8M
Output
18.8K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Matches predictionStandard tools only
Answer16
Workflow
Filter TabularBedtools CoveragebedPaste1
Total tokens
13.3M
Output
26.8K
Codex GPT-5.6 Luna

Replicate 2

Matches predictionStandard tools only
Answer16
Workflow
Bedtools MergebedBedtools SortbedFilter TabularTp Grep ToolBedtools Intersectbed4 more tools
Total tokens
3.8M
Output
20.9K
Codex GPT-5.6 Luna

Replicate 3

Matches predictionStandard tools only
Answer16
Workflow
Filter TabularBedtools IntersectbedDatamash OpsBedtools SortbedGops Merge 11 more tools
Total tokens
4.4M
Output
23.4K

Anycode

13/13 terminal item results

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Matches prediction
Answer16
Workflow
Local codePython
Codex GPT-5.5

Replicate 2

Matches prediction
Answer16
Workflow
Local codeBedtoolsPython
Codex GPT-5.5

Replicate 3

Matches prediction
Answer16
Workflow
Local codeBedtoolsPython

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Matches prediction
Answer16
Workflow
Local codeBedtools
Codex GPT-5.6 Sol

Replicate 2

Matches prediction
Answer16
Workflow
Local codeBedtools
Codex GPT-5.6 Sol

Replicate 3

Matches prediction
Answer16
Workflow
Local codeBedtools

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Matches prediction
Answer16
Workflow
Local codeBedtoolsPython
Total tokens
1.4M
Output
23.8K
Codex + DeepSeek-v4-pro-0813

Replicate 2

Matches prediction
Answer16
Workflow
Local codeBedtoolsPython
Total tokens
208.1K
Output
10.7K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Matches prediction
Answer16
Workflow
Local codeBedtoolsPython
Total tokens
331.3K
Output
8.8K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Matches prediction
Answer16
Workflow
Local codeBedtools
Codex GPT-5.6 Luna

Replicate 2

Matches prediction
Answer16
Workflow
Local codeBedtoolsPython
Codex GPT-5.6 Luna

Replicate 3

Matches prediction
Answer16
Workflow
Local codeBedtoolsPython

Codex GPT-6 Astra

1 replicate
Codex GPT-6 Astra

Replicate 1

Matches prediction
Answer16
Workflow
Local codePython
Total tokens
58.8K
Output
838