Back to results

CompBioBench item

compute-gccontent-promoter-q1

Question

Compute the GC content of the promoter window for the human transcript ENST00000269305 on assembly GRCh38. Use Ensembl release 115. Define the promoter interval as [TSS - upstream_bp, TSS + downstream_bp - 1] on the transcript’s strand, with upstream_bp=500 and downstream_bp=100. Report the results as a semicolon separated string in the format: chromosome,start,end,strand,promoter_length,gc_count,gc_fraction where chromosome, start, end and strand are the coordinates of the resolved promoter region, promoter_length is the length of the promoter, gc_count is the number of G or C bases in the promoter, and gc_fraction is the fraction of G/C bases in the promoter, rounded to two decimal places. All genome coordinates should be 1-based and closed. An example of a correctly formatted string is: 3;101;200;+;12;100;0.12

Inferred answer
17;7687391;7687990;-;600;292;0.49Uniquely inferred from submitted scores.
Domain
Genomics
Question style
Routine Analysis

An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.

Galaxy

12/12 terminal item results

UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

CorrectUDT-only
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Ensembl promoter GC r115
Total tokens
152.2K
Output
3.9K
Codex GPT-5.5

Replicate 2

CorrectUDT-only
Answer17;7687391;7687990;-;600;292;0.49
Workflow
ENST00000269305 promoter GC Ensembl 115
Total tokens
353.6K
Output
3.8K
Codex GPT-5.5

Replicate 3

CorrectUDT + standard tools
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Resolve promoter ENST00000269305 r115UDT render probe promoterUpload1Gtf Filter By Attribute Values ListGff2Bed14 more tools
Total tokens
3.5M
Output
20.9K

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

CorrectStandard tools only
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Tp Grep ToolBedtools GetfastabedExtract Genomic Dna 1Seq CompositionFasta Compute Length
Codex GPT-5.6 Sol

Replicate 2

CorrectUDT + standard tools
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Resolve Ensembl transcript and releaseFetch Ensembl 115 strand-aware promoterSeq CompositionFormat validated promoter GC result
Total tokens
803.6K
Output
6.1K
Codex GPT-5.6 Sol

Replicate 3

CorrectUDT + standard tools
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Resolve Ensembl 115 strand-aware promoterSeq CompositionFinal ENST00000269305 promoter GC answer
Total tokens
2.4M
Output
8.0K

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

RerunCorrectStandard tools only
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Filter GTF by transcript identifierExtract promoter intervalbedtools nucleotide content
Total tokens
2.4M
Output
16.7K
Codex + DeepSeek-v4-pro-0813

Replicate 2

CorrectStandard tools only
Answer17;7687391;7687990;-;600;292;0.49
Workflow
No Galaxy tool job recorded
Total tokens
24.2M
Output
50.9K
Codex + DeepSeek-v4-pro-0813

Replicate 3

CorrectStandard tools only
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Bedtools Nucbed
Total tokens
570.5K
Output
9.9K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

CorrectStandard tools only
Answer17;7687391;7687990;-;600;292;0.49
Workflow
CreateintervalTp Grep ToolExtract Genomic Dna 1Bedtools Nucbed
Total tokens
2.0M
Output
12.2K
Codex GPT-5.6 Luna

Replicate 2

CorrectStandard tools only
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Extract Genomic Dna 1Fasta Stats
Total tokens
4.6M
Output
17.3K
Codex GPT-5.6 Luna

Replicate 3

CorrectUDT + standard tools
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Resolve Ensembl 115 Transcript Promoter CoordinatesPrepare Ensembl 115 Promoter IntervalExtract Genomic Dna 1Fetch Ensembl 115 Promoter and Compute GCSeq Composition
Total tokens
1.7M
Output
20.7K

Anycode

13/13 terminal item results

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Correct
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Local codePython
Codex GPT-5.5

Replicate 2

Correct
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Local codePython
Codex GPT-5.5

Replicate 3

Correct
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Local codePython

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Correct
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Local code
Codex GPT-5.6 Sol

Replicate 2

Correct
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Local code
Codex GPT-5.6 Sol

Replicate 3

Correct
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Local code

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Correct
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Local codePython
Total tokens
3.5M
Output
26.6K
Codex + DeepSeek-v4-pro-0813

Replicate 2

RerunCorrect
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Open-ended code
Total tokens
292.5K
Output
9.3K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Correct
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Local codeSamtoolsPythonpysam
Total tokens
234.4K
Output
8.7K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Correct
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Local code
Codex GPT-5.6 Luna

Replicate 2

Correct
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Local codePython
Codex GPT-5.6 Luna

Replicate 3

Correct
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Local code

Codex GPT-6 Astra

1 replicate
Codex GPT-6 Astra

Replicate 1

Correct
Answer17;7687391;7687990;-;600;292;0.49
Workflow
Local codePython
Total tokens
278.2K
Output
2.2K