Back to results

CompBioBench item

exogenous-mix-reads-q1

Question

I have FASTQ data from a perturbation experiment involving KLF4 exogenous overexpression using a Sendai virus. I want to estimate the fraction of exogenous-origin reads in exogenous.mix.reads.q1.mix.fq, given exogenous.mix.reads.q1.exo.fq (early timepoint, assumed purely exogenous) and exogenous.mix.reads.q1.endo.fq (later timepoint, predominantly endogenous). All files contain reads mapping to KLF4. I don't have details on the Sendai construct. If possible, estimate the percent of exogenous reads in exogenous.mix.reads.q1.mix.fq (by read count) to the nearest 10 and return only the integer (e.g. 50); if not possible, return NA.

Inferred answer
30Uniquely inferred from submitted scores.
Domain
Transcriptomics
Question style
Synthetic/Augmented Data

An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.

Galaxy

12/12 terminal item results

UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

IncorrectUDT-only
Answer50
Workflow
KLF4 Exogenous Mixture Diagnostics
Total tokens
249.9K
Output
5.8K
Codex GPT-5.5

Replicate 2

CorrectUDT + standard tools
Answer30
Workflow
FASTQ mix diagnosticFASTQ mix diagnostic v2FASTQ mix diagnostic v3FASTQ mix diagnostic v4UDT render probe6 more tools
Total tokens
2.4M
Output
15.8K
Codex GPT-5.5

Replicate 3

IncorrectUDT + standard tools
Answer40
Workflow
KLF4 Exogenous DiagnosticKLF4 Exogenous Diagnostic v2UDT Render Probe CatUDT Render Probe AltFastq To Tabular4 more tools
Total tokens
3.6M
Output
20.1K

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

CorrectUDT-only
Answer30
Workflow
KLF4 source diagnosticKLF4 mixture model diagnosticKLF4 final exogenous fraction
Total tokens
1.1M
Output
12.1K
Codex GPT-5.6 Sol

Replicate 2

CorrectUDT-only
Answer30
Workflow
KLF4 FASTQ empirical mixture diagnosticKLF4 FASTQ exogenous fraction final estimator
Total tokens
700.8K
Output
11.1K
Codex GPT-5.6 Sol

Replicate 3

CorrectUDT + standard tools
Answer30
Workflow
KLF4 FASTQ signature diagnosticKLF4 FASTQ signature diagnostic v2KLF4 FASTQ signature diagnostic v3RnaspadesBwa Mem3 more tools
Total tokens
6.1M
Output
16.5K

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

CorrectUDT + standard tools
Answer30
Workflow
Cshl Fastx CollapserBwa MemSamtools ViewFilter TabularMix diagnostic4 more tools
Total tokens
5.4M
Output
44.0K
Codex + DeepSeek-v4-pro-0813

Replicate 2

CorrectStandard tools only
Answer30
Workflow
Fastq To TabularGroup and aggregateCount1
Total tokens
12.8M
Output
48.5K
Codex + DeepSeek-v4-pro-0813

Replicate 3

RerunCorrectUDT + standard tools
Answer30
Workflow
Reference retrievalMinimap2 alignmentAlignment summaryMixture estimate
Total tokens
3.1M
Output
34.9K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

CorrectUDT + standard tools
Answer30
Workflow
Seqkit Split2Fastq StatsMegahitCat1Tp Cat14 more tools
Total tokens
18.4M
Output
61.3K
Codex GPT-5.6 Luna

Replicate 2

CorrectUDT + standard tools
Answer30
Workflow
KLF4 read diagnosticKLF4 read diagnostic correctedKLF4 mixture diagnosticKLF4 mixture diagnostic correctedKLF4 mixture diagnostic final diagnostic8 more tools
Total tokens
7.1M
Output
51.4K
Codex GPT-5.6 Luna

Replicate 3

CorrectStandard tools only
Answer30
Workflow
Fastq StatsCshl Fastx CollapserFasta StatsCshl Fastq To FastaVsearch Search6 more tools
Total tokens
11.7M
Output
46.7K

Anycode

13/13 terminal item results

Codex GPT-5.5

3 replicates
Codex GPT-5.5

Replicate 1

Incorrect
Answer50
Workflow
Local codePython
Codex GPT-5.5

Replicate 2

Correct
Answer30
Workflow
Local codePythonBowtie2Minimap2BLASTN1 more tools
Codex GPT-5.5

Replicate 3

Correct
Answer30
Workflow
Local codePython

Codex GPT-5.6 Sol

3 replicates
Codex GPT-5.6 Sol

Replicate 1

Correct
Answer30
Workflow
Local codePythonBWA-MEMBowtie2Minimap22 more tools
Codex GPT-5.6 Sol

Replicate 2

Correct
Answer30
Workflow
Local codePythonMinimap2Bowtie2BWA-MEM2 more tools
Codex GPT-5.6 Sol

Replicate 3

Correct
Answer30
Workflow
Local codePythonMinimap2Bowtie2BWA-MEM2 more tools

Codex + DeepSeek-v4-pro-0813

3 replicates
Codex + DeepSeek-v4-pro-0813

Replicate 1

Correct
Answer30
Workflow
Local codePythonBWA-MEMMinimap2Bowtie24 more tools
Total tokens
610.5K
Output
20.0K
Codex + DeepSeek-v4-pro-0813

Replicate 2

Correct
Answer30
Workflow
Local codePythonBowtie2Minimap2BWA-MEM3 more tools
Total tokens
796.3K
Output
22.0K
Codex + DeepSeek-v4-pro-0813

Replicate 3

Correct
Answer30
Workflow
Local codePythonMinimap2Bowtie2BWA-MEM2 more tools
Total tokens
2.1M
Output
39.8K

Codex GPT-5.6 Luna

3 replicates
Codex GPT-5.6 Luna

Replicate 1

Correct
Answer30
Workflow
Local codePythonMinimap2Bowtie2Samtools3 more tools
Codex GPT-5.6 Luna

Replicate 2

Correct
Answer30
Workflow
Local codePythonMinimap2BWA-MEMBowtie23 more tools
Codex GPT-5.6 Luna

Replicate 3

Correct
Answer30
Workflow
Local codeMinimap2Bowtie2BWA-MEMBLASTN2 more tools

Codex GPT-6 Astra

1 replicate
Codex GPT-6 Astra

Replicate 1

Correct
Answer30
Workflow
Local codePython
Total tokens
90.9K
Output
2.4K