Question
Given paired-end 10x scRNA-seq FASTQs (three.way.barnyard.q1.R1.fq.gz, three.way.barnyard.q1.R2.fq.gz) from a 3-species barnyard (human, mouse, pig)—R1 = 28-bp cell barcode+UMI, R2 = 91-bp cDNA—assume all barcodes are valid single cells (no empty droplets or doublets; no further barcode filtering required) and report the mixture as percentages rounded to the nearest 10%, semicolon-separated, summing to 100, for human, mouse, and pig, respectively. Example output: "50;20;30".
- Predicted answer
10;30;60Most likely answer for this question; not uniquely determined from submitted scores.
- Domain
- Single-cell
- Question style
- Synthetic/Augmented Data
An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.
Galaxy
12/12 terminal item results
UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.
Codex GPT-5.5
3 replicates
Codex GPT-5.5
Replicate 1
Matches predictionUDT-only
Answer10;30;60
WorkflowFASTQ Structure Diagnostic→Three Way Barnyard Kmer Classifier
Codex GPT-5.5
Replicate 2
Matches predictionUDT-only
Answer10;30;60
WorkflowBarnyard species kmer diagnostic→Barnyard species kmer full
- Total tokens
- 448.9K
- Output
- 10.4K
Codex GPT-5.5
Replicate 3
Matches predictionUDT + standard tools
Answer10;30;60
WorkflowBarnyard Species Minimap Diagnostic→UDT Render Probe→UDT Render Probe 2→UDT Render Probe 3→UDT Render Probe 4
- Total tokens
- 5.6M
- Output
- 29.9K
Codex GPT-5.6 Sol
3 replicates
Codex GPT-5.6 Sol
Replicate 1
Matches predictionUDT + standard tools
Answer10;30;60
WorkflowFastq Stats→Kraken2→UDT environment check→Minimap2→Aggregate three-species barcodes→4 more tools
- Total tokens
- 17.3M
- Output
- 34.6K
Codex GPT-5.6 Sol
Replicate 2
Matches predictionUDT-only
Answer10;30;60
Workflow10x paired FASTQ barcode diagnostic→10x paired FASTQ barcode diagnostic corrected→Upload1→Minimap2→BWA-MEM→4 more tools
- Total tokens
- 2.2M
- Output
- 16.0K
Codex GPT-5.6 Sol
Replicate 3
Matches predictionUDT + standard tools
Answer10;30;60
WorkflowFastqc→Barnyard barcode and mate diagnostic→Minimap2
- Total tokens
- 3.3M
- Output
- 18.2K
Codex + DeepSeek-v4-pro-0813
3 replicates
Codex + DeepSeek-v4-pro-0813
Replicate 1
Matches predictionUDT + standard tools
Answer10;30;60
WorkflowRna Star→Hisat2→Samtools→Bedtools
- Total tokens
- 8.2M
- Output
- 39.4K
Codex + DeepSeek-v4-pro-0813
Replicate 2
Matches predictionUDT + standard tools
Answer10;30;60
WorkflowConverter Gz To Uncompressed→Zip Collection→Alevin→Umi Tools Whitelist→Rna Starsolo→1 more tools
- Total tokens
- 10.3M
- Output
- 41.0K
Codex + DeepSeek-v4-pro-0813
Replicate 3
Matches predictionStandard tools only
Answer10;30;60
WorkflowFastq Trimmer→Cshl Fastq To Fasta→Fasta2Tab→Select columns→Count1→1 more tools
- Total tokens
- 22.1M
- Output
- 52.2K
Codex GPT-5.6 Luna
3 replicates
Codex GPT-5.6 Luna
Replicate 1
Matches predictionUDT + standard tools
Answer10;30;60
WorkflowDatasets Download Gene→Datasets Download Genome→Minimap2→Species mapping runtime probe→UDT mechanics probe→12 more tools
- Total tokens
- 32.3M
- Output
- 80.7K
Codex GPT-5.6 Luna
Replicate 2
Matches predictionUDT + standard tools
Answer10;30;60
WorkflowFastqc→Datasets Download Genome→Minimap2→10x Three-Species Barnyard Classifier
- Total tokens
- 5.3M
- Output
- 33.8K
Codex GPT-5.6 Luna
Replicate 3
Matches predictionUDT + standard tools
Answer10;30;60
WorkflowFastq Stats→Umi Tools Extract→Datasets Download Genome→Upload1→Barnyard Runtime Probe→2 more tools
- Total tokens
- 10.4M
- Output
- 40.0K