Question
Using the human SHH MANE Select transcript, take the cDNA sequence from the annotated start codon through the end of exon 1. For each of the following species: Pan troglodytes, Macaca mulatta, Pan paniscus, Indri indri, Semnopithecus johnii, Ailuropoda melanoleuca, Delphinapterus leucas, obtain the orthologous cDNA segment corresponding to the same region (prefer a one-to-one ortholog; if multiple transcripts exist, use the canonical/longest protein-coding transcript). Compute the Levenshtein edit distance to the human sequence. Return results as a comma-separated list (no spaces) in the listed species order.
- Inferred answer
0,7,0,20,5,24,27Uniquely inferred from submitted scores.
- Domain
- Genomics
- Question style
- Retrieval
An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.
Galaxy
12/12 terminal item results
UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.
Codex GPT-5.5
3 replicates
Codex GPT-5.5
Replicate 1
IncorrectUDT-only
Answer9,16,0,20,5,24,35
WorkflowSHH MANE ortholog diagnostic→SHH parse initial Ensembl sources→SHH final cDNA segment distances→SHH final cDNA segment distances v2
- Total tokens
- 4.2M
- Output
- 30.0K
Codex GPT-5.5
Replicate 2
CorrectUDT-only
Answer0,7,0,20,5,24,27
WorkflowDiagnose SHH Ensembl ortholog annotations→Diagnose Ensembl homology endpoints→Compute SHH exon 1 ortholog edit distances→Diagnose SHH species homology→Find Ensembl species names→11 more tools
- Total tokens
- 3.5M
- Output
- 31.7K
Codex GPT-5.5
Replicate 3
CorrectUDT + standard tools
Answer0,7,0,20,5,24,27
WorkflowSHH Ensembl cDNA exon1 diagnostic→UDT input path probe→UDT cat doc probe→UDT constant command probe
- Total tokens
- 6.7M
- Output
- 34.8K
Codex GPT-5.6 Sol
3 replicates
Codex GPT-5.6 Sol
Replicate 1
CorrectUDT + standard tools
Answer0,7,0,20,5,24,27
WorkflowSHH Ensembl orthology transcript diagnostic→SHH Ensembl orthology transcript diagnostic v2→SHH Ensembl orthology transcript diagnostic v3→Datasets Download Gene→SHH core transcript and exon diagnostic→15 more tools
- Total tokens
- 27.1M
- Output
- 50.7K
Codex GPT-5.6 Sol
Replicate 2
CorrectUDT + standard tools
Answer0,7,0,20,5,24,27
WorkflowSHH human MANE exon-1 boundary diagnostic→SHH ortholog and transcript diagnostic→NCBI SHH vertebrate ortholog data package→Inspect NCBI SHH target reports→Inspect Ensembl Rapid Release target species→8 more tools
- Total tokens
- 15.2M
- Output
- 46.1K
Codex GPT-5.6 Sol
Replicate 3
CorrectUDT + standard tools
Answer0,7,0,20,5,24,27
WorkflowSHH human MANE transcript diagnostic→SHH UDT runtime probe→Datasets Download Gene→Tp Grep Tool→Upload1→10 more tools
- Total tokens
- 33.1M
- Output
- 41.3K
Codex + DeepSeek-v4-pro-0813
3 replicates
Codex + DeepSeek-v4-pro-0813
Replicate 1
CorrectUDT + standard tools
Answer0,7,0,20,5,24,27
WorkflowNo Galaxy tool job recorded
- Total tokens
- 61.0M
- Output
- 107.5K
Codex + DeepSeek-v4-pro-0813
Replicate 2
CorrectUDT + standard tools
Answer0,7,0,20,5,24,27
WorkflowDatasets Download Gene→Ncbi Blastn Wrapper→Datasets Download Genome→SHH Edit Distance Analysis→SHH Probe Minimal→6 more tools
- Total tokens
- 21.4M
- Output
- 71.7K
Codex + DeepSeek-v4-pro-0813
Replicate 3
RerunIncorrectUDT + standard tools
Answer9,16,0,29,14,24,35
WorkflowNCBI Datasets Gene→NCBI Accession Download→NCBI Datasets Genomes→NCBI BLAST+ makeblastdb→NCBI BLAST+ blastn→1 more tools
- Total tokens
- 16.2M
- Output
- 72.6K
Codex GPT-5.6 Luna
3 replicates
Codex GPT-5.6 Luna
Replicate 1
IncorrectUDT + standard tools
Answer9,16,9,20,5,24,36
WorkflowSHH cDNA segment extraction→UDT render probe→Emboss: Extractseq35→Minimap2→Bedtools Bamtobed→7 more tools
- Total tokens
- 41.9M
- Output
- 86.6K
Codex GPT-5.6 Luna
Replicate 2
RerunIncorrectUDT-only
Answer9,16,0,20,5,24,35
WorkflowSHH Annotation Diagnostic→MANE SHH Filter→SHH First Exon Segment Edit Distance→Filter Indri SHH XenoRefGene→Indri SHH First Exon Segment Edit Distance→5 more tools
- Total tokens
- 19.8M
- Output
- 63.7K
Codex GPT-5.6 Luna
Replicate 3
IncorrectUDT + standard tools
Answer9,16,0,20,5,24,36
WorkflowSHH transcript annotation diagnostic→SHH UDT render probe→SHH UDT format probe→SHH UDT legacy probe→SHH UDT busybox probe→18 more tools
- Total tokens
- 30.6M
- Output
- 88.9K