Question
Run the DNA language model here: https://huggingface.co/kuleshov-group/caduceus-ph_seqlen-131k_d_model-256_n_layer-16 on the 1000 bp long DNA sequence at hg38 chr12:7792299-7793299. Specifically, mask each base one at a time, keeping all others unmasked, and compute the per position base 2 entropy of the predictions. Return the substring corresponding to the longest run with <0.5 entropy.
- Inferred answer
GTCTCTACTAAAAATACAAAATTAGCCUniquely inferred from submitted scores.
- Domain
- Machine Learning
- Question style
- Tooling
An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.
Galaxy
12/12 terminal item results
UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.
Codex GPT-5.5
3 replicates
Codex GPT-5.5
Replicate 1
CorrectUDT-only
AnswerGTCTCTACTAAAAATACAAAATTAGCC
WorkflowCaduceus mask entropy chr12 interval→Caduceus env probe→Caduceus import probe→Caduceus mask entropy chr12 interval CPU shim→Caduceus mask entropy chr12 interval unfused CPU→1 more tools
Codex GPT-5.5
Replicate 2
RerunCorrectUDT-only
AnswerGTCTCTACTAAAAATACAAAATTAGCC
WorkflowCaduceus coordinate diagnostic→Caduceus model tokenizer probe→Caduceus model tokenizer probe high memory→Caduceus model tokenizer probe low memory→Caduceus import probe→13 more tools
- Total tokens
- 2.9M
- Output
- 23.2K
Codex GPT-5.5
Replicate 3
RerunCorrectUDT-only
AnswerGTCTCTACTAAAAATACAAAATTAGCC
Workflowhg38 interval diagnostic→Caduceus model probe→Caduceus environment probe→Caduceus import detail probe→Caduceus code probe→5 more tools
- Total tokens
- 2.0M
- Output
- 22.5K
Codex GPT-5.6 Sol
3 replicates
Codex GPT-5.6 Sol
Replicate 1
CorrectUDT-only
AnswerGTCTCTACTAAAAATACAAAATTAGCC
WorkflowGalaxy UDT→caduceus_entropy→Caduceus entropy→UDT container smoke test→Mamba runtime probe→4 more tools
- Total tokens
- 27.7M
- Output
- 32.5K
Codex GPT-5.6 Sol
Replicate 2
CorrectUDT-only
AnswerGTCTCTACTAAAAATACAAAATTAGCC
WorkflowValidate UCSC hg38 interval and emit FASTA→Caduceus masked-base entropy preflight→Caduceus mask-each-base entropy and longest low-entropy run
- Total tokens
- 4.2M
- Output
- 14.8K
Codex GPT-5.6 Sol
Replicate 3
CorrectUDT-only
AnswerGTCTCTACTAAAAATACAAAATTAGCC
WorkflowValidate UCSC hg38 interval and convert to FASTA→Probe Caduceus masked-LM token alignment and probabilities→Inspect pinned Caduceus runtime layout→Probe pinned Caduceus Python imports→Probe Caduceus masked-LM with CPU reference backend→1 more tools
- Total tokens
- 8.8M
- Output
- 21.6K
Codex + DeepSeek-v4-pro-0813
3 replicates
Codex + DeepSeek-v4-pro-0813
Replicate 1
CorrectUDT + standard tools
AnswerGTCTCTACTAAAAATACAAAATTAGCC
WorkflowNo Galaxy tool job recorded
- Total tokens
- 56.1M
- Output
- 78.7K
Codex + DeepSeek-v4-pro-0813
Replicate 2
CorrectUDT + standard tools
AnswerGTCTCTACTAAAAATACAAAATTAGCC
WorkflowExtract Genomic Dna 1→Caduceus Probe→Caduceus Probe2→Caduceus Probe2 v2→Caduceus Probe2 v3→6 more tools
- Total tokens
- 7.3M
- Output
- 48.7K
Codex + DeepSeek-v4-pro-0813
Replicate 3
CorrectUDT + standard tools
AnswerGTCTCTACTAAAAATACAAAATTAGCC
WorkflowExtract Genomic Dna 1→Caduceus Runtime Probe→Caduceus Runtime Probe v2→Caduceus Entropy Smoke→Caduceus Entropy Smoke v2→1 more tools
- Total tokens
- 4.5M
- Output
- 34.0K
Codex GPT-5.6 Luna
3 replicates
Codex GPT-5.6 Luna
Replicate 1
CorrectUDT + standard tools
AnswerGTCTCTACTAAAAATACAAAATTAGCC
WorkflowCaduceus coordinate diagnostic→Caduceus UDT render probe→Caduceus UDT render probe 2→Cat Multi Datasets→Busybox UDT render probe→5 more tools
- Total tokens
- 27.8M
- Output
- 75.7K
Codex GPT-5.6 Luna
Replicate 2
CorrectUDT + standard tools
AnswerGTCTCTACTAAAAATACAAAATTAGCC
WorkflowCreateinterval→Extract Genomic Dna 1→Caduceus runtime probe→UDT render probe→44967277 Cb96 47F9 8633 C8Da7Cff9324→8 more tools
- Total tokens
- 37.1M
- Output
- 112.6K
Codex GPT-5.6 Luna
Replicate 3
CorrectUDT + standard tools
AnswerGTCTCTACTAAAAATACAAAATTAGCC
WorkflowExtract Genomic Dna 1→Caduceus preflight→Caduceus runtime probe→Caduceus runtime probe v2→Caduceus preflight with CPU scan→8 more tools
- Total tokens
- 19.5M
- Output
- 49.3K