Question
https://zenodo.org/records/6330053 contains TensorFlow 2 models that are used for scoring the impact of SNPs on ATAC-seq in various cells types, as illustrated in the ScoreSNPs.ipynb notebook in https://zenodo.org/records/6796067. retina.score.snps.q1.tsv contains 500 SNPs (hg19 coordinates), of which half are known to be caQTLs. I would like to score the SNPs following the code in ScoreSNPs.ipynb, using the models corresponding to Rod cell type. After scoring the SNPs, report the AUPRC against the labels given in retina.score.snps.q1.tsv when using the absolute value of Rod_fold_avg_lfc as a predictor. Report answer by rounding down to two decimal places in the format: 0.80.
- Inferred answer
0.67Uniquely inferred from submitted scores.
- Domain
- Machine Learning
- Question style
- Tooling
An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.
Galaxy
12/12 terminal item results
UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.
Codex GPT-5.5
3 replicates
Codex GPT-5.5
Replicate 1
CorrectUDT-only
Answer0.67
WorkflowSciPy→Retina SNP build diagnostic→Stage retina models Zenodo 6330053→Score retina SNPs with Rod BPNet models
- Total tokens
- 981.6K
- Output
- 11.0K
Codex GPT-5.5
Replicate 2
CorrectUDT-only
Answer0.67
WorkflowCoordinate diagnostic for retina SNPs→Coordinate diagnostic for retina SNPs v2→Probe Rod model shape→Score Rod SNPs and AUPRC→Validate Rod PR metric
- Total tokens
- 3.0M
- Output
- 16.3K
Codex GPT-5.5
Replicate 3
RerunCorrectUDT-only
Answer0.67
WorkflowRetina coordinate diagnostic→Score Rod SNPs
- Total tokens
- 1.2M
- Output
- 17.5K
Codex GPT-5.6 Sol
3 replicates
Codex GPT-5.6 Sol
Replicate 1
CorrectUDT + standard tools
Answer0.67
WorkflowPrepare retina SNP coordinate diagnostics→Extract Genomic Dna 1→Check retina SNP reference conventions→Prepare 2114 bp retina model windows→Probe Retina Rod TensorFlow model→1 more tools
- Total tokens
- 10.8M
- Output
- 26.7K
Codex GPT-5.6 Sol
Replicate 2
CorrectUDT + standard tools
Answer0.67
WorkflowRetina SNP coordinate interpretations→Liftover1→Retina SNP lift-over and allele diagnostic→Retina SNP validated lift-over→Rod TensorFlow model compatibility probe→2 more tools
- Total tokens
- 21.7M
- Output
- 32.2K
Codex GPT-5.6 Sol
Replicate 3
CorrectUDT + standard tools
Answer0.67
WorkflowData Fetch→Retina coordinate diagnostic intervals→Extract Genomic Dna 1→Retina reference match summary→Inspect Retina Rod model→2 more tools
- Total tokens
- 16.2M
- Output
- 26.6K
Codex + DeepSeek-v4-pro-0813
3 replicates
Codex + DeepSeek-v4-pro-0813
Replicate 1
RerunCorrectUDT + standard tools
Answer0.67
WorkflowExtract Genomic DNA→Make BED intervals→bedtools getfasta→Compare SNP ref alleles→Convert genome coordinates→5 more tools
- Total tokens
- 21.4M
- Output
- 115.8K
Codex + DeepSeek-v4-pro-0813
Replicate 2
CorrectUDT + standard tools
Answer0.67
WorkflowLiftover1→Crossmap Bed→Bedtools Getfastabed→Model Probe→Model Probe Data→5 more tools
- Total tokens
- 18.1M
- Output
- 72.4K
Codex + DeepSeek-v4-pro-0813
Replicate 3
CorrectUDT + standard tools
Answer0.67
WorkflowMake SNP intervals→Make SNP intervals v2→Select columns→Make SNP intervals v3→UDT busybox probe→5 more tools
- Total tokens
- 74.0M
- Output
- 136.7K
Codex GPT-5.6 Luna
3 replicates
Codex GPT-5.6 Luna
Replicate 1
CorrectUDT + standard tools
Answer0.67
WorkflowUpload1→Unzip→Retina Notebook Inspect→UDT Render Probe→UDT Canonical Probe→10 more tools
- Total tokens
- 32.0M
- Output
- 78.9K
Codex GPT-5.6 Luna
Replicate 2
CorrectUDT + standard tools
Answer0.67
WorkflowUpload1→Retina reference convention diagnostic→Prepare SNP intervals for hg19 to hg38→Liftover1→Validate hg19 to hg38 SNP liftover→11 more tools
- Total tokens
- 14.2M
- Output
- 54.4K
Codex GPT-5.6 Luna
Replicate 3
CorrectUDT + standard tools
Answer0.67
WorkflowMake SNP Intervals→UDT Render Probe→UDT Render Probe Command→UDT Render Probe Tabular→UDT Render Probe Legacy→20 more tools
- Total tokens
- 105.0M
- Output
- 278.1K