Question
You are given the cellranger output of a CRISPR perturb-seq experiment in perturb.seq.effect.q1.tar.gz where cell features are at filtered_feature_bc_matrix/features.tsv.gz, counts are at filtered_feature_bc_matrix/matrix.mtx.gz, barcodes are at filtered_feature_bc_matrix/barcodes.tsv.gz, guide assignment per cell is at perturb_protospacer_calls_per_cell.csv, and guide reference at feature_reference.csv. I am interested in finding guides which robustly knockdown the interferon gamma pathway. We need to decide which target gene from this screen to explore in a follow up screen - which gene target should be selected? Respond with a single gene target name (i.e. CCL6).
- Inferred answer
ISG15Uniquely inferred from submitted scores.
- Domain
- Single-cell
- Question style
- Synthetic/Augmented Data
An answer can be uniquely inferred for 54 of 100 questions from submitted scores. Green: correct · Red: incorrect. For questions without a uniquely determined answer: Blue: matches prediction · Orange: differs from prediction. These are inferred answer checks, not official per-question grades.
Galaxy
12/12 terminal item results
UDT = user-defined tool: custom code executed by Galaxy. Route badges summarize analysis tools, excluding uploads and automatic conversions. How usage is counted.
Codex GPT-5.5
3 replicates
Codex GPT-5.5
Replicate 1
CorrectUDT-only
AnswerISG15
WorkflowPerturb-seq Diagnostic→Perturb-seq IFNG pathway analysis→Perturb-seq IFNG pathway robust analysis
- Total tokens
- 711.9K
- Output
- 12.2K
Codex GPT-5.5
Replicate 2
CorrectUDT-only
AnswerISG15
WorkflowPerturb-seq archive diagnostic→Perturb-seq IFNG pathway scoring→Perturb-seq robust IFNG pathway scoring
- Total tokens
- 592.7K
- Output
- 12.6K
Codex GPT-5.5
Replicate 3
CorrectUDT + standard tools
AnswerISG15
WorkflowPerturb-seq diagnostic→UDT Python probe→UDT Busybox probe→Unzip
- Total tokens
- 2.3M
- Output
- 19.7K
Codex GPT-5.6 Sol
3 replicates
Codex GPT-5.6 Sol
Replicate 1
CorrectUDT + standard tools
AnswerISG15
WorkflowPerturb-seq archive QC→Converter Archive To Directory→Scanpy Read 10X→Anndata Inspect→Csv To Tabular→8 more tools
- Total tokens
- 20.6M
- Output
- 41.1K
Codex GPT-5.6 Sol
Replicate 2
CorrectUDT-only
AnswerISG15
WorkflowPerturb-seq archive diagnostics→Perturb-seq metadata and QC→IFNG Perturb-seq robust target screen
- Total tokens
- 1.5M
- Output
- 12.2K
Codex GPT-5.6 Sol
Replicate 3
CorrectUDT-only
AnswerISG15
WorkflowPerturb-seq archive diagnostic→Perturb-seq IFNG robust target ranking→Perturb-seq IFNG top-target validation
- Total tokens
- 1.6M
- Output
- 20.6K
Codex + DeepSeek-v4-pro-0813
3 replicates
Codex + DeepSeek-v4-pro-0813
Replicate 1
IncorrectStandard tools only
AnswerSTAT1
WorkflowConverter Archive To Directory→Csv To Tabular→Scanpy Read 10X→Scanpy Normalize→Scanpy Inspect→2 more tools
- Total tokens
- 14.0M
- Output
- 47.2K
Codex + DeepSeek-v4-pro-0813
Replicate 2
CorrectStandard tools only
AnswerISG15
WorkflowConverter Archive To Directory→Converter Gz To Uncompressed→Scanpy Read 10X→Csv To Tabular→Tp Sort Header Tool→12 more tools
- Total tokens
- 11.5M
- Output
- 37.5K
Codex + DeepSeek-v4-pro-0813
Replicate 3
CorrectUDT + standard tools
AnswerISG15
WorkflowPerturb-seq diagnostic→Cat1→UDT probe→Converter Archive To Directory→Converter Gz To Uncompressed→11 more tools
- Total tokens
- 30.0M
- Output
- 56.8K
Codex GPT-5.6 Luna
3 replicates
Codex GPT-5.6 Luna
Replicate 1
CorrectUDT-only
AnswerISG15
WorkflowConverter Archive To Directory→Perturb-seq archive diagnostic→Perturb-seq metadata export→Perturb-seq IFN-gamma guide screen→Perturb-seq curated IFN-gamma sensitivity→1 more tools
- Total tokens
- 4.1M
- Output
- 39.3K
Codex GPT-5.6 Luna
Replicate 2
CorrectUDT-only
AnswerISG15
WorkflowConverter Archive To Directory→Perturb-seq input inspection→Perturb-seq metadata diagnostic→Perturb-seq interferon-gamma scoring→Perturb-seq hit validation
- Total tokens
- 1.5M
- Output
- 24.3K
Codex GPT-5.6 Luna
Replicate 3
CorrectUDT-only
AnswerISG15
WorkflowPerturb archive diagnostic→Perturb design diagnostic→Pilot IFNG pathway score→Robust IFNG guide analysis
- Total tokens
- 985.1K
- Output
- 24.5K