Third-round token optimization

All three replicates

Overall: 137/150 correct (91.3%). Tokens are input plus output; cached input is already included in input tokens.

Comparison with Open-ended code

All three rows average three replicates of the same 50 tasks with GPT-5.6 Sol. The Open-ended and previous Galaxy baselines reuse the existing website records. Previous runs used Codex CLI 0.146.0; the new Galaxy runs used 0.156.0.

What changed in the third optimization round

• Shorter successful replies

  Return job status, dataset identifiers, relevant results and check summaries. Bound inline text previews; keep full requests, replies and job details for later inspection. Error details remain available.

• Avoid repeated content

  Deduplicate output datasets and abbreviate unchanged results and tool schemas within a session. A tool schema is still checked against the live Galaxy interface and can be expanded again.

• Clearer submission formats

  Remove repeated parameter descriptions and provide generic templates with actual parameter paths. These describe how to call the selected tool, not how to solve a benchmark question.

• Fewer format-related retries

  Correct false parameter-mismatch alarms caused by equivalent repeat-field names or different API input formats. Check custom-tool input/output definitions before creation; keep scientific parameter checks.

• Longer waits between model requests

  Use the approved waiting instructions: wait at least five minutes, preferably thirty, rather than repeatedly asking whether an asynchronous call has finished. The Galaxy tool interface already waits for jobs; this change reduces the model's checks of that still-running call.

Full execution evidence is retained despite the shorter conversation.

These are observed batch comparisons; savings were not measured separately for each individual change. Run selection is recorded in the batch manifest, and original attempts remain retained locally.

All 50 tasks and 150 run records

Open each item for submitted answers, tokens, HF traces and Galaxy histories. A Galaxy history can be opened by link but is not listed publicly.

Lab HF batchMachine-readable results