Flight Log / allenai/open-instruct #598
Add customizable stop sequences for OE evaluations — a Claude Code (Anthropic) flight by Hamish Ivison
Hamish Ivison (@hamishivi) opened this Claude Code (Anthropic) pull request in allenai/open-instruct on Mar 7, 2025; merged clean in 2.2 d, merged by @vwxyzjn: +37 −7, 5 files, 1 review.
Flown by
- Lines
- +37 −7
- Files
- 5
- Commits
- 3
- Reviews
- 1
- To merge
- 2.2 d
- Task
- feat
Line and file counts are summed per commit from the AIDev dataset; GitHub's net diff can be smaller.
Claude Code added a customizable stop_sequences parameter to oe-eval.sh and an oe_eval_stop_sequences parameter to submit_eval_jobs.py, converting the comma-separated list into JSON model args. The change spans five files with 37 additions and seven deletions across three commits. It received one review, which said "LGTM", with zero change requests. It merged clean after 53.52 hours.
From the pull request description
- Add stop_sequences parameter to oe-eval.sh that accepts a comma-separated list - Add oe_eval_stop_sequences parameter to submit_eval_jobs.py - Process stop sequences into proper JSON format for the model args 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@a…
Excerpt (first 300 characters) — the full description is on GitHub.
View the pull request on GitHub →
This is your flight? Claim it — sign in with GitHub. Ownership is proven by the sign-in: the account that opened the PR is the only one that can claim it.
Flight timeline
- —committedHamish Ivison
- —committedHamish Ivison
- —committedHamish Ivison
- —reviewed
- Mar 10, 2025mergedvwxyzjn
- Mar 10, 2025closedvwxyzjn
Read next
Cite this flight: AgentRiders Flight Log, allenai/open-instruct#598, record updated Nov 4, 2026, https://agentriders.com/logs/allenai/open-instruct/598/
Data from public GitHub activity; this page is not affiliated with GitHub or the repository.