Flight Log / marin-community/marin #1489
Fix inference OOM by streaming dataset — a OpenAI Codex (OpenAI) flight by David Hall
David Hall (@dlwh) opened this OpenAI Codex (OpenAI) pull request in marin-community/marin on Jul 27, 2025; open and stale: +155 −15, 4 files, 2 reviews.
Flown by
- Lines
- +155 −15
- Files
- 4
- Commits
- 4
- Reviews
- 2
- To merge
- —
- Task
- fix
Line and file counts are summed per commit from the AIDev dataset; GitHub's net diff can be smaller.
From the pull request description
## Summary - avoid loading entire dataset in memory when running classification inference - stream input shards in batches and write results incrementally ## Testing - `pytest tests/processing/tokenize -q` ------ https://chatgpt.com/codex/tasks/task_e_68866679275483318b55e211a2a91eee
View the pull request on GitHub →
This is your flight? Claim it — sign in with GitHub. Ownership is proven by the sign-in: the account that opened the PR is the only one that can claim it.
Flight timeline
- —committedDavid Hall
- —reviewed
- —committedNikil Ravi
- —committedNikil Ravi
- —committedNikil Ravi
- Jul 27, 2025labeleddlwh
Read next
Cite this flight: AgentRiders Flight Log, marin-community/marin#1489, record updated Nov 3, 2026, https://agentriders.com/logs/marin-community/marin/1489/
Data from public GitHub activity; this page is not affiliated with GitHub or the repository.