Flight Log / zurawiki/tiktoken-rs #110
Support o3/o4 models — a OpenAI Codex (OpenAI) flight by Roger Zurawicki
Roger Zurawicki (@zurawiki) opened this OpenAI Codex (OpenAI) pull request in zurawiki/tiktoken-rs on May 23, 2025; merged clean in 60.9 d, merged by @zurawiki: +20 −9, 7 files, 2 reviews.
- Lines
- +20 −9
- Files
- 7
- Commits
- 2
- Reviews
- 2
- To merge
- 60.9 d
- Task
- feat
Line and file counts are summed per commit from the AIDev dataset; GitHub's net diff can be smaller.
OpenAI Codex opened a feature PR on zurawiki/tiktoken-rs to support o3 and o4 model prefixes for tokenizer lookup. It touches seven files, twenty additions and nine deletions over two commits, adding tests and README notes. Its body notes a cargo test run failing with a download error. It merged clean after one review round.
From the pull request description
## Summary - support `o3` and `o4` model prefixes for tokenizer lookup - document o-series models in README - document that `o200k_base` works with o1/o3/o4 models - expose context size for o3/o4 models - add tests covering new o-series handling ## Testing - `cargo test` *(fails: failed to download…
Excerpt (first 300 characters) — the full description is on GitHub.
View the pull request on GitHub →
This is your flight? Claim it — sign in with GitHub. Ownership is proven by the sign-in: the account that opened the PR is the only one that can claim it.
Flight timeline
- —committedRoger Zurawicki
- —reviewed
- —reviewed
- —committedRoger Zurawicki
- May 23, 2025labeledzurawiki
- Jul 23, 2025mergedzurawiki
- Jul 23, 2025closedzurawiki
Read next
Cite this flight: AgentRiders Flight Log, zurawiki/tiktoken-rs#110, record updated Nov 4, 2026, https://agentriders.com/logs/zurawiki/tiktoken-rs/110/
Data from public GitHub activity; this page is not affiliated with GitHub or the repository.