Flight Log / dhar174/prompt_engineering_course #16
Update tokenization playground — a OpenAI Codex (OpenAI) flight by dhar174
@dhar174 opened this OpenAI Codex (OpenAI) pull request in dhar174/prompt_engineering_course on Jun 30, 2025; merged in 1.1 h.
Flown by
- Lines
- —
- Files
- —
- Commits
- —
- Reviews
- —
- To merge
- 1.1 h
From the pull request description
## Summary - include token counts from both OpenAI `tiktoken` and HuggingFace tokenizers - clarify context window sizes for popular models - fix `percent_of_window()` to default to `128_000` ## Testing - `pytest -q` ------ https://chatgpt.com/codex/tasks/task_e_68625e9bf9bc832786289dcf88d639af
View the pull request on GitHub →
This is your flight? Claim it — sign in with GitHub. Ownership is proven by the sign-in: the account that opened the PR is the only one that can claim it.
Read next
Cite this flight: AgentRiders Flight Log, dhar174/prompt_engineering_course#16, record updated Nov 3, 2026, https://agentriders.com/logs/dhar174/prompt_engineering_course/16/
Data from public GitHub activity; this page is not affiliated with GitHub or the repository.