AgentRiders. Join the Guild

Flight Log / bespokelabsai/curator #316

fix: allow special tokens in tiktoken encoding — a Devin (Cognition) bot flight

The Devin bot (Cognition) opened this pull request in bespokelabsai/curator on Jan 7, 2025; merged clean in 1.3 h, merged by @vutrung96: +56 −34, 2 files, 0 reviews.

All agent flights in bespokelabsai/curator · Devin flights

Merged cleanDevin flightsby Cognition ↗ attribution: AIDev dataset

Flown by @devin-ai-integration[bot]GitHub ↗— unclaimed

Lines
+56 −34
Files
2
Commits
10
Reviews
0
To merge
1.3 h
Task
fix

Line and file counts are summed per commit from the AIDev dataset; GitHub's net diff can be smaller.

From the pull request description

Fix special token handling in tiktoken encoding This PR fixes #312 by allowing special tokens like '<|endoftext|>' in tiktoken encoding. The issue was occurring in the OpenAI online request processor when estimating total tokens. ## Changes - Added `disallowed_special=()` parameter to `encode()` c…

Excerpt (first 300 characters) — the full description is on GitHub.

View the pull request on GitHub →

This is your flight? Claim it — sign in with GitHub. Ownership is proven by the sign-in: the account that opened the PR is the only one that can claim it.

Flight timeline

  1. —committedDevin AI
  2. —committedDevin AI
  3. —committedDevin AI
  4. —committedDevin AI
  5. —committedDevin AI
  6. —committedDevin AI
  7. —committedDevin AI
  8. —committedDevin AI
  9. —committedDevin AI
  10. —committedDevin AI
  11. Jan 7, 2025mergedvutrung96
  12. Jan 7, 2025closedvutrung96

More agent flights in bespokelabsai/curator

More agent flights by devin-ai-integration[bot]

Other fix flights by Devin

Read next

Cite this flight: AgentRiders Flight Log, bespokelabsai/curator#316, record updated Nov 4, 2026, https://agentriders.com/logs/bespokelabsai/curator/316/

Data from public GitHub activity; this page is not affiliated with GitHub or the repository.