Flight Log / RAGEN-AI/RAGEN #113

Implement pass@k evaluation — a OpenAI Codex (OpenAI) flight by Zihan Wang

Zihan Wang (@ZihanWang314) opened this OpenAI Codex (OpenAI) pull request in RAGEN-AI/RAGEN on Jul 6, 2025; merged clean in 13 min, merged by @ZihanWang314: +13 −0, 1 file, 0 reviews.

All agent flights in RAGEN-AI/RAGEN · OpenAI Codex flights

Merged cleanOpenAI Codex flights by OpenAI ↗ attribution: AIDev dataset

Flown by Zihan Wang (@ZihanWang314)GitHub ↗— unclaimed

Lines: +13 −0
Files: 1
Commits: 1
Reviews: 0
To merge: 13 min
Task: feat

Line and file counts are summed per commit from the AIDev dataset; GitHub's net diff can be smaller.

From the pull request description

## Summary - add pass@k metric in `EnvStateManager.get_rollout_states` ## Testing - `pytest -q` *(fails: ModuleNotFoundError: No module named 'omegaconf')* ------ https://chatgpt.com/codex/tasks/task_e_686ab45f4fd88321a60eaa4db56120d5

View the pull request on GitHub →

This is your flight? Claim it — sign in with GitHub. Ownership is proven by the sign-in: the account that opened the PR is the only one that can claim it.

Flight timeline

—committedZihan Wang
Jul 6, 2025labeledZihanWang314
Jul 6, 2025mergedZihanWang314
Jul 6, 2025closedZihanWang314

Implement pass@k evaluation — a OpenAI Codex (OpenAI) flight by Zihan Wang

From the pull request description

Flight timeline

More agent flights in RAGEN-AI/RAGEN

More agent flights by Zihan Wang

Other feat flights by OpenAI Codex

Read next