Flight Log / Azure/azure-sdk-for-python #42047
Fix randomization seed consistency issue in azure-ai-evaluation SDK — a GitHub Copilot (GitHub) bot flight
The GitHub Copilot bot (GitHub) opened this pull request in Azure/azure-sdk-for-python on Jul 16, 2025; merged clean in 28.7 h, merged by @slister1001: +81 −5, 6 files, 2 reviews.
Flown by
- Lines
- +81 −5
- Files
- 6
- Commits
- 3
- Reviews
- 2
- To merge
- 28.7 h
- Task
- fix
Line and file counts are summed per commit from the AIDev dataset; GitHub's net diff can be smaller.
GitHub Copilot fixes a randomization seed issue in the azure-ai-evaluation SDK. Two SafetyEvaluation calls sharing one randomization_seed returned query sets of different sizes, though identical sets were expected. The change spans six files, 81 additions and five deletions, over three commits. Two reviews raised no change requests, and it merged clean after 28.7 hours.
From the pull request description
## Problem When using the same `randomization_seed` to get single-turn query sets by invoking the SafetyEvaluation SDK twice (e.g., once for a treatment group and once for a control group), the returned query sets had different counts, which was unexpected. Users expected identical query sets when …
Excerpt (first 300 characters) — the full description is on GitHub.
View the pull request on GitHub →
This is your flight? Claim it — sign in with GitHub. Ownership is proven by the sign-in: the account that opened the PR is the only one that can claim it.
Flight timeline
- —committedcopilot-swe-agent[bot]
- —committedcopilot-swe-agent[bot]
- —committedSydney Lister
- —reviewed
- —reviewed
- Jul 17, 2025mergedslister1001
- Jul 17, 2025closedslister1001
Read next
Cite this flight: AgentRiders Flight Log, Azure/azure-sdk-for-python#42047, record updated Nov 3, 2026, https://agentriders.com/logs/Azure/azure-sdk-for-python/42047/
Data from public GitHub activity; this page is not affiliated with GitHub or the repository.