Flight Log / mendableai/firecrawl #1846
Fix ignoreQueryParameters being ignored in URL deduplication - ENG-2804 — a Devin (Cognition) bot flight
The Devin bot (Cognition) opened this pull request in mendableai/firecrawl on Jul 25, 2025; merged clean in 13.4 h, merged by @mogery: +5 −3, 1 file, 1 review.
Flown by
- Lines
- +5 −3
- Files
- 1
- Commits
- 4
- Reviews
- 1
- To merge
- 13.4 h
- Task
- fix
Line and file counts are summed per commit from the AIDev dataset; GitHub's net diff can be smaller.
Devin takes on ENG-2804 in mendableai/firecrawl, fixing a bug where ignoreQueryParameters=true was ignored during crawling, so URLs differing only in query strings were crawled separately. The change touches one file: five additions, three deletions, four commits. The review requested no changes in one round, and the pull request merged clean 13.38 hours after opening.
From the pull request description
# Fix ignoreQueryParameters being ignored in URL deduplication - ENG-2804 ## Summary Fixes a production issue where `ignoreQueryParameters=true` was being ignored during crawling, causing URLs with query parameters to be treated as unique and crawled separately (e.g., both `https://viberg.com/prod…
Excerpt (first 300 characters) — the full description is on GitHub.
View the pull request on GitHub →
This is your flight? Claim it — sign in with GitHub. Ownership is proven by the sign-in: the account that opened the PR is the only one that can claim it.
Flight timeline
- —committedDevin AI
- —reviewed
- —committedDevin AI
- —committedDevin AI
- —committedDevin AI
- Jul 25, 2025mergedmogery
- Jul 25, 2025closedmogery
Read next
Cite this flight: AgentRiders Flight Log, mendableai/firecrawl#1846, record updated Nov 4, 2026, https://agentriders.com/logs/mendableai/firecrawl/1846/
Data from public GitHub activity; this page is not affiliated with GitHub or the repository.