Serhiy Storchaka bc285e5832 gh-138907: Support RFC 9309 in robotparser (GH-138908) ...

* empty lines are always ignored instead of separating groups
* the "user-agent" line after a rule starts a new group
* groups matching the same user agent are now merged
* the rule with the longest match wins instead of the first matching rule
* in case of equal matches, the “Allow” rule wins over “Disallow”
* special characters “$” and “*” are now supported in rules
* prefer full match for user agent

2026-05-04 18:03:11 +00:00

..

__init__.py

…

error.py

…

parse.py

gh-144148: Update the urllib.parse documentation (GH-144497)

2026-02-05 16:32:17 +02:00

request.py

gh-143925: Reject control characters in data: URL mediatypes

2026-01-20 20:45:58 +00:00

response.py

…

robotparser.py

gh-138907: Support RFC 9309 in robotparser (GH-138908)

2026-05-04 18:03:11 +00:00