4 people 2a5f9e0e24 [3.15] gh-79638: Restore "Treat an unreachable robots.txt as disallow all" (GH-152525) (GH-153107) ...

This change was accidentally reverted by f0daba1652 (gh-106693,
GH-149514), which only intended to revert the ob_sval change.
The tests were already restored by GH-149569.
(cherry picked from commit 70100b9ea0)

Co-authored-by: Serhiy Storchaka <[email protected]>
Co-authored-by: Claude Opus 4.8 (1M context) <[email protected]>

2026-07-05 11:44:44 +00:00

..

__init__.py

…

error.py

…

parse.py

[3.15] gh-149083: Use sentinel for urllib.parse._UNSPECIFIED (GH-149612) (#151017)

2026-06-06 13:13:52 +00:00

request.py

…

response.py

…

robotparser.py

[3.15] gh-79638: Restore "Treat an unreachable robots.txt as disallow all" (GH-152525) (GH-153107)

2026-07-05 11:44:44 +00:00