Skip to content

bpo-35922: Fix RobotFileParser when robots.txt is invalid#11791

Merged
taleinat merged 16 commits intopython:masterfrom
remilapeyre:fix-robotfileparser-for-invalid-files
Jun 16, 2019

Commits

Commits on Feb 8, 2019

Commits on Jun 9, 2019

Commits on Jun 11, 2019

Commits on Jun 12, 2019