[3.8] bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request rate (GH-11791)#14121

Merged

miss-islington merged 1 commit intopython:3.8from

miss-islington:backport-8047e0e-3.8

Jun 16, 2019

Commits on Jun 16, 2019

bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request rate (GH-11791)

Rémi Lapeyre
authored and
miss-islington
committed