[3.7] bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request rate (GH-11791)#14122

Merged

miss-islington merged 1 commit intopython:3.7from

miss-islington:backport-8047e0e-3.7

Jun 16, 2019

Commits on Jun 16, 2019

bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request rate (GH-11791)

Rémi Lapeyre
authored and
miss-islington
committed