Scrapy-broken-links

A Scrapy crawler for broken & valid links