Rewriting scrapers in Python

I forked an existing scraper on Github and rewrote a few lines to extend its range. It’s a bit slow but is working fine for such a large project.

My issue is I’m trying to use a clone of the first scraper to run on a similar webpage with mostly the same parameters but I’m getting a million index errors. I’m new to python and can’t quite figure out what I’ve done wrong.

I’m hoping to complete both sets so I can merge them into a single database of my own. Any help tweaking things is greatly appreciated.

1 Like