Scraper won't stop running

1

The ‘stop scraper’ button isn’t doing anything.

It’s been running for about a day now https://morph.io/jennahowe/El_Salvador_Legislative_Assembly, so I guess it will be killed automatically soon when it goes over 24 hours.

It should have just stopped of it’s own accord ages ago because it errored pretty much straight away (bad gateway error), but that hasn’t happened.

2

Thanks for reporting this @jennahowe :bird:

I’ve logged a bug and also manually fixed your scraper up.

3

Thanks @henare :smile_cat:

4

please stop this one too https://morph.io/soit-sk/trademarks_-_upv_sk

5

@katkad I’ve kicked off the stuck run and it’s trying to finish now.

6

hello, it is still stuck :frowning: I cannot stop it.

7

The last run of that scraper logged over 180,000 lines and scraped more than 120,000 pages.

I’d suggest not outputting so many lines as this makes your scraper page very big. It would also be a good idea to add some throttling to your scraper if you’re scraping tens of thousands of pages.