My scraper stuck, what to do?

Question & Answer
34

@JasonThomasData your scraper seems to be happy again too :sunny:

35

@henare My scraper stuck for 9 days: https://morph.io/IvanGoncharov/API_specifications
Can you please stop it?

36

@mlandauer this looks like a good issue to get back into morph stability. Can you please look at @IvanGoncharov’s scraper?

37

Three scrapers stuck
https://morph.io/drwillems/starbucks_scrape
https://morph.io/drwillems/starbucks_simple_test
& /StarB

Would you be able to stop them? Thanks!

38

I’m stuck too - https://morph.io/lowndsy/PositionAnalyser

39

@lowndsy @drwillems

There’s a big backlog of scrapers in the queue, apparently:

40

I thought we’d fixed it yesterday but it still seems to be a problem. I’ve updated the issue with what I’ve been doing to fix it https://github.com/openaustralia/morph/issues/1064#issuecomment-255895896

41

We’re now at 420 retries, down from over 600.

1 Like
42

One of my scrapers is stuck:
https://morph.io/wdiv-scrapers/DC-PollingStations-Eden
Any chance of getting it killed?

Cheers
Chris

43

Actually, I seem to have a few others that have been trying to run for more than a day under the wdiv-scrapers org. Can you just kill anything under https://morph.io/wdiv-scrapers that has been queued for > 1 day when you get a chance to look at this.
Thanks

44

Hi everyone. Thanks for reporting this @chris48s and @LoveMyData.

I’ve just checked the queue and we’ve got a massive backlog. I’m investigating the cause and will try to get things moving again.

45

The problem is this, again: https://github.com/openaustralia/morph/issues/1098

I’ve cleaned up the stopped containers and now the queue just has to run through. Which is exacerbated by this https://github.com/openaustralia/morph/issues/1099

:disappointed:

I’m manually checking the queue and loading jobs to try and clear things up a bit.

46

I’ve hit the limit of what I can do manually. We’ll just have to wait for the jobs to finish. Currently there’s about 1,000 to go. Some are not even scheduled to retry until a day from now.

47

Just had a check and my scraper has been running for 5 days. Sorry I didn’t notice before. Please can someone shake it loose? https://morph.io/lowndsy/PositionAnalyser

48

We’re down to 400 retries so it looks like we’re getting through things slowly but surely. I’ve also poked and prodded to get the queue :fire:ed up again.

@lowndsy For using such a fantastic turn of phrase, I have personally checked and shaken down your scraper :smiley: It’s all fine now.

49

I’ve got some more scrapers that have been queued for more than a day: https://morph.io/wdiv-scrapers/
Have the docker-tubes got all clogged up with goo again?

50

@chris48s now you’re just trying to out do @lowndsy :wink:

Yeah, yesterday The Tubes were a bit clogged with 800 runs waiting to retry. I got out my plunger and today’s it’s down to 200. I’ll keep an eye on it, thanks for letting me know.

In GitHub issues you can see I’ve got an idea of the root cause now. It’s just a matter of being able to allocate some time to fix it :confused:

51

@chris48s now you’re just trying to out do @lowndsy

Cue series of increasingly tortured analogies… :slight_smile:

52

Sorry to keep bugging you, but I’ve got a couple more that need a good kick up the backside :boot:
https://morph.io/wdiv-scrapers/DC-PollingStations-Calderdale
https://morph.io/wdiv-scrapers/DC-PollingStations-Mid-Sussex

53

No worries. I just wish we had the time and resources to fix this properly. It’s a pain for everyone.

I’ve manually aborted the one of those scrapers that was still stuck after this morning’s general prodding.