My scraper stuck, what to do?

Question & Answer
21

Heya,
Most of them have been fine since last time but a few have got stuck again, would it be alright to get them unstuck? Thank you!

22

Done :white_check_mark:

23

Thank you! :white_check_mark:

25

Hey,
I am also having the issue with a few stuck scrapers! Is there any way for me to stop them when this happens?
Thank you!

26

stuck for a few days now: https://api.morph.io/loren/td_austender_au

27

Another one of my scrapers seems to be stuck now:
https://api.morph.io/loren/ustda_data

This one has been stuck for 8 days:
https://api.morph.io/loren/td_austender_au

Could someone please give them a kick for me?

28

Hey, my scraper is stuck and it is probably because it is using a lot of memory(I should cut it to chunks, sorry). Please stop/fix it.

https://morph.io/masterofpun/railway_empl_uuids

29

Hi. My scraper seems to be stuck too. :cry:

https://morph.io/pietrobenito/CREATe_Studies_Scraper

Any help would be greatly appreciated.

Thank you! :smiley_cat:

30

It’s finished now. Must be more patient in future. :slight_smile:

1 Like
31

Scraper is so stuck. https://morph.io/JasonThomasData/Hume_City_Council

32

Mine appears to be stuck - https://morph.io/noelmas/png_rescrape - can’t hit stop

33

@noelmas yours is working again :smile:

34

@JasonThomasData your scraper seems to be happy again too :sunny:

35

@henare My scraper stuck for 9 days: https://morph.io/IvanGoncharov/API_specifications
Can you please stop it?

36

@mlandauer this looks like a good issue to get back into morph stability. Can you please look at @IvanGoncharov’s scraper?

37

Three scrapers stuck
https://morph.io/drwillems/starbucks_scrape
https://morph.io/drwillems/starbucks_simple_test
& /StarB

Would you be able to stop them? Thanks!

38

I’m stuck too - https://morph.io/lowndsy/PositionAnalyser

39

@lowndsy @drwillems

There’s a big backlog of scrapers in the queue, apparently:

40

I thought we’d fixed it yesterday but it still seems to be a problem. I’ve updated the issue with what I’ve been doing to fix it https://github.com/openaustralia/morph/issues/1064#issuecomment-255895896

41

We’re now at 420 retries, down from over 600.

1 Like