My scraper stuck, what to do?


#21

Heya,
Most of them have been fine since last time but a few have got stuck again, would it be alright to get them unstuck? Thank you!


#22

Done :white_check_mark:


#23

Thank you! :white_check_mark:


#25

Hey,
I am also having the issue with a few stuck scrapers! Is there any way for me to stop them when this happens?
Thank you!


#26

stuck for a few days now: https://api.morph.io/loren/td_austender_au


#27

Another one of my scrapers seems to be stuck now:
https://api.morph.io/loren/ustda_data

This one has been stuck for 8 days:
https://api.morph.io/loren/td_austender_au

Could someone please give them a kick for me?


#28

Hey, my scraper is stuck and it is probably because it is using a lot of memory(I should cut it to chunks, sorry). Please stop/fix it.

https://morph.io/masterofpun/railway_empl_uuids


#29

Hi. My scraper seems to be stuck too. :cry:

https://morph.io/pietrobenito/CREATe_Studies_Scraper

Any help would be greatly appreciated.

Thank you! :smiley_cat:


#30

It’s finished now. Must be more patient in future. :slight_smile:


#31

Scraper is so stuck. https://morph.io/JasonThomasData/Hume_City_Council


#32

Mine appears to be stuck - https://morph.io/noelmas/png_rescrape - can’t hit stop


#33

@noelmas yours is working again :smile:


#34

@JasonThomasData your scraper seems to be happy again too :sunny:


#35

@henare My scraper stuck for 9 days: https://morph.io/IvanGoncharov/API_specifications
Can you please stop it?


#36

@mlandauer this looks like a good issue to get back into morph stability. Can you please look at @IvanGoncharov’s scraper?


#37

Three scrapers stuck
https://morph.io/drwillems/starbucks_scrape
https://morph.io/drwillems/starbucks_simple_test
& /StarB

Would you be able to stop them? Thanks!


#38

I’m stuck too - https://morph.io/lowndsy/PositionAnalyser


#39

@lowndsy @drwillems

There’s a big backlog of scrapers in the queue, apparently:


#40

I thought we’d fixed it yesterday but it still seems to be a problem. I’ve updated the issue with what I’ve been doing to fix it https://github.com/openaustralia/morph/issues/1064#issuecomment-255895896


#41

We’re now at 420 retries, down from over 600.