Failed module import

Question & Answer
1

Hi
my scrapers failed today after working smoothly for several months. I did not change anything since the time they executed the first time.
It seems they can’t find modules to import, the following error appears for module lxml.html too:

Traceback (most recent call last):
File “scraper.py”, line 25, in
import scraperwiki
ImportError: No module named scraperwiki

Don’t know what is getting wrong.

2

I think this could be the same problem as Hundreds of scrapers failing with buildpack error

I’ve put in a workaround for that problem. Can you try running one of your scrapers again?

3

Hi, this morning at 9:00 (GMT+1) the scheduled run failed with the same error.
At this moment if I try to run any of my scrapers it takes unlimited time and never ends

1 Like
4

Thanks for checking @eccoilmoro. I can confirm this problem on a test scraper so I’ve opened an issue to track this problem: https://github.com/openaustralia/morph/issues/985

5

Hi , my scrapers are experienceing the problem again, since 2 days :

File “scraper.py”, line 1, in
import scraperwiki
ImportError: No module named scraperwiki

6

Sorry about this @eccoilmoro. I think it’s the same problem.

A few days ago we restarted the server and the mitmproxy rules were running for a short time after the server booted. Your scrapers must have unluckily started during that short time and now have a cached docker image that is broken.

I’ll try to get this fixed soon.

7

Running into same issue. First time using site so thought it was me!

1 Like
8

Fixed: https://morph.io/morph-test-scrapers/Albo_pretorio_Conselice

I still haven’t been able to fix the root cause though :frowning: