One of my scrapers is failing for the last 6 months with following error:
Traceback (most recent call last):
File “scraper.py”, line 11, in
from splinter import Browser
File “/app/.heroku/python/lib/python2.7/site-packages/splinter/init.py”, line 5, in
from splinter.browser import Browser # NOQA
File “/app/.heroku/python/lib/python2.7/site-packages/splinter/browser.py”, line 9, in
from splinter.driver.webdriver.firefox import WebDriver as FirefoxWebDriver
File “/app/.heroku/python/lib/python2.7/site-packages/splinter/driver/webdriver/init.py”, line 16, in
from six import BytesIO
ImportError: No module named six
Is there something that can be done to fix?
Thanks
Yes, this should be fixable, as per the instructions at https://morph.io/documentation/libraries#libraries-python - add six into your requirements.txt
I’ve created a PR at https://github.com/adamclayton/lithgow_city_council_development_applications/pull/2/files as an example of how to do this (and I’ve tided up some other versions along the way). Sadly this has just got me to the point where I’ve run into another problem - it can’t find firefox, and Morph doesn’t (currently) have a way for you to install that.
Update: What we do, theoretically, have, is chrome. However, right now Chrome is uninstallable because Google forgot to update their signing key, and that’s breaking every attempt I’ve made to get this working.
Update: I did eventually get Chrome working on the early_release platform, and my version of the scraper seems to be working now:
https://morph.io/jamezpolley/lithgow_city_council_development_applications
Does this help you?