I think I just ran into this issue too - There’s no errors, and it saves to a .sqlite on my local machine, but the scraper isn’t saving anything to Sqlite on Morph.io:
Have I missed something important or is it just that something needs a restart?
Thankyou - looks all good now! - A
The same thing again
1 record added, 1 record removed in the database
My scraper didn’t save anything last night (~8pm GMT) or just now when I manually reran. Looks like the old problem is back…
@lowndsy thanks for reporting this. I’ve run the test scraper and it’s working OK. I’ve restarted Sidekiq anyway, can you please try again and let us know if it’s working for you?
Thanks, looks fine again now.
Happy Monday everyone. I’m afraid the saving issue is back for me again. Just tried twice and nothing changed in the database.
Happy Monday! I’ve restarted the queue and verified it’s working again.
The good news is that we should have someone working on fixing this issue this week.
I’m having the same problem with this scraper: https://morph.io/everypolitician-scrapers/guernsey-2016
@ondenman hmm, not seeing the problem with the test scraper this time but I’ve restarted the queue anyhow.
Sorry, looks like it is back - nothing saved to database for my last two scrapes.
Oops, nothing saved too to database for ukraine_verkhovna_rada_votes more details https://github.com/openaustralia/ukraine_verkhovna_rada_votes/issues/17
nothing changed in the database again
We’ve fixed that problem and also addressed the big backlog of scrapers that started happening about 3 days ago.
You can read what we did on the issue: https://github.com/openaustralia/morph/issues/1064#issuecomment-255626498
There is still a backlog of over 600 runs right now but morph.io is working its way through them.
My scraper stuck, what to do?
The problem still remain
You’re right @achasik, thanks for letting us know. I’ve updated the issue with what I’ve been doing to fix it https://github.com/openaustralia/morph/issues/1064#issuecomment-255895896
Good Morning Gents. It looks like things aren’t saving again - failed over the weekend and I have just re-ran with the same result.