Nothing saving to database


Using isn’t saving anything to the database on any of my scrapers.

Is anyone else having this issue?


I think it’s a very big problem with sqlite - allmost all scrapers can’t write to dbase
Look at almost any scraper in Explore section - they all have “Nothing changed in database”


Yes. It certainly looks that way. I think they need to turn it off and on again. :wink:


Same here… Is anyone having success with alternative save methods?



It seems affect ALL scrapers.
Hey, devs Where are you?


I’ve tried running a test scraper locally and it produces these weird chars in data.sqlite. Don’t know if they should be there or not, I’m not an expert on sqlite.


b�b@aindexdata_adataCREATE UNIQUE INDEX data_a ON `data` (`a`)Z�tabledatadataCREATE TABLE `data` (
            `a` integer
��        , `bbb` text)
       	Hi there


I’m taking a look at this issue now. I’ll let you know what I find


Hey @pietrobenito, @achasik, @lowndsy

Things look to be working again at least on a test scraper Could you let me know if things are all working for the scrapers you’re looking at?



Its working now - Thank you!


@mlandauer Thanks!

It’s working again now.

Do you know what happened?


Thanks, looks good for me too!


OMG database not writeable again
Just created new scraper in node.js from template and ran it
"Nothing changed in database"

My old scraper affected too


Looks to be working again now.


It happens periodicaly. Now again nothing changed in database. Can you fix it?


I’ve just created a bunch of scrapers and they’ve run, reported success but no data has been created to download. I think I might be hitting the same problem…

Here’s a couple of examples:


@chris48s, @achasik sorry this is happening. I haven’t figured out the root cause of this problem yet but what fixes it in the short term is restarting the background queue processes.


Again the same problem


I’m guessing they’ve recently migrated to RabbitMQ and it keeps crashing.


Thanks for reporting this @achasik. @mlandauer is away so, for my sins, I’m now looking after until he returns in October.

I’ve now restarted the queue, as Matthew advised we should do when this happens, and it’s working again. He told me that this issue was still happening every few days so I’ve been trying to keep an eye out for it but please post in here if you see it happen again.

Thanks again for looking out for this!


My scraper was stuck in the queue for a day, so I just stopped it and re-ran - nothing is saving again, sorry!