Thanks for these ideas @jeffreyliu and @pudo
For now I have worked around this by manually setting an environment variable on the individual scraper. But it would be awesome if morph could automatically provide it somehow
I’d go with that for your immediate needs @jeffreyliu . Setting this up as an environment variable for everyone wouldn’t be a big change. Might I suggest opening an issue at https://github.com/openaustralia/morph/issues and describing what you’ll be able to achieve with this feature/why you need it?
Either that, or the ability to identify the scraper in the POST webhook?
There’s already an issue for this https://github.com/openaustralia/morph/issues/1043
It would be great to add your use-case on there, and also if you’re up for it, a Pull Request to add the feature