Thanks for these ideas @jeffreyliu and @pudo ![]()
For now I have worked around this by manually setting an environment variable on the individual scraper. But it would be awesome if morph could automatically provide it somehow
I鈥檇 go with that for your immediate needs @jeffreyliu . Setting this up as an environment variable for everyone wouldn鈥檛 be a big change. Might I suggest opening an issue at Issues 路 openaustralia/morph 路 GitHub and describing what you鈥檒l be able to achieve with this feature/why you need it?
Either that, or the ability to identify the scraper in the POST webhook?
There鈥檚 already an issue for this Include scraper name in data passed in the webhook post request 路 Issue #1043 路 openaustralia/morph 路 GitHub
It would be great to add your use-case on there, and also if you鈥檙e up for it, a Pull Request to add the feature ![]()