I'm using existing Splunk alerts, previously configured to send emails to my team, and have added to one of them a webhook action. Its URL points to my offsite server, running a Silex app.
Alas, while emails come through as they should every single time, my server doesn't seem to get hit with any consistency. I've looked at the Silex logs as well as the Nginx logs, and *do* see the successes but never the failures. That is to say, it's as though for those alerts that I don't see get processed, it's as though Splunk simply never fires the webhook--there's just no record of it on my Silex app.
I've taken a look at the answer in a similar question: https://answers.splunk.com/answers/350870/how-to-debug-why-webhook-alert-is-not-triggered.html?utm_source=typeahead&utm_medium=newquestion&utm_campaign=no_votes_sort_relev
but that seemed to be focused more on *never* firing, rather than firing inconsistently.
How can I go about diagnosing this? Any tips or suggestions are most welcome.
↧
