I'm having problems with DB Connect v1. This is a new Heavy Forwarder that's been running Splunk 6.3.3 well since early this month. A few days ago some of my DB inputs stopped indexing any data. Nothing I did helped so I decided to remove and reinstall dbx. That was successful and I was able to configure my database connections. However, I cannot configure any database inputs. Each attempt results in the error
Splunkd daemon is not responding: ("Error connecting to /servicesNS/richard.galloway/dbx/dbx/dbmon: ('The read operation timed out',)",)
My account has admin privileges and has been used to configure dbx previously.
The only things I see in splunkd.log are messages about connecting to my indexers (which seem to be too frequent, BTW).
The dbx.log file shows my request being sent and successfully validated, but indicates no errors. Likewise for python.log.
web_service.log seems to echo what I see in the UI, with a traceback added:
2016-03-31 10:01:57,308 ERROR [56fd3bc6be7f1054254a10] __init__:478 - Socket error communicating with splunkd (error=('The read operation timed out',)), path = /servicesNS/richard.galloway/dbx/dbx/dbmon
2016-03-31 10:01:57,309 ERROR [56fd3bc6be7f1054254a10] admin:1077 - Splunkd daemon is not responding: ("Error connecting to /servicesNS/richard.galloway/dbx/dbx/dbmon: ('The read operation timed out',)",)
Traceback (most recent call last):
File "/opt/splunk/lib/python2.7/site-packages/splunk/appserver/mrsparkle/controllers/admin.py", line 1054, in saveEntity
bolSaved = en.setEntity(updatedEnt, sessionKey=cherrypy.session['sessionKey'], uri=_extractPathFromURI(entity_uri), msgObj=msgObj)
File "/opt/splunk/lib/python2.7/site-packages/splunk/entity.py", line 371, in setEntity
serverResponse, serverContent = rest.simpleRequest(uri, sessionKey=sessionKey, postargs=postargs, raiseAllErrors=True)
File "/opt/splunk/lib/python2.7/site-packages/splunk/rest/__init__.py", line 479, in simpleRequest
raise splunk.SplunkdConnectionException, 'Error connecting to %s: %s' % (path, str(e))
SplunkdConnectionException: Splunkd daemon is not responding: ("Error connecting to /servicesNS/richard.galloway/dbx/dbx/dbmon: ('The read operation timed out',)",)
I would manually edit SPLUNK_HOME/etc/apps/dbx/local/inputs.conf to create the inputs, but the DBX manual says doing so is "not supported", whatever that means.
What's going on with my server?
↧