I am redirecting an index however, I would like to possibly increase performance.
My props.conf looks like this:
[host::MM[0-9]{6}-PC]
TRANSFORMS-index = overrideIndexoldIndex
transforms.conf looks like this:
[overrideIndexoldIndex]
DEST_KEY =_MetaData:Index
REGEX = oldIndex
SOURCE_KEY=_MetaData:Index
FORMAT = newIndex
My understanding is that it is applying this transform for all data from host:MM[0-9]{6}-PC. The transform is just redirecting index:oldIndex to newIndex. There is a lot of data from hosts that matches this criteria. Is there a way to first check that the index is oldIndex and than look for those hosts and apply the transform then. Logically this would increase performance as there is far less data being sent to the index oldIndex than, the data being sent from those hosts that match our criteria.
Essentially I would like to understand the parsing of data better surrounding transforms and if this is a valid optimization how to go about implementing it.
↧