I have batch input
[batch://C:\abc\*.zip]
move_policy = sinkhole
index = xyz
host_segment = 2
crcSalt =
sourcetype = pqr
disabled = false
for testing I added one zip file in monitored folder after consumed by splunk I again added same file in monitored folder and I found duplicate events. I was assumed that it will not index same file since I have included `crcSalt=`. What can be done avoid duplication?
Note- file monitored is zip- csv file with headers.