Why are the wrong search peers being displayed on search heads after we configured multisite indexer clustering and search affinity?

I have 2 search heads, one with site=site1 and the other with site=site2 configured in server.conf. But when I view the search peers on each search head, I see the search peers for site 1 appearing as search peers on both search heads. These search peers automatically showed up once multisite indexer clustering was enabled and configured.