steam auth error network identity failure

steam auth error network identity failure when having multiple ips on the server and trying to have multiple dedicated servers eg

Base server the machine that rust all the servers main ip is 1.1.1.1 (For example purposes only not the actual ip)

We have server one that uses this 1.1.1.1 as its main ip for the first rust server then we have server 2
It uses 1.1.1.2

They both start up fine but when it comes to joining server 2 give the error steam auth error network identity failure but server 1 does not is there any way I can fix this so that server 2 will not give the failure error and or use the second ip for all of its traffic somehow