As I understand it, the tick-box for Dynamic IP Address on NPM's Edit Properties page allows each test to be performed with a fresh DNS lookup and when the target host or site is behind a load balancer, security obfuscator or hidden away in the cloud this is exactly what is required. I've had instances when the fresh lookup has obviously not happened causing the test to be performed on an out-of-date IP address and therefore failing, raising alerts and causing unnecessary concern.
Are there any recommendations for this scenario other than just ticking the box?