You can in windows just open command promt.
Start and type cmd.
Then you just write, ping xxxpool.com
That will ping the pool and youll get a feedback stating package sent and it took x amount of ms (milliseconds). Basiclly the delay time
Basiclly this tells you that the route from your signal send, to the recieving server took that amount of time to do. Smaller ms means the server is closer or is laying on a better tier according to your connection. For example us/jp servers for me are dead slow (200ms) while eu servers like netherland/uk is around 40ms.
Do remember that if your on a wifi this might affect it a bit to.
The point in all this is that with lower ms you will send/recieve shares from the pool a bit faster which in turn “can” help with a little bit with the rejected/stale rate since theres less “passive” time
If you want to get a better picture of where your signal travel to get to server id suggest you try traceroute pool.com this shows you all the hops between links.