FPV Video Latency - does it matter?

Good video. Always wondered how the latency time translated to distance in reality. Did not expect it to be such a great distance.

Though I wonder, does it really matter while flying FPV? Ofcourse least latency is best, but since your viewing first person through the goggles and somehow compensating from the moment of take off, when you fly the quad 'inside the goggles' through some gates, it is bound to do the same in reality.