Here's how I do it, seems to work...
Calculate the maximum latency in network. If its less than 60 ms use 60ms for the calculations.
For RTCM Tx Buffer length, take latency * 8. Minimum therefore is 480 (this value is in packets (8 packets per ms))
For buflen in voter.conf, take latency + 100. Minimum therefore is 160 (this value is in ms)
The delay of the system is RTCM Tx Buffer Length /8 + tx buffer length in Asterisk. Minimum therefore is 220ms
If you have voter.conf set to 250 the RTCM should be set to 1200. This should make the system able to handle latency spikes to 150ms.
Note: If your GPS is weak on the RTCM which is connected to your Asterisk server it'll cause lots of problems. I've also had better luck using a dedicated RTCM for the server timing and using a different one for the radio/repeater, even if they are in the same building. I suspect the UDP TX audio stream combined with the 10Mbps 1/2 duplex RTCM ethernet causes packet collisions which messes up the server timing packets (this is a hunch at this point).
Cheers,
Jesse