We still have about ~200 nodes trying to register to the old server; please check your node and reboot it if it's not registering. Enabling dnsmgr will prevent this in the future and allow asterisk to failover to other servers. Please enable dnsmgr. We've tried to email most of these we can identify, but several have bounced back as the email on file is different. The vast majority of nodes (90%) came back up fine on Sunday, but we were having some serious issues with call number exhaustion from nodes which don't authenticate, and then hammer the server over and over again. Once you're out of call numbers on IAX, even valid nodes cannot authenticate. I think we've resolved this enough for now, there will be a better fix coming, but it's in test. As these are on a per IP basis, we didn't see this in testing as only about 200 hosts tested the cluster even though we had each host registering 100 nodes. The other unplanned event was nodes behind broken NAT. IAX requires a full cone nat to work and we tested with this, and everything worked. What was unplanned was when nat was broken, and Tim was able to come up with a fix to the nodes script for this. This script was completely rewritten and optimized with a 10 second cache, allowing us to generate it every 10 seconds across many servers. Previously the delta between the database and the nodes scripts was about 5 minutes, so this greatly speeds it up. If you look in /var/lib/asterisk/rpt-extnodes you'll see the cache info and which server generated it. Example: ;Generated 2574 records in 0.059 seconds. ;Served in 0.015 seconds. ;Served from cache: Yes ;Generated at 2018-08-14 13:01:26 UTC by register-ord.allstarlink.org In the above example there are 2574 nodes online, and it was served from cache by the Chicago server. The phone portal has been tweaked, and no longer reads back the invalid numbers at first call in. We've been doing much testing with it, and it's much much better as there are no longer 2900 nodes registering to it as well. I've yet to hear it stutter. 73's -- Bryan Fields 727-409-1194 - Voice http://bryanfields.net