I believe it's expected to see delays/timeouts when your primary AD server is unavailable. There is different timeouts (tcp-syn, server response, retry) , and failover to a backup server may happen only after 10-15 seconds or so after an authentication source is not responding. If your authentication/authorization server is unavailable for a longer time, it's recommended to remove the server from your authentication source (list). Authentication and authorization sources are supposed to be highly available. Authorization sources have the 'benefit' that they cache data, so it's less visible.
------------------------------
Herman Robers
------------------------
If you have urgent issues, always contact your Aruba partner, distributor, or Aruba TAC Support. Check
https://www.arubanetworks.com/support-services/contact-support/ for how to contact Aruba TAC. Any opinions expressed here are solely my own and not necessarily that of Hewlett Packard Enterprise or Aruba Networks.
In case your problem is solved, please invest the time to post a follow-up with the information on how you solved it. Others can benefit from that.
------------------------------