 |
1:18 PM CDT 07/27/20 |
We've confirmed there have been no additional issues reported since Friday for the firewall issue resulting in degraded network performance for network traffic traversing the Atlanta data center. This investigation will now be resolved on the Status Page. If you experience further issues, please contact Paige at 1-888-MY PAIGE (1-888-697-2443). |
 |
5:41 PM CDT 07/24/20 |
The SIP inspection was disabled on the main firewall. This has resulted in the CPU dropping significantly to an acceptable level (30%) which has resolved the issue. We will continue to monitor until Monday. If you experience further issues, please contact Paige at 1-888-MY PAIGE (1-888-697-2443). |
|
4:55 PM CDT 07/24/20 |
The Kibana server was rebooted. The Networking, Firewall and Cisco continued with their troubleshooting. As part of the troubleshooting, the SIP inspection was disabled on the main firewall. This has resulted in the CPU dropping significantly to an acceptable level. They are continuing to monitor the CPU usage. We will provide more information as it becomes available, but no later than 5:48 PM CDT. |
|
3:27 PM CDT 07/24/20 |
The Network and Firewall teams provided Cisco with config and log file data. The Cisco engineer disabled debug logging for a couple of the firewall contexts which helped to decrease the CPU spike. They’ve now discovered the Kibana server used for analyzing traffic is not functioning properly. Therefore, they are working to reboot the Kibana server. We will provide more information as it becomes available, but no later than 4:22 PM CDT. |
|
2:03 PM CDT 07/24/20 |
The Networking and Firewall teams have discovered a high CPU usage issue for one of the firewall devices which is subsequently causing high packet loss for some of the other firewalls in the Atlanta Data Center including a voice firewall. This may result in degraded network performance and also impact the voice call quality for some agencies. A Cisco TAC case has been raised and the Data Center Network and Firewall teams are currently working with the Cisco to resolve the issue. We will provide more information as it becomes available, but no later than 3:00 PM CDT . |
|
12:23 PM CDT 07/24/20 |
We are investigating a potential firewall issue resulting in degraded network performance for network traffic traversing the Atlanta data center. We are investigating the issue and will provide more information as it becomes available, but no later than 1:23 PM CDT |
| Legend | |
| System status normal |
| System under investigation |