System Status: Operational
| Status | System | Notes |
| Normal | vCenter | vCenter is operating normally |
| Normal | Virtual Machines | All VMs are operating normally |
| Normal | VMware Hosts | All hosts are operating normally |
| Normal | VMware Clusters | All clusters operating normally |
| Normal | SAN | All SAN components operating normally |
| Normal | L3 Switches | All switches operating normally |
| Normal | Firewall Clusters | All firewalls operating normally |
| Normal | Internet Connectivity | Internet connectivity is operating normally. |
Notes: We have determined the root cause of the outage. We have upgraded the firmware in this cluster. This will prevent this outage from occurring in the future.
System Status: Operational with Exceptions
| Status | System | Notes |
| Normal | vCenter | vCenter is operating normally |
| Normal | Virtual Machines | All VMs are operating normally |
| Normal | VMware Hosts | All hosts are operating normally |
| Normal | VMware Clusters | All clusters operating normally |
| Normal | SAN | All SAN components operating normally |
| Normal | L3 Switches | All switches operating normally |
| Impaired | Firewall Clusters | Firewall stopped passing traffic, passive firewall did not take over as active |
| Normal | Internet Connectivity | Internet connectivity is operating normally. |
Notes: One of our firewalls stopped passing traffic normally. The secondary firewall in that cluster did not take over. We manually failed to the secondary, and traffic has returned to normal. We are working with the manufacturer to determine the root cause. The offending firewall is currently inactive.
System Status: Operational
| Status | System | Notes |
| Normal | vCenter | vCenter is operating normally |
| Normal | Virtual Machines | All VMs are operating normally |
| Normal | VMware Hosts | All hosts are operating normally |
| Normal | VMware Clusters | All clusters operating normally |
| Normal | SAN | All SAN components operating normally |
| Normal | L3 Switches | All switches operating normally |
| Normal | Firewall Clusters | All firewalls operating normally |
| Normal | Internet Connectivity | Internet connectivity is operating normally. |
Notes: After carefully reviewing logs, we believe the outage on 3/9 was due to a UDP Flood. We have subsequently tightened up our flood protection to prevent another flood from causing another outage. We are still monitoring the situation carefully.
System Status: Operational
| Status | System | Notes |
| Normal | vCenter | vCenter is operating normally |
| Normal | Virtual Machines | All VMs are operating normally |
| Normal | VMware Hosts | All hosts are operating normally |
| Normal | VMware Clusters | All clusters operating normally |
| Normal | SAN | All SAN components operating normally |
| Normal | L3 Switches | All switches operating normally |
| Normal | Firewall Clusters | All firewalls operating normally |
| Normal | Internet Connectivity | Internet connectivity is operating normally. |
Notes: Connectivity has been restored to all users. We are looking into the root cause.
System Status: Operational with Exceptions
| Status | System | Notes |
| Normal | vCenter | vCenter is operating normally |
| Normal | Virtual Machines | All VMs are operating normally |
| Normal | VMware Hosts | All hosts are operating normally |
| Normal | VMware Clusters | All clusters operating normally |
| Normal | SAN | All SAN components operating normally |
| Normal | L3 Switches | All switches operating normally |
| Impaired | Firewall Clusters | Firewall03|04 cluster stopped passing traffic |
| Normal | Internet Connectivity | Internet connectivity is operating normally. |
Notes: Connectivity to the Internet disrupted for users behind firewall03|04 cluster. We are looking into the reason behind it.
System Status: Operational
| Status | System | Notes |
| Normal | vCenter | vCenter is operating normally |
| Normal | Virtual Machines | All VMs are operating normally |
| Normal | VMware Hosts | All hosts are operating normally |
| Normal | VMware Clusters | All clusters operating normally |
| Normal | SAN | All SAN components operating normally |
| Normal | L3 Switches | All switches operating normally |
| Normal | Firewall Clusters | All firewalls operating normally |
| Normal | Internet Connectivity | Internet connectivity is operating normally. |
Notes: Global Crossing determined the cause of the bgp issue. All connectivity has been restored.
System Status: Operational with Exceptions
| Status | System | Notes |
| Normal | vCenter | vCenter is operating normally |
| Normal | Virtual Machines | All VMs are operating normally |
| Normal | VMware Hosts | All hosts are operating normally |
| Normal | VMware Clusters | All clusters operating normally |
| Normal | SAN | All SAN components operating normally |
| Normal | L3 Switches | All switches operating normally |
| Normal | Firewall Clusters | All firewalls operating normally |
| Normal | Internet Connectivity | Internet connectivity to customers with external IP addresses 38.74.130.0/24 is unreachable. |
Notes: Internet connectivity to customers with external IP addresses 38.74.130.0/24 is unreachable. We are working with our upstream providers to determine the cause..
System Status: Operational
| Status | System | Notes |
| Normal | vCenter | vCenter is operating normally |
| Normal | Virtual Machines | All VMs are operating normally |
| Normal | VMware Hosts | All hosts are operating normally |
| Normal | VMware Clusters | All clusters operating normally |
| Normal | SAN | All SAN components operating normally |
| Normal | L3 Switches | All switches operating normally |
| Normal | Firewall Clusters | All firewalls operating normally |
| Normal | Internet Connectivity | Internet connectivity is normal |
Notes: InfinitePanel is back to operating normally.
System Status: Operational with Exceptions
| Status | System | Notes |
| Normal | vCenter | vCenter is operating normally |
| Normal | Virtual Machines | All VMs are operating normally |
| Normal | VMware Hosts | All hosts are operating normally |
| Normal | VMware Clusters | All clusters operating normally |
| Normal | SAN | All SAN components operating normally |
| Normal | L3 Switches | All switches operating normally |
| Normal | Firewall Clusters | All firewalls operating normally |
| Normal | Internet Connectivity | Internet connectivity is normal |
Notes: InfinitePanel is down due to database errors. We have our developers looking into it now. The blog will be updated as soon as possible.
System Status: Operational
| Status | System | Notes |
| Normal | vCenter | vCenter is operating normally |
| Normal | Virtual Machines | All VMs are operating normally |
| Normal | VMware Hosts | All hosts are operating normally |
| Normal | VMware Clusters | All clusters operating normally |
| Normal | SAN | All SAN components operating normally |
| Normal | L3 Switches | All switches operating normally |
| Normal | Firewall Clusters | All firewalls operating normally |
| Normal | Internet Connectivity | Internet connectivity is normal |
Notes: The issue has been cleared for the affected cluster. All traffic has normalized.