Resolved: Service Outage: Keller Hall 1st Floor Power Outage

When

Monday, February 28, 2022

Impact

  • Keller Hall 1st floor
  • CSE-IT services including
    • CSE Lab computers
    • VOLE
    • Datacenter services
    • Some networks
    • Faculty home pages

Outage Description

At 7:49 AM on 2/28/2022, a power outage was reported on the first floor of Keller Hall, impacting the computer labs and data center including services to VOLE, home directories, and CSE Labs log-ins. Service is now restored as of 9:45 AM on 3/1/2022.  In most cases, no action is necessary to restore service from the client-side, however, affected workstations may need to be rebooted. If you are still having the symptoms described above, please contact CSE-IT immediately at 612-625-0876 or csehelp@umn.edu.

Outage Updates

  • 3/1/2022, 10:00 a.m. VOLE service has been restored. Please contact CSE-IT at 612-625-0876 or csehelp@umn.edu if you are encountering symptoms described above.
  • 3/1/2022, 8:55 a.m. Network, home directory connections in the labs, and servers have been restored. VOLE service is degraded and is our primary focus.
  • 02/28/2022, 7:10 p.m We are seeing signs of recovery of the servers hosting home directories and project spaces. Restoration of VOLE and CSE Labs machines is in progress.
  • 02/28/2022, 6:00 p.m Servers and Services are still in the process of being brought back online. We are working with vendor support to investigate the issue.
  • 02/28/2022, 4:30 p.m Servers and Services are still in the process of being brought back online. We are working with vendor support to investigate the issue.
  • 02/28/2022, 3:06 p.m. Servers and Services are still in the process of being brought back online. Hardware changes to concerned servers has been completed. Work bringing up servers and VMs continues.
  • 02/28/2022, 1:30 p.m. Servers and Services are still in the process of being brought back online. Hardware is being swapped out on servers still having issues recovering from the power outage. Linux logins and home directories are still inaccessible
  • 02/28/2022, 11:30 a.m. Servers and Services are still in the process of being brought back online.
  • 02/28/2022, 10:32 a.m. Windows CSE Labs logins are up. Linux CSE Labs logins are still down. VOLE is not accessible either at this time. A network switch was affected by the power outage and is in process of being replaced. Servers and Services are still in the process of being brought back online.
  • 02/28/2022, 9:02 a.m. Power itself has been restored. We are now waiting for some remaining servers to come back up.

Share