Outages and Maintenance
-
Unscheduled Math Data Center Cooling Outage
The Math building data center began experience issues with its cooling system around 11:40am EDT. As one of manifestations, users may experience issues while logging in to the Anvil, Bell, Gilbreth, and Halstead clusters. To minimize thermal load on...
-
Unscheduled Data Depot Slowdown on Community Clusters
As of 9:00am EDT, users of community clusters may experience slowness while trying to access Data Depot (including loading modules, starting applications or reading data) . The symptoms appear on both login and compute nodes. System engineers are act...
-
The Weber cluster will be unavailable Wednesday, March 30, 2022 from 8:00am - 6:00pm EDT for scheduled maintenance. The cluster will return to full production by Wednesday, March 30th, 2022 at 6:00pm EDT.
-
Fortress Archive Monthly Maintenance
The Fortress Archive will be unavailable Wednesday, April 6, 2022 from 8:00am - 2:00pm EDT for scheduled monthly maintenance (first Wednesday of every month). During this time, Fortress will receive normal software and hardware updates. Any transfers...
-
Unscheduled Gilbreth cluster outage
The Gilbreth cluster began experiencing issues with its scratch filesystem around 7:00pm EDT. Engineers are currently diagnosing the issue and are working to identify a fix. Job scheduling has been paused while this issue is being addressed. We will...
-
Gilbreth scratch degraded performance
Following last night's scratch outage, the Gilbreth scratch filesystem is currently functional but operates with partially degraded performance. Engineers have opened a support ticket with the vendor and monitor the state of the filesystem continuou...
-
Unscheduled Weber ingress/egress outage
The Weber cluster's data transfer server (weber-sftp.rcac.purdue.edu) suffered a cooling fan failure around 8:30pm EDT on Saturday, April 9th, 2022. The cluster remains operation with the exception of ingress/egress of files via the affected server....
-
The Bell cluster began experiencing issues with its scratch filesystem around 9:00pm EDT on Saturday, April 9th, 2022. Access to files in scratch may appear severely delayed or frozen. Engineers are currently diagnosing the issue and are working to...
-
Unscheduled campus power outage
Several Research Computing resources became affected by a campus power outage around 7:00pm EDT. Multiple login and compute nodes may have powered down, leading to jobs fail and/or requeue with a NODE_FAIL or similar status. Engineers are currently d...
-
Fortress Archive Monthly Maintenance
The Fortress Archive will be unavailable Wednesday, May 4, 2022 from 8:30am - 12:00pm EDT for scheduled monthly maintenance (first Wednesday of every month). During this time, Fortress will receive normal software and hardware updates. Any transfers...
-
Fortress Archive Monthly Maintenance
The Fortress Archive will be unavailable Wednesday, June 1, 2022 from 8:00am to 12:00pm for scheduled monthly maintenance (first Wednesday of every month). During this time, Fortress will receive normal software and hardware updates. Any transfers w...
-
Anvil will be undergoing scheduled maintenance on Thursday, June 2, 2022 from 8:00am - 6:00pm EDT. During this time, Anvil will be unavailable for use as we fine-tune home directories filesystem and deploy updates to the scheduler. Please see detaile...
-
Scheduling Paused on Brown and Hammer
Beginning around 2:00pm EDT, the ailing cooling systems for Brown and Hammer began experiencing issues. To reduce the thermal load on the systems, scheduling of new jobs has been paused on Brown and Hammer and will not be resumed until after tomorrow...
-
Brown, Hammer and Weber Cluster Maintenance
The Brown, Hammer, and Weber clusters will be unavailable Tuesday, June 14, 2022 from 6:00am - 11:59pm EDT for scheduled maintenance. The clusters will return to full production by Tuesday, June 14th, 2022 at 11:59pm EDT. During this time, Physical F...
-
Globus services downtime on June 18, 2022
Globus services will be globally unavailable for a period between 9:00 am and 10:00 am US Central Time (10-11 Eastern) on Saturday, June 18th, 2022 due to planned maintenance that includes database upgrades. During the downtime, the following will be...
-
Fortress Tape Library Maintenance
The Fortress Archive will be unavailable Thursday, June 23, 2022 from 8:00am - 6:00pm EDT for a full-day maintenance on its SpectraLogic tape library. During this time, the vendor will perform required servicing of the library, including firmware and...
-
The Halstead cluster began experiencing issues with its scratch file system around 8:00am EDT. The problem manifests as various I/O errors or hangs when reading, writing or listing scratch directories. Engineers are currently diagnosing the issue and...
-
Bell Scratch Degraded Storage (Returned to Service)
Bell Scratch is near capacity and performance is degraded. As of this morning, Bell Scratch was 94% full. This afternoon we paused scheduling as scratch was not responding consistently. We have more drives on order, but with global supply chain issue...
-
[REVISED] Scheduled Gilbreth Upgrade
Gilbreth will be unavailable due to maintenance on July 20th 8:00am-5:00pm to allow for an expansion to Gilbreth’s resources. In response to the growing demand for hardware which can facilitate GPU-accelerated workloads, Gilbreth is being expanded to...
-
Fortress Archive Monthly Maintenance
The Fortress Archive will be unavailable Wednesday, August 3, 2022 from 8:00am - 12:00pm EDT for scheduled monthly maintenance (first Wednesday of every month). During this time, Fortress will receive normal software and hardware updates. Any transfe...