Problem with /proj on Rackham and Snowy closed

There is currently a problem with the project directory system on Rackham and Snowy. Reading and writing to /proj is currently not possible. We are working together with the vendor to resolve this issue as quickly as possible.

Update 2019-12-05 17:00

The problem occurred during a routine operation of restarting two storage servers. The storage system is redundant across many layers and reboots of storage servers is supported. This time however, even though we followed instructions sent to us by the vendor, the storage system did not respond as expected. Since this afternoon we have been working with the vendor and made progress getting the system back to normal operations. We expect no data loss of already existing data. Some running jobs will likely need to be rescheduled. We will provide more information about this after we have discussed with the vendor.

Final ticket report

Our storage vendor DDN helped us get Crex online.