Delay in Bianca jobs and login nodes being scheduled closed

There are currently issues for jobs scheduled on Bianca projects that do not already have access to a node of the right type. The movement of nodes between projects is much slower than usual, but it is not completely disabled. We have tried to bring it back to proper operations, but we will need to do a deeper troubleshooting in early 2022.

Update 2022-01-04 15:19

Bianca should now work as expected. If you have any questions or observations you want us to look at, please contact the support at support@uppmax.uu.se.

Update 2022-01-04 14:00

Most of the issues related with delayed Bianca jobs and non-scheduled login nodes should have been fixed around 18:00 CET yesterday (monday). We expect to close this news in short if the final checks are successful.

Update 2022-01-03 13:30

The issue is related to high memory usage of one of the nodes in the control plane cluster. We are transitioning services from this node to less resource constrained members, but unfortunately the migration will for some project cause a temporary disconnect to the login nodes.