0936
We’re having some widespread problems this morning, seemingly related to the high-performance scratch space. This is impacting most PACE clusters, with the exception of Atlantis and the Legacy PACE Community Cluster. Watch this blog post for updates.
1044
Looks like some network issues internal to the Panasas.. Still working.
1202
We’ve been on the phone with Panasas support. Issues still remain…
1739
Still having problems. We’ve been escalated to level 3 technical support within Panasas. Current theory is some sort of network interaction between the new Panasas and the Force10 10gige switch (provided by Panasas). The “old” set of Panasas shelves aren’t having this problem, so there’s a pretty good chance that we don’t have any issues with upstream networking equipment.
2250
Problems remain and the storage remains unavailable. We’ve been working with Panasas and Force-10 level 3 support to resolve a very unusual combination of problems. We are now awaiting replacement parts from both Panasas and Force-10 in the morning. The good news is Panasas believes we have not lost nor corrupted any data on the storage. We’ll keep you up-to-date with where we are in resolution. We apologize for this inconvenience.