Web server extended outage
Posted: 2017-04-05, 10:54
Unfortunately, there has been a rather catastrophic double drive failure in one of the host nodes we use for our web servers at around 9:15 UTC today.
This affects the following services:
Message from our service provider explaining what happened:
This affects the following services:
- Pale Moon main website
- FossaMail main website
- Pale Moon cross-reference site
- Pale Moon for Linux main website
- Pale Moon automatic update site (internal updater)
Message from our service provider explaining what happened:
About an hour ago node Suggan went offline. Upon investigation we have discovered that a second drive has failed in two days. The previous drive, replaced yesterday, had not completed its sync into the RAID arrays, meaning we are left with incomplete data sets. We have managed to rebuild the customer data array and are currently backing this up offsite to verify it's integrity so we can confirm what, if any, data has been lost.
The server itself will need rebuilding, the array the OS was installed on has been entirely lost. This will extend the outage further, updates to this issue can be tracked here: https://client.afterburst.com/network-status/open
[...]
My sincere apologies for this outage, this is the first double drive failure Afterburst has seen.