Just a notification to keep everyone in the loop on what's going on:
On Saturday, the SSD caching of the Sync server started failing due to Intel cutting corners in their storage solutions -- insufficient overprovisioning for wear leveling caused massive delays on writes, which resulted in the Sync server issues and errors for users last Saturday.
Our provider switched off SSD caching to mitigate and we're currently running on spinning disks only -- the node is stable but running at reduced performance levels as a result (caching is essential for heavy database use with tons of writes like Sync).
Replacement (larger) SSDs have been ordered for caching and will be put in (one at a time, to be sure) when they are on-site. We'll be informed when caching is switched back on.
Reduced performance on Sync server
Reduced performance on Sync server
"Sometimes, the best way to get what you want is to be a good person." -- Louis Rossmann
"Seek wisdom, not knowledge. Knowledge is of the past; wisdom is of the future." -- Native American proverb
"Linux makes everything difficult." -- Lyceus Anubite
"Seek wisdom, not knowledge. Knowledge is of the past; wisdom is of the future." -- Native American proverb
"Linux makes everything difficult." -- Lyceus Anubite
Re: Reduced performance on Sync server
Replacements are in, caching is back on, and we should be working at full speed and efficiency again!
"Sometimes, the best way to get what you want is to be a good person." -- Louis Rossmann
"Seek wisdom, not knowledge. Knowledge is of the past; wisdom is of the future." -- Native American proverb
"Linux makes everything difficult." -- Lyceus Anubite
"Seek wisdom, not knowledge. Knowledge is of the past; wisdom is of the future." -- Native American proverb
"Linux makes everything difficult." -- Lyceus Anubite