Reduced performance on Sync server

Anything to do with the Pale Moon Sync service.
User avatar
Moonchild
Pale Moon guru
Pale Moon guru
Posts: 35474
Joined: 2011-08-28, 17:27
Location: Motala, SE
Contact:

Reduced performance on Sync server

Unread post by Moonchild » 2018-01-23, 07:43

Just a notification to keep everyone in the loop on what's going on:

On Saturday, the SSD caching of the Sync server started failing due to Intel cutting corners in their storage solutions -- insufficient overprovisioning for wear leveling caused massive delays on writes, which resulted in the Sync server issues and errors for users last Saturday.
Our provider switched off SSD caching to mitigate and we're currently running on spinning disks only -- the node is stable but running at reduced performance levels as a result (caching is essential for heavy database use with tons of writes like Sync).

Replacement (larger) SSDs have been ordered for caching and will be put in (one at a time, to be sure) when they are on-site. We'll be informed when caching is switched back on.
"Sometimes, the best way to get what you want is to be a good person." -- Louis Rossmann
"Seek wisdom, not knowledge. Knowledge is of the past; wisdom is of the future." -- Native American proverb
"Linux makes everything difficult." -- Lyceus Anubite

User avatar
Moonchild
Pale Moon guru
Pale Moon guru
Posts: 35474
Joined: 2011-08-28, 17:27
Location: Motala, SE
Contact:

Re: Reduced performance on Sync server

Unread post by Moonchild » 2018-01-26, 23:12

Replacements are in, caching is back on, and we should be working at full speed and efficiency again!
"Sometimes, the best way to get what you want is to be a good person." -- Louis Rossmann
"Seek wisdom, not knowledge. Knowledge is of the past; wisdom is of the future." -- Native American proverb
"Linux makes everything difficult." -- Lyceus Anubite

Locked