Post mortem of what just occurred

Post mortem of what just occurred

  • Would give Hotaru lap pillow

    Votes: 1,777 26.8%
  • Would give Komari headpats

    Votes: 2,179 32.9%
  • Would play with Renge

    Votes: 1,658 25.0%
  • Would take the blame for Natsume

    Votes: 1,009 15.2%

  • Total voters
    6,623
  • Poll closed .
Status
Not open for further replies.
Staff
Admin
Joined
May 29, 2012
Messages
594
Continued growth of site over the last month - often over 20,000 concurrent users - has pushed the old DB slaves to, and past, their limits. During those times we've seen peaks on MD@​H of 1400MB/s (11.2Gb/s)! Splitting off the API onto its own server hasn't had as much of an impact as we had hoped either.

e4fc0f31-dd2e-4894-81cb-55e8164ae6d9.png
😍

If you are on Discord you might have already read that a new much better server has entered the fight, unfortunately it is acting as a slave DB to the old master DB for now, so you may see some desyncs and errors - hopefully less than before.

We've prioritised getting the site back up today due to time constraints on people, but we are going to have some planned downtime coming up in the near future where we will be moving the new superawesomeserver™ into the main DB role and shifting the webserver onto the more capable hardware we have available and hopefully resolving the API caching issue in the progress. In addition to this we will be lowering the API rate limit slightly to lower the impact of automated downloads on real time users. Reminder than going over rate limits will result in tempoary automated bans, so please be aware that limits will be changing soon and take steps to avoid the banhammer.

We were going to be saving $140 a month by removing the old cache server that was feeding MD@​H and legacy reader, but we've had to reinvest significant funds into paying part of the cost of new superawesomeserver™ so your continued support is appreciated!

As stated in a previous announcement the last ad campaign resulted in two month's worth of costs being covered. Going with the general acceptance of the last ads we may run further ads at some point to cover future bills.


Edit: You aren't logged into someone else's account. It's just a cache glitch from DDG. Almost any action on site will update it to your own account.
 
Joined
Jul 6, 2020
Messages
2
Hats off to everyone working behind the scenes! Thanks for your for service in providing this content for free.
 
Joined
Jan 24, 2020
Messages
30
No idea what it's about. Not going to vote carelessly...

I noticed the servers facing problems since yesterday, good job getting back everything online. Thanks for the hard work!
 
Instrumentality Instigator
Staff
Super Moderator
Joined
Jan 29, 2018
Messages
1,342
Misato is eternal best. No lolis will ever compare.
 
Status
Not open for further replies.

Users who are viewing this thread

Top