Traffic Monsoon
2 hrs ·
I'm home now, and just as i was boarding my final flight home, I received update the site was down.
Incident Report:
The website received a heavy load of traffic at the same time a server back-up was running. This caused the database tables (which saves various account details) to become corrupted.
I have restored the MySQL database from the must recent backup that was taken today between 2 AM - 3 AM EASTERN TIME Jun 18th in order to bring the business back into operation.
A meeting is underway to review the servers, which will result in placing everything at top reliability once and for all, so all future problems can be eliminated.
Since the site was backed up to 2am Eastern, it essentially made the site go "back in time" so to speak. Data between 2am - present is lost, so we'll be reviewing payment history in the payment processors to apply any purchases during this time window and get anything missing applied.
I'll be reviewing many things to ensure we can get the right amount shared what was meant to be shared.. and review data whether it's possible to add some sort of bonus to over compensate for any potential loss that might have been experienced during this window.