Track API Endpoint Partially Unavailable

Incident Report for Mixpanel

Resolved

As of September 3rd, the data recovery process has been completed. We estimate that 89-100% of events were restored successfully. Projects collecting data from European customers were impacted most heavily.
Posted Sep 04, 2017 - 17:27 PDT

Update

We are continuing the data recovery process. Due to unforeseen complications, a partial restoration is now predicted to be completed by Monday, September 4th. An update will be posted by 5pm September 4th. We truly appreciate your patience and are sincerely sorry for the delay.
Posted Sep 01, 2017 - 10:50 PDT

Update

We have started the data recovery process and are working to replay events into impacted projects. Further updates regarding the restoration process will be made by September 1st, 2017. We truly appreciate your patience and expect the restoration process to be complete by September 1st at the latest.
Posted Aug 30, 2017 - 17:39 PDT

Monitoring

From approximately 4:20am to 5:30am, 10:40am to 11:10am and 12:55pm to 1:50pm PT on August 27th, a subset of our servers in the European region that serve the api.mixpanel.com/track API endpoint served 503 errors. Applications using Mixpanel's native mobile libraries queued events locally and automatically retried sending events until successful. Other Mixpanel libraries do not have automatic queues and could have experienced data loss.

We are investigating possible data recovery methods for the event data that was lost during these times. Updates to this incident will be made by 6pm PT on August 30th, 2017. We truly appreciate your patience and apologize for any disruption.
Posted Aug 27, 2017 - 13:50 PDT