As an update, we have identified the issue (which we will explain below) that caused the delays to occur.
We have been fetching since this incident began without incident so we do not anticipate any missing data, we are working to resolve the delay in the display and availability of this data.
The following dates are still showing delayed or missing data. Once we complete the data recovery process, these dates will have complete data, there is simply a delay in their processing.
- October 8th
- October 9th
- October 10th
- October 11th
- October 12th
On October 8th, our primary distributed job queue manager cluster began to experience errors. We made several attempts over the next few days to repair it but it became clear that we would need to perform a larger upgrade. Specifically, we added additional redundancy and created separate queue manager clusters per subsystem (divided into fetching, parsing, reporting, and ui).
This, combined with further optimization of our parsing process, has improved overall stability and performance greatly. Unfortunately, during this time, the reporting and display of this data fell behind, leading to the delays currently showing in the app. We are working to back fill and have the entirety of this data caught up as quickly as possible. We will continue to provide updates until it is resolved.
Please reach out to your Account Manager with any questions or if you need data for specific dates, in the meantime.
We apologize for this inconvenience.
The DemandSphere Team