We've reached a point of stability where we have been reliably fetching the 1st page of the SERP daily and are working now to expand this to the 2nd page. We're still evaluating options for SERP page depth but feedback from clients so far has centered on the importance of the first two pages, so we're focused on that.
We are moving the status of this system back into fully operational as a result but we are continuing to work around the clock to further boost data availability as deep as we're able to go.
The challenges at this point aren't technical, we're able to get the data. It's a matter of costs, which have increased dramatically since last month. We're working to do whatever we can to reduce these costs in order to provide the most actionable data possible. We thank you for your continued understanding.
Over the last week, we have achieved a level of stability, although we are continuing to work to improve things.
Desktop is in a better place than mobile. Japan is the most challenging at the moment.
We are currently fetching page 1 for all sites / all keywords at the moment. For desktop, outside of Japan, we are currently able to fetch the top 5 pages about once every 5-6 days. We have implemented our sampling regime to provide coverage at the sub-page level, meaning that the core ranking data shouldn't have major gaps on a day to day basis.
AI Overviews are a challenge as well, and we are working to improve coverage here too. As with the rest of the situation, mobile is more of a challenge than desktop is.
We have also started to see indications that Google is returning spurious results in the SERPs. This is not yet fully widespread but it is also on our radar and clients should be aware that this is happening.
As always, we appreciate your patience and are happy to schedule a call with any customer to walk through any questions.
We are continuing to work on restoring fetching. We have made some progress on Desktop, Mobile continues to be a challenge. Data processing is still not fully restored, we will continue to provide updates.
We are continuing to work to resolve the issues related to this outage, but do not yet have a concrete timeline to share.
We have been able to confirm with other providers in the space that this is having a widespread impact. A number of providers (including DemandSphere) are collaborating in order to collectively restore access as quickly as possible.
We appreciate your patience. Please email support@demandsphere.com with any questions.
In addition to the empty AIOs, we are anticipating a delay in data for September 10th-13th.
We are seeing a large volume of empty AI Overviews. We are investigating the situation and will provide updates as we have them.