Google Apps Incident Report Google Calendar - November 15, 2010 Prepared for Google Apps Customers
The following is the incident report for the Google Calendar access issues experienced by some Google Apps customers on November 15, 2010. We understand that this service issue has affected our valued customers and their users, and we apologize for the impact. Issue Summary On November 15, a performance issue with the Google Calendar servers caused slow response, timeouts, and browser errors for the affected Google Calendar users. Actions and Root Cause Analysis At 7:50 AM PT | 16:00 UTC November 15, Google Calendar Engineering brought a system of servers online too quickly during peak traffic, which overloaded some web servers and led to Calendar processes that would start, receive an error, stop, and restart again. The resulting spike in resource consumption caused temporary browser errors and timeouts for some users trying to access Google Calendar. Within minutes, our monitoring systems detected the event and alerted Engineering. To resolve the issue, Google Calendar Engineering took the affected servers offline, and redirected incoming requests to other servers. By 9:43 AM PT | 17:43 UTC November 15, access to Google Calendar returned to normal. No existing Calendar data was affected during this event. Corrective and Preventative Measures The Engineering team conducted an internal review and analysis, and performed the following actions to help address the underlying causes of the problem and help prevent recurrence: ● ●
Google Engineering has implemented guidelines to enable new server capacity incrementally during peak traffic periods Google Engineering has updated internal training and documentation for bringing servers online.
We appreciate your patience and again apologize for the impact to your organization. We thank you for your business and continued support during this time. Sincerely, The Google Apps Team
At 7:50 AM PT | 16:00 UTC November 15, Google Calendar Engineering brought a system of servers ... your business and continued support during this time.
This misconfiguration prevented changes to existing customer data for upgraded users. ... Eliminate the need for server restarts to recover from this type of error.
Feb 27, 2011 - Google Engineering reverted the storage software update, and halted ... better identify this class of bug during the software development cycle.
We understand this service issue has impacted our valued customers and users, and we apologize to everyone ... At 6:12 AM PDT, a bug in a thirdparty software update caused a partial failure of a Google network router in ... escalated the software iss
Mar 18, 2013 - service disruption was an issue in the network control software. Actions and Root Cause Analysis. At 6:09 AM PT, a portion of Google's network ...
Mar 17, 2014 - Issue Summary. From 8:35 AM to 12:10 PM PT, Google Talk, Google Hangouts (including Chat and Video), Google. Voice, and the Google App ...
Apr 17, 2013 - The following is the incident report for the Google services access ... Talk, Google Sync, the Admin panel, and the Cloud Console, and to a ...
Mar 19, 2013 - Applications using the Google Drive and Docs APIs also returned errors. ... We thank you for your business and continued support. Sincerely,.
Feb 27, 2011 - Google Engineering reverted the storage software update, and halted further deployment. Restoration Process. While analyzing the issue and its root cause, Google Engineering also worked on the process to restore users' accounts. At 6:0
Google Drive list. Applications using ... The Google Engineering team conducted an internal review and analysis of the March 21 event. They ... Modify the Drive software to more reliably serve user requests during short periods where overall.
Google Apps Incident Report. Google Docs Outage - September 7, 2011. Prepared for Google Apps for Business customers. The following is the incident report ...
Google Apps Incident Report. Gmail Outage - September 23, 2011. Prepared for Google Apps for Business customers. The following is the incident report for the ...
Apr 17, 2013 - The following is the incident report for the Google services access disruption that occurred on. April 17 ... Talk, Google Sync, the Admin panel, and the Cloud Console, and to a lesser extent Groups,. Sites, and ... misconfiguration oc
Google Docs Outage - September 7, 2011. Prepared for Google Apps for Business customers. The following is the incident report for the Google Docs access ...
Sep 1, 2009 - On Tuesday, September 1, a small portion of Gmail's web capacity was taken ... request routing automatically directs users' requests to available servers. ... Over the next few weeks, we are dedicated to implementing these ...
Sep 25, 2009 - Between 7:00 AM - 9:50 PDT | 14:00 - 16:50 GMT, Thursday September 24, Google Apps users were unable to access the Contacts feature through the Gmail interface. However, they could view their contacts at an alternate URL. During this p
Sep 25, 2009 - Prepared for Google Apps Premier Edition Customers. Incident ... add users to their Google Apps accounts. ... business and continued support.
Sep 1, 2009 - server. Gmail processing and access through the IMAP/POP interfaces ... Over the next few weeks, we are dedicated to implementing these ...
Mar 16, 2010 - resources for Gmail routing and greatly increased the number of active Gmail routers. Following an internal investigation and analysis, the ...
Engineering was made of aware of the problem and promptly began to work to manage excessive traffic ... your business and continued support during this time.
from the Google Engineering team traced this problem to new code introduced at 3:00 PM PDT |. 22:00 UTC August 19. The Google Engineering team repaired ...
Feb 24, 2009 - The root cause of the problem was a software bug that caused an ... we monitor our systems 24 x 7, we have engineers available to analyze.
