Google

Tuesday, March 01, 2011

Nothing Soft about Software, glitches, that is...

Customers falling back during a software upgrade....have lived through it many times..

Gmail Disruption Blamed On Storage Software Snafu

http://www.informationweek.com/shared/printableArticle.jhtml;jsessionid=GDA5UOZIEOFKBQE1GHPSKHWATMY32JVN?articleID=229219581

Google on Monday evening reported that it had identified why a small percentage of Gmail users have been unable to access their messages since Sunday: buggy software.

"We released a storage software update that introduced the unexpected bug, which caused 0.02% of Gmail users to temporarily lose access to their e-mail," said Google engineering VP Ben Treynor in a blog post. "When we discovered the problem, we immediately stopped the deployment of the new software and reverted to the old version."

Unstable software in one of Google's European data centers caused a less lengthy service disruption in 2009. In the wake of that outage, Google introduced its App Status Dashboard to give customers more visibility into its operations.

Google has promised to remedy the situation as soon as possible, but that's taking longer than usual because the flaw wiped out affected customers' e-mail in multiple data centers, forcing Google's engineers to restore accounts from backup tapes. Restoring data from tapes rather than a nearby data center takes hours instead of milliseconds, explained Treynor.

No comments: