• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup

2

Markets tumble worldwide as Fed resets expectations: $400 billion wiped off SpaceX stock

3

Meet the 2 men putting New York's $300 billion pension fund in play for the first time in 20 years

1

After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup

2

Markets tumble worldwide as Fed resets expectations: $400 billion wiped off SpaceX stock

3

Meet the 2 men putting New York's $300 billion pension fund in play for the first time in 20 years
TechFortune 500

Here’s Why Google’s Cloud Went a Little Dark This Month

By
Jonathan Vanian
Jonathan Vanian
Down Arrow Button Icon
By
Jonathan Vanian
Jonathan Vanian
Down Arrow Button Icon
August 24, 2016, 4:26 PM ET
Photograph by Kevin Moloney/Fortune Brainstorm TECH
Add Fortune on Google for similar content.

Google’s cloud took a hit earlier this month, but presumably all is well now.

The search giant said on Tuesday that problems with its Central U.S.-based data center region on August 11 led to some of its cloud-computing customers experiencing errors and delays in their service. Google’s Central U.S.-based data center region is located in Council Bluffs, Iowa., and the search giant has spent roughly $2.5 billion building it out.

The data center hiccup primarily impacted Google (GOOG) customers of its cloud-based app development tool Google App Engine. Google said 18% of customer apps hosted in its Central data center region saw error rates of 10% to 50% for roughly two hours. Another 14% of customer apps experienced error rates of 1% to 10%.

Additionally, Google noted 37% of these apps that suffered more errors than usual also witnessed a slight increase in latency, meaning that the apps were slower than they should be.

“We apologize for this incident,” Google said in an engineering blog post. “We know that you choose to run your applications on Google App Engine to obtain flexible, reliable, high-performance service, and in this incident we have not delivered the level of reliability for which we strive.”

Ultimately, it was a routine data center maintenance update gone awry that led to the cloud hiccup.

Google explained it occasionally moves its customers’ cloud-based apps between its data centers to more evenly distribute network traffic and computing resources. In this case, Google preps a new data center with all the computing resources it needs before it migrates the apps into their new home. The process entails Google periodically moving a group of the apps over to the new data center in chunks so that it can “gracefully drain traffic” from the “downsized data center” and improve the data center’s efficiency.

Get Data Sheet, Fortune’s technology newsletter.

During this routine app migration process, however, a software update affecting Google’s traffic routers was also occurring simultaneously. Google admitted the software update caused its routers to restart, which “temporarily diminished the available router capacity.”

With the routers no longer being able distribute the required resources effectively, some customers’ applications ended up feeling the burden. Google continued that its data center engineers were able to address the problem as it occurred and manually redirected the network traffic “to other datacenters which further mitigated the issue.”

For more about Google, watch:

The engineers then discovered that a configuration error, or software bug, was responsible for network traffic problem, and they eventually remedied the situation.

From the blog post:

In order to prevent a recurrence of this type of incident, we have added more traffic routing capacity in order to create more capacity buffer when draining servers in this region. We will also change how applications are rescheduled so that the traffic routers are not called and also modify that the system’s retry behavior so that it cannot trigger this type of failure.

This isn’t the first time this year that Google’s cloud experienced a hiccup due to a software bug.

In April, Google engineers were performing regular networking maintenance on some of Google’s data centers when someone made an error that triggered a “previously-unseen software bug” to spread the error to more computer systems. This chain of events led to the company’s Google Compute Engine and VPN service going offline for 18 minutes.

At the time, Google said it would offer refunds to some of its customers for the error. Google did not say on Tuesday if it would offer refunds due to the August hiccup.

About the Author
By Jonathan Vanian
LinkedIn iconTwitter icon

Jonathan Vanian is a former Fortune reporter. He covered business technology, cybersecurity, artificial intelligence, data privacy, and other topics.

See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Amazon Prime Day isn’t a midsummer shopping event anymore. Here’s what changed in 2026
RetailAmazon
Amazon Prime Day isn’t a midsummer shopping event anymore. Here’s what changed in 2026
By Vidhi Choudhary and Retail BrewJune 23, 2026
9 hours ago
The hidden cost of your AI rollout: burning out the high performers running it
Workplace Cultureburnout
The hidden cost of your AI rollout: burning out the high performers running it
By Mikaela Cohen and HR BrewJune 23, 2026
9 hours ago
Quantum computing stocks surge after Trump signed executive orders backing the sector
Investingquantum computing
Quantum computing stocks surge after Trump signed executive orders backing the sector
By Marco Quiroz-GutierrezJune 23, 2026
10 hours ago
Alan Greenspan testifying before the Senate Banking Committee.
BankingFederal Reserve
The man who invented the Fed’s magic trick just died. His successor is about to try it again
By Eva RoytburgJune 23, 2026
12 hours ago
Google DeepMind CEO Demis Hassabis (left) stands on a spiral staircase next to Google DeepMind researcher John Jumper.
NewslettersEye on AI
Defections from Google DeepMind prompt questions about Alphabet’s efforts to stay at the forefront of AI
By Jeremy KahnJune 23, 2026
12 hours ago
college
SuccessEducation
47% of Harvard seniors admit to cheating — and the problem existed long before ChatGPT
By Austin Sarat and The ConversationJune 23, 2026
12 hours ago

Most Popular

After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup
Success
After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup
By Orianna Rosa RoyleJune 23, 2026
18 hours ago
Markets tumble worldwide as Fed resets expectations: $400 billion wiped off SpaceX stock
Banking
Markets tumble worldwide as Fed resets expectations: $400 billion wiped off SpaceX stock
By Jim EdwardsJune 23, 2026
20 hours ago
Meet the 2 men putting New York's $300 billion pension fund in play for the first time in 20 years
Investing
Meet the 2 men putting New York's $300 billion pension fund in play for the first time in 20 years
By Nick LichtenbergJune 22, 2026
2 days ago
Current price of oil as of June 23, 2026
Personal Finance
Current price of oil as of June 23, 2026
By Joseph HostetlerJune 23, 2026
17 hours ago
Former U.S. Secret Service agent says bringing your authentic self to work stifles teamwork: 'You don’t get high performers, you get sloppiness'
Success
Former U.S. Secret Service agent says bringing your authentic self to work stifles teamwork: 'You don’t get high performers, you get sloppiness'
By Sydney LakeJune 21, 2026
3 days ago
Current price of oil as of June 22, 2026
Personal Finance
Current price of oil as of June 22, 2026
By Joseph HostetlerJune 22, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.