You are here: Home » International » News » Companies
Business Standard

Maintenance error caused Facebook's 6-hour outage, company says

At a U.S. Senate hearing on Tuesday, a former employee turned whistleblower accused Facebook of putting profits before people's safety, which the company denies.

Topics
Facebook | Social Media

Reuters 

Facebook
Photo: Bloomberg

An error during routine maintenance on Facebook's network of data centers caused Monday's collapse of its global system for more than six hours, leading to a torrent of problems that delayed the repairs, the company said on Tuesday.

The outage was the largest that Downdetector, a web monitoring firm, said it had ever seen. It blocked access to apps for billions of users of Facebook, Instagram and WhatsApp, further intensifying weeks of scrutiny for the nearly $1 trillion company.

At a U.S. Senate hearing on Tuesday, a former employee turned whistleblower accused of putting profits before people's safety, which the company denies.

In a blog post, Vice President of engineering Santosh Janardhan explained the company's engineers issued a command that unintentionally disconnected data centers from the rest of the world.

Facebook's systems are designed to audit commands to prevent mistakes, but the audit tool had a bug and failed to stop the command that caused the outage, the company said.

The outage was not caused by malicious activity, it added.

While users lost access to one of the world's most popular messaging apps - WhatsApp has more than 2 billion users - employees were also blocked from internal tools.

The outage knocked out tools that engineers would normally use to investigate and repair such outages, making the task even more difficult, Facebook said.

The company said it sent a team of engineers to the location of its data centers to try to debug and restart the systems.

However, it took the company extra time to get engineers inside to work on the servers due to the high physical and system security in place.

Even after network connectivity was restored to the data centers, Facebook said it worried a surge in traffic would cause its websites and apps to crash.

But because the company had run drills to prepare for such situations, access to its services returned relatively quickly.

"Every failure like this is an opportunity to learn and get better," Janardhan wrote. "From here on out, our job is to ... make sure events like this happen as rarely as possible."

(Reporting by Sheila Dang in Dallas; Editing by Sonya Hepinstall, Grant McCool and Richard Pullin)

(Only the headline and picture of this report may have been reworked by the Business Standard staff; the rest of the content is auto-generated from a syndicated feed.)

Dear Reader,


Business Standard has always strived hard to provide up-to-date information and commentary on developments that are of interest to you and have wider political and economic implications for the country and the world. Your encouragement and constant feedback on how to improve our offering have only made our resolve and commitment to these ideals stronger. Even during these difficult times arising out of Covid-19, we continue to remain committed to keeping you informed and updated with credible news, authoritative views and incisive commentary on topical issues of relevance.
We, however, have a request.

As we battle the economic impact of the pandemic, we need your support even more, so that we can continue to offer you more quality content. Our subscription model has seen an encouraging response from many of you, who have subscribed to our online content. More subscription to our online content can only help us achieve the goals of offering you even better and more relevant content. We believe in free, fair and credible journalism. Your support through more subscriptions can help us practise the journalism to which we are committed.

Support quality journalism and subscribe to Business Standard.

Digital Editor

First Published: Wed, October 06 2021. 10:14 IST
RECOMMENDED FOR YOU
.