Saturday, 9 February 2019

☁️The cloud: Data is all around us

Quartz Obsession

The cloud

February 08, 2019

Food for thought

Last year, Amazon Web Services brought in more revenue than McDonald's. The branch of the e-commerce company that deals in cloud-computing has long been seen as a financial life-preserver, but for a while it seemed to be plateauing. 2018's $25.7 billion figure—up 47% from 2017—has to be a relief, especially at a time when all the tech giants are looking for ways to put our data out into the blue.

The cloud is also floating a reinvigorated Microsoft, which has been growing its Azure service at nearly 100% every quarter. Google is far behind both companies, but its cloud is the foundation for indispensable products like Gmail and Google Drive as well as the Chromebook, which challenges Apple's pricier laptops. Apple is busy growing its own cloud revenue, as is Alibaba. And what's streaming but specialized cloud services?

For consumers, the cloud powers the seamless data storage experience we've come to rely on. Gone are the days of organizing hard-drive folders, maintaining external drives, and digging through awkwardly named files. For the industry, keeping the cloud afloat requires pushing the bounds of hardware, software, and physics, and consumes a staggering amount of energy.

🐦 Tweet this!

🌐 View this email on the web

Ready to go deeper?

We're tired of all the shouting matches and echo chambers on social media, and thought you might be, too. On the new Quartz app, we've gathered a community of curious thinkers and doers to have high-quality discussions about the most important stories each day. It's like an ongoing conversation with CEOs like Richard Branson, Punit Renjen, Arianna Huffington, and many more.

Get the app for free
explain it like i'm 5!

What does Amazon Web Services do?

It was a brilliantly simple idea: at its heart, AWS just rents computer power—like server space—by the hour. In practice, it means companies can launch with tens of thousands of dollars in virtual computing costs rather than raising millions to buy their own hardware, or quickly add temporary capacity as needed. As a result, the service is reshaping the financial industry, among others, by lowering the barriers to entry for startups.

(Fun fact: A Twitter user points out that AWS hosts the National Enquirer, the publication that Jeff Bezos alleges attempted to extort him by threatening to expose embarrassing private photographs.)

The business benefits are mutual: AWS is a revenue cushion that lets Amazon be Amazon, giving the company breathing room to experiment even as Wall Street starts to demand substantial profits.

Giphy
By the digits

$33 billion: Price IBM paid in October 2018 for Linux giant Red Hat to boost its cloud services

4: Rank of IBM in cloud-computing market share

$10 billion: Size of the US Joint Enterprise Defense Infrastructure (JEDI) cloud contract

$80 billion: Cloud-infrastructure spending in 2018

¥6.6 billion ($1 billion): Alibaba cloud-computing revenue in 2018

84%: Year-over-year growth of Alibaba's cloud-computing revenue

???: Google cloud revenue in 2018

0.3%: Share of global carbon emissions that comes from data centers

12,000: Homes that the solar grid fueling Apple's Arizona data center could power

Charted
atlas_HycLk--VV@2x
Giphy
Origin story

How the cloud was seeded

When did the cloud begin? Arguably, before the internet. By 1955, the computer scientist John McCarthy, who gave us the term "artificial intelligence," had theorized time-shared computers. In 1961, MIT researcher Fernando CorbatΓ³—the inventor of the computer password—demonstrated the first one.

That became the heart of the legendary Project MAC (Mathematics and Computation), which ran for 10 years at a cost $25 million in government funding (about $184 million today) and a peak staff of 400. By 1966–1967, when the concept of the modern internet was first described, Project MAC's shared computer had 350 users storing an average of 35 files. Around the same time, commercial time-sharing computers began spreading across the US, but long-distance telephone costs limited their utility.

And then came the internet. But its use as a robust cloud was kept in check by ever-smaller and more powerful computers, which put increasingly significant computing power right in the hands of the end user. The birth of contemporary cloud computing arguably came at Oracle in the 1990s, when future NetSuite founder Evan Goldberg pitched the idea of "[a customer-relationship program] but on the Internet" to CEO Larry Ellison, explaining that customers would need accounting and enterprise resource planning software as well. From that brainstorm the cloud formed: NetSuite in 1998, and Salesforce—which founder Marc Benioff, who had also heard Goldberg's pitch, called "the end of software"—in 1999. (Google recently brought on an Oracle vet, Thomas Kurian, to lead its lagging cloud efforts.)

Something was in the air: simultaneous invention. In 1996, a tech entrepreneur named Sean O'Sullivan went to Compaq with a proposal for a software platform that would let ISPs host and bill for video conferencing, streaming video, and file storage. Nothing came of it, but in meetings over the idea someone coined the term "cloud computing" to differentiate it from the prevalent use of "cloud" as a telecom network. In 2006, when the practice was more familiar, Google CEO Eric Schmidt's use of the term finally put it in the vernacular.

Read the Obsession on simultaneous invention
Watch this!

Timesharing: A Solution to Computer Bottlenecks, a half-hour 1963 documentary, pays a visit to MIT's time-sharing computer—the first cloud.

Person of interest

All together now

One of the most powerful strengths, and trickiest problems, in cloud computing is collaborative editing: who gets to do what when in a document that has two, 10, or 100 people working on it? Programmers have been working on the issue since they started working on office software.

One of the pioneers was also the first African-American to get a PhD in computer science: the late Clarence "Skip" Ellis. He was born in Chicago in 1943, and as a teen got a job as a night watchman at an insurance company that had a computer—which, at the time, was rare. Ellis read the manuals and learned the system, and was able to show the company how to reuse punch cards when they ran out. He went on to get his doctorate at the University of Illinois in 1969, during the development of the ILLIAC IV, the most powerful computer in the world and the first true parallel supercomputer—64 processors running in tandem to break up complex problems—and eventually landed at Xerox PARC, the Alphabet of its time. There, Ellis co-developed OfficeTalk, "the first workflow system that provided a visual electronic desktop metaphor across an Ethernet network of end users' personal computers."

Ellis remained interested in the problems of shared office software for the rest of his career. He co-originated the idea of operational transformation, a software approach to collaborative editing that creates and resolves different versions of the same document as different users work on it; today this is a critical piece of how Google Docs work.

Giphy
Pop quiz

Which English poet wrote "The Cloud"?

Correct. Choice line: "I change, but I cannot die."
Incorrect.
If your inbox doesn't support this quiz, find the solution at bottom of email.
This one weird trick!

Big data rig

The synthesis of Amazon's business—and, in a way, the old and new economies—is its Snowmobile service, which is a literal moving service for data consisting of a tractor-trailer truck that can carry up to 100 petabytes of storage. (That's half the size of CERN's data archive.)

It's actually faster to upload data on that scale to the truck, which is then transferred to AWS, because moving 100 petabytes would take 28 years on gigabit-per-second Google Fiber, or 120 days on the record-setting high-speed ESnet run by the US Department of Energy.

Snowmobile, alternately, would take just two or three weeks.

Million-dollar question

Where is the cloud?

It's everywhere, and… actually, a lot of it is in the Washington, DC suburbs. In a 2016 piece for the Atlantic, Ingrid Burrington explains why: "networks build atop networks." The internet grew out of military research, in the burbs because land is cheaper and they're more immune to attack than the city. Military contractors followed, and non-military telecom companies followed them. Now up to 70% of worldwide internet traffic flows through the area.

Geography determines the location of other cloud centers in curious ways. Microsoft is testing an undersea, renewably-powered server farm; sinking it will save on cooling costs. (Stockholm plans to use server heat to warm a tenth of its residences by 2035 by using them as boilers.) North Carolina's dwindling furniture and textile industries left behind a good electric infrastructure. In general, railroad tracks and highways determine where many are, because fiber optic paths follow their predecessors.

One large, underserved market is Africa. The regional data infrastructure, like fiber networks and connections to undersea cables, is quite good in many places, but content is still slow to load because it's stored so far away. In 2015, a Google project manager sitting in a Nairobi airport found that Apple, Google, Facebook, and Twitter were all being served from Europe and the US, causing an immense—on the millisecond scale—delay. Microsoft landed in Johannesburg and Cape Town last year; Amazon's first African data center is due in Cape Town in 2020.

Dave Greer
Look at this!

Cloud computing centers are warehouses for data, and they look like… warehouses. Big, boxy, and boring (like the Oregon Google data center, pictured). But a professional photographer like Dave Greer, whose project "Internet" seeks to capture its physical geography, can bring out their beauty.

Making a map of it, though, is an incredible challenge.

Giphy
Poll

How much of your life is on the cloud?

πŸ’¬let's talk

In yesterday's poll about the Brown Dog Affair, 47% of you said we should not experiment on live animals, period.

πŸ€” What did you think of today's email?

πŸ’‘ What should we obsess over next?

🎲 Show me a random Obsession

Today's email was written by Whet Moser, edited by Jessanne Collins, and produced by Luiz Romero.

No comments:

Post a Comment