go back

Volume 14, No. 12

The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward

Authors:
Conor Power (Microsoft), Hiren Patel (Microsoft), Alekh Jindal (Keebo), Jyoti Leeka (Microsoft), Bob Jenkins (Microsoft), Michael Rys (Microsoft), Ed Triou (Microsoft), Dexin Zhu (Microsoft), Lucky Katahanas (Microsoft), Chakrapani Bhat Talapady (Microsoft), Josh Rowe (Microsoft), Fan Zhang (Microsoft), Rich Draves (Microsoft), Marc Friedman (Microsoft), Ivan Santa (Microsoft), Amrish Kumar (Microsoft)

Abstract

The twenty-first century has been dominated by the need for large scale data processing, marking the birth of Big Data platforms such as Cosmos. This paper describes the evolution of the exabyte-scale Cosmos big data platform at Microsoft; our journey from focusing on reliability and scalability to efficiency and usability, and our future steps towards improving security, compliance, and support for heterogeneous analytics scenarios. We talk about how the evolution of Cosmos parallels the evolution of the big data field as a whole, and how the changes in the Cosmos workloads over time parallel the changing requirements of users across industry.

PVLDB is part of the VLDB Endowment Inc.

Privacy Policy