NASA Logo

NTRS

NTRS - NASA Technical Reports Server

Back to Results
How NASA is Building a Petabyte Scale Geospatial Archive in the CloudNASA's Earth Observing System Data and Information System (EOSDIS) is working towards a vision of a cloud-based, highly-flexible, ingest, archive, management, and distribution system for its ever-growing and evolving data holdings. This free and open source system, Cumulus, is emerging from its prototyping stages and is poised to make a huge impact on how NASA manages and disseminates its Earth science data. This talk outlines the motivation for this work, present the achievements and hurdles of the past 18 months and charts a course for the future expansion of Cumulus. We explore not just the technical, but also the socio-technical challenges that we face in evolving a system of this magnitude into the cloud. The NASA EOSDIS archive is currently at nearly 30 PBs and will grow to over 300PBs in the coming years. We've presented progress on this effort at AWS re:Invent and the American Geophysical Union (AGU) Fall Meeting in 2017 and hope to have the opportunity to share with FOSS4G attendees information on the availability of the open sourced software and how NASA intends on making its Earth Observing Geospatial data available for free to the public in the cloud.
Document ID
20180003014
Acquisition Source
Goddard Space Flight Center
Document Type
Presentation
Authors
Pilone, Dan
(Element 84 Alexandria, VA, United States)
Quinn, Patrick
(Element 84 Alexandria, VA, United States)
Jazayeri, Alireza
(Alabama Univ. Huntsville, AL, United States)
Baynes, Kathleen
(NASA Goddard Space Flight Center Greenbelt, MD, United States)
Murphy, Kevin J.
(NASA Headquarters Washington, DC United States)
Date Acquired
May 25, 2018
Publication Date
May 14, 2018
Subject Category
Earth Resources And Remote Sensing
Mathematical And Computer Sciences (General)
Report/Patent Number
GSFC-E-DAA-TN56268
Meeting Information
Meeting: FOSS4G North America
Location: St. Louis, MO
Country: United States
Start Date: May 14, 2018
End Date: May 16, 2018
Sponsors: Open Source Geospatiale Foundation (OSGeo)
Funding Number(s)
CONTRACT_GRANT: NNG15HZ39C
Distribution Limits
Public
Copyright
Public Use Permitted.
Keywords
NASA Archive
Serverless Computing
No Preview Available