NTRS - NASA Technical Reports Server

Back to Results
Archive Management of NASA Earth Observation Data to Support Cloud AnalysisNASA collects, processes and distributes petabytes of Earth Observation (EO) data from satellites, aircraft, in situ instruments and model output, with an order of magnitude increase expected by 2024. Cloud-based web object storage (WOS) of these data can simplify the execution of such an increase. More importantly, it can also facilitate user analysis of those volumes by making the data available to the massively parallel computing power in the cloud. However, storing EO data in cloud WOS has a ripple effect throughout the NASA archive system with unexpected challenges and opportunities. One challenge is modifying data servicing software (such as Web Coverage Service servers) to access and subset data that are no longer on a directly accessible file system, but rather in cloud WOS. Opportunities include refactoring of the archive software to a cloud-native architecture; virtualizing data products by computing on demand; and reorganizing data to be more analysis-friendly.
Document ID
Acquisition Source
Goddard Space Flight Center
Document Type
Conference Paper
Lynnes, Christopher
(NASA Goddard Space Flight Center Greenbelt, MD, United States)
Baynes, Kathleen
(NASA Goddard Space Flight Center Greenbelt, MD, United States)
McInerney, Mark A.
(NASA Goddard Space Flight Center Greenbelt, MD, United States)
Date Acquired
December 1, 2017
Publication Date
November 28, 2017
Subject Category
Computer Systems
Report/Patent Number
Meeting Information
Meeting: 2017 Conference on Big Data from Space (BiDS''17)
Location: Toulouse
Country: France
Start Date: November 28, 2017
End Date: November 30, 2017
Sponsors: European Space Agency
Distribution Limits
Work of the US Gov. Public Use Permitted.
No Preview Available