NASA Logo

NTRS

NTRS - NASA Technical Reports Server

Back to Results
KDD Services at the Goddard Earth Sciences Distributed Active Archive CenterNASA's Goddard Earth Sciences Distributed Active Archive Center (GES DAAC) processes, stores and distributes earth science data from a variety of remote sensing satellites. End users of the data range from instrument scientists to global change and climate researchers to federal agencies and foreign governments. Many of these users apply data mining techniques to large volumes of data (up to 1 TB) received from the GES DAAC. However, rapid advances in processing power are enabling increases in data processing that are outpacing tape drive performance and network capacity. As a result, the proportion of data that can be distributed to users continues to decrease. As mitigation, we are migrating more data mining and mining preparation activities into the data center in order to reduce the data volume that needs to be distributed and to offer the users a more useful and manageable product. This migration of activities faces a number of technical and human-factor challenges. As data reduction and mining algorithms are normally quite specific to the user's research needs, the user's algorithm must be integrated virtually unchanged into the archive environment. Also, the archive itself is busy with everyday data archive and distribution activities and cannot be dedicated to, or even impacted by, the mining activities. Therefore, we schedule KDD 'campaigns' (similar to reprocessing campaigns), during which we schedule a wholesale retrieval of specific data products, offering users the opportunity to extract information from the data being retrieved during the campaign.
Document ID
20010016280
Acquisition Source
Goddard Space Flight Center
Document Type
Preprint (Draft being sent to journal)
Authors
Lynnes, Christopher
(NASA Goddard Space Flight Center Greenbelt, MD United States)
Mack, Robert
(NASA Goddard Space Flight Center Greenbelt, MD United States)
Wharton, Stephen W.
Date Acquired
August 20, 2013
Publication Date
January 1, 2000
Subject Category
Documentation And Information Science
Distribution Limits
Public
Copyright
Work of the US Gov. Public Use Permitted.

Available Downloads

There are no available downloads for this record.
No Preview Available