EarthServer initiative is establishing Agile Analytics on Petabyte data cubes as a commodity.
Pushing the boundaries of Big Earth Data services, the intercontinental Earthserver initiative enables researchers to browse, access, and analyze massive multi-dimensional data sets from a wide range of sources. Big Earth Data at your fingertips - this is the vision of EarthServer for unleashing the potential of Big Data through a disruptive paradigm shift in technology.
The platform baseline enabling technology is constituted by the Array Database System, rasdaman, the outcome of EU and ESA funded projects, as well as clients developed jointly by user and tech partners in EarthServer. Rasdaman is part of the GEOSS Common Infrastructure (GCI). In EarthServer-2, it is in functionality, scalability, and ease-of-administration.
EarthServer-2 strictly commits itself to open standards: the data¬cube model stems from the OGC coverage model for Big Geo Data, a unified model for spatio-temporal regular and irreg¬ular grids, pint clouds, and meshes; standards-based query languages as cli¬ent/server interfaces, wrapped into 3D/4D visual clients, in particular: NASA WorldWind. Con¬verse¬ly, the project continues the EarthServer-1 success of shaping standards in ISO (Array SQL stan¬dard), OGC (Big Geo Data standards), and RDA (co-chairing Big Data Analytics & Geospatial) and CODATA.
Concretely, EarthServer-2 technological objectives, include the following measurable items:
- Establish 3D Sentinel timeseries and 4D weather datacubes of at least 1 PB per service partner;
- Progress rasdaman to achieve real-time (ie, sub-second) query processing on these datacubes (WP1 to determine the class of queries supported);
- Establish appropriate security concepts for Array Databases distributed in clouds and across federations;
- Close the age-old gap between data and metadata by allowing queries to simultaneously address data and metadata;
- Extend rasdaman to automatically distribute incoming queries over at least three data centers;
- Establish Array SQL as an ISO standard, and further advance OGC Big Data standards; visibly promote results and push work in the RDA Big Data Analytics and Geospatial groups;
Altogether, EarthServer-2 is on the road of producing game-changing new services by enhancing existing data archives with flex¬ible, scalable query functionality. Results shall form a substantial contribution to GEOSS and Copernicus.
To achieve this, EarthServer-2 builds upon the groundbreaking results achieved in FP7 Earth-Server: world-lead¬ing Array Database technology, rasdaman; establishing the OGC Big Earth Data standards suite; leading the RDA Big Data effort; initiating ISO SQL standardization of multi-dimensional arrays; proof of concept on spatio-temporal datacubes encompassing hundreds of Terabytes; base the INSPIRE Download Services on OGC WCS.