ESASky, ESA s new open-science portal for ESA space astronomy missions Bruno Merín ESAC Science Data Centre European Space Agency bruno.merin@esa.int Visit to NAOC, Beijing, 19/05/2017 ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 1
2022 2018 2018 5 in Operations 3 in Develop. ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 2 1 in Post-Ops 4 in Legacy
5 in Operations 2 in Develop. 2 in Post-Ops 6 in Legacy 2018 2020 ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 3
Science Archives at ESAC http://archives.esac.esa.int Enable maximum scientific exploitation of data sets Enable efficient long-term preservation of data, software and knowledge, using modern technology Enable cost-effective archive production by integration in, and across, projects ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 4
ESA main Astronomy Archives ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 5
Planetary Science Archive http://psa.esa.int ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 6
ESA Heliophysics Archives ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 7
ESA Space Science Open Data Policy Proprietary period for all science data (~1 year) To instrument teams when data is being produced by instrument teams To observer for observatory missions Data then enter the public domain Freely accessible worldwide Being sometimes replicated in non ESA site (European / US data centres) Data is made available to the scientific community through Internet Through a standard web browser and through scriptable APIs Search, preview, select and download ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 8
Collaboration is key IVOA in astronomy Astronomy Science is now multi-wavelengths Existing collaboration among VO partners worldwide Existing Virtual Observatory (VO) Framework VO initially planned for space and ground based archive interoperability layer on top of existing archives VO now also used for data management infrastructure VO built-in archives at ESA (Gaia, Euclid, ) ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 9
Towards multi wavelengths Science data exploitation Goal: to facilitate data discovery and archival science for ALL users Multi-wavelength Project agnostic Exploration Interface on top of all ESA astronomy archives ESASky http://sky.esa.int Legacy: IUE,.. Herschel XMM- Newton HST Planck ISO Integral EXOSAT Gaia Future: JWST, Euclid,.. ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 10
ESASky Concept: Explore, compare, select, download ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 11
ESASky data contents roadmap Prototype (summer 2014) First Release (May 2016) Second release (fall of 2016) All-sky HiPS mosaics: All-sky HiPS mosaics: All-sky HiPS mosaics XMM-Newton (CDS) EXOSAT (ESA) Science ready data (imaging and HST (CDS) INTEGRAL (ESA) spectra): Planck (CDS) XMM-Newton (ESA) EXOSAT Herschel-SPIRE (ESA) HST (ESA) INTEGRAL Science ready data (imaging): ISO (ESA) XMM-Newton XMM-Newton AKARI (ESA) IUE HST (core) Herschel (ESA) HST Herschel-SPIRE Planck (ESA) ISOCAM Catalogs: JAXA/SUZAKU Herschel 3XMM-DR4 Science ready data (imaging): Catalogs: XMM Slew INTEGRAL 3XMM-DR6 XMM OM XMM-Newton XMM Slew HST XMM OM ISOCAM Hubble Source catalog Herschel Hipparcos JAXA/SUZAKU Gaia Catalogs: AKARI catalogs 3XMM-DR5 Herschel Point Source Catalogs XMM Slew Planck catalogs XMM OM Hubble Source catalog Hipparcos AKARI catalogs Planck catalogs ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 12
ESASky technology roadmap Prototype (summer 2014) First Release (May 2016) Second release (fall 2016) Third release (2017) Web interface All-sky HiPS mosaics from CDS Detailed footprints (imaging) Multi-target functionality Scientific validation of footprints and ESA allsky HiPS by ESA Download management Multi-target summary table Interoperability with VO tools Documentation Helpdesk Support Hardware scaling requirements Refactoring of prototype into robust and stable application Link to Vizier/Simbad Generation of detailed footprints (spectra) Imaging and spectroscopic data Online visualization of data On demand overlaying of footprints for preplanning Sample manipulation Time-series Observation planning State-fullness Massive data visualization Link to publications? Mobile app? ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 13
Collaboration is key ESASky HiPS SAMP TAP ObsCoreDM, MOC XMM-Newton and Chandra Dedicated Python module to ESASky JWST Footprints ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 14
Conclusion ESASky is an open source open-science data portal to Astronomical data from ESA missions and you are all invited to use it and to give us feedback to improve it! ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 15
Thanks for your attention!! http://sky.esa.int http://archives.esac.esa.int http://esasky.userecho.com bruno.merin@esa.int ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 16
BACKUP SLIDES ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 17
Helio/Planetary Missions in Orbit or Post-Ops 1995 SOHO (Solar and Heliospheric Observatory) 1997 Cassini-Huygens (Saturn and probe to Titan) 2000 Cluster (Sun-Earth Environment) 2003 Mars Express 2004 Rosetta (Comet exploration) now in post ops 2005 Venus Express now in legacy 2009 PROBA-2 (technology and solar observations) 2016 ExoMars2016 (Trace Gas Orbiter (TGO) ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 18
Astronomy & Physics Missions or Post-Ops 1990 Hubble Space Telescope (UV/Optical/NIR Observatory) 1999 XMM-Newton (X-ray Observatory) 2002 INTEGRAL (Gamma-ray Observatory) 2009 Herschel (FIR Observatory) now in post operations 2009 Planck (Mapping microwave background) now in post ops 2013 Gaia (astrometry charting a billion stars) 2015 Lisa Pathfinder (demonstrate gravitational wave technology) ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 19
Science Missions in Development 2018 CHEOPS (CHaracterising ExOPlanet Satellite) 2018 BepiColombo (Closing in on Mercury) 2018 Solar Orbiter (Closest to the Sun) 2018 JWST (Observing the First Light) 2020 Euclid (Mapping the geometry of the Dark Universe) 2022 JUICE (JUpiter ICy Moons Explorer) 2024 PLATO (PLAnetary Transits and Oscillations of Stars) (still to be adopted) ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 20
SCI Operations Department Science Operations Centres for Astronomy, Heliospheric, and Planetary missions. Science Data Archives long-term access to data and information. Overall management of ESA s operational space science missions. Involved in >25 missions/studies. Over 250 scientists and engineers involved at European Space Astronomy Centre (ESAC), Madrid, and at STScI, GSFC, ESTEC, ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 21
Science Operations Centres Provide, often with partners, some/all of following elements: Ø Interfaces to users, Ø calls for proposals, information, workshops, training, helpdesk, Ø Ø Ø Payload operations, Ø scientific scheduling and optimisation, payload monitoring, quick-look data analysis, Payload data acquisition and processing, Ø calibration and cross-calibration, interactive and pipeline processing tools, Science data archiving and distribution, Ø archive development, population and maintenance, Ø Plus associated software (and procedures). Ø development, integration, test, operation and maintenance. ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 22
ESAC Science Data Centre The Digital Library of the Universe At ESA s European Space Astronomy Centre near Madrid Science Archives from >15 space missions: Astronomy, Planetary, Heliophysics From all phases (development, operations, post-ops, legacy) http://archives.esac.esa.int/ Different Users: Scientific Community (public access) Instrument teams and observers (controlled access) Science Operations Team (privileged access) ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 23
ESA Science Archives Volume Evolution (2000-2020) ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 24
ESA Science Archives Volume Evolution (2000-2025) ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 25
Need for a new archive usage paradigm New ways required to access the Gaia catalogue and associated data Powerful query mechanism, asynchronicity of results One query interface for all archive services and VO services User can not download all catalogue and all data Need to have user workspaces IN the Archive User database space, user disk space User workspace shareable amongst various users Bring user code to the data Part of the user workspace in the archive Share code with other users The user works with the data WHERE the data is => Archive 2.0 concept Science Exploitation Platform ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 26
Gaia Archive Architecture ESA UNCLASSIFIED - For Official Use Christophe Arviset ESAC 04/05/2017 Slide 27