Data2Dome: A Standard for Dome Content Distribution

Transcription

1 Data2Dome: A Standard for Dome Content Distribution Lars Lindberg Christensen European Southern Observatory & the IPS Science and Data Visualization Task Force data2dome.org

2 Mathias Andre (European Southern Observatory) Max R. Rößner (European Southern Observatory) Kevin Scott (Evans & Sutherland) Mark Subbarao (Adler Planetarium) Ben Emmons (LSST) Valentina Schettini (European Southern Observatory) Jürgen Rienow (Berlin Planetarium) Björn Voss (Münster Planetarium) Robert Hurt (Infrared Processing and Analysis Center) Ka Chun Yu (Denver Museum of Nature & Science) Marta Entradas (London School of Economics and Political Science, DINÂMIA'CET/ISCTE-IUL) & The IPS Science and Data Visualization Task Force

3 Why we need to change the way we present news 1. Astronomy is a dynamic discipline. New press releases, images, videos and data are being published every day. 2. But, this flow of exciting new content is typically not integrated in planetariums: new data is typically presented days or even weeks later and often not at all. 3. As a result, the planetarium, usually seen as the local centre of astronomy competence, lags behind blogs, newspapers, TV and other media. 4. The Data2Dome (D2D) project streamlines the flow of content from research institutions to planetariums, offering audiences a unique opportunity to access the latest data from space in near real time.

4 The challenges 1. Manual work: Copying content onto the system Slicing & distributing it to the render nodes Writing scripts to actually display the assets 2. Content import not standardised: The pipelines and work procedures for importing content are typically very vendor-specific, resulting in difficulties with delivering content across the system boundaries in an easy and seamless way. 3. Lack of consolidated data access: Astronomical data on the internet are usually distributed across many different research institutions websites. As a result, it is not easily found and easily escapes the attention of a planetarium operator. 4. Lack of Internet connection 5. Content is not simplified/curated/well-served

5 Data2Dome Philosophy Data2Dome relies on: standardisation of formats and process consolidation of data or metadata in online databases a combination of staff curation of assets as well as crowd-curation a ranking system on the side of the vendors distribution via the Internet.

6 Data2Dome Vision Every morning, planetarium presenters around the world will be able to access a menu that will allow them to select interesting news and fresh datasets news, sky event data, historical event data and more (see the use cases below) and mark up the full datasets and metadata for download, for possible inclusion in show segments during the day. Some of these items may be under embargo and will only be shown when they are public. In some sense the presenter can be seen as an Astronomical Weatherman being able to report on fresh events almost as they take place.

7 Data2Dome Data Descriptive metadata as support for the presenter: concise, well-written descriptions of the content; credits; license; embargo date; links to more information etc. for the planetarium lecturer. The Astronomy Visualization Metadata Standard has been chosen for this. Flat videos Flat images, including planetary maps, images of sky objects, all-sky panoramas/fulldome images Fulldome videos Audio, including interview clips, sounds, music 3D objects Show sequences, including presentation metadata

8 Implementation

9 Implementation 1. The D2D project determines the standard of the metadata, the format for the exchange of the metadata (JSON) and data and approves the Content Providers. D2D also communicates any changes to the standards and new Content Providers with all stakeholders. 2. The Content Provider maintains a database of metadata and data. The Content Providers must guarantee that data and metadata are free to use by the planetariums. This content will need to be curated so that the best (most relevant and most interesting) data are provided. The metadata are made available in a JSON file. 3. The Planetarium Vendor will (through a Vendor Cloud solution) synchronise the JSON file as often as necessary, provide an interface that allows the presenter to search and filter the metadata instantaneously, and then download the presenter s chosen asset on demand in any size needed (the JSON file has deep links for different format/sizes). The metadata are archived and ranked so that the best content is most visible at any given time. The data assets are automatically displayed at the default location of the dome. The planetarium presenter is also offered a text summarising the content on a console screen.

10 Data2Dome Example Use Cases A new press release An Earth-like exoplanet system is announced by NASA and ESO. Within hours a human curator finds the press release interesting and features it. The D2D JSON file is automatically updated within minutes to contain the new press release metadata. Soon after (to be determined by the vendor) the news will appear in the the D2D presenter menu under News. The release has the necessary metadata to characterise the content, and points to data/high-res assets (at least an image). A lecturer thinks this is relevant news, flies to the host star in the planetarium system, downloads assets and presents them to the audience. Tonight is a lunar eclipse! The event appears in the presenter menu. As it is ranked highly the presenter bring this event up in today s Sky at Night shows. The associated assets (images, flat videos and fulldome videos) are downloaded, automatically distributed to all render nodes of the planetarium system and available for instant presentation. The lecturer is supplied with background information concerning the event, such as the times of key milestones.

11 Data2Dome Example Use Cases It s 20 July The D2D menu highlights the anniversary of the Apollo 11 Moon landing. The planetarium operator brings up this event in today s Sky at Night shows. The associated assets (images, all-sky images, flat videos and fulldome videos), are downloaded, automatically distributed to all render nodes of the planetarium system and available for instant presentation.the lecturer is supplied with background information concerning the Apollo 11 Moon landing. The Chelyabinsk meteorite An important event like the Chelyabinsk meteorite takes place. It happens too fast for a press release to appear, but a blog contains a link to a highres video of the Chelyabinsk event. The D2D blog JSON file is automatically updated within minutes to contain the new press release metadata. Soon after (to be determined by the vendor) the news will appear in the the D2D presenter menu under News. Owing to its importance and topicality the asset soars in the ranking. It is quickly discovered by presenters worldwide. The asset is displayed on domes worldwide hours after the event.

12 Data2Dome Example Use Cases HST images The presenter needs an image of the interesting Bubble Nebula. He/she searches the metadata in the Vendor Cloud, and finds a Hubble image. The 79 MB 8k-pixel image data are marked for download and are displayed on the dome after some seconds. Hubble videos (flat and fulldome) The presenter needs a video of the super-earth 55 Cancri e. He/she searches the metadata in the Vendor Cloud, and finds a Hubble flat UHD video. The 100 MB Ultra HD H.265 frames data package is marked for download and is displayed on the dome after a few minutes.

13 When will it be ready? Now

14 Digistar 6 Data2Dome has now, since 2 weeks, been integrated in Digistar 6 from Evans & Sutherland with 20,000+ images and videos. ~21 March Build will have the rest of our original Use Cases: historical events, sky events, press releases, blogs, audio files, 3D models Data providers so far: 1. ESO (images, videos) 2. Hubble (images, videos) Via AstroPix (Robert Hurt/IPAC): 3. Spitzer 4. Chandra 5. GALEX 6. WISE 7. NuSTAR 8. Planck 9. Herschel

15

16

17

18

19

20

21

22 data2dome.org supernova.eso.org/ips

23

24 Here is an example Collection that contains 1 Asset, which in turn contains 3 Resources: { "Count": 1, "Next": null, "Previous": null, "Collections": [ { "Creator": "European Southern Observatory", "URL": " "Contact": [ { "Name": [], " ": [], "Telephone": [], "Address": "Karl -Schwarzschild-Strasse 2", "City": "Garching bei München", "StateProvince": "", "PostalCode": "D-85748", "Country": "Germany" } ], "ID": "ann16086a", "Title": "A large slice of the Universe", "Description": "<p>the positions in space of just some of the galaxies identified by the VIPERS survey. This is one of two \\\"slices\\\" through the Universe produced from the survey data. It shows where the galaxies lie as we look to ever greater distances in space corresponding to looking further back in time. Data like these allow astronomers to study the evolution of galaxies as a constituent of the Universe, and tell us about how space itself evolves over time.</p>", "Credit": "B. Granett, L. Guzzo &amp, the VIPERS Collaboration", "PublicationDate": " T23:25: Z", "Subject": [ { "Category": ["Early Universe","Cosmology","Morphology","Large-Scale Structure"], "Name": ["Auxiliary Telescopes","Paranal"] } ], "ReferenceUrl": " "RelatedLinks": null, "Rights": "Creative Commons Attribution 4.0 International License", "Priority": 70, "Assets": [ { "Resources": [

25 } } ] }, { }, { } ] "Dimensions": [ 3371, 1309 ], "HorizontalFOV": [], "VerticalFOV": [], "ProjectionType": "Tan", "ResourceType": "Original", "MediaType": "Image", "Title": null, "Description": null, "URL": " "FileSize": , "Categories": null "Dimensions": [ 122, 47 ], "HorizontalFOV": [], "VerticalFOV": [], "ProjectionType": "Tan", "ResourceType": "Thumbnail", "MediaType": "Image", "Title": null, "Description": null, "URL": " "FileSize": 8028, "Categories": null "Dimensions": [ 3371, 1309 ], "HorizontalFOV": [], "VerticalFOV": [], "ProjectionType": "Tan", "ResourceType": "Large", "MediaType": "Image", "Title": null, "Description": null, "URL": " "FileSize": , "Categories": null