Astronomical Databases and Virtual Observatories Surfing the Tsunami of Data

Similar documents
Preparing for observations

StarBriefs A Dictionary of Abbreviations, Acronyms and Symbols in Astronomy, Related Space Sciences and Other Related Fields.

Andre Heck, Soizick Lesteven, Francois Ochsenbein, Gerard Jasniewicz & Marc Wenger. CDS, Observatoire astronomique de Strasbourg, Strasbourg, France

D4.2. First release of on-line science-oriented tutorials

On-line information in astronomy

Astroinformatics: massive data research in Astronomy Kirk Borne Dept of Computational & Data Sciences George Mason University

STAR CATALOGUE FACILITY

Department of Astrophysical Sciences Peyton Hall Princeton, New Jersey Telephone: (609)

RLW paper titles:

CHANGING SOURCES FOR RESEARCH LITERATURE

Rick Ebert & Joseph Mazzarella For the NED Team. Big Data Task Force NASA, Ames Research Center 2016 September 28-30

Catalog Information and Recommendations

Modern Image Processing Techniques in Astronomical Sky Surveys

These notes may contain copyrighted material! They are for your own use only during this course.

An intelligent client application for on-line astronomical information

Exploiting Virtual Observatory and Information Technology: Techniques for Astronomy

Real Astronomy from Virtual Observatories

The INES Archive in the era of Virtual Observatories. E. Solano Spanish Virtual Observatory LAEX CAB / INTA-CSIC

PASA - an Electronic-only Model for a Professional Society-owned Astronomy Journal

The NASA/IPAC Infrared Science Archive (IRSA): The Demo

HST AND BEYOND EXPLORATION AND THE SEARCH FOR ORIGINS: A VISION FOR ULTRAVIOLET- OPTICAL-INFRARED SPACE ASTRONOMY

Six Things Everyone Should Know About Astronomy (With Activities)

STScI at the AAS 231: January 2018, Washington, D.C.

Heidi B. Hammel. AURA Executive Vice President. Presented to the NRC OIR System Committee 13 October 2014

ESASky, ESA s new open-science portal for ESA space astronomy missions

CONFIRMATION OF A SUPERNOVA IN THE GALAXY NGC6946

AURA MEMBER INSTITUTIONS

arxiv: v1 [astro-ph.im] 11 May 2010 Alberto Accomazzi Harvard-Smithsonian Center for Astrophysics

Astronomy on the Internet

Machine Learning Applications in Astronomy

A SPEctra Clustering Tool for the exploration of large spectroscopic surveys. Philipp Schalldach (HU Berlin & TLS Tautenburg, Germany)

FIVE FUNDED* RESEARCH POSITIONS

Due to the fact that we are hurrying to get on the telescope this Tuesday, we will postpone the writing of a formal proposal.

Miscellaneous New Common Proper Motion Stars

Riccardo Giacconi Papers,

Dear Teacher, Overview Page 1

arxiv:astro-ph/ v2 31 Jul 1998

Yuji Shirasaki. National Astronomical Observatory of Japan. 2010/10/13 Shanghai, China

Studying galaxies with the Sloan Digital Sky Survey

NASA/IPAC EXTRAGALACTIC DATABASE

The Galactic O-Star Spectral Survey (GOSSS) Project status and first results

Data Center. b ss. Ulisses Barres de Almeida Astrophysicist / CBPF! CBPF

THE H- AND A-INDEXES IN ASTRONOMY

The Cherenkov Telescope Array (CTA)

Virtual Observatory: Observational and Theoretical data

Science in the Virtual Observatory

New physics is learnt from extreme or fundamental things

SDSS Data Management and Photometric Quality Assessment

The Cherenkov Telescope Array

Physics 629: NOAO/SALT Observing Proposal

Non Member State Summer Student Program at ISOLDE

The Astronomical Information Infrastructure from the End-User Perspective

Data challenges of the Virtual Observatory in Time Domain Astronomy

The Navy Precision Optical Interferometer for SSA applications: an update

Face recognition for galaxies: Artificial intelligence brings new tools to astronomy

Doing astronomy with SDSS from your armchair

Radio observations of the Milky Way from the classroom

MAJOR SCIENTIFIC INSTRUMENTATION

The Large Synoptic Survey Telescope

Surprise Detection in Science Data Streams Kirk Borne Dept of Computational & Data Sciences George Mason University

Current Status of Chinese Virtual Observatory

Data Management Plan Extended Baryon Oscillation Spectroscopic Survey

Virtual Observatories and Developing Countries

The CSC Interface to Sky in Google Earth

Quasar Selection from Combined Radio and Optical Surveys using Neural Networks

Use of Telescope Statistics by Observatories

National Aeronautics and Space Administration. Glos. Glossary. of Astronomy. Terms. Related to Galaxies

Chapter 0 Introduction X-RAY BINARIES

How Galaxies Get Their Gas. Jason Tumlinson STScI Hubble Science Briefing December 9, 2010

arxiv:cs/ v1 [cs.dl] 22 Sep 2006

Astro 32 - Galactic and Extragalactic Astrophysics/Spring 2016

MAJOR SCIENTIFIC INSTRUMENTATION

Astroinformatics in the data-driven Astronomy

TMT-J Project Office, National Institute of Natural Sciences/ National Astronomical Observatory of Japan TELESCOPE (TMT) ( NAOJ)

Notes: Infrared Processing and Analysis Center (IPAC). IPAC was founded to process IRAS data and has been expanded to other space observatories.

Multi-instrument, multiwavelength. energy sources with the Virtual Observatory

Tests of MATISSE on large spectral datasets from the ESO Archive

GEOGRAPHIC INFORMATION SYSTEMS AND IT SOLUTIONS FOR THE ENVIRONMENT

The VLT dealing with the Atmosphere, a Night Operation point of view

Virtual Observatory (VO) An Introduction. Sudhanshu Barway South African Astronomical Observatory (SAAO), Cape Town

Training Path FNT IT Infrastruktur Management

Detecting New Sources of High-Energy Gamma Rays

Digitising Astronomical Plates of the Heidelberg Königstuhl Archives

A Vision for the US Virtual Astronomical Observatory. October D. De Young (NOAO), VAO Project Scientist

ASI - Italian Space Agency The Space Science Data Center is a Research Infrastructure of the Italian Space Agency

Telescope Bibliographies and Astronomical Data

Telescopes. Optical Telescope Design. Reflecting Telescope

European Commission STUDY ON INTERIM EVALUATION OF EUROPEAN MARINE OBSERVATION AND DATA NETWORK. Executive Summary

Telescopes. Optical Telescope Design. Reflecting Telescope

Pulsar Surveys Present and Future: The Arecibo-PALFA Survey and Projected SKA Survey

Determining the Membership of Globular Cluster, M2 with APOGEE Data

An Introduction to ASKAP Bringing Radio Interferometers Into the Multi-pixel Era

IAU STRATEGIC PLAN

SUPERSPECTRA PROJECT. Ignacio Mendigutía Gómez Tutor: Dr. Alberto Salama and the IDC

DiscoveryGate SM Version 1.4 Participant s Guide

arxiv: v1 [astro-ph] 12 Nov 2008

ArcGIS Pro: Essential Workflows STUDENT EDITION

PlanetQuest The Planet-Wide Observatory

The Case for Provenance Juande Santander-Vela, Arancha Delgado European Southern Observatory, Archive Department

Using Authentic Astronomical Data in Investigations & Activities. Version 1.1, presented at CONASTA 59, UTS, Monday 5 July 2010.

Transcription:

Astronomical Databases and Virtual Observatories Surfing the Tsunami of Data 28th International School for Young Astronomers Instituto Nacional de Astronomía, Óptica y Electrónica Tonantzintla, México Rodolfo H. Barbá Universidad de La Serena Chile

Motivation We are living an age of very fast changes in the way to do Astronomy Astronomy is one of the prime sciences of the human being Astronomy goals through the centuries: Registering and recording of heaven events Developing of methodologies to keep and track such events SHARING During the information and the knowledge 20th century: international organization (IAU) Astronomy is one of the most international organised science. Nobody is owner of the heaven. 2

Motivation Astronomy now: The technology (computers, communications, etc.) is changing the way to access to the information. Observational facilities based in astronomical satellites, automated survey telescopes, and 4 8 meters class telescopes are available everywhere. The next decade are planned amazing facilities. The information gathered by these facilities (and their derived products) is organised in huge databases... 3

Motivation Astronomy now: and also, the services of such databases is being connected through computer grids virtual observational astronomy is coming now The observations are there, in fact, we don't need telescopes to do high-quality observational astronomy beyond the computer, software and internet connection, to use these observations and their products we need only... 4

Motivation We need... IMAGINATION and IDEAS 5

6

7

Motivation For our countries with scarce resources: Opportunity to access to high quality material. We can do good observational astrophysics to relatively very low costs: free scientific software based on LINUX are available through Internet. Training young astronomer in the use of these observations as a experimental observatory to apply for observing time in international observatories (ground and space). Participating in the development of astronomical databases and grids. and more... 8

Goals to reach The goals to be reached in this 28th ISYA about the use of astronomical databases are: To understand how the different elements of an observing proposal (as astrophysical subjects) are related. To learn how the astronomical information is collected and organised on the Internet To get quick looks of several astronomical information systems (data centres, bibliographic severs, image servers, etc.) To learn which kind of information could be retrieved 9

Goals to reach To learn about the use of image and catalogue visualisation software To learn about some warnings in the use of catalogues and images Examples how to retrieve scientific observations from data servers Labs Ideas about how to access to these systems to do... The next future: basic concepts about astrophysical virtual observatories and datamining tools. 10

Bib. References The observing proposal References Science aims Dupl. Check Observing Proposal Antecedents Objects Image Servers Theor. Backg. Experimental Design Telescope Instrument Detector Processing & Analysis Methodology 11 Catalogues Nomenclature Coordinates Beam Others: Magnitudes Fluxes Ephemeris Proper motions

Data Centres They were the first institutions to systematically collect machine readable versions of astronomical catalogues. All Data Centres offer services (increasing continuously), and they are participating in the creation of virtual observatories. The access is free through Internet, using different technologies Some services offered: Images Catalogues Bibliographic resources Yellow pages 12

Data Centres There are two general purposes Data Centres: Resolved object populations in the MW and nearby galaxies: http://cdsweb.u-strasbg.fr Extragalactic database http://nedwww.ipac.caltech.edu 13

14

15

Data Centres The increasing number of space missions have led to the creation of mission oriented data centres like: Hubble Space Telescope: STScI http://www.stsci.edu and ST ECF http://ecf.hq.eso.org Infrared missions: IPAC http://www.ipac.caltech.edu High energy: NASA HEASARC http://heasarc.gsfc.nasa.gov, Harvard http://asc.harvard.edu/ and MPE http://wave.xray.mpe.mpg.de ISO, IUE: VILSPA http://www.vilspa.esa.es Multipurpose: CADC http://cadcwww.dao.nrc.ca and many others 16

Data Centres Also several major goundbased observatories have established data centres to manage their past observations: European Southern Observatory: http://archive.eso.org NRAO Very Large Array, http://archive.nrao.edu Royal Greenwich Observatory on La Palma http://archive.ast.cam.ac.uk Gemini, CFHT: CADC http://cadcwww.dao.nrc.ca Subaru (NAO JP): SMOKA Archive Facility http://smoka.nao.ac.jp NOAO (Cerro Tololo, Kitt Peak): http://archive.noao.edu Etc. etc. 17

Data Centres Many Sky Survey Projects are developed sophisticated Data Centres, and the list is growing incredibly fast: Two Micron All Sky Survey (2MASS): Sloan Digital Sky Survey (SDSS): Deep Near Infrared Survey of the Southern Sky (DENIS): Massive Compact Halo Objects (MACHO) http://wwwmacho.anu.edu.au OGLE, http://bulge.princeton.edu/~ogle/ ASAS, http://archive.princeton.edu/~asas/ Etc. etc., see http://www.cv.nrao.edu/fits/www/yp_survey.html 18

AstroWeb AstroWeb is a collection of astronomical & space science resources on Internet with relevant significance. It is maintained by the AstroWeb Consortium (distributed in several institution worldwide): CDS, http://cdsweb.u strasbg.fr/astroweb.html MSSSO, http://msowww.anu.edu.au/~anton/astroweb/astronomy.html NRAO, http://fits.cv.nrao.edu/www/astronomy.html STScI, http://www.stsci.edu/net resources.html VILSPA, http://www.vilspa.esa.es/astroweb/astronomy.html IoA Cambridge, http://www.ast.cam.ac.uk/astroweb/yp_astronomy.html AstroWeb looks like yellow pages and it is organised in specific items, actualised more or less periodically WARNING: it is uncompleted and some URL (links) could be out of date. 19

StarPages In CDS, André Heck (StarBriefs 2001, Dordretch: Kluwer Acad. Pub.) developed a series of astronomical services on Internet: the StarPages. They are part of Star*s Family resources on WWW), configuring the true astronomical pages. http://vizier.u strasbg.fr/starpages.html StarWorlds: astronomy related organisations, institutions, associations, companies, and so on: about 6500 entries from more than 100 countries StarHeads: personal WWW pages of professional astronomers and related scientists: 6000 entries StarBits: abbreviations, acronyms, contractions, symbols, and so on: about 200,000 entries 20

AstroWeb vs StarPages AstroWeb or StarPages, which is better? Depends what you are finding. AstroWeb is free, and StarPages is expensive AstroWeb is a compilation of about 3000 URLs, compared with 12000 offered by StarPages StarPages offers specific information which is authenticated, regurlarly updated, homogenised, and systematically presents AstroWeb is presented as a long list for visual inspection StarPages is very useful for searching engines (like Google) AstrroWeb includes information of projects that not adjust in StarPages StarWorlds contains data of sites and institutions without presence on Internet 21

Object databases Object databases gather both bibliographic references and meansurement quantities on galactic and extragalactic objects. There are many with increasing specialisation and complexity. Three are the prime ones: SIMBAD, http://simbad.u strasbg.fr NED, http://nedwww.ipac.caltech.edu LEDA, Lyon Meudon Extragalactic Database SIMBAD is specialised in galactic objects, while NED and LEDA are specialised in extragalactic ones. All three involve the concept of an astronomical object-name resolver, which accept and return identifiers; it also permits retrieval of all objects within specific radius around coordinates. The nomenclature of astronomical sources of radiation outside the solar system is regulated by the IAU Commission 5 Task Group on Designations 22

Astronomical catalogues It should be in mind that object databases generally do not include the full information contained in CDS/NED catalogues. We consider astronomical catalogues as static, final compilations of data for a given set of cosmic objects. But (as we ll see the next week) now are appearing dynamic catalogues According to Jascheck (1989) they can be classified 1) Observational catalogues 2) Compilation catalogues 3) Critical compilation catalogues and bibliographical compilation catalogues In category (1) now are included a new generation of catalogues derived from very specific surveys: 2MASS, HDF, MACHO, etc. 23

Astronomical catalogues CDS maintain the most complete set of astronomical catalogues in the Astronomer's Bazaar, cdsweb.u strasbg.fr/cats.html 6060 catalogues available from CDS...... of which 5150 available on-line (as full ASCII or FITS tables)...... of which 4815 are also available through de VizieR browser VizieR is a powerful tool to search and retrieve information from catalogues A query in VizieR can be achieved: either in the traditional way of stepping through the following actions: 1.select one or a few catalogues to be queried 2.define your constraints (selection on columns) and the result layout 3. Get the results in a tabular form. Correlated data may be found. 4.Full Display of individual rows if wished; This traditional way accepts lists of constraints or targets saved in a file. or as a global search around a position on the sky addressed to all or to a subset of catalogues existing in VizieR 24

25

26

27

28

Bibliographical services Astronomischer Jahresbericht was the first astronomical abstract service (1899-1968) Astronomy & Astrophysics Abstracts - AAA (1969-2000) Internet age: NASA's Astrophysics Data System http://adsabs.harvard.edu Abstract and Paper Service - ADS (1993) Mirrors world-wide Access using web browsers and shell commands ADS provides sophisticated search facilities Access to scanned and electronic papers Links to references, object databases and other resources Refcode or Bibcode: 19-characters reference code unique for each paper, e.g. 2002ApJ...578..464S myads: E-mail notification service configurable by the user (through cookies) Internet age: e-prrint Services ArXiv http://arxiv.org including astro-ph, the most important preprint server for Astrophysics (since 4/1992), in Cornell Univ. linked to ADS and fully referenced Service integrated to myads 29

30

31

32

33

34

35

36

Miscellaneous services NED hosts the LEVEL5 project. This is an on going and developing experimental service sponsored by NASA and the Carnegie Institution of Washington, in conjunction with NED The purpose of LEVEL5 is to bring together in a single gateway WEB site (where copyrights allow) "original" documents and reviews and/or electronic links to articles of current and lasting interest to cosmologists, particle physicists and extragalactic astronomers. 37

38

39

40

41

Acknowledgements I am grateful to the ISYA organizers for the opportunity to give this lectures and for their financial support. The material presented in this talk is based on information collected from CDS, ADS, NED Data Centres and The New York Times. This talk was prepared using Open Office 2.0 running in a LINUX SuSe 9.3 box.