Project PANOPTES: a citizen-scientist exoplanet transit survey using commercial digital cameras

Transcription

1 Project PANOPTES: a citizen-scientist exoplanet transit survey using commercial digital cameras Item Type Proceedings Authors Gee, Wilfred T.; Guyon, Olivier; Walawender, Josh; Jovanovic, Nemanja; Boucher, Luc Citation Wilfred T. Gee ; Olivier Guyon ; Josh Walawender ; Nemanja Jovanovic and Luc Boucher " Project PANOPTES: a citizenscientist exoplanet transit survey using commercial digital cameras ", Proc. SPIE 9908, Ground-based and Airborne Instrumentation for Astronomy VI, 99085V (August 9, 2016); doi: / ; DOI / Publisher SPIE-INT SOC OPTICAL ENGINEERING Journal GROUND-BASED AND AIRBORNE INSTRUMENTATION FOR ASTRONOMY VI Rights 2016 SPIE Download date 28/04/ :31:33 Link to Item

2 Project PANOPTES: a citizen-scientist exoplanet transit survey using commercial digital cameras Wilfred T Gee a,b,c, Olivier Guyon b,d,e, Josh Walawander b, Nemanja Jovanovic b,c, and Luc Boucher f a Department of Physics and Astronomy, University of Hawai i at Hilo, HI 96720, U.S.A. b National Astronomical Observatory of Japan, Subaru Telescope, 650 North A Ohoku Place, Hilo, HI, 96720, U.S.A. c Department of Physics and Astronomy, Macquarie University, NSW 2109, Australia d Steward Observatory, University of Arizona, Tucson, AZ, 85721, U.S.A. e College of Optical Sciences, University of Arizona, Tucson, AZ 85721, U.S.A. f Gemini Observatory, c/o AURA, Casilla 603, La Serena, Chile ABSTRACT Project PANOPTES ( is aimed at establishing a collaboration between professional astronomers, citizen scientists and schools to discover a large number of exoplanets with the transit technique. We have developed digital camera based imaging units to cover large parts of the sky and look for exoplanet transits. Each unit costs approximately $5000 USD and runs automatically every night. By using low-cost, commercial digital single-lens reflex (DSLR) cameras, we have developed a uniquely cost-efficient system for wide field astronomical imaging, offering approximately two orders of magnitude better etendue per unit of cost than professional wide-field surveys. Both science and outreach, our vision is to have thousands of these units built by schools and citizen scientists gathering data, making this project the most productive exoplanet discovery machine in the world. Keywords: exoplanet survey, transit method, DSLR cameras, citizen science, open source, time-domain astronomy, education and outreach 1. INTRODUCTION PANOPTES (Panoptic Astronomical Networked OPtical observatory for Transiting Exoplanets Survey) is an open-source, citizen-science project aimed at discovering transiting exoplanets using an automated network of small robotic telescopes. The goal of the project is to offer continuous global coverage of the night sky by having a large number of units built and deployed all across the globe. PANOPTES is unique in that it uses inexpensive digital single-lens reflex (DSLR) cameras, color photometry, and citizen scientists to accomplish its goals. PANOPTES engages the public in both data acquisition and analysis, giving them ownership of the data and the project. Project PANOPTES occupies a unique niche in the ongoing search for exoplanets. Previous missions, such as Kepler, have focused primarily on one region of the sky, taking deep images in order to discover transiting exoplanets around mostly distant stars, leading to limited opportunities for imaging follow up, as the majority of the targets are far away and dim. Current projects, such as the Hungarian-made Automated Telescopes (HAT), aim to fill this gap by targeting relatively bright and near stars, but continue to utilize purpose-built heavy-duty mounts and dome enclosures, expensive CCDs, and optimal site locations in order to ensure the success of the project, thus limiting the ability of the project to grow and adapt. 1 Future missions, such as TESS and PLATO, will fill some of these gaps, but still suffer from problems inherent in large-scale dedicated surveys, whether it is a sparser cadence or a smaller field of view, not to mention overall cost. 2, 3 At approximately $5000 USD per Further author information: (Send correspondence to W. Gee) W. Gee: wilfredtgee@gmail.com Ground-based and Airborne Instrumentation for Astronomy VI, edited by Christopher J. Evans, Luc Simard, Hideki Takami Proc. of SPIE Vol. 9908, 99085V 2016 SPIE CCC code: X/16/$18 doi: / Proc. of SPIE Vol V-1

3 unit, PANOPTES is more than 100 times more cost-effective (in dollars per square degree per collecting area) than large-scale projects such as LSST. 4 Project PANOPTES is attractive because it can complement these missions, doing so cheaply and with the involvement of citizen scientists. These proceedings aim to provide an overview of the motivations for the project, given in Sec. 3. Some background information is provided on exoplanets in Sec.2. A status update for the project is given in Sec. 4 along with updates to the baseline unit (see Fig.1) and project goals as described in Ref. 5. Figure 1. PANOPTES unit PAN001 deployed and operating at the Mauna Loa Observatory (MLO) August Exoplanets 2. BACKGROUND Exoplanet research has been a rapidly developing field since the confirmation of 51 Pegasi b in A hot-jupiter orbiting a solar-type star, this first exoplanet was discovered via the radial velocity technique by measuring the slight shift in the position of the host star caused by the orbit of the planet. The discovery of a large gas-giant within Astronomical Units (AU) of the host star led to a rethinking of planetary formation theories, which had been modeled primarily after Sol s planetary system. With the possibility of close-in Jupitermass planets came the realization that a percentage of these exoplanets might exist in a coplanar orbit with respect to the Earth and the host star, leading to a periodic occultation of the light. Confirmation came in 1999 with the discovery of HD using this new transit technique. 7 The transit method has since become extremely prolific, mostly due to the Kepler space mission, which discovered 2300 potential exoplanets within its first 16 months of operation. 8 As of this writing, the number of exoplanet candidates discovered by Kepler and the newly rebooted K2 mission is above 4500, 9 with over 2500 of these discovered via the transit method Transit Method The transit method is made possible by a reduction in the total amount of light arriving from the host star by a planet (or other object) passing in the line of sight between the observer on Earth and the host star. The transit method relies on the exoplanet orbit being coplanar to the Earth and the host star. Estimates for the probability of this occurring are given by p = (R + R p ), (1) a Proc. of SPIE Vol V-2

4 where the R parameters represent the radius of the host star and planet respectively, and a is the distance between the two. 10 These values range from 0.1% to 10% for planets within 5 AU of the host star, making the transit technique mostly suitable for planets that are both large and close to their source. 11 Ref. 11 discusses the transit method in detail, including the high occurrence of false-positives and their sources, as well as the observable quantities that are obtained via the transit method. These quantities, namely the period, depth, and duration of the transit, can be combined with results obtained via the radical velocity method (also discussed in Ref. 11) to effectively determine the planet s mass. Because the transit method relies on the probability of both geometric alignment of the host system with Earth and the temporal alignment of an observer with the transit start time, the most reliable way to observe transiting systems is to watch large portions of the sky as frequently as possible. In order to accomplish this, a number of automated surveys, including project PANOPTES, have been designed to attempt to capture these transits. Section provides details. 3. MOTIVATION The motivation for the PANOPTES project comes from a variety of technologies and opportunities that previously didn t exist for average consumers. At the core of the imaging units are commercially available digital cameras and the advances made in their abilities, discussed in Sec Just as important, however, is the advent of open source technologies, the internet, and, along with it, the rise of citizen science projects and their ability to contribute effectively to the scientific process, seen in Sec These social and technological advances effectively complement each other, providing an ideal solution to the breadth and depth requirements required by time-domain surveys and exoplanet detection research, described in Sec Technological Advances in consumer grade electronics within the previous decades has led to a proliferation of devices and computers available to the general public at a low cost. This can perhaps be best summarized by the Maker Community, which has seen its population change from well-funded amateur enthusiasts to anyone with a passionate interest in creating something, 12 an idea reflected in Sec While PANOPTES utilizes many smaller consumer electronics for successful operation (see Fig. 2), the project is actually made feasible by the availability of cheap professional-quality digital cameras and novel processing techniques designed to overcome their inherent scientific limitations Digital Single Lens Reflect (DSLR) Cameras Commercially available DSLR cameras are designed for human vision and are thus traditionally not utilized for scientific research. The presence of a Bayer array, a repeating four-pixel square pattern of red-green-green-blue pixels (see Fig. 3), makes traditional photometry difficult as the filters don t precisely align with the standard astronomical Johnson filters. 13 While work has been done to overcome these limitations with V-band 13 and then multiband 14 photometry, the scientific use of DSLRs has remained limited. Differing approaches using relative photometry, and therefore not relying on a precise conversion of filtered values to astronomical standards, have also been demonstrated. Notably, the use of relative photometry for the detection of exoplanets was effectively demonstrated by one of the current authors for use with PANOPTES, with further details provided by Ref. 4. Future work for the PANOPTES project, discussed in Sec. 5, will include the formalization of this algorithm. 3.2 Social While amateur astronomy has always enjoyed a certain level of popularity, the rise of rapid communication and the internet has allowed for a recent resurgence in amateurs taking part in the scientific process, both in traditional and novel ways. Specifically, the joint interaction of citizen science projects with large and open datasets has created a unique opportunity for the realization of more effective participation on the part of the public in a diverse set of fields, including astronomy. PANOPTES aims to utilize this motivated public by involving participants in not only the collection and analysis of the data, but in the actual construction of the data collection devices, the individual PANOPTES units. Proc. of SPIE Vol V-3

5 Figure 2. A sample of some of the small consumer-grade electronics used in a PANOPTES unit. Figure 3. A color filter array present on typical commercial cameras. Represented here is a blue-green-green-red pattern Citizen Science The involvement of interested citizen scientists across a variety of disciplines has been studied heavily in recent years, including the mechanics of organization, the types of tasks performed, 16, 19 the motivations and demographics of the participants, and the relative effectiveness and scientific value of such projects, including 16, 22 the distrust of publicly collected data among the scientific community. Reference 19 has looked specifically at the diverse types of citizen science involvement within astronomy and Proc. of SPIE Vol V-4

6 found that the best of the projects play to the strengths of the participants and also target areas of observation that professional observatories and automated software might miss. In particular, the researchers point out that a critical motivating feature of the citizens is the desire to make authentic contributions to the field. The authors therefore recommend projects provide opportunities for the citizens that cannot be accomplished by other means while simultaneously providing a low barrier to entry as well as a pathway to more advanced scientific work. By its very design, the PANOPTES project seeks to spread the total etendue of the survey over as wide of an area as possible. 4 Since etendue is the product of how much light a survey can gather by how much of the sky it sees at one time, the best way to accomplish this is to have a large number of small collecting devices in a diverse set of global locations. The building of these devices, while inexpensive and relatively non-technical, is nevertheless too time consuming and geographically dispersed to be handled by professional observatories and staff but provides a perfect opportunity to engage citizen scientists in a task that otherwise cannot be accomplished Open Source - Data and Software Equally important as a social motivator is the abundance and availability of open source data and software. With the rise of extremely large astronomical datasets, 23 the need for a large number of human classifiers naturally increased. The success of projects like GalaxyZoo and Zooniverse have been a testament to the need and utility 20, 24 of open data sets and citizen scientists. At the same time, processing techniques for working with the data have become more readily available, with groups like NumFOCUS ( advocating the need for easily reproducible research. Gains made in the programming language Python, with the community-drive Astropy 25 leading the way, have opened up more advanced processing to a larger audience. PANOPTES utilizes all open source technologies for control of the unit with future work including lessons plans provided to educators that focuses specifically on the use of Python and the open PANOPTES data. Currently the project receives support from Google in the form of Google Cloud Computing resources, enabling the project to expand almost limitlessly with regards to storage and computing. Both Google and PANOPTES remain committed to keeping the data open for the duration of the project. 3.3 Scientific As technology has increased so has the ability to capture, store, and analyze data. As more collecting facilities are available, more observations of targets can be made across time, allowing for comparisons of an object with itself at various times. This has led to the rise of two distinct subfields within astronomy known as astroinformatics 26 and time-domain astronomy. 27 The rise of both of these subfields has mostly been enabled by automatic surveys Automated Time-Domain Surveys Many types of astronomical observations, including the detection of exoplanets via the transit technique (see Sec ), rely on collecting large amounts of information as often as possible. Since the best way to accomplish this is to automate the collection, many automated time-domain surveys either exist or are currently planned. Large space-based missions such as Kepler (now K2), TESS, 2 and PLATO 3 will look specifically for exoplanets along with ground based projects like KELT, 11 and HAT. 1 Additionally, future work by LSST 28 and other ground surveys whose focus isn t on exoplanets will also necessarily capture transiting events that can be mined from the data. Other projects like the Evryscope 29 and the Fly s Eye 30 try to increase their etendue by dividing the collecting area into small segments similar to PANOPTES. However, both projects continue to utilize professional grade equipment and necessitate a skill-level, cost, and access not available to most amateurs. While both projects aim for geographic dispersal of many units, neither project aims to employ citizen scientists. Proc. of SPIE Vol V-5

7 4. PROJECT STATUS After the initial demonstrations of the feasibility of the project,4, 5 the focus turned toward creating a baseline unit that could easily be replicated by amateur groups with limited technical knowledge. Throughout 2014 and 2015 a baseline unit known as PAN001 was developed (see Fig. 4) and deployed near the summit of Mauna Loa in Hawai i while final hardware and electronic details were worked out. With the finalization of the hardware and software for the baseline unit, PANOPTES is now ready to begin full data operations with PAN001. The building of additional units is expected to begin in Fall 2016 with units coming online in early Figure 4. PANOPTES unit PAN001 operating at the Mauna Loa Observatory (MLO). 4.1 Hardware As of this writing all aspects of the hardware for a PANOPTES unit have been finalized with the exception of some remaining work to be done with the electronics. After running the baseline unit for a number of months the ability to monitor the power consumption of the individual components became obvious. Additionally, the ability to remotely power-cycle various aspects of the unit (the mount, individual cameras, operating computer, etc). also became evident. Current work to redo the electronic boards, while also making them safer for use by high-school students, is currently underway and expected to be completed by Fall Software The PANOPTES observatory control system (POCS - is in a complete and operating mode, with data being collected automatically every night. With the successful operation of the unit, the project focus is steadily moving toward the processing of acquired data even as more data continues to be made available. The archival solution was implemented in early September 2015 such that all data obtained from PAN001 is automatically archived into a Google Cloud Storage Bucket instance of unlimited capacity. From September 2015 to January 2016 over 400 GB of archival data (in CR2 format) were archived, representing almost 20,000 exposures across 74 nights of observational data. Analysis of data from this period as well as from the first half of 2016 will be forthcoming from the current author. Proc. of SPIE Vol V-6

8 5. CONCLUSION AND FUTURE WORK Project PANOPTES ( is aimed at becoming one of the most productive exoplanet discovery surveys available, all while engaging professional astronomers, citizen scientists and interested school groups. We have developed digital camera based imaging units to cover large parts of the sky and look for exoplanet transits. In this paper we have described the unique motivations that drive the project, including the advancements in technology, open source data and software, and citizen science in general. Both science and outreach, the vision of PANOPTES is to have thousands of units built and operated at locations all across the world, all while engaging the public in legitimate scientific discovery. Future work for the project will focus on the building of additional units and the expansion of the PANOPTES network, the refinement of various electrical components of the system, and the move toward demonstration and analysis of collected data. An exciting time for PANOPTES, the project is looking to expand globally with the help of professionals and amateurs alike. ACKNOWLEDGMENTS PANOPTES is funded in part by the John D. and Catherine T. MacArthur Foundation and Subaru Telescope. A special thanks to Jenny Tong at Google for the donation of cloud computing resources to the project. The author would also like to thank the NASA Hawai i Space Grant Consortium (HSGC) for providing the opportunity to work with Project PANOPTES. Special thanks to Dr. Ken Hon and Marcia Rei Sistoso at HSGC for all the support and organization. Thanks also to VYSOS and the Mauna Loa Observatory for continued use of the facilities. REFERENCES [1] Bakos, G., Noyes, R., Kovács, G., Stanek, K., Sasselov, D., and Domsa, I., WideField Millimagnitude Photometry with the HAT: A Tool for Extrasolar Planet Detection, Publications of the Astronomical Society of the Pacific 116, (3 2004). [2] Ricker, G. R., Winn, J. N., Vanderspek, R. K., Latham, D. W., Bakos, G. a., Bean, J. L., Berta-Thompson, Z. K., Brown, T. M., Buchhave, L., Butler, N. R., Butler, R. P., Chaplin, W. J., Charbonneau, D., Christensen-Dalsgaard, J., Clampin, M., Deming, D., Doty, J. P., De Lee, N., Dressing, C., Dunham, E. W., Endl, M., Fressin, F., Ge, J., Henning, T., Holman, M. J., Howard, A. W., Ida, S., Jenkins, J. M., Jernigan, G., Johnson, J. A., Kaltenegger, L., Kawai, N., Kjeldsen, H., Laughlin, G. P., Levine, A. M., Lin, D., Lissauer, J. J., MacQueen, P., Marcy, G., McCullough, P. R., Morton, T. D., Narita, N., Paegert, M., Palle, E., Pepe, F., Pepper, J., Quirrenbach, A., Rinehart, S. a., Sasselov, D. D., Sato, B., Seager, S., Sozzetti, A., Stassun, K. G., Sullivan, P., Szentgyorgyi, A., Torres, G., Udry, S., Villasenor, J. S., Vanderspek, R. K., Ennico, K. A., Bakos, G. a., Brown, T. M., Burgasser, A. J., Charbonneau, D., Clampin, M., Deming, L. D., Doty, J. P., Dunham, E. W., Elliot, J. L., Holman, M. J., Ida, S., Jenkins, J. M., Jernigan, J. G., Kawai, N., Laughlin, G. P., Lissauer, J. J., Martel, F., Sasselov, D. D., Schingler, R. H., Seager, S., Torres, G., Udry, S., Villasenor, J. S., Winn, J. N., and Worden, S. P., The Transiting Exoplanet Survey Satellite, American Astronomical Society Meeting Abstracts # (2014). [3] Rauer, H., Catala, C., Aerts, C., Appourchaux, T., Benz, W., Brandeker, A., Christensen-Dalsgaard, J., Deleuil, M., Gizon, L., Goupil, M. J., Güdel, M., Janot-Pacheco, E., Mas-Hesse, M., Pagano, I., Piotto, G., Pollacco, D., Santos, N. C., Smith, A., C., J., Suárez, Szabó, R., Udry, S., Adibekyan, V., Alibert, Y., Almenara, J. M., Amaro-Seoane, P., Eiff, M. A.-v., Asplund, M., Antonello, E., Ball, W., Barnes, S., Baudin, F., Belkacem, K., Bergemann, M., Bihain, G., Birch, a. C., Bonfils, X., Boisse, I., Bonomo, a. S., Borsa, F., Brandão, I. M., Brocato, E., Brun, S., Burleigh, M., Burston, R., Cabrera, J., Cassisi, S., Chaplin, W., Charpinet, S., Chiappini, C., Church, R. P., Csizmadia, S., Cunha, M., Damasso, M., Davies, M. B., Deeg, H. J., DÍaz, R. F., Dreizler, S., Dreyer, C., Eggenberger, P., Ehrenreich, D., Eigmüller, P., Erikson, A., Farmer, R., Feltzing, S., Fialho, F. D. O., Figueira, P., Forveille, T., Fridlund, M., García, R. a., Giommi, P., Giuffrida, G., Godolt, M., da Silva, J. G., Granzer, T., Grenfell, J. L., Grotsch-Noels, A., Günther, E., Haswell, C. a., Hatzes, a. P., Hébrard, G., Hekker, S., Helled, R., Heng, K., Jenkins, J. M., Johansen, A., Khodachenko, M. L., Kislyakova, K. G., Kley, W., Kolb, U., Krivova, N., Kupka, F., Lammer, Proc. of SPIE Vol V-7

9 H., Lanza, a. F., Lebreton, Y., Magrin, D., Marcos-Arenal, P., Marrese, P. M., Marques, J. P., Martins, J., Mathis, S., Mathur, S., Messina, S., Miglio, A., Montalban, J., Montalto, M., Monteiro, M. J. P. F. G., Moradi, H., Moravveji, E., Mordasini, C., Morel, T., Mortier, A., Nascimbeni, V., Nelson, R. P., Nielsen, M. B., Noack, L., Norton, a. J., Ofir, A., Oshagh, M., Ouazzani, R. M., Pápics, P., Parro, V. C., Petit, P., Plez, B., Poretti, E., Quirrenbach, A., Ragazzoni, R., Raimondo, G., Rainer, M., Reese, D. R., Redmer, R., Reffert, S., Rojas-Ayala, B., Roxburgh, I. W., Salmon, S., Santerne, A., Schneider, J., Schou, J., Schuh, S., Schunker, H., Silva-Valio, A., Silvotti, R., Skillen, I., Snellen, I., Sohl, F., Sousa, S. G., Sozzetti, A., Stello, D., Strassmeier, K. G., Švanda, M., Szabó, G. M., Tkachenko, A., Valencia, D., van Grootel, V., Vauclair, S. D., Ventura, P., Wagner, F. W., Walton, N. a., Weingrill, J., Werner, S. C., Wheatley, P. J., and Zwintz, K., [The PLATO 2.0 Mission], no. December, ESA/SRE(2013)5. (2013). [4] Guyon, O. and Martinache, F., Achieving high-precision ground-based photometry for transiting exoplanets, Proceedings of the SPIE 8151, 81511C (9 2011). [5] Guyon, O., Walawender, J., Jovanovic, N., Butterfield, M., Gee, W. T., and Mery, R., The PANOPTES project: discovering exoplanets with low-cost digital cameras, Proceedings of the SPIE 9145, 91453V (7 2014). [6] Mayor, M. and Queloz, D., A Jupiter-mass companion to a solar-type star, Nature 378, ( ). [7] Charbonneau, D., Brown, T. M., Latham, D. W., and Mayor, M., Detection of Planetary Transits Across a Sun-like Star, The Astrophysical Journal 529, L45 L48 (1 2000). [8] Batalha, N. M., Rowe, J. F., Bryson, S. T., Barclay, T., Burke, C. J., Caldwell, D. A., Christiansen, J. L., Mullally, F., Thompson, S. E., Brown, T. M., Dupree, A. K., Fabrycky, D. C., Ford, E. B., Fortney, J. J., Gilliland, R. L., Isaacson, H., Latham, D. W., Marcy, G. W., Quinn, S. N., Ragozzine, D., Shporer, A., Borucki, W. J., Ciardi, D. R., Gautier, T. N., Haas, M. R., Jenkins, J. M., Koch, D. G., Lissauer, J. J., Rapin, W., Basri, G. S., Boss, A. P., Buchhave, L. A., Carter, J. A., Charbonneau, D., Christensen-Dalsgaard, J., Clarke, B. D., Cochran, W. D., Demory, B.-O., Desert, J.-M., Devore, E., Doyle, L. R., Esquerdo, G. A., Everett, M., Fressin, F., Geary, J. C., Girouard, F. R., Gould, A., Hall, J. R., Holman, M. J., Howard, A. W., Howell, S. B., Ibrahim, K. A., Kinemuchi, K., Kjeldsen, H., Klaus, T. C., Li, J., Lucas, P. W., Meibom, S., Morris, R. L., Prša, A., Quintana, E., Sanderfer, D. T., Sasselov, D., Seader, S. E., Smith, J. C., Steffen, J. H., Still, M., Stumpe, M. C., Tarter, J. C., Tenenbaum, P., Torres, G., Twicken, J. D., Uddin, K., Van Cleve, J., Walkowicz, L., and Welsh, W. F., PLANETARY CANDIDATES OBSERVED BY i KEPLER /i. III. ANALYSIS OF THE FIRST 16 MONTHS OF DATA, The Astrophysical Journal Supplement Series 204, 24 (2 2013). [9] NASA Strategic Plan, tech. rep., National Aeronautics and Space Administration (2014). [10] Borucki, W. J. and Summers, A. L., The photometric method of detecting other planetary systems, Icarus 58, (4 1984). [11] Kuhn, R. B., Photometric techniques for Exoplanet detection: The construction and deployment of the KELT-South telescope, PhD thesis, University of Cape Town (2014). [12] Dougherty, D., The Maker Movement, Innovations: Technology, Governance, Globalization 7, (7 2012). [13] Kloppenborg, B. B. K., Pieri, R., Eggenstein, H.-B. B., Maravellias, G., Pearson, T., and Maravelias, G., A Demonstration of Accurate Wide-field V-band Photometry Using a Consumer-grade DSLR Camera, arxiv preprint arxiv:... 40, (3 2013). [14] Zhang, M., Bakos, G.., Penev, K., Csubry, Z., Hartman, J. D., Bhatti, W., and Val-Borro, M. d., Precision Multiband Photometry with a DSLR Camera, Publications of the Astronomical Society of the Pacific 128, (3 2016). [15] Franzoni, C. and Sauermann, H., Crowd science: The organization of scientific research in open collaborative projects, Research Policy 43(1), 1 20 (2014). [16] Catlin-Groves, C. L., The citizen science landscape: From volunteers to citizen sensors and beyond, International Journal of Zoology (2012). [17] Newman, G., Graham, J., Crall, A., and Laituri, M., The art and science of multi-scale citizen science support, (2011). Proc. of SPIE Vol V-8

10 [18] Wiggins, A. and Crowston, K., Goals and tasks: Two typologies of citizen science projects, in [Proceedings of the Annual Hawaii International Conference on System Sciences], (2011). [19] Marshall, P. J., Lintott, C. J., and Fletcher, L. N., Ideas for Citizen Science in Astronomy, Annual Review of Astronomy and Astrophysics 53, (9 2015). [20] Jordan Raddick, M., Bracey, G., Gay, P. L., Lintott, C. J., Cardamone, C., Murray, P., Schawinski, K., Szalay, A. S., and Vandenberg, J., Galaxy zoo: Motivations of citizen scientists, Astronomy Education Review 12(1) (2013). [21] Tulloch, A. I., Possingham, H. P., Joseph, L. N., Szabo, J., and Martin, T. G., Realising the full potential of citizen science monitoring programs, Biological Conservation 165, (2013). [22] Szabo, J. K., Fuller, R. a., and Possingham, H. P., A comparison of estimates of relative abundance from a weakly structured mass-participation bird atlas survey and a robustly designed monitoring scheme, Ibis 154, (2012). [23] Ball, N. M. and Brunner, R. J., Data Mining and Machine Learning in Astronomy, International Journal of Modern Physics 19, 61 (7 2009). [24] Fortson, L., Masters, K., Nichol, R., Borne, K., Edmondson, E., Lintott, C., Raddick, J., Schawinski, K., and Wallin, J., Galaxy Zoo: Morphological Classification and Citizen Science, 11 (4 2011). [25] Robitaille, T. P., Tollerud, E. J., Greenfield, P., Droettboom, M., Bray, E., Aldcroft, T., Davis, M., Ginsburg, A., Price-Whelan, A. M., Kerzendorf, W. E., Conley, A., Crighton, N., Barbary, K., Muna, D., Ferguson, H., Grollier, F., Parikh, M. M., Nair, P. H., Günther, H. M., Deil, C., Woillez, J., Conseil, S., Kramer, R., Turner, J. E. H., Singer, L., Fox, R., Weaver, B. A., Zabalza, V., Edwards, Z. I., Azalee Bostroem, K., Burke, D. J., Casey, A. R., Crawford, S. M., Dencheva, N., Ely, J., Jenness, T., Labrie, K., Lim, P. L., Pierfederici, F., Pontzen, A., Ptak, A., Refsdal, B., Servillat, M., and Streicher, O., Astropy: A community Python package for astronomy, Astronomy & Astrophysics 558, A33 (9 2013). [26] Borne, K., Scientific Data Mining in Astronomy, Next Generation of Data Mining, 26 ( ). [27] Graham, M. J., Djorgovski, S. G., Mahabal, A. A., Donalek, C., and Drake, A. J., Machine-assisted discovery of relationships in astronomy, Monthly Notices of the Royal Astronomical Society 431, (3 2013). [28] Ivezic, Z., Monet, D. G., Claver, C. F., Axelrod, T. S., Gizis, J., and Lupton, R., LSST Astrometry: Simulations and Numerical Studies, American Astronomical Society, AAS Meeting #221, # ( ). [29] Law, N. M., Fors, O., Ratzloff, J., Wulfken, P., Kavanaugh, D., Sitar, D. J., Pruett, Z., Birchart, M., Barlow, B., Cannon, K., Cenko, S. B., Dunlap, B., Kraus, A., and Maccarone, T. J., Evryscope science: exploring the potential of all-sky gigapixel-scale telescopes, (2015). [30] Pál, A., Mészáros, L., Csépány, G., Jaskó, A., Schlaffer, F., Vida, K., Mező, G., Döbrentei, L., Farkas, E., Kiss, C., Oláh, K., Regály, Z., Mezo, G., Döbrentei, L., Farkas, E., Kiss, C., Oláh, K., and Regály, Z., The Fly s Eye Camera System: An instrument design for large étendue time-domain survey, Astronomische Nachrichten 334, ( ). Proc. of SPIE Vol V-9