The GapVis project and automated textual geoparsing

Transcription

1 The GapVis project and automated textual geoparsing Google Ancient Places team, Edinburgh Language Technology Group GeoBib Conference, Giessen, 4th-5th May

2 1 Google Ancient Places and GapVis The GAP year How GapVis Works Evaluation 2 Language Technology Group Recent georeferencing projects Problems, issues, lessons learned 2

3 1 Google Ancient Places and GapVis The GAP year How GapVis Works Evaluation 2 Language Technology Group Recent georeferencing projects Problems, issues, lessons learned 3

4 The GAP year Google Ancient Places Google Digital Humanities award, Cross-disciplinary and multi-national team humanities, classics, archaeology, natural language processing, graphical interface England, Scotland, California Produced the GapVis utility for reading Classics 4

5 GapVis nrabinowitz.github.com/gapvis/ 5

6 Pleiades gazetteer of the Classical World 6

7 Pleiades+ etc 7

8 Pleiades+ etc Alignment with Geonames (Pleiades+) More precise lat/long locations. Support for multiple names (incl. modern) for same place, eg Halicarnassus Bodrum. 7

9 Pleiades+ etc Alignment with Geonames (Pleiades+) More precise lat/long locations. Support for multiple names (incl. modern) for same place, eg Halicarnassus Bodrum. At run time (Pleiades++) Modern names often used in translations, eg Egypt not in Pleiades. Find alternative names for Egypt in Geonames, eg Aegyptus; search for these in Pleiades. 7

10 Pleiades+ etc Alignment with Geonames (Pleiades+) More precise lat/long locations. Support for multiple names (incl. modern) for same place, eg Halicarnassus Bodrum. At run time (Pleiades++) Modern names often used in translations, eg Egypt not in Pleiades. Find alternative names for Egypt in Geonames, eg Aegyptus; search for these in Pleiades. Pleiades team s plans Seeking funding from NEH to build robust API, with daily download option cf Geonames. 7

11 Geoparsing engine Automatic detection of placenames in free text (English). 8

12 Geoparsing engine Automatic detection of placenames in free text (English). Online RESTful API: Stand-alone toolkit from LTG coming soon 8

13 Step 1: Geotagging Named Entity Recognition location mentions Also finds person, date/time expressions, organisation Rule-based, uses syntactic and semantic clues in context 9

14 Step 2: Georesolution Ground location mentions against one or more gazetteers Prefer populated places Prefer locations closer to others mentioned in document. 10

15 Step 2: Georesolution Ground location mentions against one or more gazetteers Prefer populated places Prefer locations closer to others mentioned in document. Document is about USA. Prefer Paris,Texas to Paris,France. 10

16 Putting it all together: How GapVis Works classical texts from Google Books 11

17 Putting it all together: How GapVis Works classical texts from Google Books Edinburgh Geoparser 11

18 Putting it all together: How GapVis Works classical texts from Google Books Pleiades gazetteer of ancient places Edinburgh Geoparser 11

19 Putting it all together: How GapVis Works classical texts from Google Books Pleiades gazetteer of ancient places Edinburgh Geoparser database of toponym URIs tied back to text snippets 11

20 Putting it all together: How GapVis Works classical texts from Google Books Pleiades gazetteer of ancient places Edinburgh Geoparser database of toponym URIs tied back to text snippets finding relationships between places 11

21 Putting it all together: How GapVis Works classical texts from Google Books Pleiades gazetteer of ancient places Edinburgh Geoparser putting it all together GapVis database of toponym URIs tied back to text snippets finding relationships between places 11

22 GapVis is still evolving Forks and Re-use GAP2 the Geographic Annotation Platform Hestia2: Used in undergraduate teaching Includes Greek original Related projects: Pelagios, Perseus, Perseids Journey of the Hero people network as well as places hand-annotated by students in coursework 12

23 Perseids Journey of the Hero 13

24 Evaluation We like it, but is it good? Traditional NLP evaluation against Gold Standard Qualitative evaluation use in coursework 14

25 Using a hand-annotated Gold Standard Geotagging Precision: were tokens we tagged actually places? Recall: how many did we miss? F-score: harmonic mean of P and R Georesolution: placenames correctly located? Varies considerably across domains 15

26 Using a hand-annotated Gold Standard Geotagging Precision: were tokens we tagged actually places? Recall: how many did we miss? F-score: harmonic mean of P and R Georesolution: placenames correctly located? Varies considerably across domains Geotagging: F-score; Georesolution: 69-92% Richard Tobin, Claire Grover, Kate Byrne, James Reid and Jo Walsh. (2010) Evaluation of georeferencing. In Proceedings of the 6th Workshop on Geographic Information Retrieval (GIR10), Zurich, Switzerland, Feb

27 Evaluation in Coursework GapVis used in 2 undergraduate Classics courses. hestia.open.ac.uk/reading-herodotus-spatially-in-the-undergraduate-classroom-part-i hestia.open.ac.uk/reading-herodotus-spatially-in-the-undergraduate-classroom-part-ii hestia.open.ac.uk/reading-herodotus-spatially-in-the-undergraduate-classroom-part-iii Visualisations of time and space help You can ask different questions Digital doesn t necessarily mean easier Adam Rabinowitz, University of Texas, Austin 16

28 1 Google Ancient Places and GapVis The GAP year How GapVis Works Evaluation 2 Language Technology Group Recent georeferencing projects Problems, issues, lessons learned 17

29 Recent LTG georeferencing projects DEEP: Digital Exposure of English Placenames Trading Consequences: 19th Century commodity trading Palimpsest: an Edinburgh literature landscape 18

30 Recent LTG georeferencing projects DEEP: Digital Exposure of English Placenames Trading Consequences: 19th Century commodity trading Palimpsest: an Edinburgh literature landscape Natural Language Processing over historical and cultural documents, with Humanities partners 18

31 Palimpsest Edinburgh-related fiction from British Library, Hathi Trust, Project Gutenberg, NLS, etc 550 books Created a fine-grained gazetteer of Edinburgh Visualise geo-located snippets of text 19

32 Palimpsest online interface: LitLong 20

33 Problems, issues, lessons learned New domains, new problems newswire, classics, fiction... OCR issues!! TEI does not enforce well-formed XML No standard document structure Only as good as the gazetteer Distinguishing Places from People Paris, Priam, [Earl of] Montrose,... 21

34 OCR issues Around the World in Eighty Days 22

35 Assisted Curation Edinburgh Geo-annotator 23

36 24

37 25

38 26

39 Conclusions Visualisations of space and time give new perspectives 27

40 Conclusions Visualisations of space and time give new perspectives Tailoring for each new domain is required 27

41 Conclusions Visualisations of space and time give new perspectives Tailoring for each new domain is required Automated NLP is fast, but not perfect 27

42 Conclusions Visualisations of space and time give new perspectives Tailoring for each new domain is required Automated NLP is fast, but not perfect Quality of copyright-free material often poor 27

43 Conclusions Visualisations of space and time give new perspectives Tailoring for each new domain is required Automated NLP is fast, but not perfect Quality of copyright-free material often poor Often need specialist gazetteers 27

44 Conclusions Visualisations of space and time give new perspectives Tailoring for each new domain is required Automated NLP is fast, but not perfect Quality of copyright-free material often poor Often need specialist gazetteers Collaboration between different disciplines essential 27

45 28