Citation for published version (APA): Andogah, G. (2010). Geographically constrained information retrieval Groningen: s.n.

Transcription

1 University of Groningen Geographically constrained information retrieval Andogah, Geoffrey IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document version below. Document Version Publisher's PDF, also known as Version of record Publication date: 2010 Link to publication in University of Groningen/UMCG research database Citation for published version (APA): Andogah, G. (2010). Geographically constrained information retrieval Groningen: s.n. Copyright Other than for strictly personal use, it is not permitted to download or to forward/distribute the text or part of it without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license (like Creative Commons). Take-down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Downloaded from the University of Groningen/UMCG research database (Pure): For technical reasons the number of authors shown on this cover page is limited to 10 maximum. Download date:

2 Geographically Constrained Information Retrieval Geoffrey Andogah

3 ii CLCG Center for Language and Cognition Groningen The work in this thesis has been carried out under the auspices of the Center for Language and Cognition Groningen (CLCG) with funding from Nuffic Project NPT/UGA/132 on Building Sustainable ICT Training Capacity in the Public Universities in Uganda. Groningen Dissertations in Linguistics 79 ISSN Geoffrey Andogah ISBN Cover design by: Peter Kleiweg Printed by Wöhrmann Print Service, Zutphen, Netherlands. Document prepared with L A TEX2ε using Stasinos Konstantopoulos RuGthesis.cls.

4 Rijksuniversiteit Groningen Geographically Constrained Information Retrieval Proefschrift ter verkrijging van het doctoraat in de Wiskunde en Natuurwetenschappen aan de Rijksuniversiteit Groningen op gezag van de Rector Magnificus, dr. F. Zwarts, in het openbaar te verdedigen op vrijdag 21 mei 2010 om 14:45 uur door Geoffrey Andogah geboren op 7 december 1968 te Kampala, Uganda

5 Promotor: Copromotor: Prof. dr. ir. J. Nerbonne Dr. G. Bouma Beoordelingscommissie: Prof. dr. V. Baryamureeba Prof. dr. F. de Jong Prof. dr. H. Sol

6 To God the Father, God the Son and God the Holy Spirit. v

7 vi

8 Preface I am honoured to thank all the people who directly or indirectly contributed to the realization of this thesis. Indeed I will not remember everyone of you who helped me in one-way or another to achieve what I have reported in this thesis. The one thing that I can promise you is that God Almighty, the Father of our Lord Jesus Christ knows you, and remembers your contribution toward this thesis, and will indeed reward you abundantly. This thesis would not have been possible without the encouragement, leadership and support of my promoter Prof. dr. ir. John Nerbonne, and co-promoter and supervisor Dr. Gosse Bouma. Thank you Prof. John and Dr. Gosse for your patience to ensure that this thesis is completed. John, I vividly remember the day you introduced me to Dutch soup, I will continue to enjoy it. I am indebted to fellow PhD students at CLCG for the support and encouragement Lonneke van der Plas, Jori Mur, Ismael Fahmi and Jacky Benavides. I am also grateful to Wyke van der Meer for taking care of all the practical stuff at CLCG. I want to say thank you to every member of staff of CLCG for your cooperation Dr. Gertjan van Noord, Dr. Elwin Koster, Dr. Leonie Bosveld-de Smet, Drs. Peter Kleiweg. It is a pleasure to thank the people at the International Bureau for taking care of all the practical issues during my stay at Groningen Erik Haarbrink, Gonny Lakerveld and Marieke Farchi. I am deeply grateful to the members of the reading committee for their critical and positive comments Prof. dr. Venansius Baryamureeba, Prof. dr. Franciska de Jong and Prof. dr. Henk Sol. I am solely responsible for any error still lingering in this dissertation. I thank my paranymphs Jelena Prokic and Peter Nabende for accepting to stand by me. I am especially indebted to Jelena Prokic for making sure that all the paper work is completed for my defence. I am indebted to Prof. dr. J.H. Nyeko Pen-Mogi, the Vice Chancellor of Gulu University for swaying me to pursue PhD studies way back in Thank you forsowing theseed ofdetermination andcouragein meto venture vii

9 viii into unknown territories. I am grateful to Prof. dr. Venansius Baryamureeba for making available space to conduct my research at the Faculty of Computing and Informatics (FCI), Makerere University. I indeed enjoyed the company of FCI staff, not forgetting the wonderful meals at FCI. I enjoyed the company of fellow PhD/Masters students at Groningen sponsored under NPT Project NPT/UGA/132 on Building a Sustainable ICT Training Capacity in four (4) Public Universities in Uganda Florence Tushabe, Julianne Sansa Otim and Proscovia Olango. I also acknowledge the contribution of CLEF to this work by providing dataset and forum to evaluate our GIR system. MysinceregratitudegoestothepastoralteamandmembersoftheRCCG Embassy of God Groningen. Thank you for spiritual guidance and comfort you accorded me at Church. My deepest thanks and love goes to my dear wife Annastazia Nicodemus Chengulla for being supportive over the years. Your prayers, kindness and love kept me going in times when things are at standstill. I am also indebted to my children Glory Rong Babua, Samuel Godwill Babua and Victoria Peace Babua for those questions I could not respond to knowing that I will be away for awhile Dad are you coming back? My gratitude also goes to my parents Stephen Babua and Margaret Nguju; uncle Michael E. Nguma, brothers Edemah Fredrick and Alile Roland; and sisters Adiru Lydia and Robinah Angucia.

10 Contents 1 The thesis Geographical information retrieval Research Problem statement Research objective Research justification Contribution Overview State-of-the-art in GIR Toponym resolution Default sense heuristics Pattern matching and hierarchy overlap One referent per discourse Summary Scope resolution Country scope A graph ranking algorithm Taxonomy hierarchy Geographical distribution Summary Query Expansion Knowledge-based expansion Relevance feedback expansion Document geographic term expansion Summary Relevance ranking Euclidean distance Extent of overlap Containment relations Query footprint as filter ix

11 x CONTENTS Geographic scope indexing Other criteria Summary Conclusion Data and tools Geographical database Geonames.org database Other GeoDBs Corpus TR-CLEF TR-RNW Other collections Tools Alias-i Lingpipe OpenNLP tools WordFreak GATE ANNIE Apache UIMA Conclusion Scope resolution Resolution with place names Approach Reference scope Implementation Resolution with person names Person name ambiguity resolution Approach Implementation Evaluation metric Evaluation Evaluating place name based strategy Evaluating person name based strategy Conclusion Toponym resolution Toponym resolution procedure Evaluation metric Evaluation The big picture

12 CONTENTS xi 5.5 Conclusion Query expansion Document processing Query expansion Top term-based expansion Scope constrained expansion Query expansion evaluation Conclusion Relevance ranking Non-geographic relevance measure Scope-based relevance measure Type-based relevance measure Relevance measure unification Linear interpolated combination Weighted harmonic mean combination Extended harmonic mean combination Evaluation Harmonic mean vs. linear interpolated combination Extended harmonic mean combination Conclusion Conclusion Achievements Scope resolution Toponym resolution Query expansion Relevance ranking Evaluation data Reflection Future work Scope resolution Toponym resolution Query expansion Relevance ranking Evaluation data Final remark

13 xii CONTENTS A Sample stories 159 A.1 News story about Mexico A.2 News story about Thailand A.3 News story about Lake Victoria B GeoCLEF topics 163 B.1 GeoCLEF 2005 English topic titles B.2 GeoCLEF 2006 English topic titles B.3 GeoCLEF 2007 English topic titles Bibliography 167 Summary 177 Samenvatting 181

14 List of Figures 1.1 Common GIR processing procedure Schematic of the research objectives Example taxonomy of places Schematic of the Geonames.org feature code hierarchy Potential ambiguity in GeoCLEF 2006 relevant documents Map showing the result of toponym resolution Sample of a GeoCLEF document Sample of RNW story Example output of Alias-i s LingPipe NLP tool Geographic terms in articles appendix A.1, A.2 and A Geographical scopes of article A.1 (top) and A.2 (bottom) Scope of plane crash in Lake Victoria in March Data model for geographical scope modeling Sample data model for scope of the Netherlands Directional sub-division of the Netherlands Example U.S.A & Canada GeoVIP grouping News story featuring Hillary Clinton and Stockwell Day place name based scope resolution performance Sample pseudo documents VIP based resolution performance on pseudo document Toponym resolution schematic Toponym resolution algorithm Nearness to correct location Example hierarchy structure Sample Geonames.org feature code hierarchy Mahali system architecture Radio Netherlands Worldwide (RNW) summary Schematic of scope constrained relevance feedback procedure xiii

15 xiv LIST OF FIGURES 6.3 Sample scope hierarchy for Groningen and Rotterdam GeoCLEF 2007 topic and pre-processed format Interpolated recall vs precision average Performance of term-based query expansion procedure Performance of scope-based query expansion procedure Topic performance on residual collection Sample Geonames.org feature code hierarchy Sample documents with geographic feature classes and types Variation of MAP as a factor of NIF λ T Variation of MAP as a factor of RIF β Variation of MAP as a function of RIF β GeoCLEF 2007 per topic performance

16 List of Tables 1.1 Sample keywords with geographical interest of Groningen Toponym resolution techniques in literature Scope resolution techniques in literature Geonames.org feature classification Geonames.org feature statistics per classification Example Geonames.org feature code Example Geonames.org database structure (as used in here) English monolingual GeoCLEF relevant document counts GeoCLEF 2006 topic GeoCLEF 2006 relevant document characteristic Fifteen most frequent and least frequent toponyms Inter-annotator agreement Inter-annotator agreement per feature types TR-RNW corpus characteristic TR-RNW fifteen most frequent and least frequent toponyms TR-CoNLL & TR-MUC4 corpus characteristic Named entity types defined in Chinchor (1997) Zone index for the sample Netherlands scope data in Fig Statistics of standard geographic scope Example Lucene index for scope Europe Example Lucene index for scope the Netherlands Reference scope data layout in Lucene index Place type and population weights Place and people adjective occurrence on the Internet Example query formulation for per field querying Example administrative division vs. position Top ten surnames and first names in Wikipedia Example GeoVIP data for U.S.A Example GeoVIP sample data for Canada xv

17 xvi LIST OF TABLES 4.13 Person name weight computation for VIPs in Fig Example scope resolution using VIP names in Fig Example country scope Lucene index data source Example district scope Lucene index data source Fictitious sample data to illustrate metric performance CoNLL 2003 place name statistics Scope resolution result using Eq and Eq Results of PageRank and HITS on Reuters Performance of VIP based approach on news articles Characteristics of TR-CoNLL, TR-CLEF & TR-RNW Toponym resolution results on TR-CoNLL Toponym resolution results on TR-RNW and TR-CLEF Query place name expansion illustration with Eq Summary of term based relevance feedback evaluation Result of term-based approach using relevant documents Summary of scope-based relevance feedback evaluation Summary of feedback evaluation on residual collection Example topic grouping and query formulation Comparison to GeoCLEF 2007 participants