Modeling User s Cognitive Dynamics in Information Access and Retrieval using Quantum Probability (ESR-6) SAGAR UPRETY THE OPEN UNIVERSITY, UK QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018
Self-Introduction Age: 27 Years Nationality: Indian Languages Spoken: Hindi, English Research Interests: Artificial Intelligence, Quantum Theory Foundations, User Behaviour Other interests: Cricket, Ancient History, Indian Philosophy QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 1
Background Higher Education Masters of Science (MSc.) in Physics, BITS Pilani, India Thesis: Quantum Information and Communication Bachelor of Engineering (B.E) in Computer Science and Engineering, BITS Pilani, India Work Experience Software Engineer Machine Intelligence, Justdial, Bengaluru, India (2016-2017) Key Task: Using Neural Networks to classify queries in a voice search engine. Software Development Engineer, Stayzilla, Bengaluru, India (2015-2016) Key Task: Using Elasticsearch to do retrieval and ranking for vertical search. QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 2
Training Experiences within the Network QUARTZ Project QUARTZ Winter School and Workshop 1, 07/02/2018 14/02/2018, Padua, Italy. QUARTZ ESR Summer School, 20/06/2018 21/06/2018, Luton, UK QUARTZ ESR Autumn Workshop, 24/09/2018 26/09/2018, Cottbus, Germany The Open University, UK Meetings of Postgraduate Research Forum. NLP Reading Group meetings including a presentation given. Passed PhD Probation at The Open University (August 2018). Submitted Probation Report (Mini- Thesis) and defended it in a Viva taken by internal examiners Participated Conferences ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) 2018, USA International Joint Conference in Artificial Intelligence (IJCAI) 2018, Sweden Association for Computational Linguistics (ACL) 2018, Australia Quantum Interactions (QI) 2018, France ACM International Conference on the Theory of Information Retrieval (ICTIR) 2018, China QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 3
Main objectives of the Project(1/2) Investigate advantages of Quantum (non-classical) probabilities (via interference) in different aspects of user judgements in IR. Quantum probabilities arising out of cognitive uncertainty in multidimensional relevance judgment. Quantum probabilities arising out of interference of different incompatible decision perspectives in session search interactions. Investigate and detect Quantum-like properties in IR. Is user behaviour in IR Quantum-like? Mathematically and empirically establish Quantum-nature of IR QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 4
Main objectives of the Project(2/2) Investigate advantages of Quantum probabilities (via interference) in different aspects of user judgements in IR. Investigate and detect Quantum-like properties in IR. Develop Quantum Cognitive models of dynamic user judgments in IR. User models incorporating Quantum probabilities, superposition, complex numbers, etc. Using Order Effects, Contextual relevance judgments, etc. to improve ranking of documents. QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 5
Methodologies Used Capturing multidimensional relevance in a Hilbert Space Mining query log data to construct a Hilbert Space of user s cognitive state of documents in multiple dimensions. Vectors. / = & 1 *+,%-&$ + ' 1 ) *+,%-&$ "#$%&'$# *+,%-&$ 0.8. / = & 2 "#$%&'$# + ' 2 ) "#$%&'$# "#$%&'$# ) 0.3 *+,%-&$ ) Using machine learning techniques to learn the values of the coefficients & 4, ' 4 QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 6
Methodologies Used Investigating Order Effects Investigating query log data for Order Effects in relevance judgements Proposing a Quantum Cognitive explanation of such effects in IR Reliability Topicality! # Document! "! # Topicality Reliability! " QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 7
Methodologies Used Investigating Contextuality Using Bell-type inequalities to test for Quantum-ness in data:! " # " $ +! " # & $ +! " $ & #! " $ & $ 2 where " *, &, are relevance of documents i and j with respect to Reliability and Topicality respectively. Using the Contextuality-by-Default Theory 1 to test for contextuality in IR Designing crowdsourcing user studies to collect user judgment data with potential quantum statistics. Using probabilistic programming to simulate contextual judgment behaviour in IR. [1] Ehtibar N. Dzhafarov, Janne V. Kujala: Contextuality-by-Default: A Brief Overview of Ideas, Concepts, and Terminology, 2015, Lecture Notes in Computer Science 9535, 12-23, 2016. DOI: [https://dx.doi.org/10.1007/978-3-319-28675-4-2 10.1007/978-3-319-28675-4-2]. QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 8
Main Results Obtained (Multidimensional Relevance) Dynamic re-ranking of documents in session search based on weighted multidimensional relevance feedback performs better than ranking based on a single dimension. Published in ACM SIGIR 2018, Michigan, USA Query 1 Clicked Document Capture weights of different relevance dimensions Improved Ranking! Rank documents according to user preference for relevance dimensions Query 2 QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 9
Main Results Obtained (Order Effects) Particular irrational behaviour in relevance judgment can be explained through Quantum Cognitive formulation of Order Effects. Published in ACM ICTIR 2018, Tianjin, China #$% '() * + #$% " #$% '() * d #$% " 0.0399 "'() 0.3014 "'() QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 10
Main Results Obtained (Violation of Bell Inequalities) Query log data for relevance judgment does not violate Bell-type inequalities due to lack of joint judgment over pairs of documents. The experiment provides further clarity on how to design experiments to test for contextuality in IR. First experiments investigating Quantum-phenomena in large-scale real-world data in IR. Two papers accepted (in collaboration with ESR-7) in the 11 th Conference on Quantum Interactions, 2018, Nice, France. QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 11
Publications Uprety, S., Su, Y., Song, D., & Li, J. (2018). Modelling Multidimensional User Relevance in IR using Vector Spaces. SIGIR '18 The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. Li, Q., Uprety, S., Wang, B., & Song, D. (2018). Quantum-inspired Complex Word Embedding. In ACL Third Workshop on Representation Learning for NLP. Uprety, S., & Song, D. (2018). Reconciling Irrational Human Behaviour with AI based Decision Making: A Quantum Probabilistic Approach. 1st IJCAI-ECAI Workshop on AI and Computational Psychology: Theories, Algorithms and Applications (CompPsy). Uprety, S., & Song, D. (2018). Investigating Order Effects in Multidimensional Relevance Judgment using Query Logs.The 4th ACM SIGIR Informational Conference on the Theory of Information Retrieval, ICTIR 2018 Uprety, S., Gkoumas, D., & Song, D. (2018). Investigating Bell Inequalities in Multidimensional Relevance Judgment in Information Retrieval, Quantum Interaction, 2018 Gkoumas, D., Uprety, S., & Song, D. (2018). Investigating non-classical correlations between decision fused multimodal documents. Quantum Interaction 2018. Nice, France. Uprety, S., Gkoumas, D., & Song, D. (2018) A Survey of Quantum Theory Inspired approaches in Information Retrieval, Submission to ACM Computing Surveys QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 12
Expectations/Impact on Future Career Gain expertise in Quantum-IR Deep understanding of Quantum Cognitive aspects of IR Constructing User models in IR using Quantum Theory Gain expertise in cognitive aspects of IR User behaviour analysis Conducting large scale user studies Apply knowledge and skills obtained in related areas of Artificial Intelligence Intelligent agents augmented with Quantum cognitive models can understand complex human behaviour better than agents build using classical models. Pursue research in the above areas in academia or the industry QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 13
Thank You This work is funded by the European Union s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 721321. QUARTZ Mid-term Review Meeting, Padova, Italy, 07/12/2018 H2020-MSCA-ITN Grant Agreement N. 721321 14