An Overview of the Indri Search Engine Don Metzler Center for Intelligent Information Retrieval University of Massachusetts, Amherst Joint work with Trevor Strohman, Howard Turtle, and Bruce Croft
? Outline n n n Overview Retrieval Model System Architecture Evaluation Conclusions
? Zoology 101 n n n Lemurs are primates found only in Madagascar 50 species (17 are endangered) Ring-tailed lemurs ¡ lemur catta
? Zoology 101 n n n The indri is the largest type of lemur When first spotted the natives yelled “Indri!” Malagasy for "Look! Over there!"
? What is INDRI? n n INDRI is a “larger” version of the Lemur Toolkit Influences ¡ INQUERY [Callan, et. al. ’ 92] Inference network framework n Structured query language Lemur [http: //www. lemurproject. org/] n Language modeling (LM) toolkit Lucene [http: //jakarta. apache. org/lucene/docs/index. html] n Popular off the shelf Java-based IR system n Based on heuristic retrieval models n ¡ ¡ n No IR system currently combines all of these features
? Design Goals n Robust retrieval model ¡ n Powerful query language ¡ ¡ n Extensions to INQUERY query language driven by requirements of QA, web search, and XML retrieval Designed to be as simple to use as possible, yet robust Off the shelf (Windows, *NIX, Mac platforms) ¡ ¡ ¡ n Inference net + language modeling [Metzler and Croft ’ 04] Separate download, compatible with Lemur Simple to set up and use Fully functional API w/ language wrappers for Java, etc… Scalable ¡ ¡ Highly efficient code Distributed retrieval
? Comparing Collections Collection Documents Space CACM 3204 1. 4 MB WT 10 G GOV 2 Google 1. 7 million 25 million 8 billion 10 GB 426 GB 80 TB (? )
? Outline n n Overview Retrieval Model ¡ ¡ ¡ n n n Model Query Language Applications System Architecture Evaluation Conclusions
? Document Representation
Department Descriptions The following list describes …
Agriculture …
Chemistry …
Computer Science …
Electrical Engineering … …
Zoology context <title>department descriptions extents <body> context <body>the following list describes … <h 1>agriculture</h 1> … </body> <body> extents <h 1> context <h 1>agriculture</h 1> <h 1>chemistry</h 1> … <h 1>zoology</h 1> <h 1> extents . . . 1. department descriptions 1. the following list describes <h 1>agriculture </h 1> … 1. agriculture 2. chemistry … 36. zoology </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Model n n n Based on original inference network retrieval framework [Turtle and" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-10.jpg" alt="? Model n n n Based on original inference network retrieval framework [Turtle and" />
? Model n n n Based on original inference network retrieval framework [Turtle and Croft ’ 91] Casts retrieval as inference in simple graphical model Extensions made to original model ¡ ¡ Incorporation of probabilities based on language modeling rather than tf. idf Multiple language models allowed in the network (one per indexed context) </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Model hyperparameters (observed) Document node (observed) α, βtitle α, βh 1 Context language" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-11.jpg" alt="? Model hyperparameters (observed) Document node (observed) α, βtitle α, βh 1 Context language" />
? Model hyperparameters (observed) Document node (observed) α, βtitle α, βh 1 Context language models θtitle r 1 α, βbody D … θbody r. N Representation nodes (terms, phrases, etc…) r 1 … q 1 Information need node (belief node) θh 1 r. N r 1 … r. N q 2 I Belief nodes (#combine, #not, #max) </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Model α, βbody D α, βh 1 α, βtitle θtitle r 1 …" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-12.jpg" alt="? Model α, βbody D α, βh 1 α, βtitle θtitle r 1 …" />
? Model α, βbody D α, βh 1 α, βtitle θtitle r 1 … θbody r. N r 1 … q 1 θh 1 r. N r 1 q 2 I … r. N </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? P( r | θ ) n Probability of observing a term, phrase, or" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-13.jpg" alt="? P( r | θ ) n Probability of observing a term, phrase, or" />
? P( r | θ ) n Probability of observing a term, phrase, or “concept” given a context language model ¡ n Assume r ~ Bernoulli( θ ) ¡ n ri nodes are binary “Model B” – [Metzler, Lavrenko, Croft ’ 04] Nearly any model may be used here ¡ ¡ tf. idf-based estimates (INQUERY) Mixture models </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Model α, βbody D α, βh 1 α, βtitle θtitle r 1 …" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-14.jpg" alt="? Model α, βbody D α, βh 1 α, βtitle θtitle r 1 …" />
? Model α, βbody D α, βh 1 α, βtitle θtitle r 1 … θbody r. N r 1 … q 1 θh 1 r. N r 1 q 2 I … r. N </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? P( θ | α, β, D ) n n Prior over context language" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-15.jpg" alt="? P( θ | α, β, D ) n n Prior over context language" />
? P( θ | α, β, D ) n n Prior over context language model determined by α, β Assume P( θ | α, β ) ~ Beta( α, β ) ¡ ¡ Bernoulli’s conjugate prior αw = μP( w | C ) + 1 βw = μP( ¬ w | C ) + 1 μ is a free parameter </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Model α, βbody D α, βh 1 α, βtitle θtitle r 1 …" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-16.jpg" alt="? Model α, βbody D α, βh 1 α, βtitle θtitle r 1 …" />
? Model α, βbody D α, βh 1 α, βtitle θtitle r 1 … θbody r. N r 1 … q 1 θh 1 r. N r 1 q 2 I … r. N </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? P( q | r ) and P( I | r ) n n" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-17.jpg" alt="? P( q | r ) and P( I | r ) n n" />
? P( q | r ) and P( I | r ) n n Belief nodes are created dynamically based on query Belief node CPTs are derived from standard link matrices ¡ ¡ n n Combine evidence from parents in various ways Allows fast inference by making marginalization computationally tractable Information need node is simply a belief node that combines all network evidence into a single value Documents are ranked according to: P( I | α, β, D) </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Example: #AND P(Q=true|a, b) A B 0 false 0 true false true B" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-18.jpg" alt="? Example: #AND P(Q=true|a, b) A B 0 false 0 true false true B" />
? Example: #AND P(Q=true|a, b) A B 0 false 0 true false true B false true 0 1 A Q </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Query Language n n Extension of INQUERY query language Structured query language ¡" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-19.jpg" alt="? Query Language n n Extension of INQUERY query language Structured query language ¡" />
? Query Language n n Extension of INQUERY query language Structured query language ¡ ¡ ¡ n Additional features ¡ ¡ ¡ n Term weighting Ordered / unordered windows Synonyms Language modeling motivated constructs Added flexibility to deal with fields via contexts Generalization of passage retrieval (extent retrieval) Robust query language that handles many current language modeling tasks </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Terms Type Example Matches Stemmed term dog All occurrences of dog (and its" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-20.jpg" alt="? Terms Type Example Matches Stemmed term dog All occurrences of dog (and its" />
? Terms Type Example Matches Stemmed term dog All occurrences of dog (and its stems) Surface term “dogs” Exact occurrences of dogs (without stemming) Term group (synonym group) <”dogs” canine> All occurrences of dogs (without stemming) or canine (and its stems) Extent match Any occurrence of an extent of type person #any: person </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Date / Numeric Fields Example Matches #less(URLDEPTH 3) Any URLDEPTH numeric field extent" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-21.jpg" alt="? Date / Numeric Fields Example Matches #less(URLDEPTH 3) Any URLDEPTH numeric field extent" />
? Date / Numeric Fields Example Matches #less(URLDEPTH 3) Any URLDEPTH numeric field extent with value less than 3 #greater(READINGLEVEL 3) Any READINGINGLEVEL numeric field extent with value greater than 3 #between(SENTIMENT 0 2) Any SENTIMENT numeric field extent with value between 0 and 2 #equals(VERSION 5) Any VERSION numeric field extent with value equal to 5 #date: before(1 Jan 1900) Any DATE field before 1900 #date: after(June 1 2004) Any DATE field after June 1, 2004 #date: between(1 Jun 2000 1 Sep 2001) Any DATE field in summer 2000. </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Proximity Type Example Matches #od. N(e 1 … em) or #N(e 1 …" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-22.jpg" alt="? Proximity Type Example Matches #od. N(e 1 … em) or #N(e 1 …" />
? Proximity Type Example Matches #od. N(e 1 … em) or #N(e 1 … em) #od 5(saddam hussein) or #5(saddam hussein) All occurrences of saddam and hussein appearing ordered within 5 words of each other #uw. N(e 1 … em) #uw 5(information retrieval) All occurrences of information and retrieval that appear in any order within a window of 5 words #uw(e 1 … em) #uw(john kerry) All occurrences of john and kerry that appear in any order within any sized window #phrase(e 1 … em) #phrase(#1(willy wonka) #uw 3(chocolate factory)) System dependent implementation (defaults to #odm) </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Context Restriction Example Matches yahoo. title All occurrences of yahoo appearing in the" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-23.jpg" alt="? Context Restriction Example Matches yahoo. title All occurrences of yahoo appearing in the" />
? Context Restriction Example Matches yahoo. title All occurrences of yahoo appearing in the title context yahoo. title, paragraph All occurrences of yahoo appearing in both a title and paragraph contexts (may not be possible) <yahoo. title yahoo. paragraph> All occurrences of yahoo appearing in either a title context or a paragraph context #5(apple ipod). title All matching windows contained within a title context </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Context Evaluation Example Evaluated google. (title) The term google evaluated using the title" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-24.jpg" alt="? Context Evaluation Example Evaluated google. (title) The term google evaluated using the title" />
? Context Evaluation Example Evaluated google. (title) The term google evaluated using the title context as the document google. (title, paragraph) The term google evaluated using the concatenation of the title and paragraph contexts as the document google. figure(paragraph) The term google restricted to figure tags within the paragraph context. </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Belief Operators INQUERY #sum / #and #wsum* #or #not #max INDRI #combine #weight" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-25.jpg" alt="? Belief Operators INQUERY #sum / #and #wsum* #or #not #max INDRI #combine #weight" />
? Belief Operators INQUERY #sum / #and #wsum* #or #not #max INDRI #combine #weight #or #not #max * #wsum is still available in INDRI, but should be used with discretion </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Extent / Passage Retrieval Example Evaluated #combine[section](dog canine) Evaluates #combine(dog canine) for each" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-26.jpg" alt="? Extent / Passage Retrieval Example Evaluated #combine[section](dog canine) Evaluates #combine(dog canine) for each" />
? Extent / Passage Retrieval Example Evaluated #combine[section](dog canine) Evaluates #combine(dog canine) for each extent associated with the section context #combine[title, section](dog canine) Same as previous, except is evaluated for each extent associated with either the title context or the section context #combine[passage 100: 50](white house) Evaluates #combine(dog canine) 100 word passages, treating every 50 words as the beginning of a new passage #sum(#sum[section](dog)) Returns a single score that is the #sum of the scores returned from #sum(dog) evaluated for each section extent #max(#sum[section](dog)) Same as previous, except returns the maximum score </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Extent Retrieval Example <document> <section><head>Introduction</head> Statistical language modeling allows formal methods to be" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-27.jpg" alt="? Extent Retrieval Example <document> <section><head>Introduction</head> Statistical language modeling allows formal methods to be" />
? Extent Retrieval Example <document> <section><head>Introduction</head> Statistical language modeling allows formal methods to be applied to information retrieval. . </section> <section><head>Multinomial Model</head> Here we provide a quick review of multinomial language models. . </section> <section><head>Multiple-Bernoulli Model</head> We now examine two formal methods for statistically modeling documents and queries based on the multiple-Bernoulli distribution. . </section> … </document> Query: #combine[section]( dirichlet smoothing ) 0. 15 1. Treat each section extent as a “document” 0. 50 2. Score each “document” according to #combine( … ) 0. 05 SCORE 0. 50 0. 35 0. 15 … 3. Return a ranked list of extents. DOCID IR-352 … BEGIN 51 405 0 … END 205 548 50 … </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Other Operators Type Example Description Filter require #filreq( #less(READINGLEVEL 10) ben franklin) )" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-28.jpg" alt="? Other Operators Type Example Description Filter require #filreq( #less(READINGLEVEL 10) ben franklin) )" />
? Other Operators Type Example Description Filter require #filreq( #less(READINGLEVEL 10) ben franklin) ) Requires that documents have a reading level less than 10. Documents then ranked by query ben franklin Filter reject #filrej( #greater(URLDEPTH 1) microsoft) ) Rejects (does not score) documents with a URL depth greater than 1. Documents then ranked by query microsoft Prior #prior( DATE ) Applies the document prior specified for the DATE field </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Example Tasks n Ad hoc retrieval ¡ ¡ n Web search ¡ ¡" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-29.jpg" alt="? Example Tasks n Ad hoc retrieval ¡ ¡ n Web search ¡ ¡" />
? Example Tasks n Ad hoc retrieval ¡ ¡ n Web search ¡ ¡ n n Flat documents SGML/XML documents Homepage finding Known-item finding Question answering KL divergence based ranking ¡ ¡ Query models Relevance modeling </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Ad Hoc Retrieval n Flat documents ¡ n Query likelihood retrieval: q 1" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-30.jpg" alt="? Ad Hoc Retrieval n Flat documents ¡ n Query likelihood retrieval: q 1" />
? Ad Hoc Retrieval n Flat documents ¡ n Query likelihood retrieval: q 1 … q. N ≡ #combine( q 1 … q. N ) SGML/XML documents ¡ ¡ Can either retrieve documents or extents Context restrictions and context evaluations allow exploitation of document structure </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Web Search n Homepage / known-item finding Use mixture model of several document" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-31.jpg" alt="? Web Search n Homepage / known-item finding Use mixture model of several document" />
? Web Search n Homepage / known-item finding Use mixture model of several document representations [Ogilvie and Callan ’ 03] n Example query: Yahoo! n #combine( #wsum(0. 2 yahoo. (body) 0. 5 yahoo. (inlink) 0. 3 yahoo. (title) ) ) </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Question Answering n n More expressive passage- and sentencelevel retrieval Example: ¡ Where" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-32.jpg" alt="? Question Answering n n More expressive passage- and sentencelevel retrieval Example: ¡ Where" />
? Question Answering n n More expressive passage- and sentencelevel retrieval Example: ¡ Where was George Washington born? #combine[sentence]( #1( george washington ) born #any: LOCATION ) ¡ Returns a ranked list of sentences containing the phrase George Washington, the term born, and a snippet of text tagged as a LOCATION named entity </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? KL / Cross Entropy Ranking n INDRI handles ranking via KL / cross" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-33.jpg" alt="? KL / Cross Entropy Ranking n INDRI handles ranking via KL / cross" />
? KL / Cross Entropy Ranking n INDRI handles ranking via KL / cross entropy ¡ Query models [Zhai and Lafferty ’ 01] ¡ Relevance modeling [Lavrenko and Croft ’ 01] n Example: ¡ ¡ Form user/relevance/query model P(w | θQ) Formulate query as: #weight (P(w 1 | θQ) w 1 … P(w|V| | θQ) w|V|) n n Ranked list equivalent to scoring by: KL(θQ || θD) In practice, probably want to truncate </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Outline n n n Overview Retrieval Model System Architecture ¡ ¡ n n" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-34.jpg" alt="? Outline n n n Overview Retrieval Model System Architecture ¡ ¡ n n" />
? Outline n n n Overview Retrieval Model System Architecture ¡ ¡ n n Indexing Query processing Evaluation Conclusions </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? System Overview n Indexing Inverted lists for terms and fields ¡ Repository consists" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-35.jpg" alt="? System Overview n Indexing Inverted lists for terms and fields ¡ Repository consists" />
? System Overview n Indexing Inverted lists for terms and fields ¡ Repository consists of inverted lists, parsed documents, and document vectors ¡ n Query processing Local or distributed ¡ Computing local / global statistics ¡ n Features </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Repository Tasks n Maintains: ¡ ¡ n n inverted lists document vectors field" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-36.jpg" alt="? Repository Tasks n Maintains: ¡ ¡ n n inverted lists document vectors field" />
? Repository Tasks n Maintains: ¡ ¡ n n inverted lists document vectors field extent lists statistics for each field Store compressed versions of documents Save stopping and stemming information </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Inverted Lists n n One list per term One list entry for each" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-37.jpg" alt="? Inverted Lists n n One list per term One list entry for each" />
? Inverted Lists n n One list per term One list entry for each term occurrence in the corpus Entry: (term. ID, document. ID, position) Delta-encoding, byte-level compression ¡ ¡ ¡ Significant space savings Allows index size to be smaller than collection Space savings translates into higher speed </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Inverted List Construction n All lists stored in one file ¡ ¡ n" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-38.jpg" alt="? Inverted List Construction n All lists stored in one file ¡ ¡ n" />
? Inverted List Construction n All lists stored in one file ¡ ¡ n 50% of terms occur only once Single term entry = approximately 30 bytes Minimum file size: 4 K Directory lookup overhead Lists written in segments ¡ ¡ ¡ Collect as much information in memory as possible Write segment when memory is full Merge segments at end </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Field Extent Lists n n Like inverted lists, but with extent information List" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-39.jpg" alt="? Field Extent Lists n n Like inverted lists, but with extent information List" />
? Field Extent Lists n n Like inverted lists, but with extent information List entry document. ID ¡ begin (first word position) ¡ end (last word position) ¡ number (numeric value of field) ¡ </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Term Statistics n Statistics for collection language models ¡ ¡ ¡ n Field" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-40.jpg" alt="? Term Statistics n Statistics for collection language models ¡ ¡ ¡ n Field" />
? Term Statistics n Statistics for collection language models ¡ ¡ ¡ n Field statistics ¡ ¡ ¡ n total term counts for each term document length total term count in a field counts for each term in the field document field length Example: ¡ “dog” appears: n n 45 times in the corpus 15 times in a title field Corpus contains 56, 450 words Title field contains 12, 321 words </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Query Architecture " src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-41.jpg" alt="? Query Architecture " />
? Query Architecture </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Query Processing n n n Parse query Perform query tree transformations Collect query" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-42.jpg" alt="? Query Processing n n n Parse query Perform query tree transformations Collect query" />
? Query Processing n n n Parse query Perform query tree transformations Collect query statistics from servers Run the query on servers Retrieve document information from servers </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Query Parsing #combine( white house #1(white house) ) " src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-43.jpg" alt="? Query Parsing #combine( white house #1(white house) ) " />
? Query Parsing #combine( white house #1(white house) ) </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Query Optimization " src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-44.jpg" alt="? Query Optimization " />
? Query Optimization </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Evaluation " src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-45.jpg" alt="? Evaluation " />
? Evaluation </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Off the Shelf n n Indexing and retrieval GUIs API / Wrappers ¡" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-46.jpg" alt="? Off the Shelf n n Indexing and retrieval GUIs API / Wrappers ¡" />
? Off the Shelf n n Indexing and retrieval GUIs API / Wrappers ¡ ¡ n Java PHP Formats supported ¡ ¡ ¡ TREC (text, web) PDF Word, Power. Point (Windows only) Text HTML </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Programming Interface (API) n Indexing methods ¡ ¡ ¡ n open / create" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-47.jpg" alt="? Programming Interface (API) n Indexing methods ¡ ¡ ¡ n open / create" />
? Programming Interface (API) n Indexing methods ¡ ¡ ¡ n open / create add. File / add. String / add. Parsed. Document set. Stemmer / set. Stopwords Querying methods ¡ ¡ ¡ add. Server / add. Index remove. Server / remove. Index set. Memory / set. Scoring. Rules / set. Stopwords run. Query / run. Annotated. Query documents / document. Vectors / document. Metadata term. Count / term. Field. Count / field. List / document. Count </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Outline n n Overview Retrieval Model System Architecture Evaluation ¡ ¡ ¡ n" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-48.jpg" alt="? Outline n n Overview Retrieval Model System Architecture Evaluation ¡ ¡ ¡ n" />
? Outline n n Overview Retrieval Model System Architecture Evaluation ¡ ¡ ¡ n TREC Terabyte Track Efficiency Effectiveness Conclusions </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Terabyte Track Summary n GOV 2 test collection ¡ ¡ ¡ n Parsing" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-49.jpg" alt="? Terabyte Track Summary n GOV 2 test collection ¡ ¡ ¡ n Parsing" />
? Terabyte Track Summary n GOV 2 test collection ¡ ¡ ¡ n Parsing ¡ ¡ ¡ n Collection size: 25, 205, 179 documents (426 GB) Index size: 253 GB (includes compressed collection) Index time: 6 hours (parallel across 6 machines) ~ 12 GB/hr/machine Vocabulary size: 49, 657, 854 Total terms: 22, 811, 162, 783 No index-time stopping Porter stemmer Normalization (U. S. => US, etc…) Topics ¡ 50. gov-related standard TREC ad hoc topics </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? UMass Runs n indri 04 QL ¡ n indri 04 QLRM ¡ n" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-50.jpg" alt="? UMass Runs n indri 04 QL ¡ n indri 04 QLRM ¡ n" />
? UMass Runs n indri 04 QL ¡ n indri 04 QLRM ¡ n phrases indri 04 AWRM ¡ n query likelihood + pseudo relevance feedback indri 04 AW ¡ n query likelihood phrases + pseudo relevance feedback indri 04 FAW ¡ phrases + fields </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? indri 04 QL / indri 04 QLRM n Query likelihood ¡ ¡ ¡" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-51.jpg" alt="? indri 04 QL / indri 04 QLRM n Query likelihood ¡ ¡ ¡" />
? indri 04 QL / indri 04 QLRM n Query likelihood ¡ ¡ ¡ Standard query likelihood run Smoothing parameter trained on TREC 9 and 10 main web track data Example: #combine( pearl farming ) n Pseudo-relevance feedback Estimate relevance model from top n documents in initial retrieval ¡ Augment original query with these term ¡ Formulation: #weight( 0. 5 #combine( QORIGINAL ) 0. 5 #combine( QRM ) ) ¡ </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? indri 04 AW / indri 04 AWRM n Goal: Given only a title" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-52.jpg" alt="? indri 04 AW / indri 04 AWRM n Goal: Given only a title" />
? indri 04 AW / indri 04 AWRM n Goal: Given only a title query, automatically construct an Indri query ¡ How can we make use of the query language? ¡ n Include phrases in query Ordered window (#N) ¡ Unordered window (#uw. N) ¡ </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Example Query prostate cancer treatment => #weight( 1. 5 prostate 1. 5 cancer" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-53.jpg" alt="? Example Query prostate cancer treatment => #weight( 1. 5 prostate 1. 5 cancer" />
? Example Query prostate cancer treatment => #weight( 1. 5 prostate 1. 5 cancer 1. 5 treatment 0. 1 #1( prostate cancer ) 0. 1 #1( cancer treatment ) 0. 1 #1( prostate cancer treatment ) 0. 3 #uw 8( prostate cancer ) 0. 3 #uw 8( prostate treatment ) 0. 3 #uw 8( cancer treatment ) 0. 3 #uw 12( prostate cancer treatment ) ) n </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? indri 04 FAW n Combines evidence from different fields Fields indexed: anchor, title," src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-54.jpg" alt="? indri 04 FAW n Combines evidence from different fields Fields indexed: anchor, title," />
? indri 04 FAW n Combines evidence from different fields Fields indexed: anchor, title, body, and header (h 1, h 2, h 3, h 4) ¡ Formulation: #weight( 0. 15 QANCHOR 0. 25 QTITLE 0. 10 QHEADING 0. 50 QBODY ) ¡ n Needs to be explore in more detail </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="MAP fields -> QL QLRM AW AWRM T 0. 2565 0. 2529 0. 2839" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-55.jpg" alt="MAP fields -> QL QLRM AW AWRM T 0. 2565 0. 2529 0. 2839" />
MAP fields -> QL QLRM AW AWRM T 0. 2565 0. 2529 0. 2839 0. 2874 TD 0. 2730 0. 2675 0. 2988 0. 2974 TDN 0. 3088 0. 2928 0. 3293 0. 3237 P 10 fields -> QL QLRM AW AWRM T 0. 4980 0. 4878 0. 5857 0. 5653 TD 0. 5510 0. 5673 0. 6184 0. 6102 TDN 0. 5918 0. 5796 0. 6306 0. 6367 Indri Terabyte Track Results T = title D = description N = narrative italicized values denote statistical significance over QL </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="33 GB / hr 2 GB / hr 12 GB / hr Didn’t index" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-56.jpg" alt="33 GB / hr 2 GB / hr 12 GB / hr Didn’t index" />
33 GB / hr 2 GB / hr 12 GB / hr Didn’t index entire collection 33 GB / hr </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-57.jpg" alt="" />
</p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="0 run id irttbtl apl 04 w 4 tdn UAms. T 04 TBm 1" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-58.jpg" alt="0 run id irttbtl apl 04 w 4 tdn UAms. T 04 TBm 1" />
0 run id irttbtl apl 04 w 4 tdn UAms. T 04 TBm 1 pisa 3 nn 04 tint Dcu. TB 04 Base mpi 04 tb 07 sabir 04 ta 2 MSRAt 1 iit 00 t zetplain hum. T 04 l THUIRtb 4 MU 04 tb 4 indri 04 AWRM cmuapfs 2500 uog. TBQEL MAP Best Run per Group 0. 35 0. 3 0. 25 0. 2 0. 15 0. 1 0. 05 </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="0 indri 04 AWRM indri 04 FAW uog. TBBase. S uog. TBAnch. S indri" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-59.jpg" alt="0 indri 04 AWRM indri 04 FAW uog. TBBase. S uog. TBAnch. S indri" />
0 indri 04 AWRM indri 04 FAW uog. TBBase. S uog. TBAnch. S indri 04 AW MU 04 tb 4 MU 04 tb 1 indri 04 QLRM indri 04 QL cmutufs 2500 THUIRtb 5 hum. T 04 l zetplain hum. T 04 vl THUIRtb 3 zetbodoffff zetanch hum. T 04 dvl iit 00 t cmutuns 2500 zetfunkyz THUIRtb 6 robertson hum. T 04 MSRAt 1 MSRAt 5 MSRAt 4 MSRAt 3 hum. T 04 l 3 zetfuzzy mpi 04 tb 07 Dcu. TB 04 Base sabir 04 tt 2 sabir 04 tt nn 04 tint pisa 3 pisa 4 pisa 2 MSRAt 2 Dcu. TB 04 Wbm 25 nn 04 eint MU 04 tb 5 MU 04 tb 2 pisa 1 UAms. T 04 TBm 1 MU 04 tb 3 UAms. T 04 TBm 1 p UAms. T 04 TBtit Dcu. TB 04 Combo nn 04 test apl 04 w 4 t UAms. T 04 TBanc irttbtl MAP Title-Only Runs 0. 3 0. 25 0. 2 0. 15 0. 1 0. 05 run id </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="? Conclusions n INDRI extends INQUERY and Lemur ¡ ¡ n n Off the" src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-60.jpg" alt="? Conclusions n INDRI extends INQUERY and Lemur ¡ ¡ n n Off the" />
? Conclusions n INDRI extends INQUERY and Lemur ¡ ¡ n n Off the shelf Scalable Geared towards tagged (structured) documents Employs robust inference net approach to retrieval Extended query language can tackle many current retrieval tasks Competitive in both terms of effectiveness and efficiency </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="Questions? Contact Info Email: metzler@cs. umass. edu Web: http: //ciir. cs. umass. edu/~metzler " src="https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-61.jpg" alt="Questions? Contact Info Email: metzler@cs. umass. edu Web: http: //ciir. cs. umass. edu/~metzler " />
Questions? Contact Info Email: metzler@cs. umass. edu Web: http: //ciir. cs. umass. edu/~metzler </p>
</div>
<div style="width: auto;" class="description columns twelve"><p><img class="imgdescription" title="" src="" alt="" />
</p>
</div>
</div>
<div id="inputform">
<script>$("#inputform").load("https://present5.com/wp-content/plugins/report-content/inc/report-form-aj.php");
</script>
</div>
</p>
<!--end entry-content-->
</div>
</article><!-- .post -->
</section><!-- #content -->
<div class="three columns">
<div class="widget-entry">
</div>
</div>
</div>
</div>
<!-- #content-wrapper -->
<footer id="footer" style="padding: 5px 0 5px;">
<div class="container">
<div class="columns twelve">
<!--noindex-->
<!--LiveInternet counter--><script type="text/javascript"><!--
document.write("<img src='//counter.yadro.ru/hit?t26.10;r"+
escape(document.referrer)+((typeof(screen)=="undefined")?"":
";s"+screen.width+"*"+screen.height+"*"+(screen.colorDepth?
screen.colorDepth:screen.pixelDepth))+";u"+escape(document.URL)+
";"+Math.random()+
"' alt='' title='"+" ' "+
"border='0' width='1' height='1'><\/a>")
//--></script><!--/LiveInternet-->
<a href="https://slidetodoc.com/" alt="Наш международный проект SlideToDoc.com!" target="_blank"><img src="https://present5.com/SlideToDoc.png"></a> <script>
$(window).load(function() {
var owl = document.getElementsByClassName('owl-carousel owl-theme owl-loaded owl-drag')[0];
document.getElementById("owlheader").insertBefore(owl, null);
$('#owlheader').css('display', 'inline-block');
});
</script>
<script type="text/javascript">
var yaParams = {'typepage': '1000_top_300k',
'author': '1000_top_300k'
};
</script>
<!-- Yandex.Metrika counter --> <script type="text/javascript" > (function(m,e,t,r,i,k,a){m[i]=m[i]||function(){(m[i].a=m[i].a||[]).push(arguments)}; m[i].l=1*new Date(); for (var j = 0; j < document.scripts.length; j++) {if (document.scripts[j].src === r) { return; }} k=e.createElement(t),a=e.getElementsByTagName(t)[0],k.async=1,k.src=r,a.parentNode.insertBefore(k,a)}) (window, document, "script", "https://mc.yandex.ru/metrika/tag.js", "ym"); ym(32395810, "init", { clickmap:true, trackLinks:true, accurateTrackBounce:true, webvisor:true }); </script> <noscript><div><img src="https://mc.yandex.ru/watch/32395810" style="position:absolute; left:-9999px;" alt="" /></div></noscript> <!-- /Yandex.Metrika counter -->
<!--/noindex-->
<nav id="top-nav">
<ul id="menu-top" class="top-menu clearfix">
</ul> </nav>
</div>
</div><!--.container-->
</footer>
<script type='text/javascript'>
/* <![CDATA[ */
var wpcf7 = {"apiSettings":{"root":"https:\/\/present5.com\/wp-json\/contact-form-7\/v1","namespace":"contact-form-7\/v1"}};
/* ]]> */
</script>
<script type='text/javascript' src='https://present5.com/wp-content/plugins/contact-form-7/includes/js/scripts.js?ver=5.1.4'></script>
<script type='text/javascript' src='https://present5.com/wp-content/themes/sampression-lite/lib/js/jquery.shuffle.js?ver=4.9.26'></script>
<script type='text/javascript' src='https://present5.com/wp-content/themes/sampression-lite/lib/js/scripts.js?ver=1.13'></script>
<script type='text/javascript' src='https://present5.com/wp-content/themes/sampression-lite/lib/js/shuffle.js?ver=4.9.26'></script>
<!--[if lt IE 9]>
<script type='text/javascript' src='https://present5.com/wp-content/themes/sampression-lite/lib/js/selectivizr.js?ver=1.0.2'></script>
<![endif]-->
<script type='text/javascript' src='https://present5.com/wp-content/themes/sampression-lite/lib/js/notify.js?ver=1737978307'></script>
<script type='text/javascript'>
/* <![CDATA[ */
var my_ajax_object = {"ajax_url":"https:\/\/present5.com\/wp-admin\/admin-ajax.php","nonce":"76f861e268"};
/* ]]> */
</script>
<script type='text/javascript' src='https://present5.com/wp-content/themes/sampression-lite/lib/js/filer.js?ver=1737978307'></script>
</body>
</html> 
 Evaluates #combine(dog canine) for each](https://present5.com/presentation/27220f5302d0faa59d133550258cb894/image-26.jpg "? Extent / Passage Retrieval Example Evaluated #combine[section](dog canine) Evaluates #combine(dog canine) for each")
Скачать презентацию An Overview of the Indri Search Engine Don