Binary Independence Model: Difference between revisions

Browse history interactively ← Previous edit Next edit →Content deleted Content addedVisual WikitextInline

Revision as of 00:57, 5 January 2019 editGaspanic99 (talk \| contribs)2 edits Almost all the content of this article is a very close parapharse of a copyrighted book.← Previous edit		Revision as of 05:55, 5 January 2019 edit undoAnthony Appleyard (talk \| contribs)209,150 edits nominated for deletion: see Misplaced Pages:Articles for deletion/Binary Independence Model Tag: nowiki addedNext edit →
Line 1:		Line 1:
			<!-- Please do not remove or change this AfD message until the discussion has been closed. -->
⚫	{{db-copyvio\|url=https://nlp.stanford.edu/IR-book/html/htmledition/the-binary-independence-model-1.html}}
			{{Article for deletion/dated\|page=Binary Independence Model\|timestamp=20190105055524\|year=2019\|month=January\|day=5\|substed=yes}}
			<!-- Once discussion is closed, please place on talk page: {{Old AfD multi\|page=Binary Independence Model\|date=5 January 2019\|result='''keep'''}} -->
			<!-- End of AfD message, feel free to edit beyond this point -->

		⚫	<nowiki>{{db-copyvio\|url=https://nlp.stanford.edu/IR-book/html/htmledition/the-binary-independence-model-1.html}}</nowiki>

	{{context\|date=June 2012}}		{{context\|date=June 2012}}

Revision as of 05:55, 5 January 2019

An editor has nominated this article for deletion.
You are welcome to participate in the deletion discussion, which will decide whether or not to retain it.Feel free to improve the article, but do not remove this notice before the discussion is closed. For more information, see the guide to deletion.
Find sources: "Binary Independence Model" – news · newspapers · books · scholar · JSTOR%5B%5BWikipedia%3AArticles+for+deletion%2FBinary+Independence+Model%5D%5DAFD

{{db-copyvio|url=https://nlp.stanford.edu/IR-book/html/htmledition/the-binary-independence-model-1.html}}

This article provides insufficient context for those unfamiliar with the subject. Please help improve the article by providing more context for the reader. (June 2012) (Learn how and when to remove this message)

The Binary Independence Model (BIM) is a probabilistic information retrieval technique that makes some simple assumptions to make the estimation of document/query similarity probability feasible.

Definitions

The Binary Independence Assumption is that documents are binary vectors. That is, only the presence or absence of terms in documents are recorded. Terms are independently distributed in the set of relevant documents and they are also independently distributed in the set of irrelevant documents. The representation is an ordered set of Boolean variables. That is, the representation of a document or query is a vector with one Boolean element for each term under consideration. More specifically, a document is represented by a vector d = (x₁, ..., x_m) where x_t=1 if term t is present in the document d and x_t=0 if it's not. Many documents can have the same vector representation with this simplification. Queries are represented in a similar way. "Independence" signifies that terms in the document are considered independently from each other and no association between terms is modeled. This assumption is very limiting, but it has been shown that it gives good enough results for many situations. This independence is the "naive" assumption of a Naive Bayes classifier, where properties that imply each other are nonetheless treated as independent for the sake of simplicity. This assumption allows the representation to be treated as an instance of a Vector space model by considering each term as a value of 0 or 1 along a dimension orthogonal to the dimensions used for the other terms.

The probability $P(R|d,q)$ that a document is relevant derives from the probability of relevance of the terms vector of that document $P(R|x,q)$ . By using the Bayes rule we get:

P(R|x,q)={\frac {P(x|R,q)*P(R|q)}{P(x|q)}}

where $P(x|R=1,q)$ and $P(x|R=0,q)$ are the probabilities of retrieving a relevant or nonrelevant document, respectively. If so, then that document's representation is x. The exact probabilities can not be known beforehand, so use estimates from statistics about the collection of documents must be used.

$P(R=1|q)$ and $P(R=0|q)$ indicate the previous probability of retrieving a relevant or nonrelevant document respectively for a query q. If, for instance, we knew the percentage of relevant documents in the collection, then we could use it to estimate these probabilities. Since a document is either relevant or nonrelevant to a query we have that:

P(R=1|x,q)+P(R=0|x,q)=1

Query Terms Weighting

Given a binary query and the dot product as the similarity function between a document and a query, the problem is to assign weights to the terms in the query such that the retrieval effectiveness will be high. Let $p_{i}$ and $q_{i}$ be the probability that a relevant document and an irrelevant document has the i term respectively. Yu and Salton, who first introduce BIM, propose that the weight of the i term is an increasing function of $Y_{i}={\frac {p_{i}*(1-q_{i})}{(1-p_{i})*q_{i}}}$ . Thus, if $Y_{i}$ is higher than $Y_{j}$ , the weight of term i will be higher than that of term j. Yu and Salton showed that such a weight assignment to query terms yields better retrieval effectiveness than if query terms are equally weighted. Robertson and Spärck Jones later showed that if the i term is assigned the weight of $\log Y_{i}$ , then optimal retrieval effectiveness is obtained under the Binary Independence Assumption.