Research on multitruth finding based on EM algorithm
CHEN Chao
CUI hong-xia
Abstract：A large number of web applications need to fuse data from different data sources .However , dif-ferent data sources may provide different or even conflicting information about the same attribute of the same enti -ty.How to determine the credibility of a data source and the reliability of a fact , which is called the truth find-ing, is gaining increasing attention .In this paper the multi truth finding for integrating of Web data is discussed since the web data sources often provide conflicting information about the same entities .We propose an iterative calculation method based on Bayesian analysis and maximum likelihood estimation , combining tightly every truth finding steps and the source reliability estimation .Firstly, the maximum likelihood function is constructed based on the principle that the sources which provide more real information are more reliable and the facts provided by reliable sources are more likely to be true .In the model , a latent variable indicates whether the corresponding fact is true and the parameters evaluate the data source quality from the two aspects of correctness and incorrect -ness.Then the E step ( calculating the probability that each fact is true ) and the step M ( evaluating the quality of the data sources ) are performed iteratively until the parameters converge .At last, experiments on real data sets show that our approach improves the accuracy for truth discovery and effectively solves the conflict in the process of data fusion .
Keywords：truth findingBayesian analysisEM algorithmmulti truthdata fusion
Publication Date：2017-01-01
Online Publishing Date：2025-08-15(First online date of this platform, not the publication date of the document)
Pages：7( 264-270 )