skip to main content
10.1145/3132847.3133182acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article
Public Access

ClaimVerif: A Real-time Claim Verification System Using the Web and Fact Databases

Published: 06 November 2017 Publication History

Abstract

Our society is increasingly digitalized. Every day, a tremendous amount of information is being created, shared, and digested through all kinds of cyber channels. Although people can easily acquire information from various sources (social media, news articles, etc.), the truthfulness of most received information remains unverified. In many real-life scenarios, false information has become the de facto cause that leads to detrimental decision makings, and techniques that can automatically filter false information are highly demanded. However, verifying whether a piece of information is trustworthy is difficult because: (1) selecting candidate snippets for fact checking is nontrivial; and (2) detecting supporting evidences, i.e. stances, suffers from the difficulty of measuring the similarity between claims and related evidences. We build ClaimVerif, a claim verification system that not only provides credibility assessment for any user-given query claim, but also rationales the assessment results with supporting evidences. ClaimVerif can automatically select the stances from millions of documents and employs two-step training to justify the opinions of the stances. Furthermore, combined with the credibility of stances sources, ClaimVerif degrades the score of stances from untrustworthy sources and alleviates the negative effects from rumor spreaders. Our empirical evaluations show that ClaimVerif achieves both high accuracy and efficiency in different claim verification tasks. It can be highly useful in practical applications by providing multi-dimension analysis for the suspicious statements, including the stances, opinions, source credibility and estimated judgements.

References

[1]
Hunt Allcott and Matthew Gentzkow. 2017. Social media and fake news in the 2016 election. Technical Report. National Bureau of Economic Research.
[2]
Sardar Hamidiain and Mona Diab. 2015. Rumor detection and classification for twitter data. In SOTICS, IARIA.
[3]
Zhiwei Jin, Juan Cao, Yu-Gang Jiang, and Yongdong Zhang. 2014. News credibility evaluation on microblog with a hierarchical propagation model. In Data Mining (ICDM), 2014 IEEE International Conference on. IEEE, 230--239.
[4]
Quoc V Le and Tomas Mikolov. 2014. Distributed Representations of Sentences and Documents. In ICML, Vol. 14. 1188--1196.
[5]
Jing Ma, Wei Gao, Zhongyu Wei, Yueming Lu, and Kam-Fai Wong. 2015. Detect rumors using time series of social context information on microblogging websites. In CIKM. ACM, 1751--1754.
[6]
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems.
[7]
Kashyap Popat, Subhabrata Mukherjee, Jannik Strötgen, and Gerhard Weikum. 2016. Credibility Assessment of Textual Claims on the Web. In CIKM. ACM.
[8]
Kashyap Popat, Subhabrata Mukherjee, Jannik Strötgen, and Gerhard Weikum. 2017. Where the Truth Lies: Explaining the Credibility of Emerging Claims on the Web and Social Media. In WWW.
[9]
Marta Recasens, Cristian Danescu-Niculescu-Mizil, and Dan Jurafsky. 2013. Linguistic Models for Analyzing and Detecting Biased Language. In ACL.
[10]
Fan Yang, Yang Liu, Xiaohui Yu, and Min Yang. 2012. Automatic detection of rumor on Sina Weibo. In SIGKDD Workshop on Mining Data Semantics. ACM, 13.

Cited By

View all
  • (2025)DRIVE: An adjustable parallel architecture based on evidence awareness for fake news detectionExpert Systems with Applications10.1016/j.eswa.2024.126043266(126043)Online publication date: Mar-2025
  • (2024)Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AIProceedings of the ACM on Human-Computer Interaction10.1145/36869628:CSCW2(1-44)Online publication date: 8-Nov-2024
  • (2022)Beyond facts – a survey and conceptualisation of claims in online discourse analysisSemantic Web10.3233/SW-21283813:5(793-827)Online publication date: 18-Aug-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CIKM '17: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management
November 2017
2604 pages
ISBN:9781450349185
DOI:10.1145/3132847
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. fact checking
  2. rumor detection
  3. source credibility analysis
  4. text mining

Qualifiers

  • Research-article

Funding Sources

Conference

CIKM '17
Sponsor:

Acceptance Rates

CIKM '17 Paper Acceptance Rate 171 of 855 submissions, 20%;
Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)119
  • Downloads (Last 6 weeks)28
Reflects downloads up to 02 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)DRIVE: An adjustable parallel architecture based on evidence awareness for fake news detectionExpert Systems with Applications10.1016/j.eswa.2024.126043266(126043)Online publication date: Mar-2025
  • (2024)Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AIProceedings of the ACM on Human-Computer Interaction10.1145/36869628:CSCW2(1-44)Online publication date: 8-Nov-2024
  • (2022)Beyond facts – a survey and conceptualisation of claims in online discourse analysisSemantic Web10.3233/SW-21283813:5(793-827)Online publication date: 18-Aug-2022
  • (2022)DISCO: Comprehensive and Explainable Disinformation DetectionProceedings of the 31st ACM International Conference on Information & Knowledge Management10.1145/3511808.3557202(4848-4852)Online publication date: 17-Oct-2022
  • (2022)A real-time hostile activities analyses and detection systemApplied Soft Computing10.1016/j.asoc.2021.107175104:COnline publication date: 22-Apr-2022
  • (2020)The Future of False Information Detection on Social MediaACM Computing Surveys10.1145/339388053:4(1-36)Online publication date: 11-Jul-2020
  • (2020)Claim verification under positive unlabeled learningProceedings of the 12th IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining10.1109/ASONAM49781.2020.9381336(143-150)Online publication date: 7-Dec-2020
  • (2020)Socio-Technical Mitigation Effort to Combat Cyber Propaganda: A Systematic Literature MappingIEEE Access10.1109/ACCESS.2020.29946588(92929-92944)Online publication date: 2020
  • (2020)Veracity assessment of online dataDecision Support Systems10.1016/j.dss.2019.113132129:COnline publication date: 1-Feb-2020
  • (2018)CredEyeCompanion Proceedings of the The Web Conference 201810.1145/3184558.3186967(155-158)Online publication date: 23-Apr-2018
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media