ABSTRACT
Specificity is the level of detail at which a given term is represented. Existing approaches to estimating term specificity are primarily dependent on corpus-level frequency statistics. In this work, we explore how neural embeddings can be used to define corpus-independent specificity metrics. Particularly, we propose to measure term specificity based on the distribution of terms in the neighborhood of the given term in the embedding space. The intuition is that a term that is surrounded by other terms in the embedding space is more likely to be specific while a term surrounded by less closely related terms is more likely to be generic. On this basis, we leverage geometric properties between embedded terms to define three groups of metrics: (1) neighborhood-based, (2) graph-based and (3) cluster-based metrics. Moreover, we employ learning-to-rank techniques to estimate term specificity in a supervised approach by employing the three proposed groups of metrics. We curate and publicly share a test collection of term specificity measurements defined based on Wikipedia's category hierarchy. We report on our experiments through metric performance comparison, ablation study and comparison against the state-of-the-art baselines.
- Ben He and Iadh Ounis. 2004. Inferring Query Performance Using Pre-retrieval Predictors.. In String Processing and Information Retrieval, 11th International Conference, SPIRE 2004, Padova, Italy, October 5--8, 2004, Proceedings. 43--54.Google Scholar
- Karen Spärck Jones. 2004. A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation 60, 5 (2004), 493--502.Google ScholarCross Ref
- P. Kapanipathi, P. Jain, C. Venkatramani, and A. P. Sheth. 2014. User Interests Identification on Twitter Using a Hierarchical Knowledge Base. In ESWC. 99--113.Google Scholar
- Y. Li, R. Zheng, T. Tian, Z. Hu, R. Iyer, and K. P. Sycara. 2016. Joint Embedding of Hierarchical Categories and Entities for Concept Categorization and Dataless Classification. In COLING. 2678--2688.Google Scholar
- Bhaskar Mitra and Nick Craswell. 2018. An Introduction to Neural Information Retrieval. Foundations and Trends in Information Retrieval 13, 1 (2018), 1--126.Google ScholarDigital Library
- H. Zamani, W. B. Croft, and J. S. Culpepper. 2018. Neural Query Performance Prediction using Weak Supervision from Multiple Signals. In SIGIR. 105--114.Google Scholar
Index Terms
- Geometric Estimation of Specificity within Embedding Spaces
Recommendations
Lower Recall Rates Reduced Readers' Sensitivity in Screening Mammography
IWDM 2016: Proceedings of the 13th International Workshop on Breast Imaging - Volume 9699Higher recall rates have been related to increased false positive decisions, causing significant psychological and economical costs for both screened women and the mammography screening service respectively. This study compares breast readers' ...
Looking for optimized weights of CA125 and HE4 in early screening system of ovarian cancer for Korean patients
Recent Innovations on Biomedical EngineeringWe try to find out the best weight values of CA125 and HE4 in a discriminant formula classifying ovarian cancer patients from benign patients. We utilize a logistic regression analysis for the early screening system of the ovarian cancer for Korean patients. ...
Mammography Feature Analysis and Mass Detection in Breast Cancer Images
ICESC '14: Proceedings of the 2014 International Conference on Electronic Systems, Signal Processing and Computing TechnologiesThis paper introduces a novel approach for accomplishing mammographic feature analysis through detection of tumor, in terms of their size and shape with experimental work for early breast tumor detection. The objective is to detect the abnormal tumor/...
Comments