poster

Constrained multi-aspect expertise matching for committee review assignment

Authors:

Maryam Karimzadehgan,

ChengXiang ZhaiAuthors Info & Claims

CIKM '09: Proceedings of the 18th ACM conference on Information and knowledge management

Pages 1697 - 1700

https://doi.org/10.1145/1645953.1646207

Published: 02 November 2009 Publication History

Get Access

Abstract

Automatic review assignment can significantly improve the productivity of many people such as conference organizers, journal editors and grant administrators. Most previous works have set the problem up as using a paper as a query to independently "retrieve" a set of reviewers that should review the paper. A more appropriate formulation of the problem would be to simultaneously optimize the assignments of all the papers to an entire committee of reviewers under constraints such as the review quota. In this paper, we solve the problem of committee review assignment with multi-aspect expertise matching by casting it as an integer linear programming problem. The proposed algorithm can naturally accommodate any probabilistic or deterministic method for modeling multiple aspects to automate committee review assignments. Evaluation using an existing data set shows that the proposed algorithm is effective for committee review assignments based on multi-aspect expertise matching.

References

[1]

C. Basu, H. Hirsh, W. Cohen, and C. Nevill-Manning. Recommending papers by mining the web. IJCAI, 1999.

Google Scholar

[2]

S. Benferhat and J. Lang. Conference paper assignment. International J. of Intelligent Systems, 16:1183--1192, 2001.

Crossref

Google Scholar

[3]

H. K. Biswas and M. M. Hasan. Using publications and domain knowledge to build research profiles: An application in automatic reviewer assignment. ICICT 2007, pages 82--86, 2007.

Crossref

Google Scholar

[4]

S. Dumais and J. Nielsen. Automating the assignments of submitted manuscripts to reviewers. ACM SIGIR, pages 233--244, 1992.

Digital Library

Google Scholar

[5]

D. Hartvigsen and J. C. Wei. The conference paper-reviewer assignment problem. Decision Sciences, 30:865--876, 1999.

Crossref

Google Scholar

[6]

S. Hettich and M. J. Pazzani. Mining for proposal reviewers: Lessons learned at the national science foundation. ACM SIGKDD, pages 862--871, 2006.

Digital Library

Google Scholar

[7]

T. Hofmann. Probabilistic latent semantic indexing. ACM SIGIR, pages 50--57, 1999.

Digital Library

Google Scholar

[8]

M. Karimzadehgan, C. Zhai, and G. Belford. Multi-aspect expertise matching for review assignment. CIKM, pages 1113--1122, 2008.

Digital Library

Google Scholar

[9]

J. J. Merelo-Guervt'os and P. Castillo-Valdivieso. Conference paper assignment using a combined greedy/evolutionary algorithm. Springer, 3242:602--611, 2004.

Google Scholar

[10]

D. Mimno and A. McCallum. Expertise modeling for matching papers with reviewers. ACM SIGKDD, pages 500--509, 2007.

Digital Library

Google Scholar

[11]

C. J. Taylor. On the optimal assignment of conference papers to reviewers. University of Pennsylvania, Technical Reports pages 1--5, 2008.

Google Scholar

Cited By

View all

Zheng XLi PWu X(2025)An Automatic Paper-Reviewer Recommendation Algorithm Based on Depth and BreadthIEEE Transactions on Emerging Topics in Computational Intelligence10.1109/TETCI.2024.34026949:1(607-616)Online publication date: Feb-2025
https://doi.org/10.1109/TETCI.2024.3402694
Luo XLi HZhang ZJiang W(2024)Multi-objective optimization for assigning reviewers to proposals based on social networksJournal of Management Science and Engineering10.1016/j.jmse.2024.05.001Online publication date: Jun-2024
https://doi.org/10.1016/j.jmse.2024.05.001
Azad SHoque MRimon NHabib MMahmud MKaiser MKarim M(2023)A Reviewer Recommender System for Scientific Articles Using a New Similarity Threshold Discovery TechniqueProceedings of the Fourth International Conference on Trends in Computational and Cognitive Engineering10.1007/978-981-19-9483-8_42(503-518)Online publication date: 28-May-2023
https://doi.org/10.1007/978-981-19-9483-8_42
Show More Cited By

Index Terms

Constrained multi-aspect expertise matching for committee review assignment
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking

Recommendations

Multi-aspect expertise matching for review assignment
CIKM '08: Proceedings of the 17th ACM conference on Information and knowledge management

Review assignment is a common task that many people such as conference organizers, journal editors, and grant administrators would have to do routinely. As a computational problem, it involves matching a set of candidate reviewers with a paper or ...
A robust model for paper reviewer assignment
RecSys '14: Proceedings of the 8th ACM Conference on Recommender systems

Automatic expert assignment is a common problem encountered in both industry and academia. For example, for conference program chairs and journal editors, in order to collect "good" judgments for a paper, it is necessary for them to assign the paper to ...
Integer linear programming for Constrained Multi-Aspect Committee Review Assignment

Automatic review assignment can significantly improve the productivity of many people such as conference organizers, journal editors and grant administrators. A general setup of the review assignment problem involves assigning a set of reviewers on a ...

Comments

Information & Contributors

Information

Published In

CIKM '09: Proceedings of the 18th ACM conference on Information and knowledge management

November 2009

2162 pages

ISBN:9781605585123

DOI:10.1145/1645953

General Chairs:
David Cheung
University of Hong Kong, Hong Kong
,
Il-Yeol Song
Drexel University, USA
,
Program Chairs:
Wesley Chu
UCLA, USA
,
Xiaohua Hu
Drexel University, USA
,
Jimmy Lin
University of Maryland, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

CIKM '09

Sponsor:

CIKM '09: Conference on Information and Knowledge Management

November 2 - 6, 2009

Hong Kong, China

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

47
Total Citations
View Citations
401
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)2

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zheng XLi PWu X(2025)An Automatic Paper-Reviewer Recommendation Algorithm Based on Depth and BreadthIEEE Transactions on Emerging Topics in Computational Intelligence10.1109/TETCI.2024.34026949:1(607-616)Online publication date: Feb-2025
https://doi.org/10.1109/TETCI.2024.3402694
Luo XLi HZhang ZJiang W(2024)Multi-objective optimization for assigning reviewers to proposals based on social networksJournal of Management Science and Engineering10.1016/j.jmse.2024.05.001Online publication date: Jun-2024
https://doi.org/10.1016/j.jmse.2024.05.001
Azad SHoque MRimon NHabib MMahmud MKaiser MKarim M(2023)A Reviewer Recommender System for Scientific Articles Using a New Similarity Threshold Discovery TechniqueProceedings of the Fourth International Conference on Trends in Computational and Cognitive Engineering10.1007/978-981-19-9483-8_42(503-518)Online publication date: 28-May-2023
https://doi.org/10.1007/978-981-19-9483-8_42
Kwatra DBhatnagar V(2022)Expertise Computation for Automatic Reviewer AssignmentInformation Integration and Web Intelligence10.1007/978-3-031-21047-1_48(531-547)Online publication date: 20-Nov-2022
https://doi.org/10.1007/978-3-031-21047-1_48
Zhang JLo Bianco GBeck J(2022)Model-Based Approaches to Multi-attribute Diverse MatchingIntegration of Constraint Programming, Artificial Intelligence, and Operations Research10.1007/978-3-031-08011-1_28(424-440)Online publication date: 20-Jun-2022
https://dl.acm.org/doi/10.1007/978-3-031-08011-1_28
Rae AMork JDemner‐Fushman D(2022)The National Library of Medicine indexer assignment dataset: A new large‐scale dataset for reviewer assignment researchJournal of the Association for Information Science and Technology10.1002/asi.2472274:2(205-218)Online publication date: 8-Nov-2022
https://doi.org/10.1002/asi.24722
Choi DSeo T(2021)Development of an open peer review system using blockchain and reviewer recommendation technologiesScience Editing10.6087/kcse.2378:1(104-111)Online publication date: 20-Feb-2021
https://doi.org/10.6087/kcse.237
Cagliero LGarza PPasini ABaralis E(2021)Additional Reviewer Assignment by Means of Weighted Association RulesIEEE Transactions on Emerging Topics in Computing10.1109/TETC.2018.28612149:1(329-341)Online publication date: 1-Jan-2021
https://doi.org/10.1109/TETC.2018.2861214
Yong YYao ZZhao Y(2021)Beyond Accuracy: A Feature Crossing Method for Chinese Thesis Reviewer Recommendation2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC52423.2021.9658668(1151-1158)Online publication date: 17-Oct-2021
https://doi.org/10.1109/SMC52423.2021.9658668
Yong YYao ZZhao Y(2021)A Framework for Reviewer Recommendation Based on Knowledge Graph and Rules Matching2021 IEEE International Conference on Information Communication and Software Engineering (ICICSE)10.1109/ICICSE52190.2021.9404099(199-203)Online publication date: 19-Mar-2021
https://doi.org/10.1109/ICICSE52190.2021.9404099
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Multi-aspect expertise matching for review assignment

A robust model for paper reviewer assignment

Integer linear programming for Constrained Multi-Aspect Committee Review Assignment

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations