research-article

G-Finder: routing programming questions closer to the experts

Authors:

Songlin HuAuthors Info & Claims

OOPSLA '10: Proceedings of the ACM international conference on Object oriented programming systems languages and applications

Pages 62 - 73

https://doi.org/10.1145/1869459.1869466

Published: 17 October 2010 Publication History

Abstract

Programming forums are becoming the primary tools for programmers to find answers for their programming problems. Our empirical study of popular programming forums shows that the forum users experience long waiting period for answers and a small number of experts are often overloaded with questions. To improve the usage experience, we have designed and implemented G-Finder, both an algorithm and a tool that makes intelligent routing decisions as to which participant is the expert for answering a particular programming question. Our main approach is to leverage the source code information of the software systems that forums are dedicated to, and discover latent relationships between forums users. Our algorithms construct the concept networks and the user networks from the program source and the forum data.We use programming questions to dynamically integrate these two networks and present an adaptive ranking of the potential experts. Our evaluation of G-Finder, using the data from three large programming forums, takes a retrospective view to check if G-Finder can correctly predict the experts who provided answers to programming questions. The evaluation results show that G-Finder improves the prediction precision by 25% to 74%, compared to related approaches.

References

[1]

}}J. Anvik, L. Hiew, and G. C. Murphy. Who should fix this bug? In 28th International Conference on Software Engineering (ICSE 2006), Shanghai, China, May 20--28, 2006, pages 361--370. ACM, 2006. ISBN 1-59593-375-1.

Digital Library

[2]

}}K. Balog, L. Azzopardi, and M. de Rijke. Formal models for expert finding in enterprise corpora. In SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, pages 43--50, New York, NY, USA, 2006. ACM. ISBN 1-59593-369-7.

Digital Library

[3]

}}K. Balog, T. Bogers, L. Azzopardi, M. de Rijke, and A. van den Bosch. Broad expertise retrieval in sparse data environments. In SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 551--558, New York, NY, USA, 2007. ACM. ISBN 978-1-59593-597-7.

Digital Library

[4]

}}D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent dirichlet allocation. J. Mach. Learn. Res., 3:993--1022, 2003. ISSN 1532-4435.

[5]

}}S. Brin and L. Page. The anatomy of a large-scale hypertextual web search engine. Comput. Netw. ISDN Syst., 30(1-7):107--117, 1998. ISSN 0169-7552. S0169-7552(98)00110-X.

Digital Library

[6]

}}P. Jurczyk and E. Agichtein. Discovering authorities in question answer communities by using link analysis. In CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, pages 919--922, New York, NY, USA, 2007. ACM. ISBN 978-1-59593-803-9.

Digital Library

[7]

}}J. M. Kleinberg. Authoritative sources in a hyperlinked environment. In SODA '98: Proceedings of the ninth annual ACM-SIAM symposium on Discrete algorithms, pages 668--677, Philadelphia, PA, USA, 1998. Society for Industrial and Applied Mathematics. ISBN 0-89871-410-9.

Digital Library

[8]

}}C. Manning, P. Raghavan, and H. Schtze. Introduction to Information Retrieval. Cambridage University Press, 2008.

Digital Library

[9]

}}D. Mimno and A. McCallum. Expertise modeling for matching papers with reviewers. In KDD '07: Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 500--509, New York, NY, USA, 2007. ACM. ISBN 978-1-59593-609-7.

Digital Library

[10]

}}A. Mockus and J. D. Herbsleb. Expertise browser: a quantitative approach to identifying expertise. In Proceedings of the 22rd International Conference on Software Engineering, ICSE 2002, 19-25 May 2002, Orlando, Florida, USA, pages 503--512. ACM, 2002.

Digital Library

[11]

}}D. Petkova and W. B. Croft. Hierarchical language models for expert finding in enterprise corpora. In ICTAI '06: Proceedings of the 18th IEEE International Conference on Tools with Artificial Intelligence, pages 599--608, Washington, DC, USA, 2006. IEEE Computer Society. ISBN 0-7695-2728-0.

Digital Library

[12]

}}J. M. Ponte and W. B. Croft. A language modeling approach to information retrieval. In SIGIR '98: Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, pages 275--281, New York, NY, USA, 1998. ACM. ISBN 1-58113-015-5.

Digital Library

[13]

}}G. Salton and C. Buckley. Term weighting approaches in automatic text retrieval. Technical report, Ithaca, NY, USA, 1987.

Digital Library

[14]

}}C. Shah and W. B. Croft. Evaluating high accuracy retrieval techniques. In SIGIR '04: Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, pages 2--9, New York, NY, USA, 2004. ACM. ISBN 1-58113-881-4.

Digital Library

[15]

}}E. Voorhees and D. Tice. The trec-8 question answering track evaluation. In Proceedings 8th Text REtrieval Conference (TREC-8), pages 83--105, 1999.

[16]

}}C. Zhai and J. Lafferty. A study of smoothing methods for language models applied to information retrieval. ACM Trans. Inf. Syst., 22(2):179--214, 2004. ISSN 1046-8188.

Digital Library

[17]

}}J. Zhang, M. S. Ackerman, and L. Adamic. Expertise networks in online communities: structure and algorithms. In WWW '07: Proceedings of the 16th international conference on World Wide Web, pages 221--230, New York, NY, USA, 2007. ACM. ISBN 978-1-59593-654-7.

Digital Library

[18]

}}Y. Zhou, G. Cong, B. Cui, C. S. Jensen, and J. Yao. Routing questions to the right users in online communities. In ICDE'09: Proceedings of the 2009 IEEE International Conference on Data Engineering, pages 700--711,Washington, DC, USA, 2009. IEEE Computer Society. ISBN 978-0-7695-3545-6.

Digital Library

Cited By

Ye GLi SWu LWei JWu CWang YLi JLiang BLiu S(2024)Multi-dimensional feature fusion-based expert recommendation in community question answeringThe Electronic Library10.1108/EL-01-2024-001142:6(996-1016)Online publication date: 22-Aug-2024
https://doi.org/10.1108/EL-01-2024-0011
Nie LZhang LYan YChang XLiu MShaoling L(2017)Multiview Physician-Specific Attributes Fusion for Health SeekingIEEE Transactions on Cybernetics10.1109/TCYB.2016.257759047:11(3680-3691)Online publication date: Nov-2017
https://doi.org/10.1109/TCYB.2016.2577590
Yao YTong HXie TAkoglu LXu FLu J(2015)Detecting high-quality posts in community question answering sitesInformation Sciences: an International Journal10.1016/j.ins.2014.12.038302:C(70-82)Online publication date: 1-May-2015
https://dl.acm.org/doi/10.1016/j.ins.2014.12.038
Show More Cited By

Index Terms

G-Finder: routing programming questions closer to the experts
1. Software and its engineering
  1. Software notations and tools
    1. Development frameworks and environments

Recommendations

G-Finder: routing programming questions closer to the experts
OOPSLA '10

Programming forums are becoming the primary tools for programmers to find answers for their programming problems. Our empirical study of popular programming forums shows that the forum users experience long waiting period for answers and a small number ...
Find an Expert: Designing Expert Selection Interfaces for Formal Help-Giving
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

A critical aspect of formal help-giving tasks in the enterprise is finding the right expert. We built and evaluated a tool, Find an Expert, to examine what the most important expert selection criteria are for help-seekers and how to represent them in ...
Discriminative probabilistic models for expert search in heterogeneous information sources
Abstract
In many realistic settings of expert finding, the evidence for expertise often comes from heterogeneous knowledge sources. As some sources tend to be more reliable and indicative than the others, different information sources need to receive ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

OOPSLA '10: Proceedings of the ACM international conference on Object oriented programming systems languages and applications

October 2010

984 pages

ISBN:9781450302036

DOI:10.1145/1869459

General Chairs:
William R. Cook
University of Texas at Austin
,
Siobhán Clarke
Trinity College Dublin
,
Program Chairs:
Martin Rinard
MIT
,
Kevin J. Sullivan
University of Virginia
,
Daniel H. Steinberg
Dim Sum Thinking Inc.

ACM SIGPLAN Notices Volume 45, Issue 10
OOPSLA '10
October 2010
957 pages
ISSN:0362-1340
EISSN:1558-1160
DOI:10.1145/1932682
Issue’s Table of Contents

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGPLAN: ACM Special Interest Group on Programming Languages

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SPLASH '10

Sponsor:

SIGPLAN

SPLASH '10: Systems Programming Languages and Applications: Software for Humanity

October 17 - 21, 2010

Nevada, Reno/Tahoe, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,244 submissions, 22%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
350
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ye GLi SWu LWei JWu CWang YLi JLiang BLiu S(2024)Multi-dimensional feature fusion-based expert recommendation in community question answeringThe Electronic Library10.1108/EL-01-2024-001142:6(996-1016)Online publication date: 22-Aug-2024
https://doi.org/10.1108/EL-01-2024-0011
Nie LZhang LYan YChang XLiu MShaoling L(2017)Multiview Physician-Specific Attributes Fusion for Health SeekingIEEE Transactions on Cybernetics10.1109/TCYB.2016.257759047:11(3680-3691)Online publication date: Nov-2017
https://doi.org/10.1109/TCYB.2016.2577590
Yao YTong HXie TAkoglu LXu FLu J(2015)Detecting high-quality posts in community question answering sitesInformation Sciences: an International Journal10.1016/j.ins.2014.12.038302:C(70-82)Online publication date: 1-May-2015
https://dl.acm.org/doi/10.1016/j.ins.2014.12.038
Zhang CChen LTong YLi JWang XGarofalakis MSoboroff ISuel TWang M(2014)MaCProceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management10.1145/2661829.2661880(11-20)Online publication date: 3-Nov-2014
https://dl.acm.org/doi/10.1145/2661829.2661880
Pal AWang FZhou MNichols JSmith BHe QIyengar ANejdl WPei JRastogi R(2013)Question routing to user communitiesProceedings of the 22nd ACM international conference on Information & Knowledge Management10.1145/2505515.2505669(2357-2362)Online publication date: 27-Oct-2013
https://dl.acm.org/doi/10.1145/2505515.2505669
Jiau HYang F(2012)Facing up to the inequality of crowdsourced API documentationACM SIGSOFT Software Engineering Notes10.1145/2088883.208889237:1(1-9)Online publication date: 27-Jan-2012
https://dl.acm.org/doi/10.1145/2088883.2088892
Fleming SChalmers DWakeman I(2012)A deniable and efficient question and answer service over ad hoc social networksInformation Retrieval10.1007/s10791-012-9185-015:3-4(296-331)Online publication date: 1-Jun-2012
https://dl.acm.org/doi/10.1007/s10791-012-9185-0
Pal A(2015)Metrics and Algorithms for Routing Questions to User CommunitiesACM Transactions on Information Systems10.1145/272470633:3(1-29)Online publication date: 9-Mar-2015
https://dl.acm.org/doi/10.1145/2724706
Yao YTong HXie TAkoglu LXu FLu J(2015)Detecting high-quality posts in community question answering sitesInformation Sciences: an International Journal10.1016/j.ins.2014.12.038302:C(70-82)Online publication date: 1-May-2015
https://dl.acm.org/doi/10.1016/j.ins.2014.12.038
Pal AWang FZhou MNichols JSmith BHe QIyengar ANejdl WPei JRastogi R(2013)Question routing to user communitiesProceedings of the 22nd ACM international conference on Information & Knowledge Management10.1145/2505515.2505669(2357-2362)Online publication date: 27-Oct-2013
https://dl.acm.org/doi/10.1145/2505515.2505669

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten