Abstract
Friend recommendation algorithms in large-scale social networks such as Facebook or Twitter usually require the exploration of huge user graphs. In current solutions for parallelizing graph algorithms, the burden of dealing with distributed concerns falls on algorithm developers. In this paper, a simple yet powerful programming interface (API) to implement distributed graph traversal algorithms is presented. A case study on implementing a followee recommendation algorithm for Twitter using the API is described. This case study not only illustrates the simplicity offered by the API for developing algorithms, but also how different aspects of the distributed solutions can be treated and experimented without altering the algorithm code. Experiments evaluating the performance of different job scheduling strategies illustrate the flexibility or our approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Armentano, M., Godoy, D., Amandi, A.: Topology-based recommendation of users in micro-blogging communities. Journal of Computer Science and Technology 27(3), 624–634 (2012)
Aurelius. Titan (2014), http://thinkaurelius.github.io/titan/ (accessed April 14, 2014)
Cattell, R.: Scalable SQL and NoSQL data stores. ACM SIGMOD Record 39(4), 12–27 (2011)
Gupta, P., Goel, A., Lin, J., Sharma, A., Wang, D., Zadeh, R.: WTF: The who to follow service at Twitter. In: Proceedings of the 22th International World Wide Web Conference (WWW 2013), Rio de Janeiro, Brazil (2013)
Java, A., Song, X., Finin, T., Tseng, B.: Why we Twitter: Understanding microblogging usage and communities. In: Proceedings of the 9th WebKDD and 1st SNA-KDD 2007 Workshop on Web Mining and Social Network Analysis, San Jose, CA, USA, pp. 56–65 (2007)
Kleinberg, J.M.: Authoritative sources in a hyperlinked environment. Journal of the ACM 46(5), 604–632 (1999)
Krepska, E., Kielmann, T., Fokkink, W., Bal, H.: HipG: Parallel processing of large-scale graphs. ACM SIGOPS Operating Systems Review 45(2), 3–13 (2011)
Krishnamurthy, B., Gill, P., Arlitt, M.: A few chirps about Twitter. In: Proceedings of the 1st Workshop on Online Social Networks (WOSP 2008), Seattle, USA, pp. 19–24 (2008)
Kwak, H., Lee, C., Park, H., Moon, S.: What is Twitter, a social network or a news media? In: Proceedings of the 19th International Conference on World Wide Web (WWW 2010), Raleigh, NC, USA, pp. 591–600 (2010)
Lempel, R., Moran, S.: SALSA: the stochastic approach for link-structure analysis. ACM Transactions on Information Systems 19(2), 131–160 (2001)
Malewicz, G., Austern, M.H., Bik, A.J.C., Dehnert, J.C., Horn, I., Leiser, N., Czajkowski, G.: Pregel: A system for large-scale graph processing. In: Proceedings of the 2010 International Conference on Management of Data (SIGMOD 2010), Indianapolis, IN, USA, pp. 135–146 (2010)
Inc. Neo Technology. Neo4J (2013), http://www.neo4j.org/ (accessed August 5, 2013)
Page, L., Brin, S., Motwani, R., Winograd, T.: The PageRank citation ranking: bringing order to the web, pp. 1–17 (1999)
Shao, B., Wang, H., Li, Y.: The Trinity Graph Engine. Technical Report MSR-TR-2012-30, Microsoft Research (March 2012)
da Silva, S.T.F., Oliveira, J., Borges, M.R.S.: Contextual analysis of the victims’ social network for people recommendation on the emergency scenario. In: Herskovic, V., Hoppe, H.U., Jansen, M., Ziegler, J. (eds.) CRIWG 2012. LNCS, vol. 7493, pp. 200–207. Springer, Heidelberg (2012)
Strauch, C., Sites, U.L.S., Kriha, W.: NoSQL databases. Lecture Notes, Stuttgart Media University (2011)
Twitter Inc. FlockDB (2013), https://github.com/twitter/flockdb (accessed August 5, 2013)
Yang, S., Yan, X., Zong, B., Khan, A.: Towards effective partition management for large graphs. In: Proceedings of the 2012 International Conference on Management of Data (SIGMOD 2012), Scottsdale, AZ, USA, pp. 517–528 (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Corbellini, A., Godoy, D., Mateos, C., Zunino, A., Schiaffino, S. (2014). A Programming Interface and Platform Support for Developing Recommendation Algorithms on Large-Scale Social Networks. In: Baloian, N., Burstein, F., Ogata, H., Santoro, F., Zurita, G. (eds) Collaboration and Technology. CRIWG 2014. Lecture Notes in Computer Science, vol 8658. Springer, Cham. https://doi.org/10.1007/978-3-319-10166-8_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-10166-8_6
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10165-1
Online ISBN: 978-3-319-10166-8
eBook Packages: Computer ScienceComputer Science (R0)