Misplaced Pages

GroupLens Research

Established	1992
Field of research	recommender systems, social computing
Faculty	5
Staff	2
Students	20 postgraduate students
Location	Minneapolis, Minnesota, United States
Operating agency	College of Science and Engineering, University of Minnesota
Website	www.grouplens.org

44°58′27″N 93°13′57″W / 44.974280°N 93.232502°W / 44.974280; -93.232502

GroupLens Research is a human–computer interaction research lab in the Department of Computer Science and Engineering at the University of Minnesota, Twin Cities specializing in recommender systems and online communities. GroupLens also works with mobile and ubiquitous technologies, digital libraries, and local geographic information systems.

The GroupLens lab was one of the first to study automated recommender systems with the construction of the "GroupLens" recommender, a Usenet article recommendation engine, and MovieLens, a popular movie recommendation site used to study recommendation engines, tagging systems, and user interfaces. The lab has also gained notability for its members' work studying open content communities such as Cyclopath, a geo-wiki that was used in the Twin Cities to help plan the regional cycling system.

History

Formation

In 1992, John Riedl and Paul Resnick attended the CSCW conference together. After they heard keynote speaker Shumpei Kumon talk about his vision for an information economy, they began working on a collaborative filtering system for Usenet news. The system collected ratings from Usenet readers and used those ratings to predict how much other readers would like an article before they read it. This recommendation engine was one of the first automated collaborative filtering systems in which algorithms were used to automatically form predictions based on historical patterns of ratings. The overall system was called the "GroupLens" recommender, and the servers that collected the ratings and performed the computation were called the "Better Bit Bureau". This name was later dropped after a request from the Better Business Bureau. "GroupLens" is now used as a name both for this recommender system, and for the research lab at the University of Minnesota.

A feasibility test was done between MIT and the University of Minnesota and a research paper was published including the algorithm, the system design, and the results of the feasibility study, in the CSCW conference of 1994.

In 1993, Riedl and Resnick invited Joseph Konstan to join the team. Together, they decided to create a higher-performance implementation of the algorithms to support larger-scale deployments. In summer 1995 the team gathered Bradley Miller, David Maltz, Jon Herlocker, and Mark Claypool for "Hack Week" to create the new implementation, and to plan the next round of experiments.

In the Spring of 1996, the first workshop on collaborative filtering was put together by Resnick and Hal Varian at the University of California, Berkeley. There, researchers from projects around the US that were studying similar systems came together to share ideas and experience.

Net Perceptions

In the summer of 1996, David Gardiner, a former Ph.D. student of Riedl's, introduced John Riedl to Steven Snyder. Snyder had been an early employee at Microsoft, but left Microsoft to come to Minnesota to do a Ph.D. in Psychology. He realized the commercial potential of collaborative filtering, and encouraged the team to found a company in April 1996. By June, Gardiner, Snyder, Miller, Riedl, and Konstan had incorporated their company, and by July they had their first round of funding, from Hummer Winblad Venture Partners venture capital company. Net Perceptions went on to be one of the leading companies in personalization during the Internet boom of the late 1990s, and stayed in business until 2004. Based on their experience, Riedl and Konstan wrote a book about the lessons learned from deploying recommenders in practice. Recommender systems have since become ubiquitous in the online world, with leading vendors such as Amazon and Netflix deploying highly sophisticated recommender systems. Netflix even offered a $1 million prize for improvements in recommender technology.

When the EachMovie site closed in 1997, the researchers behind it released the anonymous rating data they had collected, for other researchers to use. The GroupLens Research team, led by Brent Dahlen and Jon Herlocker, used this data set to jumpstart a new movie recommendation site called MovieLens which has been a very visible research platform, including a detailed discussion in a New Yorker article by Malcolm Gladwell, and a report in a full episode of ABC Nightline.

Between 1997 and 2002 the group continued its research on collaborative filtering, which became known in the community by the more general term of recommender systems. With Joe Konstan's expertise in user interfaces, the team began exploring interface issues in recommenders, such as explanations, and meta-recommendation systems.

Studying online communities

In 2002, GroupLens expanded into social computing and online communities with the addition of Loren Terveen, who was known for his research of social recommender systems such as PHOAKS.

In order to broaden the set of research ideas and tools they used, Riedl, Konstan, and Terveen invited colleagues in social psychology (Robert Kraut and Sara Kiesler, of the Carnegie Mellon Human Computer Interaction Institute), and economic and social analysis (Paul Resnick and Yan Chen of the University of Michigan School of Information) to collaborate. The new, larger team adopted the name CommunityLab, and looked generally at the effects of technological interventions on the performance of online communities. For instance, some of their research explored technology for enriching conversation systems, while other research explored the personal, social, and economic motivations for user ratings.

In 2008 GroupLens launched Cyclopath, a computational geo-wiki for bicyclists within a city.

In 2010, GroupLens won the annual ACM software system award. Riedl died in 2013.

Brent Hecht joined the GroupLens faculty in 2013, focusing on geographic human-computer interaction. Lana Yarosh joined the GroupLens faculty in 2014; she works with social computing and child-computer interaction. A third professor, Haiyi Zhu, joined in 2015. Haiyi has published research on Facebook and other social networks. Stevie Chancellor, a human-centered computing and social computing researcher, joined the GroupLens faculty in 2020.

Contributions

• The MovieLens recommender system: MovieLens is a non-commercial movie recommender system that has been running since 1997 with over 164,000 unique visitors as of 2009, who have provided over 15 million movie ratings.

• MovieLens ratings datasets: In the early days of recommender systems, research was slowed down by the lack of publicly available datasets. In response to requests from other researchers, GroupLens released three datasets: the MovieLens 100,000 rating dataset, the MovieLens 1 million rating dataset, and the MovieLens 10 million rating dataset. These datasets became the standard datasets for recommender research, and have been used in over 300 papers by researchers around the world. The dataset is also being used for teaching about recommender technology.

• MovieLens tagging dataset: GroupLens added tagging to MovieLens in 2006. Since then, users have provided over 85,000 applications of 14,000 unique tags to movies. The MovieLens 10 million ratings dataset also includes a 100,000 tag applications dataset for researchers to use.

• Information leakage from recommender datasets: a paper in the information retrieval conference analyzed the privacy risks to users of having large recommender datasets released. The basic risk discovered is that an anonymized dataset might be combined with public information to identify a user. For instance, a user who has written about his preference for movies on online forums could be associated with a specific row in the MovieLens datasets. In some cases, these associations might leak information the user would prefer to keep private.

• Misplaced Pages research: The study of value and vandalism in Misplaced Pages published in 2007 described the concentration of contribution across Misplaced Pages editors. This paper was one of the first to focus on the length of time that a contribution survives within Misplaced Pages as a measure of its value. The paper also investigated the effects of vandalism on Misplaced Pages readers, by measuring the probability that a view of a page would capture that page in a vandalized state. GroupLens has also explored ways to help editors find pages which they can effectively contribute to with the SuggestBot recommender. The group has also explored the evolution of the norms in Misplaced Pages that determine which articles are accepted or rejected, and the effect of changes in those norms on the Long Tail of Misplaced Pages articles. GroupLens has also explored the functioning of the informal peer review system within Misplaced Pages to discover ways the decisions being made appear to be influenced inappropriately by ownership, and that experience does not seem to change editor performance very much. GroupLens researchers have also explored visualizations of the edit history of Misplaced Pages articles. In 2011, the GroupLens researchers completed a scientific exploration of gender imbalance in Misplaced Pages's popular editors, resulting in finding that there was a large gap between male and female editors.

• Shilling recommender systems: GroupLens has explored ways that users of recommender systems can attempt to inappropriately influence the recommendations given to other users. They call this behavior shilling, because of its relationship to the practice of hiring associates to pretend to be enthusiastic customers. They showed that some types of shilling are likely to be effective in practice. One concern about shilling is that the false predictions may change the reported opinions of later users, further corrupting the recommendations.

• Cyclopath: Beginning in 2008, GroupLens launched Cyclopath, a computational geo-wiki for local bicyclists. Cyclopath has since been used by hundreds of cyclists within the Twin Cities. More recently, Cyclopath has been adopted by the Twin Cities Metropolitan Council to help plan the regional cycling system.

References

1. ^ "Cycloplan". Archived from the original on 2011-07-03. Retrieved 2010-01-04.
2. ^ Gonzalez, Tony (July 18, 2008). "Biking website pools cyclists' expertise". Star Tribune. Minneapolis. Retrieved 2010-01-04.
3. Kumon, Shumpei (1992). "From wealth to wisdom: a change in the social paradigm". Proceedings of the 1992 ACM conference on Computer-supported cooperative work. Computer Supported Cooperative Work. ACM Press. p. 3. doi:10.1145/143457.371587. ISBN 0-89791-542-9.
4. Goldman, Alvin I (1999). Knowledge in a Social World. Oxford University Press. doi:10.1093/0198238207.001.0001. ISBN 978-0-19-823820-1. Another possibility is "social filtering" systems, such as GroupLens.
5. Resnick, Paul; Iacovou, Neophytos; Suchak, Mitesh; Bergstrom, Peter; Riedl, John (1994). "GroupLens: an open architecture for collaborative filtering of netnews". Proceedings of the 1994 International ACM Conference on Computer Supported Cooperative Work. Computer Supported Cooperative Work. ACM Press. pp. 175–186. doi:10.1145/192844.192905. ISBN 0-89791-689-1.
6. Borchers, Al; Herlocker, Jon; Konstan, Joseph; Riedl, John (April 1998). "Ganging up on Information Overload". Computer. 31 (4): 106–108. doi:10.1109/2.666847. ISSN 0018-9162.
7. "Collaborative Filtering". March 16, 1996. Archived from the original on 2013-08-17. Retrieved 2009-12-30.
8. "Minnesota in the .Com Age" (PDF). Minnesota Public Radio. 1999. Retrieved 2009-12-30.
9. "Firms honored at e-commerce awards". MIT. May 19, 1999.
10. Dragan, Richard (January 2001), "Net Perceptions for E-commerce 6.0", PC Magazine
11. Riedl, John; Konstan, Joseph; Vrooman, Eric (August 2002). Word of Mouse: The Marketing Power of Collaborative Filtering. Grand Central. ISBN 978-0-7595-2727-0.
12. Zeitchik, Steven (July 18, 2008). "Technology Gets Personal". The Wall Street Journal. p. W9. Retrieved 2009-12-23.
13. Hafner, Katie (October 2, 2006). "Netflix offers cash for good suggestions". The New York Times. Retrieved 2009-12-23.
14. Lim, Myungeun; Kim, Juntae (2001). "An Adaptive Recommendation System with a Coordinator Agent". Proceedings of the First Asia-Pacific Conference on Web Intelligence: Research and Development. Asia-Pacific Conference on Web Intelligence. Lecture Notes in Computer Science. Vol. 2198/2001. Springer Berlin/Heidelberg. pp. 438–442. doi:10.1007/3-540-45490-X_56. ISBN 978-3-540-42730-8. Retrieved 2009-12-30.
15. Gladwell, Malcolm (October 4, 1999). "Annals of Marketing: The Science of the Sleeper: How the Information Age Could Blow Away the Blockbuster". New Yorker. 75 (29): 48–55. Archived from the original on December 30, 2009. Retrieved 2009-12-29.
16. Krulwich, Robert (December 10, 1999). "ABC Nightline: Soulmate". ABC.
17. "SIGCHI 2003 Election Results". SIGCHI Bulletin. 35 (3). July–August 2003. Retrieved 2010-01-04.
18. Konstan, Joseph (March–April 2004). "President's Report: Advancing the Field". SIGCHI Bulletin. 36 (2). Retrieved 2009-12-30.
19. Herlocker, Jon; Konstan, Joseph; Riedl, John (2000). "Explaining Collaborative Filtering Recommendations". Proceedings of the 2000 ACM conference on Computer supported cooperative work. Computer Supported Cooperative Work. ACM Press. pp. 241–259. doi:10.1145/358916.358995. ISBN 1-58113-222-0.
20. Schafer, J. Ben; Konstan, Joseph; Riedl, John (2002). "Meta-recommendation Systems: User-controlled Integration of Diverse Recommendations". Proceedings of the eleventh international conference on Information and knowledge management. Conference on Information and Knowledge Management. ACM Press. pp. 43–51. doi:10.1145/584792.584803. ISBN 1-58113-492-4. Retrieved 2010-01-06.
21. Lueg, Christopher; Fisher, Danyel, eds. (2003). From Usenet to CoWebs: Interacting with Social Information Spaces. Springer. ISBN 978-1-85233-532-8.
22. Terveen, Loren; Hill, Will; Amento, Brian; McDonald, David; Creter, Josh (March 1997). "PHOAKS: a system for sharing recommendations". Communications of the ACM. 40 (3): 59–62. CiteSeerX 10.1.1.103.8264. doi:10.1145/245108.245122. ISSN 0001-0782. S2CID 207201836.
23. Harper, F. Maxwell; Frankowski, Dan; Drenner, Sara; Ren, Yuqing; Kiesler, Sara; Terveen, Loren; Kraut, Robert; Riedl, John (2007). "Talk amongst yourselves: inviting users to participate in online conversations". Proceedings of the 12th international conference on Intelligent user interfaces. International Conference on Intelligent User Interfaces. ACM Press. pp. 62–71. doi:10.1145/1216295.1216313. ISBN 978-1-59593-481-9. Retrieved 2009-12-29.
24. Harper, F. Maxwell; Li, Xin; Chen, Yan; Konstan, Joseph (2005). "An Economic Model of User Rating in an Online Recommender System". User Modeling 2005 Proceedings. 10th International Conference on User Modeling. Lecture Notes in Computer Science. Vol. 3538. Springer. pp. 307–316. doi:10.1007/11527886_40. ISBN 978-3-540-27885-6. Retrieved 2009-12-29.
25. Rashid, Al Mamunur; Ling, Kimberly; Tassone, Regina D.; Resnick, Paul; Kraut, Robert; Riedl, John (2006). "Motivating Participation by Displaying the Value of Contribution". Proceedings of the 2006 CHI Conference. ACM SIGCHI Conference on Human Factors in Computing Systems. Lecture Notes in Computer Science. Vol. 3538. Springer. pp. 955–958. doi:10.1145/1124772.1124915. ISBN 1-59593-372-7. Retrieved 2009-12-30.
26. "cyclopath.org". cyclopath.org. Retrieved 2012-01-06.
27. Chin, Richard (July 19, 2008). "Mapquest for the cycling set". St. Paul Pioneer Press. p. A1. Archived from the original on February 18, 2015. .
28. "Software System Award - Award Winners: List By Year". acm.org. Archived from the original on 2016-05-05. Retrieved 2013-08-24.
29. "Obituary: U's John Riedl was pioneer of recommender systems". Star Tribune. Retrieved 2021-03-14.
30. "New professor brings focus on human-centered machine learning". June 5, 2020.
31. Vig, Jesse; Sen, Shilad; Riedl, John (2009). "Tagsplanations: Explaining Recommendations using Tags". Proceedings of the 13th international conference on Intelligent user interfaces. International Conference on Intelligent User Interfaces. ACM Press. pp. 47–56. doi:10.1145/1502650.1502661. ISBN 978-1-60558-168-2. Retrieved 2009-12-30.
32. "MovieLens". 6 September 2013.
33. Segaran, Toby (August 2007). Programming Collective Intelligence: Building Smart Web 2.0 Applications. O'Reilly Media. ISBN 978-0-596-52932-1.
34. Sen, Shilad; Vig, Jesse; Riedl, John (2009). "Tagommenders: Connecting Users to Items through Tags". Proceedings of the 18th international conference on World wide web. International World Wide Web Conference. ACM Press. pp. 671–680. doi:10.1145/1526709.1526800. ISBN 978-1-60558-487-4. Retrieved 2009-12-29.
35. Frankowski, Dan; Cosley, Dan; Sen, Shilad; Terveen, Loren; Riedl, John (2006). "You are what you say: privacy risks of public mentions". Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval. Annual ACM Conference on Research and Development in Information Retrieval. ACM Press. pp. 565–572. doi:10.1145/1148170.1148267. ISBN 1-59593-369-7. Retrieved 2009-12-29.
36. Schneier, Bruce (August 2006). "Schneier on Security: A blog covering security and security technology". Retrieved 2009-12-29.
37. Priedhorsky, Reid; Chen, Jilin; Lam, Shyong (Tony); Panciera, Katherine; Terveen, Loren; Riedl, John (2007). "Creating, Destroying, and Restoring Value in Misplaced Pages". Proceedings of the 2007 international ACM conference on Supporting group work. Conference on Supporting Group Work. ACM Press. pp. 259–268. doi:10.1145/1316624.1316663. ISBN 978-1-59593-845-9. Archived from the original on 2010-12-15. Retrieved 2009-12-29.
38. Cosley, Dan; Frankowski, Dan; Terveen, Loren; Riedl, John (2008). "SuggestBot: Using Intelligent Task Routing to Help People Find Work in Misplaced Pages". Proceedings of the 12th international conference on Intelligent user interfaces. Conference on Intelligent User Interfaces. ACM Press. pp. 32–41. doi:10.1145/1216295.1216309. ISBN 978-1-59593-481-9. Retrieved 2010-01-04.
39. Lam, Shyong (Tony) K.; Riedl, John (2009). "Is Misplaced Pages Growing a Longer Tail?". Proceedings of the 2009 international ACM conference on Supporting Group Work. International Conference on Supporting Group Work. ACM Press. pp. 105–114. doi:10.1145/1531674.1531690. ISBN 978-1-60558-500-0. Retrieved 2010-01-04.
40. Halfaker, Aaron; Kittur, Aniket; Kraut, Robert; Riedl, John (2009). "A Jury of Your Peers: Quality, Experience and Ownership in Misplaced Pages". Proceedings of the 2009 International Symposium on Wikis and Open Collaboration. International Symposium on Wikis and Open Collaboration. ACM Press. doi:10.1145/1641309.1641332. ISBN 978-1-60558-730-1. Retrieved 2010-01-04.
41. Panciera, Katherine; Halfaker, Aaron; Terveen, Loren (2009). "Wikipedians are born, not made: a study of power editors on Misplaced Pages". Proceedings of the 2009 international ACM conference on Supporting Group Work. International Conference on Supporting Group Work. ACM Press. doi:10.1145/1531674.1531682. ISBN 978-1-60558-500-0. Retrieved 2010-01-04.
42. Ekstrand, Michael; Riedl, John (2009). "rv you're dumb: Identifying Discarded Work in Wiki Article History". Proceedings of the 2009 International Symposium on Wikis and Open Collaboration. International Symposium on Wikis and Open Collaboration. ACM Press. doi:10.1145/1641309.1641317. ISBN 978-1-60558-730-1. Retrieved 2010-01-04.
43. Lam, Shyong K.; Anuradha, Uduwage; Zhenhua, Dong; Sen, Shilad; Riedl, John (2011). "WP: Clubhouse? An Exploration of Misplaced Pages's Gender Imbalance". Proceedings of the 7th international symposium on wikis and open collaboration. The International Symposium on Wikis and Open Collaboration. ACM Press. pp. 1–10. doi:10.1145/2038558.2038560. Archived from the original on 2011-09-20. Retrieved 2011-10-25.
44. Lam, Shyong K.; Riedl, John (2004). "Shilling recommender systems for fun and profit". Proceedings of the 13th international conference on World Wide Web. International World Wide Web Conference. ACM Press. pp. 393–402. doi:10.1145/988672.988726. ISBN 1-58113-844-X. Retrieved 2010-01-04.
45. Charles, Julie (May 22, 2003). "False Web Ratings Swing Opinion, Study Says". The New York Times. p. G4. Retrieved 2009-12-23.
46. Cosley, Dan; Lam, Shyong K.; Albert, Istvan; Konstan, Joseph A.; Riedl, John (2003). "Is Seeing Believing? How Recommender Systems Influence Users' Opinions". ACM SIGCHI Conference on Human Factors in Computing Systems. Conference on Human Factors in Computing Systems. ACM Press. doi:10.1145/642611.642713. ISBN 1-58113-630-7. Retrieved 2010-01-04.
47. Priedhorsky, Reid; Masli, Mikhil; Terveen, Loren (2010). "Eliciting and Focusing Geographic Volunteer Work". Proceedings of the 2010 ACM conference on Computer supported cooperative work. Conference on Computer Supported Cooperative Work. ACM Press. doi:10.1145/1718918.1718931. ISBN 978-1-60558-795-0. Archived from the original on 2010-06-12. Retrieved 2010-03-02.

External links

• GroupLens Research Homepage

• University of Minnesota
• Human–computer interaction
• Computer science research organizations
• Research organizations in the United States
• Recommender systems