Reading Group

The Crowd Lab hosts a crowdsourcing reading group at the end of its weekly lab meeting, every Wednesday around 10:30am in the Athenaeum. Lab members nominate and lead each paper and discussion. Non-lab members are welcome to attend, provided they read that week’s paper and contact the lab manager ahead of time.

Papers

Date Citation URL(s) Leader
06/19/19 Keiko Katsuragawa, Qi Shu, and Edward Lank. 2019. PledgeWork: Online Volunteering through Crowdwork. In CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019), May 4– 9, 2019, Glasgow, Scotland UK. ACM, New York, NY, USA, 11 pages. Paper Aditya Bharadwaj
06/13/19 Gray, M. and Suri, S. (2019). Ghost Work. Boston: Houghton Mifflin Harcourt Publishing Company. Chapters provided in Slack Sukrit Venkatagiri
05/29/19 Pascal Lessel, Maximilian Altmeyer, Lea Verena Schmeer, and An- tonio Krüger. 2019. “Enable or Disable Gamification?” – Analyzing the Impact of Choice in a Gamified Image Tagging Task. In CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019), May 4–9, 2019, Glasgow, Scotland UK. ACM, New York, NY, USA, 12 pages. Paper Aditya Bharadwaj
05/22/19 Tal August and Katharina Reinecke. 2019. Pay Attention, Please: Formal Language Improves Attention in Volunteer and Paid Online Experiments. In Proceedings of CHI Conference on Human Factors in Computing Systems (CHI ’19), May 4–9, 2019, Glasgow, Scotland UK. ACM, New York, NY, USA 11 Pages. Paper Tianyi Li
05/16/19 Julia Deeb-Swihart, Alex Endert, and Amy Bruckman. 2019. Understanding Law Enforcement Strategies and Needs for Combating Human Trafficking. In CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019), May 4–9, 2019, Glasgow, Scotland, UK.ACM, New York, NY, USA, 14 pages. Paper Kurt Luther
02/27/19 Heer, J. (2019). Agency plus automation: Designing artificial intelligence into interactive systems. Proceedings of the National Academy of Sciences, 116(6), 1844-1850. Paper Vikram Mohanty
02/20/19 Kittur, Aniket, Lixiu Yu, Tom Hope, Joel Chan, Hila Lifshitz-Assaf, Karni Gilon, Felicia Ng, Robert E. Kraut, and Dafna Shahaf. “Scaling up analogical innovation with crowds and AI.” Proceedings of the National Academy of Sciences 116, no. 6 (2019): 1870-1877. Paper Sukrit Venkatagiri
02/13/19 Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil ,and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In CHI Conference on Human Factors in Computing Systems Proceedings (CHI2019), May 4–9, 2019, Glasgow, Scotland UK. ACM, NewYork, NY, USA, 13 pages. Paper Aditya Bharadwaj
02/06/19 Eshwar Chandrasekharan, Umashanthi Pavalanathan, Anirudh Srinivasan, Adam Glynn, Jacob Eisenstein, and Eric Gilbert. 2017. You Can’t Stay Here: The Efficacy of Reddit’s 2015 Ban Examined Through Hate Speech. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 31 (December 2017), 22 pages. Paper Jacob Thebault-Spieker
9/19/18 Lee, S. W., Krosnick, R., Keelean, B., Vaidya, S., O’Keefe, S. D., Park, S. Y., Lasecki, W.S. “Exploring Real-time Collaboration in Crowd-Powered Systems Through a UI Design Tool”, In Proceedings of the International ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW 2018). New York, NY. Paper Sang Won Lee
9/12/18 Daniela Retelny, Michael S. Bernstein, and Melissa A. Valentine. 2017. No Workflow Can Ever Be Enough: How Crowdsourcing Workflows Constrain Complex Work. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 89 (December 2017), 23 pages. DOI: https://doi.org/10.1145/3134724 Paper Tianyi
8/29/18 Vineet Pandey, Amnon Amir, Justine Debelius, Embriette R. Hyde, Tomasz Kosciolek, Rob Knight, and Scott Klemmer. 2017. Gut Instinct: Creating Scientific Theories with Online Learners. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 6825-6836. DOI: https://doi.org/10.1145/3025453.3025769 Paper Dr. Luther
7/18/18 Jennifer Wortman Vaughan. Making Better Use of the Crowd: How Crowdsourcing Can Advance Machine Learning Research. Journal of Machine Learning Research 18(193):1−46, 2018. Paper Sukrit
7/11/18 Eric Horvitz. 1999. Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI ’99). ACM, New York, NY, USA, 159-166. DOI=http://dx.doi.org/10.1145/302979.303030 Paper Jake
6/13/18 Michael Veale, Max Van Kleek, and Reuben Binns. 2018. Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Paper 440, 14 pages. DOI: https://doi.org/10.1145/3173574.3174014 Paper Sukrit
5/23/18 Ming Yin, Siddharth Suri, and Mary L. Gray. 2018. Running Out of Time: The Impact and Value of Flexibility in On-Demand Crowdwork. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Paper 430, 11 pages. DOI: https://doi.org/10.1145/3173574.3174004 Paper Sukrit
2/-/18 For the month of February, we are discussing papers from the Systems of Truth workshop reading list.
12/6/17 Ujwal Gadiraju, Ricardo Kawase, Stefan Dietze, and Gianluca Demartini. 2015. Understanding Malicious Behavior in Crowdsourcing Platforms: The Case of Online Surveys. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15). ACM, New York, NY, USA, 1631-1640. Paper Rifat
11/8/17 Jacob Thebault-Spieker, Daniel Kluver, Maximillian Klein, Aaron Halfaker, Brent Hecht, Loren Terveen and Joseph Konstan. 2017. Simulation Experiments On (The Absence of) Ratings Bias in Reputation Systems. Proc. ACM Hum.-Comput. Interact. 1, 101. 1 (November 2017), 26 pages. DOI: 10.1145/3134736 Paper Dr. Luther
11/1/17 Lasecki, W. S., Murray, K. I., White, S., Miller, R. C., & Bigham, J. P. (2011). Real-time crowd control of existing interfaces. In Proceedings of the 24th annual ACM symposium on User interface software and technology (pp. 23-32). ACM. Paper Lee
10/18/17 Meredith Ringel Morris, Jeffrey P. Bigham, Robin Brewer, Jonathan Bragg, Anand Kulkarni, Jessie Li, and Saiph Savage. 2017. Subcontracting Microwork. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 1867-1876. DOI: https://doi.org/10.1145/3025453.3025687 Paper Sukrit
10/11/17 Joy Kim, Sarah Sterman, Allegra Argent Beal Cohen, Michael S. Bernstein. Mechanical Novel: Crowdsourcing Complex Work through Reflection and Revision (CSCW 2017) Paper Nai-Ching
10/4/17 Prithvijit Chattopadhyay, Deshraj Yadav, Viraj Prabhu, Arjun Chandrashekharan, Abhishek Das, Stefan Lee, Dhruv Batra, Devi Parikh
Evaluating Visual Conversational Agents via Cooperative Human-AI Games
(HCOMP 2017)
Paper Vikram
9/27/17 Jian Zhao, Michael Glueck, Petra Isenberg, Fanny Chevalier, Azam Khan (2017 August)
Supporting Handoff in Asynchronous Collaborative Sensemaking Using Knowledge-Transfer Graphs
(IEEE VAST honorable mention 2017)
Paper, Video Tianyi
9/20/17 H. Kaur, M. Gordon, Y. Yang, J. Bigham, E. Kamar, W. Lasecki (2017, October). CrowdMask: Using Crowds to Preserve Privacy in Crowd-Powered Systems via Progressive Filtering. In Proceedings of the 5th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2017). Paper Dr. Luther
8/16/17 Niloufar Salehi, Jaime Teevan, Shamsi Iqbal, and Ece Kamar. 2017. Communicating Context to the Crowd for Complex Writing Tasks. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW ’17). ACM, New York, NY, USA, 1890-1901. Paper Dr. Luther
8/2/17 Crowdsourcing good landmarks for in-vehicle navigation systems
David R. Large, Gary Burnett, Steve Benford & Keith Oliver
Behaviour & Information Technology Vol. 35 , Iss. 10,2016
Paper Lee
7/19/17 Jorge Goncalves, Simo Hosio, Denzil Ferreira, and Vassilis Kostakos. 2014. Game of words: tagging places through crowdsourcing on public displays. ACM, 705–714. Paper Navid
7/12/17 Vineet Pandey, Amnon Amir, Justine Debelius, Embriette R. Hyde, Tomasz Kosciolek, Rob Knight, and Scott Klemmer. 2017. Gut Instinct: Creating Scientific Theories with Online Learners. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 6825-6836. DOI: https://doi.org/10.1145/3025453.3025769 Paper Nai-Ching
7/5/17 Edith Law, Ming Yin, Joslin Goh, Kevin Chen, Michael A. Terry, and Krzysztof Z. Gajos. 2016. Curiosity Killed the Cat, but Makes Crowdwork Better. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA, 4098-4110. DOI: https://doi.org/10.1145/2858036.2858144 Paper Dr. Luther
6/21/17 Guy, I., Hashavit, A., & Corem, Y. (2015, February). Games for Crowds: A crowdsourcing game platform for the enterprise. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (pp. 1860-1871). ACM. Paper Lee
6/7/17 Yuanchao Shu, Kang G Shin, Tian He, and Jiming Chen. 2015. Last-mile navigation using smartphones. ACM, 512–524. Paper Navid
5/21/17 Joseph Chee Chang, Saleema Amershi, and Ece Kamar. 2017. Revolt: Collaborative Crowdsourcing for Labeling Machine Learning Datasets. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 2334-2346. DOI: https://doi.org/10.1145/3025453.3026044 Paper Nai-Ching
5/24/17 Edith Law, Krzysztof Z. Gajos, Andrea Wiggins, Mary L. Gray, and Alex Williams. 2017. Crowdsourcing as a Tool for Research: Implications of Uncertainty. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW ’17). ACM, New York, NY, USA, 1544-1561. DOI: https://doi.org/10.1145/2998181.2998197 Paper Dr. Luther