Papers

2024

OSINT Research Studios: A flexible crowdsourcing framework to scale up open source intelligence investigations
Anirban Mukhopadhyay, Sukrit Venkatagiri, Kurt Luther
CSCW 2024 Paper

Redistrict Online: Supporting Public School Rezoning Deliberations through Visualization of Complex Data and Multidisciplinary Constraints
Andreea Sistrunk, Nathan Self, Subhodip Biswas, Kurt Luther, Nervo Verdezoto, Javier Tibau Escuela, Naren Ramakrishnan
CSCW 2024 Paper

Understanding the Relationship Between Social Identity and Self-Expression Through Animated Gifs on Social Media
Marx Boyuan Wang, Md Momen Bhuiyan, Eugenia Ha Rim Rho, Kurt Luther, Sang Won Lee
CSCW 2024 Paper

2023

DoubleCheck: Designing community-based assessability for historical person identification
Vikram Mohanty, Kurt Luther
ACM Journal on Computing and Cultural Heritage

Community-driven AI support for genealogy research
Fei Shan, Kurt Luther
CSCW 2023 Workshop Paper

Developing Collaboration and Competition Skills in a Crowd of Student OSINT Investigators
Anirban Mukhopadhyay, Sukrit Venkatagiri, Kurt Luther
CSCW 2023 Workshop Paper

Behind the Canvas: A Human-AI Workflow for Tracing 19th-Century Photographers and Studio Backdrops
Vikram Mohanty, Jude Lim, Terryl Dodson, Kurt Luther
HCOMP 2023 Demo Best Poster/Demo Award

Photo Steward: A deliberative collective intelligence workflow for validating historical archives
Vikram Mohanty, Kurt Luther
CI 2023 Paper

BackTrace: A human-AI collaborative approach to discovering studio backdrops in historical photographs
Jude Lim, Vikram Mohanty, Terryl Dodson, Kurt Luther
HCOMP 2023 Paper

CoSINT: Designing a collaborative capture the flag competition to investigate misinformation
Sukrit Venkatagiri, Anirban Mukhopadhyay, David Hicks, Aaron Brantly, Kurt Luther
DIS 2023 Paper

Diverse perspectives can mitigate political bias in crowdsourced content moderation
Jacob Thebault-Spieker, Sukrit Venkatagiri, Naomi Mine, Kurt Luther
FAccT 2023 Paper

Redistrict: Designing a self-serve interactive boundary optimization system
Andreea Sistrunk, Nathan Self, Subhodip Biswas, Kurt Luther, Nervo Verdezoto, Naren Ramakrishnan
DIS 2023 Demo

Sedition Hunters: A Quantitative Study of the Crowdsourced Investigation into the 2021 U.S. Capitol Attack
Tianjiao Yu, Sukrit Venkatagiri, Ismini Lourentzou, Kurt Luther
WWW 2023 Paper

Human-in-the-loop for computer vision assurance: A survey
Matthew Wilchek, Will Hanley, Jude Lim, Kurt Luther, Feras Batarseh
Engineering Applications of Artificial Intelligence

Redrawing public school boundaries: An intersection of geography, education policy, and computer science
Andreea Sistrunk, Nathan Self, Subhodip Biswas, James A. Egenrieder, Kurt Luther, Adriana Glenn, Naren Ramakrishnan
ECSCW 2023 Exploratory Paper

Save A Tree or 6 kg of CO2? Understanding Effective Carbon Footprint Interventions for Eco-Friendly Vehicular Choices
Vikram Mohanty, Alexandre Filipowicz, Nayeli Bravo, Rumen Iliev, Scott Carter, David Ayman Shamma
CHI 2023 Paper Best Paper Honorable Mention Award

Designing Human-AI Collaborative Systems for Historical Photo Identification
Vikram Mohanty
Virginia Tech Computer Science Ph.D. Dissertation

Backdrop Explorer: A Human-AI Collaborative Approach for Exploring Studio Backdrops in Civil War Portraits
Jude Lim
Virginia Tech Computer Science M.S. Thesis

Behind the Scenes: Evaluating Computer Vision Embedding Techniques for Discovering Similar Photo Backgrounds
Terryl Dodson
Virginia Tech Computer Science M.S. Thesis

2022

Supporting and Transforming High-Stakes Investigations with Expert-Led Crowdsourcing
Sukrit Venkatagiri
Virginia Tech Computer Science Ph.D. Dissertation

Civil War Twin: Exploring ethical challenges in designing an educational face recognition application
Manisha Kusuma, Vikram Mohanty, Marx Wang, Kurt Luther
AIES 2022 Paper

Pick Your CARbon: User Perceptions of Equivalencies for Carbon Emissions when Selecting Rideshares
Vikram Mohanty, Alexandre Filipowicz, Nayeli Bravo, Rumen Iliev, Scott Carter, David A. Shamma
AutomotiveUI 2022 Poster

Towards designing a flexible expert-led crowdsourcing framework for investigating misinformation
Anirban Mukhopadhyay, Sukrit Venkatagiri, Kurt Luther
Syracuse University Combating Misinformation Workshop Paper

Compete, collaborate, investigate: Exploring the social structures of open source intelligence investigations
Yasmine Belghith, Sukrit Venkatagiri, Kurt Luther
CHI 2022 Paper

Towards designing a flexible expert-led crowdsourcing framework for investigating misinformation
Anirban Mukhopadhyay, Sukrit Venkatagiri, Kurt Luther
CHI 2022 Workshop Paper

Redistricting Practices in Public Schools: Social Progress or Necessity?
Andreea Sistrunk, Subhodip Biswas, Nathan Self, Kurt Luther, Naren Ramakrishnan
ECSCW 2022 Poster

Flud: A hybrid crowd-algorithm approach for visualizing biological networks
Aditya Bharadwaj, David Gwizdala, Yoonjin Kim, Kurt Luther, T. M. Murali
ACM Transactions on Computer-Human Interaction

2021

Civil War Twin: Exploring ethical challenges in designing an educational face recognition application
Manisha Kusuma
Virginia Tech Computer Science M.S. Thesis

Sedition Hunters: Countering extremism through collective action
Sukrit Venkatagiri, Vikram Mohanty, Tianjiao Yu, Kurt Luther
CSCW 2021 Workshop Paper

Supporting high-stakes investigations with expert-led crowdsourcing
Sukrit Venkatagiri
HCOMP 2021 Graduate Symposium

Designing human-AI collaborative systems for historical photo identification
Vikram Mohanty
HCOMP 2021 Graduate Symposium

Double-checking history: Designing assessable systems for historical photo identification
Vikram Mohanty, Kurt Luther
HCOMP 2021 Demo

When content decides where you belong: Investigating micro communities on VSCO
Vikram Mohanty, Geneviève Patterson
HCOMP 2021 Poster

SleuthTalk: Identifying historical photos with intelligent shortlists, private collaboration, and structured feedback
Liling Yuan, Vikram Mohanty, Kurt Luther
CSCW 2021 Demo

The social structures of OSINT: Examining collaboration and competition in open source intelligence investigations
Yasmine Belghith
Virginia Tech Computer Science M.S. Thesis

SleuthTalk: Addressing the last-mile problem in historical person identification with privacy, collaboration, and structured feedback
Liling Yuan
Virginia Tech Computer Science M.S. Thesis

CrowdSolve: Managing tensions in an expert-led crowdsourced investigation
Sukrit Venkatagiri, Aakash Gautam, Kurt Luther
CSCW 2021 Paper

The psychological well-being of content moderators: The emotional labor of commercial moderation and avenues for improving support
Miriah Steiger, Timir J. Bharucha, Sukrit Venkatagiri, Martin J. Riedl, Matthew Lease
CHI 2021 Paper

The expanding circles of information behavior and human–computer interaction
Tim Gorichanaz, Sukrit Venkatagiri
Journal of Librarianship & Information Science

The collective wisdom handbook: Perspectives on crowdsourcing in cultural heritage
Mia Ridge, Samantha Blickhan, Meghan Ferriter, Austin Mast, Ben Brumfield, Brendon Wilkins, Daria Cybulska, Denise Burgher, Jim Casey, Kurt Luther, Michael Haley Goldman, Nick White, Pip Willcox, Sara Carlstead Brumfield, Sonya J. Coleman, Ylva Berglund Prytz
Book

2020

Find your twin in history: Exploring ethical design challenges in facial recognition
Vikram Mohanty, Marx Wang, Manisha Kusuma, David Thames, Kurt Luther
CSCW 2020 Workshop Paper

CrowdTrace: Visualizing provenance in distributed sensemaking
Tianyi Li, Yasmine Belghith, Chris North, Kurt Luther
VIS 2020 Paper

Mixed-initiative methods for following design guidelines in creative tasks
Aditya Bharadwaj
Virginia Tech Computer Science Ph.D. Dissertation

Solving mysteries with crowds: Supporting crowdsourced sensemaking with a modularized pipeline and context slices
Tianyi Li
Virginia Tech Computer Science Ph.D. Dissertation

Supporting historical photo identification with face recognition and crowdsourced human expertise
Vikram Mohanty, David Thames, Sneha Mehta, Kurt Luther
IJCAI 2020 Paper

Introduction to the special issue on negotiating truth and trust in socio-technical systems
Kurt Luther, Andrea Kavanaugh, Jacob Thebault-Spieker, Judd Antin
ACM Transactions on Social Computing

Photo Sleuth: Identifying historical portraits with face recognition and crowdsourced human expertise
Vikram Mohanty, David Thames, Sneha Mehta, Kurt Luther
ACM Transactions on Interactive Intelligent Systems

2019

Read-Agree-Predict: A crowdsourced approach to discovering relevant primary sources for historians
Nai-Ching Wang, David Hicks, Paul Quigley, Kurt Luther
Human Computation Journal

Solving AI’s last-mile problem with crowd-augmented expert work
Kurt Luther
2019 AAAI Fall Symposium on Artificial Intelligence and Work

GroundTruth: Augmenting expert image geolocation with crowdsourcing and shared representations
Sukrit Venkatagiri, Jacob Thebault-Spieker, Rachel Kohler, John Purviance, Rifat Sabbir Mansur, Kurt Luther
CSCW 2019 Paper

Dropping the baton? Understanding errors and bottlenecks in a crowdsourced sensemaking pipeline
Tianyi Li, Chandler J. Manns, Chris North, Kurt Luther
CSCW 2019 Paper

Solving Mysteries with the Wisdom of Crowds: A Modularized Pipeline and Context Slices
Tianyi Li
CSCW 2019 Doctoral Consortium

Designing for coordinated action: Challenges and opportunities of working with experts
Sukrit Venkatagiri, Jacob Thebault-Spieker, Kurt Luther
CSCW 2019 Workshop Paper

Second Opinion: Supporting last-mile person identification with crowdsourcing and face recognition
Vikram Mohanty, Kareem Abdol-Hamid, Courtney Ebersohl, Kurt Luther
HCOMP 2019 Paper

PairWise: Mitigating political bias in crowdsourced content moderation
Jacob Thebault-Spieker, Sukrit Venkatagiri, David Mitchell, Chris Hurt, Kurt Luther
HCOMP 2019 Demo Best Poster/Demo Award

It’s QuizTime: A study of online verification practices on Twitter
Sukrit Venkatagiri, Jacob Thebault-Spieker, Sarwat Kazmi, Efua Akonor, Kurt Luther
HCOMP 2019 Poster

Mixed-initiative methods for following design guidelines in creative tasks
Aditya Bharadwaj
HCOMP 2019 Doctoral Consortium

Critter: Augmenting creative work with dynamic checklists, automated quality assurance, and contextual reviewer feedback
Aditya Bharadwaj, Pao Siangliulue, Adam Marcus, Kurt Luther
CHI 2019 Paper

Flud: A hybrid crowd-algorithm approach for visualizing biological networks
Aditya Bharadwaj, David Gwizdala, Yoonjin Kim, Kurt Luther, T.M. Murali
CHI 2019 Workshop Paper

Flud: A hybrid crowd-algorithm approach for visualizing biological networks
Aditya Bharadwaj, David Gwizdala, Yoonjin Kim, Kurt Luther, T.M. Murali
BioVis@ISMB 2019 Talk and Poster

Photo Sleuth: Combining human expertise and face recognition to identify historical portraits
Vikram Mohanty, David Thames, Sneha Mehta, Kurt Luther
IUI 2019 Paper Best Paper Award

What Data Should I Protect? A Recommender and Impact Analysis Design to Assist Decision Making
Tianyi Li, Gregorio Convertino, Ranjeet Kumar Tayi, Shima Kazerooni
IUI 2019 Paper

Adding intelligence to a data security analysis system: recommendation and planning support
Tianyi Li, Gregorio Convertino, Ranjeet Kumar Tayi, Shima Kazerooni, Gary Patterson
IUI 2019 Demo

Validating the national-scale remote sensing models using crowdsourced observations
Jill M. Derwin, Valerie A. Thomas, Randolph H. Wynne, S. Seth Peery, John Coulston, Kurt Luther, Greg Liknes, Stacie Bender
Pecora 21 and ISRSE-38 Talk

Supporting Historical Research and Education with Crowdsourced Analysis of Primary Sources
Nai-Ching Wang
Virginia Tech Computer Science Ph.D. Dissertation

2018

Response to “Heuristics for the Online Curator”
Sukrit Venkatagiri, Amy X. Zhang
Rita Allen Foundation Misinformation Solutions Forum

Exploring Trade-Offs Between Learning and Productivity in Crowdsourced History
Nai-Ching Wang, David Hicks, Kurt Luther
CSCW 2018 Paper

CrowdIA: Solving Mysteries with Crowdsourced Sensemaking
Tianyi Li, Kurt Luther, Chris North
CSCW 2018 Paper

Localness and Urbanness in Geographic Crowd Work
Sukrit Venkatagiri, Jacob Thebault-Spieker, Aliza Camacho, Kurt Luther
CSCW 2018 Workshop Paper

Validating the 2011 and 2016 NLCD Tree Canopy Cover Products using Crowdsourced Interpretations
Jill M. Derwin, Valerie A. Thomas, Randolph H. Wynne, S. Seth Peery, John Coulston, Kurt Luther, Greg Liknes, Stacie Bender
AGU 2018 Poster

The American Soldier Collaborative Digital Archive
Edward J.K. Gitre, Kurt Luther
NEH White Paper

The Effect of Edge Bundling and Seriation on Sensemaking of Biclusters in Bipartite Graphs
Maoyuan Sun, Jian Zhao, Hao Wu, Kurt Luther, Chris North, Naren Ramakrishnan
IEEE Transactions on Visualization and Computer Graphics

CrowdLayout: Crowdsourced Design and Evaluation of Biological Network Visualizations
Divit P. Singh, Lee Lisle, T. M. Murali, Kurt Luther
CHI 2018 Paper

Geolocating Images with Crowdsourcing and Diagramming
Rachel Kohler, John Purviance, Kurt Luther
IJCAI 2018 Paper

Photo Sleuth: Combining Collective Intelligence and Computer Vision to Identify Historical Portraits
Vikram Mohanty, David Thames, Kurt Luther
CI 2018 Talk

Are 1,000 Features Worth A Picture? Combining Crowdsourcing and Face Recognition to Identify Civil War Soldiers
Vikram Mohanty, David Thames, Kurt Luther
HCOMP 2018 Demo Best Poster/Demo Award

Crowdsourcing Intelligence Analysis with Context Slices
Tianyi Li, Asmita Shah, Kurt Luther, Chris North
CHI 2018 Workshop Paper

Verifying Truth from the Ground: Leveraging Human Strengths in the Image Geolocation Process
Sukrit Venkatagiri, Jacob Thebault-Spieker, Kurt Luther
HCIC 2018 Poster

Human Computation for Image and Video Analysis
Kurt Luther
AI Magazine

HyperTuner: Visual Analytics for Hyperparameter Tuning by Professionals
Tianyi Li, Gregorio Convertino, Wenbo Wang, Haley Most, Tristan Zajonc, Yi-Hsun Tsai
IEEE VIS 2018 Workshop Paper

2017

Supporting Image Geolocation with Diagramming and Crowdsourcing
Rachel Kohler, John Purviance, Kurt Luther
HCOMP 2017 Paper Notable Paper Award

GroundTruth: Bringing Together Experts and Crowds for Image Geolocation
Rachel Kohler, John Purviance, Kurt Luther
HCOMP 2017 Workshop Paper

Supporting Open Source Investigative Journalism with Crowdsourced Image Geolocation
Rachel Kohler
Virginia Tech Computer Science M.S. Thesis William Preston Society Master’s Thesis Award

GraphSpace: Stimulating Interdisciplinary Collaborations in Network Biology.
Aditya Bharadwaj, Divit P. Singh, Anna Ritz, Allison N. Tegge, Christopher L. Poirel, Pavel Kraikivski, Neil Adames, Kurt Luther, Shiv D. Kale, Jean Peccoud, John J. Tyson, T. M. Murali
Bioinformatics

GraphSpace: Stimulating Interdisciplinary Collaborations in Network Biology
Aditya Bharadwaj, Divit P. Singh, Anna Ritz, Allison N. Tegge, Christopher L. Poirel, Pavel Kraikivski, Neil Adames, Kurt Luther, Shiv D. Kale, Jean Peccoud, John J. Tyson, T. M. Murali
BOSC@ISMB 2017 Talk

Crowdsourced Image Geolocation as Collective Intelligence
Rachel Kohler, Kurt Luther
CI 2017 Poster

2016

GraphCrowd: Harnessing the Crowd to Lay Out Graphs with Applications to Cellular Signaling Pathways
Divit P. Singh
Virginia Tech Computer Science M.S. Thesis

Researching and Learning History via Crowdsourcing
Nai-Ching Wang
HCOMP 2016 Doctoral Consortium

Crowdnection: Connecting High-level Concepts with Historical Documents via Crowdsourcing
Nai-Ching Wang
CHI 2016 Student Research Competition

An Exploratory Study of Human Performance in Image Geolocation Tasks
Sneha Mehta, Chris North, Kurt Luther
HCOMP 2016 Workshop Paper

Almost an Expert: The Effects of Rubrics and Expertise on Perceived Value of Crowdsourced Design Critiques
Alvin Yuan, Kurt Luther, Markus Krause, Sophie Isabel Vennix, Steven P. Dow, Björn Hartmann
CSCW 2016 Paper

2015

Crowdlines: Supporting Synthesis of Diverse Information Sources through Crowdsourced Outlines
Kurt Luther, Nathan Hahn, Steven P. Dow, Aniket Kittur
HCOMP 2015 Paper

When Should We Use Real Names in Published Accounts of Internet Research? 
Amy Bruckman, Kurt Luther, Casey Fiesler
Digital Research Confidential: The Secrets of Studying Behavior Online

Structuring, Aggregating, and Evaluating Crowdsourced Design Critique
Kurt Luther, Jari-Lee Tolentino, Wei Wu, Amy Pavel, Brian P. Bailey, Maneesh Agrawala, Björn Hartmann, Steven P. Dow
CSCW 2015 Paper

Supporting Local News Sharing with Mobile Crowdsourcing and Large Display Technologies
Kurt Luther, Andrea Kavanaugh, Michael Horning
CSCW 2015 Workshop Paper

2014 and earlier

Curated City: Capturing Individual Mental Maps Through Social City Guides
Justin B. Cranshaw, Kurt Luther, Patrick Gage Kelley, Norman Sadeh
CHI 2014 Paper

CrowdCrit: Crowdsourcing and Aggregating Visual Design Critique
Kurt Luther, Amy Pavel, Wei Wu, Jari-lee Tolentino, Maneesh Agrawala, Björn Hartmann, Steven P. Dow
CSCW 2014 Demo

How Can Crowdsourcing Help Individuals Learn?
Kurt Luther, Steven Dow, Aniket Kittur
CSCW 2014 Workshop Paper

Redistributing Leadership in Online Creative Collaboration
Kurt Luther, Casey Fiesler, Amy Bruckman
CSCW 2013 Paper Best Paper Award

Supporting and Transforming Leadership in Online Creative Collaboration
Kurt Luther
Georgia Tech Human-Centered Computing Ph.D. Dissertation

Who Gives a Tweet: Evaluating Microblog Content Value
Paul André, Michael Bernstein, Kurt Luther
CSCW 2012 Paper Best Paper Honorable Mention Award

Fast, Accurate, and Brilliant: Realizing the Potential of Crowdsourcing and Human Computation
Kurt Luther
CHI 2011 Workshop Paper

Leadership and Success Factors in Online Creative Collaboration
Kurt Luther, Amy Bruckman
IEEE Potentials

Why It Works (When It Works): Success Factors in Online Creative Collaboration
Kurt Luther, Kelly Caine, Kevin Ziegler, Amy Bruckman
GROUP 2010 Paper

Edits & Credits: Exploring Integration and Attribution in Online Creative Collaboration
Kurt Luther, Nicholas Diakopoulos, Amy Bruckman
alt.chi 2010 Paper

Designing for Schadenfreude (or, how to express well-being and see if you’re boring people)
Paul André, m.c. schraefel, Alan Dix, Ryen W. White, Michael Bernstein, Kurt Luther
CHI 2010 Workshop Paper

Pathfinder: An Online Collaboration Environment for Citizen Scientists
Kurt Luther, Scott Counts, Kristin B. Stecher, Aaron Hoff, Paul Johns
CHI 2009 Paper

An Empirical Study of Cognition and Theatrical Improvisation
Brian Magerko, Waleed Manzoul, Mark Riedl, Allan Baumer, Daniel Fuller, Kurt Luther, Celia Pearce
C&C 2009 Paper

CHIstory
Michael Bernstein, Paul André, Kurt Luther, Erin Treacy Solovey, Erika S. Poole, Sharoda A. Paul, Shaun K. Kane, Jonathan Grudin
CHI 2009 Video Most Entertaining Video Award

Predicting Successful Completion of Online Collaborative Animation Projects
Kurt Luther, Kevin Ziegler, Kelly E. Caine, Amy Bruckman
C&C 2009 Poster

Provelt: A New Tool for Supporting Citation in MediaWiki
Kurt Luther, Matthew Flaschen, Andrea Forte, Christopher Jordan, Amy Bruckman
WikiSym 2009 Demo

Flash Collabs: Collaborative Innovation Networks in Online Communities of Animators
Kurt Luther, Amy Bruckman
COINS 2009 Talk

Leadership in Online Creative Collaboration
Kurt Luther, Amy Bruckman
CSCW 2008 Paper

Games for Virtual Team Building
Jason B. Ellis, Kurt Luther, Katherine Bessière, Wendy A. Kellogg
DIS 2008 Paper

Audio Puzzler: Piecing Together Time-Stamped Speech Transcripts with a Puzzle Game
Nicholas Diakopoulos, Kurt Luther, Irfan Essa
MM 2008 Paper

Opening the Black Box: Four Views of Transparency in Remix Culture
Sarita Yardi, Kurt Luther, Nicholas Diakopoulos, Amy Bruckman
CSCW 2008 Workshop Paper

RevisiTour: Enriching the Tourism Experience with User-Generated Content
Youn-ah Kang, John Stasko, Kurt Luther, Avinash Ravi, Yan Xu
ENTER 2008 Paper

Games for Virtual Team Building
Jason B. Ellis, Kurt Luther, Katherine Bessière, Wendy A. Kellogg
CSCW 2008 Workshop Paper

The Evolution of Authorship in a Remix Society
Nicholas Diakopoulos, Kurt Luther, Yevgeniy (Eugene) Medynskiy, Irfan Essa
HT 2007 Paper

Distributed Creativity
Kurt Luther, Nicholas Diakopoulos
C&C 2007 Workshop Paper