Paper accepted to CHI 2018 Sensemaking workshop

Our paper, Crowdsourcing Intelligence Analysis with Context Slices, was accepted to the CHI 2018 Sensemaking in a Senseless World workshop in the most competitive long presentation category (21% acceptance rate). Congratulations to Crowd Lab co-authors Tianyi Li (Ph.D. student) and Asmita Shah (undergraduate researcher), as well as Tianyi’s co-advisor, Dr. Chris North.

Dr. Luther gave the presentation at the conference in Montreal, Canada, in April.

Paper accepted for CHI 2018

CHI 2018 logo

Our full paper on CrowdLayout, a system that uses crowdsourcing to design better layouts of biological network visualizations, was accepted for the CHI 2018 conference in Montreal, Canada. The acceptance rate for this top-tier HCI conference was 26% (of 2,590 submissions). Congrats to Crowd Lab alumni Divit Singh and Lee Lisle, and collaborator Dr. T.M. Murali, on this accomplishment.

Notable Paper Award at HCOMP 2017

Adam Kalai, Jeff Nichols, and Steven Dow presenting Notable Paper Award to Kurt Luther at HCOMP 2017

Our paper on crowdsourced image geolocation and diagramming won the Notable Paper Award at HCOMP 2017. Congrats to Crowd Lab alums Rachel Kohler and John Purviance, co-authors of the paper, for this recognition. In the photo above, Dr. Luther receives the award certificate on behalf of his co-authors from Adam Kalai and Steven Dow (HCOMP 2017 co-chairs) and Jeff Nichols (Awards committee).

You can read the award-winning paper, Supporting Image Geolocation with Diagramming and Crowdsourcing, in the online proceedings.

GraphSpace published in Bioinformatics journal


Our work on GraphSpace, an online hub where scientists can share network data, was published in Bioinformatics journal. The title of the article is, GraphSpace: stimulating interdisciplinary collaborations in network biology. The authors include Dr. Luther, his collaborator Dr. T.M. Murali, and Crowd Lab alum Divit Singh.

Here’s the abstract for the article:

Networks have become ubiquitous in systems biology. Visualization is a crucial component in their analysis. However, collaborations within research teams in network biology are hampered by software systems that are either specific to a computational algorithm, create visualizations that are not biologically meaningful, or have limited features for sharing networks and visualizations. We present GraphSpace, a web-based platform that fosters team science by allowing collaborating research groups to easily store, interact with, layout and share networks.

This work was partly funded by our NIH Big Data to Knowledge grant.

Paper accepted for GroupSight workshop at HCOMP 2017

Our paper on GroundTruth, a system that allows experts to collaborate with crowds on image geolocation tasks, was accepted for the second GroupSight workshop at HCOMP 2017. Congratulations to Crowd Lab alumni Rachel Kohler and John Purviance, co-authors on the accepted paper.

Here’s the abstract for the paper:

Geolocation, the process of identifying the specific location where a photo or video was taken, is an important task in verifying evidence for investigations in journalism, national security, human rights, and other domains. However, experts typically perform geolocation work as a time-consuming, manual process. This paper introduces GroundTruth, a web-based system that leverages the powerful vision system of crowd workers to support experts in image geolocation tasks. We describe the technical contributions of GroundTruth and present preliminary results from an evaluation with expert geolocators and novice crowds.

For details, please check out the paper and and the corresponding video.

Paper accepted for HCOMP 2017

Our full paper on using crowdsourcing and diagramming to support image and video geolocation was accepted for the HCOMP 2017 conference in Québec City, Canada. Only 29% of paper submissions were accepted for this competitive crowdsourcing conference. Congrats to MS Computer Science alumna Rachel Kohler and BS Computer Science alumnus John Purviance, the first and second authors of the paper, respectively.

Here’s the abstract for the paper:

Geolocation, the process of identifying the precise location in the world where a photo or video was taken, is central to many types of investigative work, from debunking fake news posted on social media to locating terrorist training camps. Professional geolocation is often a manual, time-consuming process that involves searching large areas of satellite imagery for potential matches. In this paper, we explore how crowdsourcing can be used to support expert image geolocation. We adapt an expert diagramming technique to overcome spatial reasoning limitations of novice crowds, allowing them to support an expert’s search. In two experiments (n=1080), we found that diagrams work significantly better than ground-level photos and allow crowds to reduce a search area by half before any expert intervention. We also discuss hybrid approaches to complex image analysis combining crowds, experts, and computer vision.

The full version of the paper can be read here.

Finalist for CHI 2016 Student Research Competition

Congrats to Ph.D. student Nai-Ching Wang, who was a finalist in graduate student division of the CHI 2016 Student Research Competition. His paper is titled, “Crowdnection: Connecting High-level Concepts with Historical Documents via Crowdsourcing.” He traveled to San Jose, CA to attend the conference and present his research to a panel of expert judges.