My research is on human-in-the-loop systems and the design of new algorithms, interaction techniques and incentive mechanisms for leveraging "the wisdom of the crowd" to solve problems in information retrieval, science and medicine. I am driven both by the desire to answer fundamental questions about the evolving nature of the human-machine partnership, and to address real-world problems while engaging real users over the Web. As part of my research, we are building two platforms for scientific and medical crowdsourcing: CrowdCurio and CrowdEEG.
E. Law, V. Cai, E. Liu, S. Sasy, J. Goh, A. Blidaru and D. Kulic. A Wizard-of-Oz Study of Curiosity in Human-Robot Interaction. To appear in IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), 2017.
M. A. O’Leary, K. Alphonse, M. Arce H., D. Cavaliere, A. Cirranello, T Dietterich, M. Julius, S. Kaufman, E. Law, M. Passarotti, A. Reft, J. Robalino, N. B. Simmons, S. Smith, D. Stevenson, E. Theriot, P. M. Velazco, R. Walls, M. Yu and M. Daly. Crowds Replicate Performance of Scientific Experts Scoring Phylogenetic Matrices of Phenotypes. To appear in Systematic Biology, 2017. (The definitive version is available here)
C. Willis, E. Law, A. Williams, B. Franzone, R. Bernardos, L. Bruno, C. Hopkins, C. Schorn, E. Weber, D. Park and C. Davis. CrowdCurio: an online crowdsourcing platform to facilitate climate change studies using herbarium specimens. In New Phytologist, 2017. (The definitive version is available here)
P. Jaini, Z. Chen, P. Carbajal, E. Law, L. Middleton, K. Regan, M. Schaekermann, G. Trimponias, J. Tung, and P. Poupart. Online Bayesian Transfer Learning for Sequential Data Modeling. In 5th International Conference on Learning Representations (ICLR), 2017.
E. Law, K. Z. Gajos, A. Wiggins, M. Gray and A. Williams. Crowdsourcing as a Tool for Research: Implications of Uncertainty. In CSCW 2017.
T. Tse, J. Salamon, A. Williams, H. Jiang and E. Law. Ensemble: A Hybrid Human-Machine System for Generating Melody Scores from Audio. In ISMIR 2016.
S. Pan, K. Larson, J. Bradshaw and E. Law. Dynamic Task Allocation Algorithm for Hiring Workers that Learn. In IJCAI 2016.
E. Law, M. Yin, J. Goh, K. Chen, M. Terry and K. Gajos. "Curiosity Killed the Cat, but Makes Crowdwork Better." In CHI 2016. * Best Paper Honorable Mention
E. Law, B. Grosz, L. M. Sanders and S. H. Fischer. "SimplyPut: Leveraging a Mixed-Expertise Crowd to Improve Health Literacy." In AAMAS Workshop on Human-Agent Interaction Design and Models 2013.
E. Law, C. Dalton, N. Merrill, A. Young, K. Z. Gajos. "Curio: A Platform for Supporting Mixed-Expertise Crowdsourcing." In HCOMP 2013.
O. Amir, B. Grosz, E.Law and R. Stern. "Collaborative Health Plan Support." In AAMAS 2013. * Challenges and Visions Track, Best Paper Second Prize
H. Zhang, E. Law, K. Gajos, E. Horvitz, R. C. Miller and D. Parkes. "Human Computation Tasks with Global Constraints: A Case Study." In CHI 2012. * Best Paper Honorable Mention
E. Law and L. von Ahn. Human Computation. Morgan & Claypool Synthesis Lectures on Artificial Intelligence and Machine Learning, edited by Ron Brachman, Tom Dietterich and William Cohen, June 2011.
E. Law. "Human Computation for Music Classification." In Music Data Mining, edited by T. Li, M. Ogihara and G. Tzanetakis. CRC Press/Chapman Hall, 2011.
E. Law, B. Settles, A. Snook, H. Surana, L. von Ahn and T. Mitchell. "Human Computation for Attribute and Attribute Value Acquisition." In CVPR Workshop on Fine-Grained Visual Categorization 2011.
E. Law, P. Bennett, and E. Horvitz. "The Effects of Choice in Routing Relevance Judgments." In SIGIR 2011.
E. Law and H. Zhang. "Towards Large-Scale Collaborative Planning: Answering High-Level Search Queries Using Human Computation." In AAAI 2011.
E. Law, B. Settles and T. Mitchell. "Learning to Tag using Noisy Labels." In ECML 2010.
E. Law, K. West, M. Mandel, M. Bay and S. Downie. "Evaluation of Algorithms Using Games: The Case of Music Tagging." In ISMIR 2009. EXPERIMENTS
E. Law and L. von Ahn. "Input-agreement: A New Mechanism for Data Collection using Human Computation Games." In CHI 2009. VIDEODATASETBLOG * Best Paper Honorable Mention
J. Betteridge, A. Carlson, S. Hong, E. Hruschka Jr., E. Law, T. Mitchell and S. Wang. "Towards Never Ending Language Learning." In AAAI Spring Symposium on Learning by Reading and Learning to Read 2009.
E. Law, L. von Ahn and T. Mitchell. "Search Wars: A Game for Improving Web Search." In HCOMP 2009.
E. Law, A. Mityagin and M. Chickering. "Intentions: A Game for Classifying Search Query Intent." In CHI 2009 Work-in-Progress.
E. Law. The Problem of Accuracy as An Evaluation Criterion." In ICML Workshop on Evaluation Methods for Machine Learning 2008.
E. Law, L. von Ahn, R. Dannenberg and M. Crawford. "TagATune: a Game for Sound and Music Annotation." In ISMIR 2007.