David J. Crandall


Associate Professor
School of Informatics, Computing, and Engineering
Indiana University

Mailing address: 901 E Tenth St
Physical address: 611 N Park Ave
(one block west of Informatics West)
Bloomington, IN 47408
djcran@indiana.edu

Fall 2017 office hours:
   Mon 5pm-6pm in person (priority for B551)
   Fri 10am-11am online
   Fri 5pm-6pm in person (priority for independent studies)

Curriculum vitae

David Crandall photo

News
Nov 1, 2017: We have openings for postdoc researchers -- please contact David for more information!
Oct 20, 2017: Two fun remote sensing papers: 3d reconstruction of ice bed surfaces (at ICIP) and combining ground and satellite images to make maps (at ICCV).
Aug 23, 2017: IU is hiring faculty in the general area of Machine and Human Learning. Consider applying!
Jul 22, 2017: Check out our CVPR paper on associating wearable (egocentric) video with third-person video!
Jun 26, 2017: How has visual design on the web changed over time? Two new papers use expert surveys and computer vision to help find out.
Jun 10, 2017: How can developmental psychology inform computer vision, and vice-versa? Check out the talks from our Workshop on Egocentric Vision: From Science to Real-World Applications.
May 20, 2017: I'm very honored for the IU Trustees Teaching Award. But the credit goes to great IU students who make teaching fun -- thanks everyone!
Apr 28, 2017: Congratulations to Dr. Jeff Johnson on a successful proposal defense!
Mar 20, 2017: Co-organizing WebSci workshop on The Social Web for Environmental and Ecological Monitoring. Deadline is May 1. Please consider submitting!
Feb 15, 2017: Co-organizing CVPR workshop on The Bright and Dark Sides of Computer Vision: Challenges and Opportunities for Privacy and Security. Consider submitting a paper or abstract!
Jan 11, 2017: Very excited to lead the CS part of a new $2.5 million award to study interdisciplinary connections between human and machine learning!
Dec 15, 2016: Co-editing special issue on Egocentric Vision and Lifelogging Tools in the Journal of Visual Communication and Image Representation. Please consider submitting a manuscript!
Dec 7, 2016: Check out our NIPS 2016 paper on training diverse networks using multiple choice learning.
Oct 15, 2016: Robert Pless and I are CVPR 2017 tutorial co-chairs. Please consider submitting a proposal!
Oct 8, 2016: Could wearable cameras narrate our lives? Our "DeepDiary" paper at ECCV EPIC is a first step.
Aug 22, 2016: Best paper award at ICDL-Epirob 2016 on wearable cameras to study infant word learning, with Sven Bambach and Profs. Linda Smith and Chen Yu.
Aug 10, 2016: What may machine learning reveal about infant learning? Check out ourCogSci 2016 paper!
Aug 22, 2016: Congratulations to Dr. Sven Bambach on successfully defending his dissertation to earn two PhDs, in Computer Science and Cognitive Science!
Jul 30, 2016: We've moved! Come visit our new lab (and my new office) at 611 N Park Ave (one block west of Informatics West).
Jul 20, 2016: Congratulations to Dr. Stefan Lee on his dissertation defense!
Jul 13, 2016: New contract to collaborate with NSWC Crane on analyzing images of microelectronic devices!
Jul 1, 2016: Promoted to Associate Professor (with tenure).
Jun 27, 2016: Interested in improving diversity of your deep networks? Check out this talk by my student Stefan Lee at a CVPR tutorial.
May 26, 2016: Grant from the IU Social Science Research Commons to investigate applications of computer vision to geography, with Prof. Tom Evans. Thanks SSRC!!
Mar 29, 2016: Congratulations to senior Ben Newman on winning an NSF Graduate Research Fellowship!
Feb 12, 2016: Our new CHI 2016 paper on detecting computer screens to enhance lifelogger privacy is a CHI best paper honorable mention!
Jan 15, 2016: I'm co-organizing an International Workshop on the Social Web for Environmental and Ecological Monitoring at ICWSM 2016. Short and long papers due Feb 20. Consider submitting!
Sept 15, 2015: New ICCV 2015 paper, website, and dataset on hand recognition in first person video. Check out the video spotlight!
Aug 1, 2015: Welcome to new IU faculty member Prof. Michael Ryoo! Check out his interesting work on vision and robotics.
May 26, 2015: Congratulations Dr. Mohammed Korayem on a successful dissertation defense!
Apr 20, 2015: ICCP paper on mining architectural elements in Google Street View. Check out the demo!
Apr 15, 2015: Two CHI papers on privacy challenges and opportunities of wearable cameras
Jan 1, 2015: Recent and upcoming papers: WACV paper on geo-informative attributes, Signal Processing article on pose recognition, ICIP paper on ice layer detection
Dec 18, 2014: New NSF grant to study privacy in first-person cameras, with Apu Kapadia and Denise Anthony. Check out the video!
Oct 28, 2014: New NSF grant to help build high-performance computing libraries for computer vision and other applications (with G. Fox, J. Qiu, and others)
Sep 8, 2014: Looking for a faculty job? Our school is hiring in Interactive and Intelligent Systems (as well as several other areas).
Aug 22, 2014: Congratulations Dr. Haipeng Zhang on a successful dissertation defense!
Aug 6, 2014: Check out our redesigned lab website, including a nice new overview of our projects!
Jul 21, 2014: Congratulations Dr. Kun Duan on a successful dissertation defense!
Jun 28, 2014: Best paper award at CVPR Workshop on Egocentric Vision
Feb 18, 2014: Google Research Award to study privacy in first-person cameras, with Apu Kapadia
Feb 8, 2014: Our EMBO paper on science funding featured in Science
Jan 30, 2014: Our PlaceAvoider paper featured in MIT Tech Review and elsewhere
Dec 9, 2013: Best paper award at ICCV Workshop on CV for Converging Perspectives
Oct 1, 2013: Air Force Office of Scientific Research contractto study cloud robotics, with G. Fox and K. Hauser
May 2, 2013: IU Collaborative Research Grant to use first-person cameras to study parent interactions with deaf children (with Houston, Smith, Pisoni, Bergeson-Dana, Yu)
Mar 25, 2013: Awarded NSF CAREER grant
Jan 1, 2013: Awarded IU Faculty Research Support Program (FRSP) grant for studying privacy in first-person cameras, with Apu Kapadia
Sept 12, 2012: Awarded NSF EAGER grant with Chris Raphael, to study optical music recognition
June 15, 2012: Communications of the ACM paper on social photo mining (with Noah Snavely)
May 5, 2012: Our WWW 2012 paper on using Flickr to study ecology featured in New Scientist
April 11, 2012: Awarded subcontract from ObjectVideo to participate in the IARPA Finder program
Sept 12, 2011: Awarded IU Faculty Research Support Program grant to use first-person cameras for studying autistic and typically-developing children, with Chen Yu
June 22, 2011: Our paper on 3d reconstruction won runner-up best paper at CVPR 2011!
Dec 21, 2010: Our PNAS paper on inferring social ties from geo-tags featured in New Scientist and BBC World Service
Aug 24, 2010: Awarded grant from the IU D2I Center for mining social media for ecology
Sept 12, 2011: Awarded IU Faculty Research Support Program grant to use first-person cameras for studying autistic and typically-developing children, with Chen Yu
June 22, 2011: Our paper on 3d reconstruction won runner-up best paper at CVPR 2011!
Dec 21, 2010: Our PNAS paper on inferring social ties from geo-tags featured in New Scientist and BBC World Service
Aug 24, 2010: Awarded grant from the IU D2I Center for mining social media for ecology
Aug 1, 2010: Joining the faculty of Indiana University School of Informatics and Computing! -->

Research
For an overview of my research, check out our vision lab projects page.

I work in computer vision, the area of computer science concerned with automatically inferring semantic meaning from images -- teaching computers to "see." More generally, I am interested in problems that involve analyzing and modeling large amounts of uncertain data, like mining data from social networking websites.

I'm an Associate Professor in the School of Informatics, Computing, and Engineering at Indiana University, where I direct the IU Computer Vision Lab. I'm on the faculty of the Computer Science, Informatics, Cognitive Science, and Data Science programs, and I'm adjunct in the Department of Statistics. My work has been funded by grants and contracts from the National Science Foundation (including through a CAREER award), Google, Kodak, the Department of Defense, and Indiana University.

Before joining IU, I was a graduate student and postdoc in Computer Science at Cornell University. I worked with Professor Dan Huttenlocher on statistical part-based object recognition algorithms, and with Professor Jon Kleinberg on modeling and mining data from online social networks. I completed the Ph.D. degree in August 2008.

Before Cornell, I spent two years in the research labs of Eastman Kodak Company. There I worked mostly on image understanding and enhancement algorithms for both consumer and medical images.

As an undergraduate and Masters student at Penn State University, I worked with Professor Rangachar Kasturi on content-based video indexing, and specifically on detecting, tracking and recognizing text in video (both captions and text appearing naturally in a scene).


Publications
This is a partial list – please see my lab publications page or Google Scholar profile for more.

3-d reconstruction
  • "SfM with MRFs: Discrete-Continuous Optimization for Large-Scale Structure from Motion," in PAMI 2013 (with A. Owens, N. Snavely, D. Huttenlocher) [pdf] [project website]
  • "Discrete-Continuous Optimization for Large-Scale Structure from Motion," in CVPR 2011 (with A. Owens, N. Snavely, D. Huttenlocher) [pdf] [project website] Runner-up best paper!
First-person and opportunistic imagery
  • "Identifying first-person camera wearers in third-person videos," in CVPR 2017 (with C. Fan, J. Lee, M. Xu, K.K. Singh, Y.J. Lee, M. Ryoo) [pdf]
  • "DeepDiary: Automatically Captioning Lifelogging Image Streams," in ECCV EPIC 2016 (with C. Fan) [pdf] [www with code and data]
  • "Enhancing Lifelogging Privacy by Detecting Screens," in CHI 2016 (with M. Korayem, R. Templeman, D. Chen, A. Kapadia) [pdf] [www] Best paper honorable mention!
  • "Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions," in ICCV 2015 (with S. Bambach, S. Lee, C. Yu) [pdf] [www] [dataset]
  • "Viewpoint Integration for Hand-Based Recognition of Social Interactions from a First-Person View," in ICMI 2015 (with S. Bambach, C. Yu) [pdf] [dataset]
  • "PlaceAvoider: Steering First-Person Cameras away from Sensitive Spaces," in NDSS 2014 (with R. Templeman, M. Korayem, A. Kapadia) [pdf]
  • "This Hand is My Hand: A Probabilistic Approach to Hand Disambiguation in Egocentric Video," in CVPR Workshop on Egocentric Vision 2014 (with S. Lee, S. Bambach, J. Franchak, C. Yu) [pdf] Best paper!
  • "PlaceRaider: Virtual Theft in Physical Spaces with Smartphones," in NDSS 2013 (with R. Templeman, Z. Rahman, A. Kapadia) [pdf] [project website]
Object recognition
  • "Vehicle Recognition with Constrained Multiple Instance SVMs," in WACV 2014 (with K. Duan, L. Marchesotti) [pdf]
  • "Discovering localized attributes for fine-grained recognition," in CVPR 2012 (with K. Duan, D. Parikh, K. Grauman) [pdf] [project website]
  • "A Multi-layer Composite Model for Human Pose Estimation," in BMVC 2012 (with K. Duan, D. Batra) [pdf] [project website]
  • "Landmark classification in large-scale image collections," in ICCV 2009 (with Y. Li and D. Huttenlocher) [pdf] [expanded book chapter]
  • "Composite models of objects and scenes for category recognition," in CVPR 2007 (with D. Huttenlocher) [pdf]
  • "Weakly-supervised learning of part-based spatial models for visual object recognition," in ECCV 2006 (with D. Huttenlocher) [pdf] [source code]
  • "Spatial Priors for Part-Based Recognition using Statistical Models," in CVPR 2005 (with P. Felzenszwalb and D. Huttenlocher) [pdf] [expanded LNCS version] [source code]
  • "Robust Color Object Detection using Spatial-Color Joint Probability Functions," in IEEE Transactions on Image Processing, 2006 (with J. Luo) [CVPR 2004 version]
  • "Part-based statistical models for visual object class recognition," 2008 (Ph.D. thesis) [pdf]
Mining and modeling large-scale photo collections
  • A Unified Model for Near and Remote Sensing," in ICCV 2017 (with S. Workman, M. Zhai, N. Jacobs) [pdf]
  • "Tracking Natural Events through Social Media and Computer Vision," in ACM Multimedia 2016 (with J. Wang, M. Korayem, S. Blanco) [pdf]
  • "Linking Past to Present: Discovering Style in Two Centuries of Architecture," in ICCP 2015 (with S. Lee, N. Maisonneuve, A. Efros, J. Sivic) [pdf] [project website]
    See also an online demo of some results.
  • "Predicting Geo-informative Attributes in Large-scale Image Collections using Convolutional Neural Networks," in WACV 2015 (with S. Lee, H. Zhang) [pdf]
  • "Multimodal Learning in Loosely-organized Web Images," in CVPR 2014 (with K. Duan, D. Batra) [pdf]
  • "Observing the natural world with Flickr," in ICCV Workshop on Computer Vision for Converging Perspectives, 2013 (with J. Wang, M. Korayem) [pdf] Best paper!
  • "Modeling people and places with internet photo collections," in Communications of the ACM (with N. Snavely) [pdf]
  • "Mining photo-sharing websites to study ecological phenomena," in WWW 2012 (with H. Zhang, M. Korayem, G. LeBuhn) [pdf] [project website]
  • "Beyond co-occurrence: Discovering and visualizing tag relationships from geo-spatial and temporal similarities," in WSDM 2012 (with H. Zhang, M. Korayem, E. You) [pdf] [project website]
  • "Mapping the World's Photos," in WWW 2009 (with L. Backstrom, D. Huttenlocher, J. Kleinberg) [pdf] Runner-up best paper!
    See also a gallery of automatically-generated maps.
Mining and modeling online social networks
  • "Where have all the people gone? Enhancing global conservation using night lights and social media," in Ecological Applications 2015 (with N. Levin, S. Kark) [pdf]
  • "De-anonymizing users across heterogeneous social computing platforms," in ICWSM 2013 (with M. Korayem) [pdf] [project website]
  • "Inferring Social Ties from Geographic Coincidences," in Proc. National Academy of Sciences (PNAS), 8 December 2010 (with L. Backstrom, D. Cosley, S. Suri, D. Huttenlocher, J. Kleinberg) [pdf]
  • "Feedback Effects between Similarity and Social Influence in Online Communities," in KDD 2008 (with D. Cosley, J. Kleinberg, D. Huttenlocher, S. Suri) [pdf]
Wearable camera attitudes and applications
  • "Addressing physical safety, security, and privacy for people with visual impairments," in SOUPS 2016 (with T. Ahmed, P. Shaffer, K. Connelly, A. Kapadia) [pdf]
  • "Sensitive Lifelogs: A Privacy Analysis of Photos from Wearable Cameras," in CHI 2015 (with R. Hoyle, R. Templeman, D. Anthony, A. Kapadia) [pdf]
  • "Privacy Concerns and Behaviors of People with Visual Impairments" in CHI 2015 (with T. Ahmed, R. Hoyle, K. Connelly, A. Kapadia) [pdf]
  • "Privacy Behaviors of Lifeloggers using Wearable Cameras," in Ubicomp 2014 (with R. Hoyle, R. Templeman, S. Armes, D. Anthony, A. Kapadia) [pdf]
Human vision and learning
  • "Exploring inter-observer differences in first-person object views using deep learning models," in ICCV MBCCV workshop, 2017 (with S. Bambach, Z. Zhang, C.Yu) [pdf]
  • "An Egocentric Perspective on Active Vision and Visual Object Learning in Toddlers," in ICDL 2017 (with S. Bambach, L. Smith, C. Yu) [pdf]
  • "Active Viewing in Toddlers Facilitates Visual Object Learning: An Egocentric Vision Approach," in CogSci 2016 (with S. Bambach, L. Smith, C. Yu) [pdf]
  • "Objects in the Center: How the Infant's Body Constrains Infant Science," in ICDL 2016 (with S. Bambach, L. Smith, C. Yu) [pdf] Best paper!
  • "Detecting Hands in Children's Egocentric Views to Understand Embodied Attention during Social Interaction," in CogSci 2014 (with S. Bambach, J. Franchak, C. Yu) [pdf]
  • "Understanding embodied visual attention in child-parent interaction," in ICDL 2013 (with S. Bambach, C. Yu) [pdf]
  • "Psychophysical study of image orientation perception," in Spatial Vision, 2003, pp. 429-457. (with J. Luo, A. Singhal, M. Boutell and R. Gray.) [pdf]
Deep networks
  • "Stochastic Multiple Choice Learning for Training Diverse Deep Ensembles," NIPS 2016 (with S. Lee, S. Purushwalkam, M. Cogswell, V. Ranjan, D. Batra) [pdf]
  • "Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models," arXiv 2016 (with A. Vijayakumar, M Cogswell, R. Selvaraju, Q. Sun, S. Lee, D. Batra) [arXiv link]
  • "Why M Heads are Better than One: Training a Diverse Ensemble of Deep Networks," arXiv 2015 (with S. Lee, S. Purushwalkam, M. Cogswell, D. Batra) [arXiv link]
Computer vision for polar science
  • "Automatic estimation of ice bottom surfaces from radar imagery", in ICIP 2017 (with M. Xu, G. Fox, J. Paden) [pdf]
  • Estimating bedrock and surface layer boundaries and confidence intervals in ice sheet radar imagery using MCMC", in ICIP 2014 (with S. Lee, J. Mitchell, G. Fox) [pdf]
  • "Estimating bedrock and surface layer boundaries and confidence intervals in ice sheet radar imagery using MCMC", in ICIP 2014 (with S. Lee, J. Mitchell, G. Fox) [pdf] [project website]
  • "Layer-finding in radar echograms using probabilistic graphical models", in ICPR 2012 (with G. Fox, J. Paden) [pdf] [project website]
Text and document analysis
  • A Data Driven Approach for Compound Figure Separation Using Convolutional Neural Networks," in ICDAR 2017 (with S. Tsutsui) [pdf] [project website]
  • "Extraction of special effects caption text events from digital video," in International Journal on Document Analysis and Recognition, 2002 (with S. Antani and R. Kasturi) [pdf] [M.S. thesis version] [ICDAR01 version]
Other interests :)
  • "A deep study into the history of web design," in WebSci 2017 (with B. Doosti, N. Su) [pdf] [project website]
  • "Understanding the Aesthetic Evolution of Websites: Towards a Notion of Design Periods," in CHI 2017 (with W. Chen, N. Su) [pdf]
  • "From funding agencies to scientific agency: Collective allocation of science funding as an alternative to peer review," in EMBO Reports, 2014 (with J. Bollen, D. Junk, Y. Ding, K. Borner) [pdf]
  • "Learning visual features for the Avatar Captcha Recognition Challenge," in ICMLA 2012 (with M. Korayem, A. Mohammed, D. Crandall, R. Yampolskiy) [pdf]
  • "Subjectivity and Sentiment Analysis of Arabic: A Survey", in AMLTA, 2012 (with M. Korayem, M. Abdul-Mageed) [pdf]

Teaching
Current:
  • CS B551, Elements of Artificial Intelligence (residential and online)

Past:
  • CS B551, Elements of Artificial Intelligence (Fall 2015, Fall 2016, Spring 2017)
  • CS B657, Computer Vision, (Spring 2017, Spring 2016, Spring 2014, Spring 2012, Fall 2010)
  • CS B490/B659, Image processing and recognition (Spring 2015)
  • Info I210, Information Infrastructure I (Fall 2014)
  • Info I399, Research Methods for Undergraduates (Fall 2013)
  • CS B553, Probabilistic Approaches to Artificial Intelligence (Spring 2013)
  • Info I427, Search Informatics (Fall 2011, Spring 2011, Fall 2012, Fall 2013, Fall 2014, Fall 2015)
  • Info 2950, Mathematical Methods for Information Science, Fall 2008 (at Cornell)
  • CS 113, Introduction to C, Fall 2007 and Spring 2008 (at Cornell)
  • CS 211, Algorithms and Data Structures in Java, Summer 2007 (at Cornell)
  • T.A. for CS 664, Computer Vision, Fall 2003 (at Cornell)
  • CSE 275, Digital Design Lab, Fall 2000 and Spring 2001 (at Penn State)

Graduated Ph.D. Students
For a complete list of current and former graduate and undergraduate students, please see our lab web page.

Other projects
These are other projects I've worked on that were never polished enough to be publishable, but that someone somewhere might still find interesting. :-)

Fun
I love cycling. During graduate school I would take multi-day bike trips spanning hundreds of miles, but the tenure track has made those trips less feasible. These days I stay closer to home, enjoying weekend rides along the beautiful country roads of southern Indiana. I used to ski during winter until I moved to the second flattest state east of the Mississippi.

Now current preferred winter activity is swimming in IU's fantastic pools. (My unofficial hobby is to swim in a public lap pool in as many cities of the world as possible (so far: Amsterdam, Barcelona, Beijing, Blacksburg, Bloomington, Boulder, Chicago, Columbus, Copenhagen, D.C., Denver, Detroit, Fort Collins, Hong Kong, Honolulu, Indianapolis, Ithaca, Jamestown, Las Vegas, Los Angeles, Madrid, Nashville, New Orleans, Paris, Phoenix, Quebec City, San Jose, Santiago, Seoul, State College, Sydney, Tokyo, Venice).

I took piano for 12 years as a child and recently started picking it back up again. Since I can't produce great music myself, I'm happy to live just a few blocks from the amazing IU Jacobs School of Music.

I'm on a perpetual quest to become fluent in Spanish. In addition to taking classes in high school and throughout college and graduate school, I've studied abroad in Spain and Mexico, and I've also traveled to Puerto Rico, Chile, and El Salvador. Despite all that effort, my Spanish is still remarkably lousy. :)

If you like pretty pictures, you might check out my dad's amazing bird photos. My own household flock includes Pichu, Ron, Sally, Betsy, and Sebastian; alumni are Toto, Zuma, Rameses, Rameses II, and, of course, Cocoa.