Publications

* denotes student advisee at time of submission. I use an authoring convention where students are listed first. Through 2016, I appear earlier in the list when I am the primary faculty mentor. From 2017 - present, I list myself last when I am the primary faculty mentor.

2020

Kale, A.*, Kay, M., and Hullman, J. Visual Reasoning Strategies and Satisficing: How Uncertainty Visualization Design Impacts Effect Size Judgments and Decisions. IEEE VIS 2020 Best Paper Award. preprint

Kim, YS.*, Kayongo, P., Grunde-McLaughlin, M., and Hullman, J. Bayesian-Assisted Inference from Visualized Data. IEEE VIS 2020. preprint

Hong, S., Hullman, J., and Bertini, E. Human Factors in Model Interpretability: Industry Practices, Challenges, and Needs. ACM CSCW 2020. PDF

Hofman, J., Goldstein, D., Hullman, J. How Visualizing Inferential Uncertainty can Mislead Readers About Treatment Effects in Scientific Results. ACM CHI 2020. Honorable Mention (Top 5% Submissions) PDF

Nguyen*, F., Qiao*, X., Heer, J., Hullman, J. Exploring the Effects of Aggregation Choices on Untrained Visualization Users' Generalizations from Data. Computer Graphics Forum 2020. PDF

2019

Hullman, J. Why Authors Don't Visualize Uncertainty. IEEE VIS 2019. PDF

Xiong, C., Shapiro, J., Hullman, J., Franconeri, S. Illusion of Causality in Visualized Data. IEEE VIS 2019. PDF

Kim*, YS., Walls, L., Krafft, P., and Hullman, J. Modeling the Interpretation of Visualized Statistics as Bayesian Cognition. Behavioral Economics Workshop at Economics and Computation (EC) 2019. PDF Github

Hullman, J. Confronting Unknowns: How to Read Common Visualizations of Uncertainty. Scientific American. Sept. 2019. PDF

Kim*, YS., Walls, L., Krafft, P., and Hullman, J. A Bayesian Cognition Approach to Improve Data Visualization. ACM CHI 2019. PDF Github

Kim*, YS., Dontcheva, M., Adar, E., and Hullman, J. Vocal Shortcuts for Creative Experts. ACM CHI 2019. PDF

Kale*, A., Kay, M., and Hullman, J.. Decision-Making Under Uncertainty in Research Synthesis: Designing for the Garden of Forking Paths. ACM CHI 2019. PDF

Phelan, C., Hullman, J., Kay, M., and Resnick, P. Some Prior(s) Experience Necessary: Templates for Getting Started with Bayesian Analysis. ACM CHI 2019. PDF

Nguyen*, F., Shrestha*, S., Germuska, J., Kim*, YS., and Hullman, J.. Belief-Driven Data Journalism. Computation+Journalism 2019. PDF

2018

Hullman, J., Qiao*, X., Correll, M., Kale*, A., and Kay, M. In Pursuit of Error: A Survey of Uncertainty Visualization Evaluation. IEEE VIS 2018. PDF Supplement

Kale*., A., Nguyen*, F., Kay, M., and Hullman, J.. Hypothetical Outcome Plots Help Untrained Observers Judge Trends in Ambiguous Data. IEEE VIS 2018. PDF

Hullman, J., and Bach, B. Picturing Science: Design Patterns in Graphical Abstracts. DIAGRAMS 2018. PDF

Hullman, J., Kim*, YS., Nguyen*, F., Speers, L., and Agrawala, M. Improving Comprehension of Measurements Using Concrete Re-expression Strategies. ACM CHI 2018. PDF

Fernandes, M., Walls, L., Munson, S., Hullman, J., and Kay, M. Uncertainty Displays Using Quantile Dotplots or CDFs Improve Transit Decision-Making. ACM CHI 2018. Honorable Mention (Top 5% Submissions) PDF

2017


Qu*, Z. and Hullman, J.. Keeping Multiple Views Consistent: Constraints, Validations, and Exceptions in Visualization Authoring. IEEE InfoVis 2017. Honorable Mention (Top 3 Papers) PDF

Kim*, YS., Reinecke, K., and Hullman, J.. Data Through Others' Eyes: The Impact of Visualizing Others’ Expectations on Visualization Interpretation. IEEE InfoVis 2017. PDF

Hullman, J., Kay, M., Kim*, YS., and Shrestha, S. Imagining Replications: Graphical Prediction & Discrete Visualizations Improve Recall & Estimation of Effect Uncertainty. IEEE InfoVis 2017. PDF

Hullman, J., Kosara, R., and Lam, H. Finding a Clear Path: Structuring Strategies for Visualization Sequences. EuroVis 2017. PDF

Kim*, YS, Reinecke, K., and Hullman, J. Explaining the Gap: Visualizing One's Predictions Improves Recall and Comprehension of Data. ACM CHI 2017. Best Paper Award (To 1% Submissions) PDF

Kim, Y., Wongsuphasawat, K., Hullman, J., and Heer, J. Graphscape: A Model for Automated Reasoning About Visualization Similarity and Sequencing. ACM CHI 2017. Honorable Mention (Top 5% Submissions) PDF

Adar, E., Gearig, C., Balusubramanian, A., and Hullman, J. Persalog: Personalization of News Article Content. ACM CHI 2017. PDF

2016


Kim*, YS, Hullman, J., Burgess, M., and Adar, E. SimpleScience: Lexical Simplification of Scientific Terminology. EMNLP 2016 PDF

Hullman, J. Why Evaluating Uncertainty Visualization is Error Prone. Proc. BELIV 2016 PDF

Qu*, Z. and Hullman, J. Evaluating Visualization Sets: Trade-offs Between Local Effectiveness and Global Consistency. Proc. BELIV 2016 PDF

Kim*, YS, Hullman, J., and Agrawala, M. Generating Personalized Spatial Analogies for Distances and Areas. ACM CHI 2016 PDF | Data repository | Tapestry Keynote | Atlas of Me Chrome plugin

Kay, M., Kola, T., Hullman, J., and Munson, S. When(ish) is My Bus? User-centered Visualizations of Uncertainty in Everyday, Mobile Predictive Systems. ACM CHI 2016 PDF, Code repository

2015


Hullman, J., Resnick, P., and Adar, E. Hypothetical Outcome Plots Outperform Error Bars and Violin Plots for Inferences About Reliability of Variable Ordering. PLOS ONE 2015. Animated PDF (view in Adobe Acrobat) | Animated appendix | Zipped results | Zipped interface/stimuli

Kim*, YS and Hullman, J. Expectation Visualization: Opportunities for Personalized Feedback. IEEE InfoVis 2015 Workshop on Personal Visualization. Chicago, IL (Oct. 25, 2015). PDF

Kim*, YS, Hullman, J., and Adar, E. DeScipher: A Text Simplification Tool for Science Journalism. Computation+Journalism 2015. PDF

Gearig, C, Adar, E., and Hullman, J., Designing for Personalized Article Content. Computation+Journalism 2015. PDF

Hullman, J., Krupka, E., and Adar, E. Evaluating Approaches To Crowdsourced Visual Analytics. Paper selected for presentation at Collective Intelligence 2015.

Hullman, J., Diakopoulos, N., Momeni Roochi, E., and Adar, E. Content, Context, and Critique: Commenting on a Data Visualization Blog, ACM CSCW 2015. PDF

2014


Gao, T., Hullman, J., Adar, E., Hecht, B., and Diakopoulos, N. NewsViews: An Automated Pipeline for Creating Custom Geovisualizations for News. ACM CHI 2014. Demo, PDF

2013


Hullman, J. Understanding and Supporting Trade-offs in the Design of Visualizations for Communication. Dissertation, University of Michigan School of Information, 2013.

Lease, M., Hullman, J., Bigham, J.P., Bernstein, M.S., Kim, J., Lasecki, W.S., Bakhshi, S., Mitra, T., and Miller, R.C. Mechanical Turk is Not Anonymous. Social Science Research Network 2013. [Reached Top Ten Downloaded Articles]. Available here.

Hullman, J., Drucker, S., Henry-Riche, N., Lee, B., Fisher, D., and Adar, E. A Deeper Understanding of Sequence in Narrative Visualization, IEEE InfoVis 2013. PDF

Hullman, J. How Prior Knowledge Affects the Processing of Visualized Data. ACM CHI 2013, Many People Many Eyes workshop. Paris, France (Apr. 28, 2013). PDF

Hullman, J., Diakopoulos, N., and Adar, E. Contextifier: Automatic Generation of Annotated Stock Visualizations. ACM CHI 2013. Demo, PDF

2012


Hullman, J., Rhodes, R., Rodriguez, F., and Shah, P. (2012) Research on Graph Comprehension and Data Interpretation: Implications for Score Reporting. In Zapata, D., & Zwick, R. (Eds.) Recent Research on Score Reporting. Princeton, NJ: Educational Testing Service. PDF

2011


Hullman, J., Adar, E., and Shah, P. Benefitting InfoVis with Visual Difficulties. IEEE InfoVis 2011. Honorable Mention (Top 3 Papers) PDF

Hullman, J., and Diakopolous, D. Visualization Rhetoric: Framing Effects in Narrative Visualization. IEEE InfoVis 2011. PDF

Hullman, J., Adar, E., and Shah, P. The Effect of Social Information on Visual Judgments. ACM CHI 2011. PDF

Hullman, J. Not all HITs are Created Equal: Controlling for Reasoning and Learning Processes in MTurk. Position paper presented at ACM CHI 2011, Workshop on Crowdsourcing and Human Computation. Vancouver, BC (May 8, 2011). PDF, blog post

Hullman, J., McQuaid, M., Chia, Y., Lin, T., and Zhang, Z. Chance-it: Motivating Collaborative Exploration using Spatial Layout on a Multitouch Surface. Position paper presented at ACM CHI 2011, Workshop on Large Displays in Urban Life. Vancouver, BC (May 7, 2011).PDF

2010 and earlier


Hullman, J. Visual Texts: Adapting Narratology for Information Visualization. Position paper and featured presenter at Telling Stories with Data workshop, IEEE InfoVis, Oct. 2010, Salt Lake City, UT. PDF slides

Hullman, J. Framing Artistic Visualization: Aesthetic Object as Evidence. Position paper presented at ACM Creativity & Cognition workshop Understanding the Creative Conversation: Modeling to Engagement, Oct. 2009, Berkeley, CA. PDF