CS-7960 | Design Studies | Spring 2013

INSTRUCTOR: Miriah Meyer
TIME: T/Th 2-3:20pm
PLACE: WEB 1450
OFFICE HRS: T 12-2pm, WEB 4887

This course will take students through the process of conducting a design study, which is a problem-driven, collaborative process for conducting visualization research. You will learn how to design a visualization system for a real-world problem taking a user-centered, iterative design approach. Topics covered include methods for interviewing, extracting requirements, rapid prototyping, and evaluating deployed systems. There will be a number of lectures devoted to peer-review workshops.

There are several "collaborators" lined up who have some interesting data analysis challenges and are excited to work with students in the course -- you will select a collaborator and conduct a design study over the course of the semester. The goal of the course is to deploy a visualization system, and, depending on progress, write up the design study as a paper submission to a visualization venue.

schedule

week date topic date topic homework
1 1/8 Class overview 1/10 Introduction to design studies
2 1/15 Design model 1/17 Design model
3 1/22 Tips for talks 1/24 DS's: bio
4 1/29 DS's: linguistics and space 1/31 DS's: time and networks
5 2/5 DS's: play and Collaboration 2/9 Process models
6 2/12 Observing 2/14 Contextual inquiry
7 2/19 Abstraction 2/21 Domain characterization workshop
8 2/26 no class 2/28 no class Domain write-up | due Thurs
9 3/5 Abstraction workshop 3/7 Prototyping
10 3/12 no class 3/14 no class Abstraction write-up | due Tues
11 3/19 Prototyping workshop 3/21 Prototyping workshop
12 3/26 Ben Fry talk + roundtable 3/28 Aesthetics
13 4/2 Prototyping workshop 4/4 Prototyping workshop
14 4/9 Janet Iwasa roundtable 4/12 no class Full write-up | due Thurs
15 4/16 Write-up workshop 4/19 no class
16 4/23 Project presentations

syllabus

prerequisites

The prerequisites for this class are CS-5360/6630 Scientific Visualization, CS-6964 Information Visualization, or an equivalent course. You will need a broad understanding of visualization techniques and methods, predominately those for abstract data (tables, graphs, time series, etc). The final project will require you to build an interactive visualization system, so knowledge of a graphics API or language (like OpenGL or Processing) are required. If you have any questions please let me know.

required textbook

There are no required textbooks. All required reading will be available on this website.

grading

Grades in this course will be determined by:

There will be no final examination in this course.

late policy

For each day that an assignment is turned in late I will deduct 10% off the total possible points. That is, one-day late is 10% off, two-days is 20%, etc. For example, if you turn in an assignment 3 days late, the max number of points (out of 100) that you can receive is 70.

assignments

readings

You should do the core readings before the lectures and participate in class discussions during both lectures and student presentations. Your participation grade is partially based on the required reading questions you submit before class as well as in-class discussion -- both during the professor's lectures, and during your classmates' presentations.

more details...

Content
By noon (2 hours before class starts), you must send me email with a set of questions/comments about the material being covered that day. You should include at least one question/comment per reading. Your submitted questions/comments should be thoughtful, and clearly show that you've done the reading and reflected on it. If you genuinely are confused by some aspect of the reading, then it's useful and legitimate to ask for clarification. However, simply asking something that you could trivially look up yourself is not a good question. Neither are vague statements like "I liked it" or "I learned a lot". As with any written work that you hand in, I expect correct grammar and spelling. Do be concise: a few sentences per question is good, with a maximum of one paragraph per question.

Grading
Your submitted questions/comments will be bucket-graded. Below are example questions, ranging from great to poor:

  • excellent
    • I'm curious as to what would have happened if the authors had simply preselected the values of the free parameters for the participants in their user study, and then had the users compare their technique to the standard magnification tools present in a 'normal' application (much like the space-scale folks did). Could it be that the users are `manufacturing' a large standard deviation in the free parameter specifications by settling for values that merely produce a local improvement in their ability to manipulate the interface, instead of actively searching for an optimal valuation scheme?
    • In a related vein, the speed-dependent automatic zooming met with mixed success on some applications. Isn't this success related to how "compressible" some information is? i.e. because zooming must necessarily throw out some information, it isn't obvious which information to keep around to preserve the navigable structure.
  • good
    • It would be interesting to compare the approach in this paper to some other less-mathematically-thought-out zoom and pan solutions to see if it is really better. Sometimes "faking it" is perceived to be just as good (or better) by users.
    • The space-scale diagrams provided a clear intuition of why zooming out, panning then zooming in is a superior navigation technique. However, I found the diagram too cumbersome for practical use, especially for objects with zoom-dependent representations (Figure 11).
  • ok
    • This seems like something fun to play around with, are there any real implementations of this? Has a good application for this type of zooming been found? Is there still a real need for this now that scroll wheels have become prevailent and most people don't even use the scroll bar anymore?
    • Playing with the applet, I find I like half of their approach. It's nice to zoom out as my scroll speed increases, but then I don't like the automatic zoom in when I stop scrolling. Searching the overview I found the location I wanted, but while I paused and looked at the overview, I fell back in to the closeup. I think they need to significantly dampen their curve.
  • poor
    • Well, what exactly Pad++ is? Is it a progarmming library or a set of API or a programming language? how can we use it in our systems, for xample may be programming in TCL or OpenGL may be ?
    • I learned some from this paper and got some ideas of my project.

Submission Details
Submit your questions by noon (2 hours before class starts) via email to miriah@cs.utah.edu. I encourage you to also bring these with you to class and use them as a springboard for discussion. Your email must have the subject line

7960 submit QXX
where XX is the lecture number (02-29).

paper presentations

Throughout the course you will be asked to present several papers on the current lecture topic. You will be given at least one week notice about the papers. The purpose of this is to give you practice reading and analyzing research papers, and presenting your analysis in a clear way. You should expect to present at least twice throughout the semester.

more details...

Content
You will prepare a mini-lecture on the papers you are asked to present. Your presentation should not simply outline the papers. You will need to present the critical ideas in the paper so that your colleagues in the class have a basis for understanding your subsequent discussion. Part of this assignment is to use your judgement on what those critical ideas are and how to concisely present them. If presenting on more than one paper, you should compare the approaches of the papers by a specific discussion of their relative strengths and weaknesses as they relate to the lecture topic.

Often papers on systems, techniques, or methods will be accompanied by a video or demo. I encourage you to make use of these if they are available.

Presentation
You should prepare slides to accompany your talk. You may use the software platform of your choice to present these slides, as long as it's also possible to create a PDF version of your talk for the course web site. Most people use PowerPoint, Keynote, OpenOffice, or latex/beamer. There are links to advice on giving good talks on the resources page.

You may use my laptop for presentations. If you need to use anything except for PDF, Keynote, or PowerPoint, check with me in advance to make sure that the required software is installed on my machine.

Grading
This is the grading break-down I plan to use:

  • content summary: 50%
  • synthesis/critique: 20%
  • presentation style: 15%
  • materials preparation: 15%

Submission Details
By noon on the day of class, send me either your presentation, or a note telling me that you're using your own laptop. In the latter case, send me your presentation right after class ends in PDF format. Submit your presentation via email to miriah@cs.utah.edu. Your email must have the subject line

7960 submit slides

write-ups

The goal of the course is to conduct visualization research using a design study methodology. As such, we will be working on a paper draft on your design study as one of the tangible outcomes of the class. Writing the paper will be broken up into pieces over the course of the semester.

more details...

Content
Your paper draft is not expected to be a complete paper -- most of your projects will likely take more than the semester to finish. You will, however, be able to describe your domain characterization, abstraction, and initial design ideas.

Now that you've read a number of design study papers you should reflect on what you thought made for a clear, concise, and persuasive paper. Keep these things in mind as you work on your write-ups. I will give you feedback on each stage of writing. We will also workshop your final drafts as a class on the last day of the semester.

Your final write-up must be in the IEEE VIS format, the details of which can be found in the Call For Papers. You are welcome to submit your domain and abstraction write-ups in whatever format you'd like.

Domain write-up, due Thurs. Feb 28
Based on feedback from the domain characterization workshop you should write-up a summary of the problem you are tackling. What is the field? Who are your target users? What questions are they asking, and what measurements have they aquired? What is the potential impact of their work? Please include only the necessary information about the domain that is needed to motivate and understand the problem.

Abstraction write-up, due Tues. Mar 12
Based on feedback from the abstraction workshop you should write-up a summary of your abstraction. Be as clear and concise as possible about the structure and type of data, any transformations you decide to do, and the specific tasks you are going to support.

Full write-up, due Thurs. Apr 12
This write-up should include an introduction with anticipated contributions, a review of relevant visualization literature, the domain description, and your abstraction. You should also discuss and justify your design ideas -- prototypes are fine here. In justifying your design, you should consider both your stated tasks and visualization design principles.

Submission Details
Submit your write-ups via email to miriah@cs.utah.edu. Your email must have the subject line

7960 submit XXX write-up

where XXX is the appropriate phase of writing.

lectures

L1. CLASS OVERVIEW | TUES JAN. 8

slides L01-overview.pdf

L2. INTRODUCTION TO DESIGN STUDIES | THURS JAN. 10

required - MizBee: A Multiscale Synteny Browser. Miriah Meyer, Tamara Munzner, and Hanspeter Pfister. IEEE Trans. Visualization and Computer Graphics 15(6):897-904 (Proc. InfoVis 09), 2009.
- Process and Pitfalls in Writing Information Visualization Research Papers. Tamara Munzner. Chapter from Information Visualization: Human-Centered Issues and Perspectives. Andreas Kerren, John T. Stasko, Jean-Daniel Fekete, Chris North, eds. Springer LNCS Volume 4950, p 134-153, 2008.
suggested - Wicked Problems in Design Thinking. Richard Buchanan. Design Issues: Vol. VIII, Number 2 Spring 1992.
slides L02-design-studies.pdf

L3. DESIGN MODEL | TUES JAN. 15

required - Visualization Design and Analysis: Abstractions, Principles, and Methods. Chapter 2: A Visualization Design Framework. Tamara Munzner, AK Peters, (to appear 2012).
- The Four-Level Nested Model Revisited: Blocks and Guidelines. Miriah Meyer, Michael Sedlmair, and Tamara Munzner. Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization (BELIV), 2012.
- An Empirical Model of Slope Ratio Comparisons. Justin Talbot, John Gerth, Pat Hanrahan. IEEE Trans. Visualization & Comp. Graphics (Proc. InfoVis), 2012.
slides L03-nested-model.pdf

L4. DESIGN MODEL | THURS JAN. 17

Alex - Smooth and efficient zooming and pannings. Wijk, J. J. Van, Nuij, W. A. A., & Eindhoven, T. U. (1995).
Sean - Memorability of Visual Features in Network Diagrams.Marriott, K., Purchase, H.C., Wybrow, M., and Goncu, C. IEEE Transactions on Visualization and Computer Graphics, 2012.
Hoa - A User Study to Compare Four Uncertainty Visualization Methods for 1D and 2D Datasets. Jibonananda Sanyal, Song Zhang, Gargi Bhattacharya, Phil Amburn, Robert J. Moorhead, 2009.
Saquib - Interactive Level-of-Detail Rendering of Large Graphs. Michael Zinsmaier, Ulrik Brandes, Oliver Deussen, Hendrik Strobelt, IEEE Transaction on Visualization and Computer Graphics (TVCG), InfoVis 2012.
Konstantin - Historygrams: Enabling Interactive Global Illumination in Direct Volume Rendering using Photon Mapping. Daniel Jönsson, Joel Kronander, Timo Ropinski, Anders Ynnermant, IEEE Transactions on Visualization and Computer Graphics (TVCG), Volume 18, Number 12, page 2364--2371 - December 2012.
Sam - How Capacity Limits of Attention Influence Information Visualization Effectiveness. Steve Haroz and David Whitney, Visualization and Computer Graphics, IEEE Transactions on , vol.18, no.12, pp.2402-2410, Dec. 2012

L5. TIPS FOR TALKS | TUES JAN. 22

suggested - How to Give a Talk. Paul N. Edwards
- The secret structure of great talks. Nancy Duarte.
- Hans Rosling, TED 2006
- Brian Cox, TED 2008
- Non-designer's Design Book. Robin Williams. 2008.
slides L05-tips-for-talks.pdf

L6. DESIGN STUDIES: BIO | THURS JAN. 24

bio | Saquib - ABySS-Explorer: Visualizing genome sequence assemblies. Cydney B. Nielsen, Shaun D. Jackman, Inanc Birol, Steven J.M. Jones. IEEE Transactions on Visualization and Computer Graphics (Proc InfoVis 2009) 15(6):881-8, 2009.
- Interactive Coordinated Multiple-View Visualization of Biomechanical Motion Data. Daniel F. Keefe, Marcus Ewert, William Ribarsky, Remco Chang. IEEE Trans. Visualization and Computer Graphics (Proc. Vis 2009), 15(6):1383-1390, 2009.
slides L06-biovis.pdf

L7. DESIGN STUDIES: LINGUISTICS and SPACE | TUES JAN. 29

linguistics | Hoa - Facilitating Discourse Analysis with Interactive Visualization. Jian Zhao, Fanny Chevalier, Christopher Collins, and Ravin Balakrishnan. Visualization and Computer Graphics, IEEE Transactions on , vol.18, no.12, pp.2639-2648, Dec. 2012
- Constellation: A Visualization Tool For Linguistic Queries from MindNet. Tamara Munzner, Francois Guimbretiere, and George Robertson. Proc. InfoVis 1999, p 132-135.
space | Sam - BallotMaps: Detecting Name Bias in Alphabetically Ordered Ballot Papers. Jo Wood, Donia Badawood, Jason Dykes, Aidan Slingsby. IEEE TVCG 17(12): 2384-2391 (Proc InfoVis 2011).
- Visual Exploration and Analysis of Historic Hotel Visits. Chris Weaver, David Fyfe, Anthony Robinson, Deryck W. Holdsworth, Donna J. Peuquet and Alan M. MacEachren. Information Visualization (Special Issue on Visual Analytics), Feb 2007.
slides L07-linguistics.pdf
L07-BallotMaps.pdf
L07-Improvise.pdf

L8. DESIGN STUDIES: TIME and NETWORKS | THURS JAN. 31

time | Alex - Cluster and Calendar based Visualization of Time Series Data. Jarke J. van Wijk and Edward R. van Selow, Proc. InfoVis 1999, p 4-9.
- SignalLens: Focus+Context Applied to Electronic Time Series. Robert Kincaid. IEEE Transactions on Visualization and Computer Graphics (Proc. InfoVis 2010), 16(6):900-907, 2010.
networks | Sean - RelEx: Visualization for Actively Changing Overlay Network Specifications. Michael Sedlmair, Annika Frank, Tamara Munzner, Andreas Butz IEEE Trans. Visualization and Computer Graphics (Proc. InfoVis), 18(12): 2729-2738, 2012.
- Pathline: A Tool for Comparative Functional Genomics. Miriah Meyer, Bang Wong, Tamara Munzner, Mark Styczynski and Hanspeter Pfister. Computer Graphics Forum (Proc. EuroVis 2010), 29(3):1043-1052
slides L08-networks.pdf
L08-time.pdf

L9. DESIGN STUDIES: PLAY and COLLABORATION | TUES FEB. 5

play | Konstantin - SnapShot: Visualization to Propel Ice Hockey Analytics. Hannah Pileggi, Charles D. Stolper, J. Michael Boyle, and John T. Stasko, IEEE Trans. Visualization and Computer Graphics (Proc. InfoVis), 18(12), 2012.
- Living Liquid: Design and Evaluation of an Exploratory Visualization Tool for Museum Visitors. J. Ma, I Liao, K. Ma, J. Frazier. IEEE Trans. Visualization and Computer Graphics (Proc. InfoVis), 18(12), 2012.
required - Visualization Collaborations: Reflections on What Works and Why.Mike Kirby and Miriah Meyer, draft.
suggested - What do you mean?’ The importance of language in developing interdisciplinary research. L J Bracken (née Bull) and E A Oughton, Transactions of the Institute of British Geographers, 31: 371–382. doi: 10.1111/j.1475-5661.2006.00218.x, 2006.
- Going beyond Disciplines: The Meanings of Interdisciplinarity. Anders Karlqvist Policy Sciences , Vol. 32, No. 4, The Theory and Practice of Interdisciplinary Work (Dec., 1999), pp. 379-383.
slides L09-play.pdf

L10. PROCESS MODELS | THURS FEB. 7

required - Design Study Methodology: Reflections from the Trenches and the Stacks.Michael Sedlmair, Miriah Meyer, and Tamara Munzner. IEEE Trans. Visualization and Computer Graphics (Proc. InfoVis), 18(12): 2431-2440, 2012.
- Strategies for Evaluating Information Visualization Tools: Multi-dimensional In-depth Long-term Case Studies. Ben Shneiderman and Catherine Plaisant, Proc. AVI Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization (BELIV), 2006, p 38--43.
suggested - 99% Details. Podcast from 99% Invisible, Sep 2010.
- How to design breakthrough inventions. 60 minutes, Jan 2013.
slides

L11. OBSERVING | TUES FEB. 12

guest lecture Prof. Jim Agutter, assistant professor of design, University of Utah.
required - An Ethnography Primer, AIGA.
- Six Things to Remember When Observing What People Do, D. School Stanford and IDEO.
suggested - Some Techniques for Observing Users, Kathleen Gomoll.
- Doing Design Ethnography, chapters: 1. Precis, 2. Ethnography and Systems Design, 3. Finding the Animal in the Foliage, and 6. Doing Fieldwork. Crabtree, Rouncefield, Tolmie. Human-Computer Interaction Series, Springer-Verlag London 2012.
templates Infovisguides.zip

L12. CONTEXTUAL INQUIRY | THURS FEB. 14

required - Principles of Contextual Inquiry. Hugh Beyer. 1997. Contextual Design: Defining Customer-Centered Systems. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
suggested - The One Conversational Tool That Will Make You Better At Absolutely Everything. Fast Company, Dec 2012.
- Why Are Contextual Inquiries So Difficult? Jim Ross, June 2012.
- Participatory design. Michael J. Muller and Sarah Kuhn. ACM 36, 6, 1993.
- Contextual Design: Defining Customer-Centered Systems . Hugh Beyer and Karen Holtzblatt. Morgan Kaufmann, 1998.
slides L12-contextual-inquiry.pdf

L13. ABSTRACTION | TUES FEB. 19

required - What does the user want to see?: what do the data want to be?. A. Johannes Pretorius and Jarke J. Van Wijk. 2009, Information Visualization 8, 3 (June 2009), 153-166.
suggested - Data Abstractions. Information Visualization: Principles, Methods, and Practice (pre-publication draft), chapter 3, Tamara Munzner, AK Peters, (to appear 2012).
- Polaris: A System for Query, Analysis and Visualization of Multi-dimensional Relational Databases (extended paper). Chris Stolte, Diane Tang and Pat Hanrahan. IEEE Transactions on Visualization and Computer Graphics, 8(1), Jan 2002.
- The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. Ben Shneiderman. Proceedings of the IEEE Conference on Visual Languages, 1996.
- Low-Level Components of Analytic Activity in Information Visualization. Robert Amar, James Eagan, and John Stasko. Proceedings of InfoVis, 2005.
slides L13-abstraction.pdf

L14. DOMAIN CHARACTERIZATION WORKSHOP | THURS FEB. 21


L15. ABSTRACTION WORKSHOP | TUES MAR. 5


L16. PROTOTYPING | THURS MAR. 7

guest lecture Prof. Jim Agutter, assistant professor of design, University of Utah.
required - Parallel Prototyping Leads to Better Design Results, More Divergence, and Increased Self-Efficacy. Steven P. Dow, Alana Glassco, Jonathan Kass, Melissa Schwarz, Daniel L. Schwartz, and Scott R. Klemmer. ACM Transactions on Computer-Human Interaction, Vol. 17, No. 4, Article 18, Publication date: December 2010.
- Human-Centered Approaches in Geovisualization Design: Investigating Multiple Methods Through a Long-Term Case Study. D. Lloyd and J. Dykes. Transactions in Visualization and Computer Graphics, 17(12), pp. 2498-2507.

L17. PROTOTYPING WORKSHOP | TUES MAR. 19


L18. PROTOTYPING WORKSHOP | THURS MAR. 21


L19. ROUNDTABLE with BEN FRY | TUES MAR. 26

guest Dr. Ben Fry, principal at Fathom.
suggested - Connected China.

L20. AESTHETICS | THURS MAR. 28

required - Emotion & design: attractive things work better. Don Norman. interactions 9, 4 (July 2002), 36-42.
- Influencing Visual Judgment through Affective Priming. Lane Harrison, Aidong Lu, and Remco Chang. In Proc. ACM Human Factors in Computing Systems (CHI), 2013.
suggested - Apparent usability vs. inherent usability: experimental analysis on the determinants of the apparent usability. Masaaki Kurosu and Kaori Kashimura. Conference Companion on Human Factors in Computing Systems (CHI '95).
- What is beautiful is usable. N Tractinsky , A.S Katz , D Ikara. Interacting with Computers, Volume 13, Issue 2, December 2000, Pages 127–145.
- Is beautiful really usable? Toward understanding the relation between usability, aesthetics, and affect in HCI. Alexandre N. Tucha, Sandra P. Rotha, Kasper Hornbækb, Klaus Opwisa, Javier A. Bargas-Avila. Volume 28, Issue 5, September 2012, Pages 1596–1607.
slides

L21. PROTOTYPING WORKSHOP | TUES APR. 2


L22. PROTOTYPING WORKSHOP | THURS APR. 4


L23. ROUNDTABLE with JANET IWASA | TUES APR. 9

guest Dr. Janet Iwasa, research assistant professor, Department of Biochemistry, U of Utah School of Medicine.

L24. WRITE-UP WORKSHOP | TUES APR. 16