A Distributed Display System for Interactive Sketching Brian P. Bailey Department of Computer Science University of Illinois Urbana, IL 61801 [email protected] display, e.g., [13, 14], did not support sketching. Photoshop provides a radar view in a separate window, but this overly competes for screen space, a precious commodity.


When using physical tools, designers can sketch artifacts and spread them about the walls of a room to explore, communicate, and juxtapose design ideas. However, when using electronic sketching tools, designers are typically confined to the use of a physically smaller (desktop-size) workspace, which inhibits creativity and collaboration.


We are developing a distributed display system effective for sketching solutions to large-scale design problems. Our first implementation tethered a high-resolution tablet (focus) to a lower-resolution large screen (context) [6]. A designer can sketch details on the tablet and instantaneously view context on the large screen. The focus screen provides a magnified view of that part of a design lying in the frame of reference.

To be effective for sketching, a larger workspace must enable designers to sketch on a high-resolution screen in an ergonomic manner, quickly navigate to different parts of a design, sketch details in context of the broader design, instantaneously switch between details and context, and support groups of designers. Such workspaces are needed in mechanical, industrial, graphics, and interactive design [3].

Multiple Displays and Two-Handed Interaction

We physically separate the screens to enable the views to be controlled independently, i.e., the focus view can be panned or zoomed without affecting the context view. The large screen is positioned just above the focus screen to ensure that it does not block the context view and just far enough away to make it more ‘public’ - enabling others to view the design without awkwardly leaning over the designer. This would occur if the context screen was placed adjacent to the focus screen in a designer’s private workspace.

To provide a workspace satisfying these requirements, we are developing a distributed display system that electronically tethers smaller focus screens to a larger context screen. Integrating sketching tools with our display system can make them more effective. For example, it could enhance tools that enable designers to sketch early designs, annotate large-scale graphs, or shade curves and surfaces.

A graphics display tablet is used as a focus screen since it offers a high-resolution surface for sketching as well as the freedom to move, pivot, and reposition the display itself. For the context screen, a large screen is projected on the wall, but any large display could be used. The displays are driven from a single machine with a multi-head video card.


A zooming canvas can provide a virtually larger workspace [2], but does not enable designers to sketch details in context of the broader design. Distortion-based views [8, 9, 10] are effective for visualizing large data sets, but the inherent spatial distortion is inappropriate for sketching.

Consistent with bimanual theory [7], a designer controls the views with a 6DOF input device in her non-dominant hand while sketching with her dominant hand, facilitating better performance and more naturalistic interaction [4].

To provide a physically larger workspace, we could use a large digital desk. However, it does not allow the focus to be controlled independent of the context and offers poor ergonomics [5]. The use of a single large vertical display requires that a designer stand, reach, and physically move about, which is unacceptable for many hours of design.

Support for Collaboration

Design is often collaborative, e.g., designers exploring early ideas together or communicating ideas to others. To better support collaboration, we are extending our implementation to allow any number of tablets to connect to a machine driving a large display. For maximum flexibility, a client / server architecture is being used to integrate the systems.

A high-resolution screen could be surrounded by a lowerresolution large screen [1]. However, since the screens lie in the same vertical plane, a designer must sit very close to sketch, overly limiting the view of surrounding context. Previous systems which tied smaller displays to a large

Once a design is loaded, it is shown on the context screen while each focus screen shows a different part of the design, as controlled by a designer. To enable more detail to be shown on the context screen, we are now using a highresolution large display as the context screen, though our implementation still allows any large display to be used.


and practice will facilitate more effective evaluation. For example, this will help in selecting appropriate metrics as well as predicting and explaining the experimental results.

The interaction design of the system is being guided by theory and practice related to collaboration and creativity. For example, field studies of collaborative work show that people often shift between public and private work modes [11] and theories of creativity argue that juxtaposing alternative ideas facilitates creative thinking [12]. We are currently exploring how to best support these and other tasks through a series of low-fidelity prototypes.

Broader Implications of DDEs to HCI Research

While we are investigating how the use of a distributed display system impacts interactive systems design, similar systems could be developed and evaluated for industrial, mechanical, architectural, and graphic design. Our system is just one example of how small and large displays can be integrated to form a workspace more effective than its parts.


We discuss how our experiences with distributed display environments (DDE) can contribute to the workshop goals.

To enable broader research on DDEs, software toolkits are needed that will allow users to immediately form integrated workspaces from a collection of small and large displays. Developing toolkits is a hallmark of the CHI community.

Promising Areas for Interaction Research

Interacting with content on a large display changes the ergonomics of the user experience, as users must now stand, reach, and physically move about the display. While many techniques have been developed to reduce physical movement, they often require that users be near the screen. By mediating interaction through smaller, portable devices, the use of DDEs offers a new approach for interacting with remote content. Investigating how smaller devices can be most effectively used to interact with remote content on large displays offers exciting areas for interaction research.

Another implication is to understand how the use of DDEs can enhance, or even amplify, creativity in design, e.g., by enabling more effective exploration, communication, and juxtaposition of ideas. How technology shapes creativity is an emerging research topic in the CHI community. REFERENCES 1. Baudisch, P., D. DeCarlo, A. Duchowski and B. Geisler. Focusing on the Essential: Considering Attention in Display Design. Communications of the ACM, 46 (3), 60-66, 2003. 2. Bederson, B.B., et al. Pad++: A Zoomable Graphical Sketchpad for Exploring Alternate Interface Physics. Journal of Visual Languages and Computing, 7, 3-31, 1996. 3. Buxton, W., G. Fitzmaurice, R. Balakrishnan and G. Kurtenbach. Large Displays in Automotive Design. IEEE Computer Graphics and Applications, 20 (4), 68-75, 2000. 4. Buxton, W. and B. Myers. A Study in Two-Handed Input. CHI, 1986, 321-326. 5. Elliott, A. and M.A. Hearst. A Comparison of the Affordances of a Digital Desk and Tablet for Architectural Image Tasks. Intl. J. Human-Computer Studies, 56 (2), 173-197, 2002. 6. Flider, M. and B.P. Bailey. An Evaluation of Techniques for Controlling Focus+Context Screens. Proceedings of Graphics Interface, London, Ontario, 2004, 135-144. 7. Guiard, Y. Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model. Journal of Motor Behavior, 19 (4), 486-517, 1987. 8. Mackinlay, J., G. Robertson and S.K. Card. The Perspective Wall:Detail and Context Smoothly Integrated. Proceedings of the ACM Conference on Human Factors in Computing Systems, 1991, 173-179. 9. Robertson, G. and J.D. Mackinlay. The Document Lens. UIST, 1993, 101-108. 10. Sarkar, M. and M.H. Brown. Graphical Fisheye Views of Graphs. CHI, 1992, 83-91. 11. Shen, C., K. Everitt and K. Ryall. Ubitable: Impromptu FaceToface Collaboration on Horizontal Interactive Surfaces. Proc. Ubicomp, 2003. 12. Shneiderman, B. Creating Creativity: User Interfaces for Supporting Innovation. ACM Transactions on ComputerHuman Interaction, 7 (1), 114-138, 2000. 13. Streitz, N.A., et al. I-Land: An Interactive Landscape for Creativity and Innovation. CHI, 1999, 120-127. 14. Tani, M., et al. Courtyard: Integrating Shared Overview on a Large Screen and Per-User Detail on Individual Screens. CHI, 1994, 44-50.

However, interaction research in DDEs must be grounded in theory and practice. This will serve to guide design decisions and provide a basis for later evaluation. Incorporating Passive Information Display

Passive information display is a central part of our system designers use it to maintain awareness of design context, alternative design ideas, and ongoing activity of other designers. All of this information is shown on the context screen. One challenge is to understand how often designers use this information and how it affects the design process. Another challenge is determine an effective level of detail for conveying design activity in collaborative settings. For example, should the visualization show each stroke in realtime or groups of strokes made during periodic intervals? Because there is more screen space in a DDE, it will also be important to understand when, where, and how often users allocate their visual attention to this information. Since no single visualization will likely satisfy the needs of all DDE research, we should focus on developing toolkits that enable rapid exploration of alternative visualizations and developing guidelines for determining an appropriate level of detail to show given the task environment. Evaluation of DDEs

Evaluation should focus on how well a user can perform relevant tasks using a DDE and how the use of the DDE affects the tasks performed. For our system, for example, we want to evaluate not only how effectively designers can utilize the system to sketch design ideas, but also how the use of the system affects the ideas that are sketched - design shapes the designer as much as the designer shapes the design. Grounding interaction designs for DDEs in theory


A Distributed Display System for Interactive Sketching

A Distributed Display System for Interactive Sketching. Brian P. Bailey. Department of Computer Science ... away to make it more 'public' - enabling others to view the design without awkwardly leaning over the designer. ... Incorporating Passive Information Display. Passive information display is a central part of our system -.

29KB Sizes 3 Downloads 107 Views

Recommend Documents

A distributed system architecture for a distributed ...
Advances in communications technology, development of powerful desktop workstations, and increased user demands for sophisticated applications are rapidly changing computing from a traditional centralized model to a distributed one. The tools and ser

Method and apparatus for driving the display device, display system ...
Feb 5, 1998 - 345/100. AND DATA PROCESSING DEVICE. 5,604,511 A ... Foreign Application Priority Data. It is an object to .... DATA DRIVER. I l. 'IIII'IIIII'I IJ.

Method and apparatus for driving the display device, display system ...
Feb 5, 1998 - 345/206. THE DISPLAY DEVICE, DISPLAY SYSTEM,. 5,251,051 A * 10/1993 Fujiiyoshi et a1. .. 345/100. AND DATA PROCESSING DEVICE.

A Management System for Distributed Knowledge ...
Many standards, little coherence and a ... ontological bias into such standards, which then causes ... about a new drug into a medical data management system).

A Web Based Workflow System for Distributed ...
Dec 9, 2009 - Keywords: scientific workflow; web service; distributed atmospheric data ... gird infrastructure as shared resources. The core service in.

Implementing a Distributed Execution System for ... - Flavio Figueiredo
execution service that allows for load balancing and improves MyGrid performance. A checkpointing ... system by using a grid middleware; with it the user can access a variety of services, such as: resource management, security ... Local Area Network

LNBI 4360 - A Distributed System for Genetic Linkage ... - Springer Link
We present a distributed system for exact LOD score computations, called .... application on a single CPU, defined as a portion of CPU-bound operations in the over- ..... D., Foster, I.: Scheduling in the grid application development software.

A Distributed Multi-Agent System for Collaborative ...
Mail Stop 269-2 ... aided by easy sharing utilities as well as automated information .... between agents is supported with automatic indexing methods in.

Bigtable: A Distributed Storage System for ... - Research at Google
service consists of five active replicas, one of which is ... tains a session with a Chubby service. .... ble to networking issues between the master and Chubby,.

A Management System for Distributed Knowledge and ... - CiteSeerX
to transfer added knowledge (meta data) from one type of system to ... from heterogeneous data sources. ... Business facet - specifies how to trade the content.

Implementing a Distributed Execution System for ... - Flavio Figueiredo
FINAL phase. 3.2. Reliable Communication. 3.2.1. Contacts from the MyGrid broker to the Master and from the Master to the Slaves. In the system three messages are sent from the MyGrid broker to the Master, they are: 1. Use. Service; 2. Execute Replic

Distributed Operating System
IJRIT International Journal of Research in Information Technology, Volume 1, ... control unifies the different computers into a single integrated compute and ... resources, connections between these processes, and mappings of events ... of excellent

Distributed File System
Hadoop file. System. Clustered- based, asymmetric. , parallel, object based. Statef ul ... File System http://hadoop.apache.org/core/docs/current/hdfs_de sign.html.

System and method for synchronization of video display outputs from ...
Jun 16, 2009 - by executing an interrupt service routine by all host processors. FIG. 9 .... storage medium or a computer netWork Wherein program instructions are sent over ..... other information include initialization information such as a.