USO0RE39090E

(19) United States (12) Reissued Patent

(10) Patent Number: US (45) Date of Reissued Patent:

Beauregard et al. (54)

RE39,090 E May 2, 2006

“NetWord,” URL:http://WWW.netWord.com, Copyright 1998

SEMANTIC USER INTERFACE

NetWord LLC, and WWW.netWord.com/Whyuse.html.*

(75) Inventors: Serge Pierre Beauregard, Winter Park,

“Microsystems HandiWORD”, URL:http://WWW.microsy

FL (US); Jesus Roberto

scorn/handiw/hwfwordhtm, pp. 143, undated.*

Armijo-Tamez, Santa Teresa, NM (US)

(Continued)

(73) Assignee: ActiveWord Systems, Inc., Winter Park, FL (US)

Primary Examinerishahid Alam (74) Attorney, Agent, or Firmisterne, Kessler, Goldstein & Fox PLLC

(21) Appl. No.: 09/983,981 (22) Filed:

(57)

Oct. 26, 2001

A system and method that alloWs a user to use their everyday language or user de?ned Words to operate the computer in a

Related US. Patent Documents

Reissue of:

(64) Patent No.:

(51)

ABSTRACT

5,974,413

highly e?icient Way. In short, every Word, letter, control character and symbols is potentially actionable. A computer

user’s productivity is dramatically increased by making

Issued:

Oct. 26, 1999

Appl. No.:

08/886,011

available those functions that enable a user to produce most

Filed:

Jul. 3, 1997

of his Work through simple, language-based commands. The present invention provides an intuitive interface, referred to

Int. Cl. G06F 17/30

as a semantic user interface (SUI), that enhances the opera tion of the current standard Window-based interface in a

(2006.01)

manner that is simple, richer and natural. By leveraging all (52)

US. Cl. ................... .. 707/6; 707/2; 707/3; 707/10;

707/101; 707/1; 345/781 (58)

of the richness and poWer inherent in a user’s language, the

present invention provides an important tool that alloWs the

Field of Classi?cation Search ................... .. 707/ 1,

personal computer to operate in a manner that is much closer

707/2, 3*6, 100, 101, 103 R, 104.1, 202, 707/10; 704/251, 252, 270, 271, 9, 10; 379/8822;

to our natural Way of interacting. A user is allowed to enter

345/781

See application ?le for complete search history. (56)

“commands” in his everyday natural language in order to control the operations of the computer. All commands are language-based and user-de?ned. These commands can be entered from any context of the user’s computer (e.g., any

References Cited

application or operating system Workspace). The commands alloWs a user to launch applications and navigate Within

U.S. PATENT DOCUMENTS

applications by using language rather than clicks from a 4,689,737 A 4,724,521 A

8/1987 2/1988

Grant ....................... .. 345/781 Carron et a1. ............... .. 7l7/ll

(Continued) FOREIGN PATENT DOCUMENTS W0

WO 99/01831

l/l999

OTHER PUBLICATIONS

pointing device such as a mouse. It also alloWs the replace

ment of keystrokes With stored Words or keystrokes. The system keeps a complete archive record of all the text content the user provides as input, regardless of Which application program or operating system Window the user is operating in at the time. The combined set of all user de?ned commands and the memory of all the input text that is stored

in the archive constitutes the personality pro?le and is transportable from one computer to another.

“Perfect Keyboard”, Version 2.01, from http://softWareutili

ties.com/pkindex.htm and http://softWareutilities.com/pki history.htm, date unknoWn.*

100 Claims, 30 Drawing Sheets

330

micro

Kemei

Navigational Manager

Engine Windows

Applications

US RE39,090 E Page 2

US. PATENT DOCUMENTS 4,907,283 4,955,066 4,974,191 5,252,951 5,287,514

A A A A A

5,418,717

A

5,421,012

A

*

3/1990

Tanaka et al. ............ .. 382/176

*

9/1990

Notenboom .............. .. 358/1.9

* 11/1990 Amirghodsi et a1. ...... .. 345/700 10/1993 Tannenbaum et a1. .... .. 345/156 *

5,434,963 A

2/1994

Gram ....................... .. 395/700

5/1995

Su et al.

5/1995

Khoyi et al.

......

. . . . . . ..

........

7/1995 Kuwamoto et al. .

5,530,861 A

*

6/1996 Diamant et al.

5,544,352

A

*

8/1996

Egger

5,551,020

A

*

8/1996

Flax et al.

5,555,288 A

......

9/1996 Wilson et al. ..

*

1/1997 Doner et al.

5,623,406

A

*

4/1997

5,704,060

12/1997

Ichbiah

A

*

*

3/1998 Pentheroudakis ..

Del Monte

.....

5,729,730 A

*

3/1998 Wlaschin et al.

5,754,712

A

*

5/1998

Tanaka et al.

5,760,768

A

6/1998

Gram

......

. . . . . . . . . . . . .

5,764,906 A

*

6/1998 Edelstein et al.

5,768,578

*

6/1998

5,899,996 A

. ... .. ... .

5/1999 Dysart et al.

5,900,004 A 5,915,001 A 5,974,413 A

*

5,987,446

*

A

Kirk et al.

707/5

707/101

.. 379/88.01

. . . ..

704/3

704/7

704/10

707/1 . . . ..

345/163

. . . ..

345/333

709/203 . . . ..

“Product Information for LaunchBoard V2.0 for Windows”,

prod.htm, pp. 143, date unknown.*

. . . ..

5,724,594 A

Greene, Inc.*

345/708

345/835

. ... ... .

SpellCatcherTM User Manual, Copyright 1996, Casady & from

. . . ..

. . . ..

Stearns , T., “The utility Windows is missing”, LANTIMES, Jul. 21, 1997.*

709/107

705/8

... ... ... .. ..

5,598,557 A

A

. . . ..

704/9

“ShortKeys V1.0 Press Release”, URL:http://www.smartco de.com/isshtml/shtpress.htm, pp. 142, Sep. 12, 1996*

707/100

707/103

5/1999 Gipson ..................... .. 707/530 6/1999 Uppaluru ............... .. 379/8822

http ://softwareA1epot.netscape.com/PKSN02047 9/

“Product Information for 34D KEYBOARD V2.5”, from

http://softwareidepot.netscape.com/PKSN020076/ prod.htm, pp. 144, date unknown.* “Product Information for Shortcuts V1.1 for Win 95”, from

http://softwareidepot.netscape.com/PKSNl00239/ prod.htm, pp. 143, date unknown.* Microsoft MSiDos, Operating System Version 5.0, User’s Guide and Reference, Microsoft Corporation, Redmond, Washington. QA 76.76.063 M52 1991 c.2.* Microsoft MSiDOS Operating System, Version 5.0, “User’s Guide and Reference”, Microsoft Corporation, Redmond, Washington. QA 76.76.063 M52 1991 c.2.* AIM Keys, The AlliiniOne Macro Utility (Copyright

199641999) http://www.aimsoft.com/aimkeys/indexhtm, 2

10/1999 Beauregard et a1. ......... .. 707/6

pages.

11/1999

707/3

ActiveWordsithe Semantic User Interface for Windows 95

707/1

and NT, Copyright 1997, 1998, ActiveWord Systems, Inc.,

Corey et a1.

.. .. ... ... .

. . . ..

6,026,388 A

2/2000 Liddy et a1. .

6,077,077 A

6/2000 Geipe ........................ .. 434/30

2 pages.

ActiveWordsTM: The Semantic User InterfaceTM, 1998, ActiveWord Systems, Inc., 4 pages.

OTHER PUBLICATIONS

“Unisyn Macro Magic”, URL:http://ww.unisyn.com/macro magic/. pp. 1|:I2, Copyright 1997, and www.unisyn.com/ macromagic/pics/wiZardgif, and www.unisyn.com/macro magic/pics/maingif. and mvw.unisyn.com/macromagic/

Cowart, Robert, Mastering Windows 3.] Special Edition, 1993 Sybex Inc. 2021 Challenger Drive, Alameda, CA 94501. How can you use AIM keys to save time? (Copyright

pics/properties.gif.*

199641999)

“Instant TextiTextware Solutions”, URL:http://www.twso lutions.com, Copyright 1997 Textware Solutions, (Last modi?ed Oct. 27, 1997), and www.twsolutions.com/new/

show.htm, 2 pages.

Version2.htm, and www.twsolutions.com/product/product s .htm, and www.twsolutions .com/overview/overviewhtm,

and www.twsolutions.com/overview/wordabbvhtm, and www.twsolutions .com/overview/phrsabbvhtm, and www.twsolutions .com/oVerview/markers .htm, and www.twsolutions .com/oVerView/custmglo .htm, and www.twsolutions .com/oVerview/glocomphtm, and www.twsolutions.com/oVerView/actiglohtm, and www.tw solutions.com/overview/advisoryhtm, and www.twsolu tions.com/oVerView/continue.htm, and www.twsolution s.com/oVerview/workit.htm, and www.twsolutions.com/ oVerView/stalonehtm, and www.twsolutions .com/overview/

http://www.aimsoft.com/aimkeys/aky

“Index”, r‘CompanyBackground”, r‘The TechnologyBehind

Autonomy Agentware”, r‘Autonomy Agentware Technology Whitepaper” and “ActiveKnowledge”, all printed from http://www.autonomy.com/ and hyperlinks, 20 pages. Pike, Rob, “Acme: A User Interface for Programmers,” URL: http://www.cs.bell*labs.com/sys/doc/acme/acme. html, Copyright 2000 Lucent Technologies Inc., 16 pgs. “TextW'ise: Information Access and Analytic Software and

Services,”

URL:http"//www.textwise.com

Copyright

199942000, 1 pg., and www.textwise.com/knowit.html, 1 pg., www.textwise.com/news.html. 1 pg. and www.text

wise.com/cindor.html, 3 pgs.

Welcomel, Project: DRiLINK, r‘Project Cindor”, r‘Eva”,

wordpro.htm.*

“Knowilt” and “Chess”, all printed from http://www.text wise.com/ and hyperlinks, 9 pages, Copyright 1997.

Ettore, R., “TypeIt4Me: The tool to speed up your typing”, User Manual for Version 4.7.0, pp. 1415, Mar. 22, 1997.*

w.aimsoft.com/aimkeys/akyswhat.htm>, 2 pages.

“Lifestreams Project Home Page”, URL:http://www.cs.ya le.edu/homes/freeman/lifestreams.html, pp. 143, Copyright

Netword LLC, and www.netword.com/whyuse.html.

1996 Eric T. Freeman and Yale University.* “Why Take The Long Way When You Can Take A Short

cutl”, (advertisement describing Tempo Shortcutter soft ware), and Brief description of Version 1.5.*

What is AIM Keys? (Copyright 199641999)
“Netword,” URLzhttp://www.netword.com. Copyright 1998

“Unisyn Macro Magic”, URL:http://www.unisyn.com/mac romagic/. pp. 142, Copyright 1997, and www.unisyn.com/ macromagic/pics/wiZardgif, and www.unisyn.com/macro magic/pics/maingif. and www.unisyn.com/macromagic/

pics/propertiesgif.

“Shortkeys Home Page”, URLzhttp://www.smartcode.com/

Rue, T.V., Knowledge Navigational Mapping and Explora

isshtml/shortkhtm, p. 1, date unknown.*

Zion/Expression Tools and The Knowledge Calculator, 29 pages (1994). Rue, T.V., First VIC CommandiAl, 8 pages (1994). Rue, T.V., PK Command, 9 pages (1994).

“Insight Software Solutions, Inc.iShortKeys Software”, URL:http://www.smartcode.com/isshtml/shortk2.htm, 142, undated.*

pp.

US RE39,090 E Page 3

Rue, TV, 0] command, 2 pages (1994). Rue, T.V., IP Command, 2 pages (1994). Rue, T.V., OP command, 2 pages (1994). Rue, T.V., SF Command, 2 pages (1994). Rue, T.V., IQ Command, 5 pages (1994). Rue, T.V., ID Command, 3 pages (1994). Rue, T.V., KE command, 3 pages (1994). Rue, T.V., J/irtual Interaction Con?guration Objective, 13 pages (1988). Rue, T.V., Project: J/irtual Interaction Con?guration, 7 pages (1975). ActiveWordsTM The Semantic User InterfaceTM: Run the

World’s Most Powerful Software: English! ActiveWord Sys tems, Inc, Copyright 1997, 1998, 2 pages. ActiveWordsTM: The Semantic User InterfaceTM, http://ww w.ActiveWords.com, date and publisher unknown, 4 pages. Ettore Riccardo, “TypeIt4Me: The Tool to Speed Up Your

Typing,” Version 4.7.0 User Manual, Copyright 1989*1997, R. Ettore, pp. 1*15.

Autonomy, “Company,” http://www.autonomy.com/com

Fingertip Software, “3*D Keyboard 2.5,” software.net,

1998,

http ://www.softwareidepot.netscape.com/

PKSN020076/prod.htm, last visited Jun. 22, 1998, 4 pages. LaunchBoard V2.0 for Windows, “The Quickest, Easiest Way to Launch Applications and Web Sites!” software.net,

1998,

http ://www.softwareidepot.netscape.com/

PKSN020479/prod.htm, last visited Jun. 22, 1998, 3 pages. ShortCuts v1.1 for Win 95, “PersonaliZe Your Function

Keys,” software.net, 1998, http://www.software*depot. netscape.com/PKSN100239/prod.htm, last visited Jun. 22, 1998, 3 pages. ShortKeys, “The Ultimate Text Replacement Utility for

Windows 3.1, 95, NT,” http://www.smartcode.com/isshtml/ shortk.htm, date unknown, 1 page.

SpellCatcherTM User Manual, Copyright 1996, Casady & Greene, Inc. Stearns Tom, “The Utility Windows Is Missing,” LAN TIMES, Jul. 21, 1997. Unisyn Macro Magic, “Blast Through the Net! And All other Repetive Tasks . . . ” Unisyn Software, LLC, 1997, http://

pany/index.html, last visited Apr. 26, 1999, 2 pages.

www.unisyn.com/macromagic/, date unknown, 2 pages.

Autonomy, “Company Background,” http://autonomy.com/

Unisyn, “Macro Setup WiZard,” http://www.unisyn.com/

company/background.htm, last visited Apr. 26, 1999, 5

Autonomy,

macromagic/pics/wiZard.gif, date unknown, 1 page.

Unisyn, “Macro Magic,” http://www.unisyn.com/macro

pages.

“Technology:

The

Technology

Behind

magic/pics/main.gif, date unknown, 1 page.

Autonomy AgentwareTM,” http://www.autonomy.com/tech/

Unisyn, “Macro Properties,” http://www.unisyn.com/mac

index.html, last visited Apr. 26, 1999, 2 pages.

romagic/pics/properties.gi? date unknown, 1 page.

Autonomy, “Technology: Autonomy AgentwareTM Technol

TeXtWiseTM, “Welcome!” TextWise, LLC, Copyright 1997,

ogy Whitepaper,” http://www.autonomy.com/tech/wp.html,

http://www.teXtwise.com/index.html, last visited Jun. 7, 1999, 1 page.

last visited Apr. 26, 1999, 8 pages.

Autonomy, “Active Knowledge,” http://www.autonomy.

TeXtWiseTM, “Project: DRiLlNK,” TeXtWise, LLC, Copy

com/activeknowledge.html, last visited Apr. 26, 1999, 3

right 1997, http://www.textwise.com/drlink.html, last vis

pages.

ited Jun. 7, 1999, 1 page.

Press Release, “Insight Software Solutions, Inc. ShortKeys Software for Windows 3.1, 95 or NT,” date unknown, 2

TeXtWiseTM, “Project: CINDOR,” TextWise, LLC, Copy right 1997, http://www.textwise.com/cindor.html, last vis

pages.

ited Jun. 7, 1999, 1 page.

Press Release, “Text Replacement Made Easy with New

TeXtWiseTM, “EVA: Evolving Intelligent TextiBased Agents for Geospatial Information,” TextWise, LLC, Copyright

ShortKeys Macro Utility,” Insight Software Solutions, Inc., Sep. 12, 1996, 2 pages. “LifestreamsTM Organizing Your Electronic Life,” http://

www.cs.yale.edu/homes/freeman/lifestreams.html,

Copy

right 1994*1996, Eric T. Freeman and Yale University, 3 pages.

Microsoft® MSiDOS, Operating System Version 5.0, User’s guide and Reference, Microsoft® Corporation, date unknown. “HandiWORD and HandiWORD International: Word Pre

diction for Windows and DOS,” http://www.microsys.com/ handiw/hwiwordhtm, 3 pages. Netword®, “Networds Are the Fastest, Easiest Way to Get Around the Internet: URLs are for Computers. Networds are

for People.” Netword LLC, 1998, http://www.netword.com/, 1 page.

1998, http://www.textwise.com/eva.html, last visited Jun. 7, 1999, 2 pages. TeXtWiseTM, “KNOWilT: KNOWledge Base Information

Tools,” TextWise, LLC, Copyright 1998, http://www.text wise.com/abs.html, last visited Jun. 7, 1999, 2 pages. TeXtWiseTM, “CHESS: Chronological Information Extrac

tion System,” TextWise, LLC Copyright 1998, http://www. teXtwise.com/chess.html, last visited Jun. 7, 1999, 2 pages. “Why Take The Long Way When You Can Take A Shortcut:

Tempo Shortcutter Macros Simplify Your Work,” publisher and date unknown, 1 page.

“About Tempo Shortcutter Version 1.5,” publisher and date unknown, 2 pages. AIM Keys The AlliiniOne Macro Utility, “New Electronic

Netword®, “Why Use Networds?: URLs are for Computers. Networds are for People.” Netword LLC, 1998, http:// www.netword.com/whyuse.html, 2 pages.

Version 2.0,” Aimsoft Development Corporation, Copyright

“Perfect Keyboard Main Page,” Pitrinec Software, 1998, http://www.softwareutilities.com/pkindex.htm, last visited Jul. 8, 1998, 2 pages.

“What is AIM Keys?” Aimsoft Development Corporation,

1996*1999,

http://www.aimsoft.com/aimkeys/index.htm,

date unknown, 2 pages.

Copyright 1998, 1999, http://www.aimsoft.com/aimkeys/ akyswhat.htm, 2 pages.

“Perfect Keyboard History,” Pitrinec Software, 1998, http://

“How Can You Use AIM Keys to Save Time?” Aimsoft

www.softwareutilities.com/pkihistoryhtm, last visited Jul. 13, 1998, 2 pages.

Development Corporation, Copyright 1998, 1999, http:// www.aimsoft.com/aimkeys/akyshow.htm, 2 pages.

US RE39,090 E Page 4

TextWareTM Solutions, “InstantTextTM Makes a Few Letters

Advisories, Textware Solutions, Copyright 1997, http://ww

Worth a Thousand Words,” Textware Solutions, Copyright

w.twsolutions.com/overview/advisory.htm, date unknown, 3

1997, last modi?ed Oct. 27, 1997, http://www.twsolution

pages.

s.com/, 1 page. Instant Text Version 2.0 Now Available, “Instant Text 2.0 for Windows 95 and NT 4: Textware Solutions Just Released

Instant Text 2.0,” Textware Solutions, Copyright 1997, http://www.twsolutions.com/new/version2.htm, date unknown, 3 pages. Textware Solutions Product List, Textware Solutions, Copy

Continuations, Textware Solutions, Copyright 1997, http:// www.twsolutions.com/overview/continue.htm,

date

unknown, 2 pages.

Working With Instant Text, “Start With Glossary Compila

tion,” Textware Solutions, Copyright 1997, http://www.tw solutions.com/overview/workit.htm, date unknown, 1 page.

right 1997, http://www.twsolutions.com/product/product

Instant Text Can Be Used as a StandiAlone Editor, Textware

s.htm, date unknown, 2 pages. Instant Text?verview, “Instant TextiThe Fastest Way

overview/stalone.htm, date unknown, 1 page.

from Thought to Type!” http://www.twsolutions.com/over view/overview.htm, publisher and date unknown, 1 page. Word Abbreviations, Textware Solutions, Copyright 1996, http://www.twsolutions.com/overview/wordabbv.htm, date unknown, 2 pages. Phrase Abbreviations, Textware Solutions, Copyright 1997, http://www.twsolutions.com/overview/phrsabbv.htm, date unknown, 1 page.

Markers, Textware Solutions, Copyright 1997, http://ww w.twsolutions.com/overview/markers.htm, date unknown, 1 page.

Custom Glossaries, Textware Solutions, Copyright 1997, http://www.twsolutions.com/overview/custmglo.htm, date unknown, 1 page.

Solutions, Copyright 1997, http://www.twsolutions.com/ Instant Text Can Be Used With A Word Processor, Textware

Solutions, Copyright 1997, http://www.twsolutions.com/ overview/wordpro.htm, date unknown, 2 pages.

Cowart, Robert, Mastering Windows 3.1 Special Edition, 1993 Sybex Inc. 2021 Challenger Drive, Alameda, CA 94501.

“TextWise: Information Access and Analytic Software and

Services,” URL: http://www.textwise.com, Copyright 1999*2000, 1 pg., and www.textwise.com/knowiithtm), 1 pg., www.textwise.com/news.html, 1 pg., and www.text

wise.com/cindor.html, 3pgs. “AsiUiType4Correct Spelling Errors and Increase Typing Productivity as You Tpe,” URL: http://www.fanix.com/asu

Glossary Compilation, Textware Solutions, Copyright 1997, httpz//www.twsolutions.com/overview/glocomp.htm, date

type/index.htm, Copyright 1999*2000, 2 pgs.

unknown, 1 page.

http://www.cs.bellilabs.com/sys/doc/acme/acme.html,

Active Glossaries, Textware Solutions, Copyright 1997, http://www.twsolutions.com/overview/actiglo.htm, date

Copyright 2000 Lucent Technologies Inc., 16 pgs.

unknown, 1 page.

* cited by examiner

Rob Pike, “Acme: A User Interface for Programmers,” URL:

U.S. Patent

May 2, 2006

Sheet 1 0f30

118H VM

US RE39,090 E

App's'

VM

VM

VM

(\?rtual Machine) (Wrtual Machine) (Virtual Machine) (\?rtual Machine) 106

_

_

_

_

_

*

w



Window's

Components

w

_

.

m

~

n



.

_

_

_

.

g

.

n

M

w



.

_

_

_



.

32b|t application 16bit application ‘

manager

~

K

_

_

___

00rd DRV

manager

Dislay DRV ____________________ “;;;;/_“T1_6_

Position of Monitor —--- /MONITOR vloi/v /////// Ti ______________________________ __

VKD VMD VTD

VDD

V?ndow's

components KERNEL

104

VP'CD

(Wrtual Programable Interrupt Control Device) 120

VMM

(Virtual Machine Manager)

' ______________ '_utit-_t_tttTttt__

HARWARE

102 j

FIG. 1

U.S. Patent

May 2, 2006

Sheet 2 0f 30

Yeur1

— Month1

FIG.2

US RE39,090 E

U.S. Patent

31°

"0

May 2, 2006

Sheet 3 0f 30

550

U keyboard\ ‘"23 mouse_ VID

US RE39,090 E

= Wordbose < ---- --> it

350

fl i

_

Pro?les

Registry

F1

‘ Agent Re ist

8c Servii‘zesfy <____>

‘es

Windows

Agents

<————>

' _ _ ' '

113

Number _to text Calculations l l

Conversions

V 'L-{IQEEEE'IEI

FIG.3

Control

> Center

360 r,

Start

Applications

____

<

U.S. Patent

May 2, 2006

Sheet 4 0f 30

470

315

5

340

.

Agg‘rm

US RE39,090 E

.

“\

' “mg?”

Wordbose

420 k

"M 1 r’410 9

User

1

mput

*

W

=

Table

\r?omma"d

‘1

Interpreter

440

no

\'\

micro Keme|

330

A

State .

~

450

‘ VID

_

W 1

* MM“ ‘ one er

31°

9‘

450

460



\'\

Navigational Manager

AW Agent Services

Engine

1 1

_

Windows

Applications ‘

\

118

‘Mn95

Messaging

\

405

_

AW

Agents

s

370

U.S. Patent

May 2, 2006

Sheet 5 0f 30

US RE39,090 E

310

540

@J

,..J

Wordbuse

5 545

\ 530

Configuration

‘ r-J Control

/_J

405

Center

370

r) 2_



4

Files

FIG.5

Win95

* Messaging “

r) 1

Active Words Agents

U.S. Patent

May 2, 2006

Sheet 6 0f 30

US RE39,090 E

345

/_J 620

Control Center

R Pro?les =

' Registry

A 340

_

Master

330

User/Pro?le

Registry \

U

-

Con?guration /

Manager

Folders

E) Editing Mask * * User §_5_0



ii \

?les

310

Drawers 8c

A

\control Center _

/

540

i Organizer f-}

Agents-DLL f Organizer:

/J wordbqse

4

/

L610 Active Words

Win95

Apps

Messaging = > Voice

Input Others 405

370

FIG.6

U.S. Patent

May 2, 2006

Sheet 7 0f 30

US RE39,090 E

5' —- Navigation 3 — - Active Openin ords-Agenti docs/files - Third......... Party.. Agent '°.:'..

Foremost Application

W

Cursor

text string

:

\|

i

=

v



Pertorm

Commie

710 .

.

.

.

.

Action

Action

Erase

Service .

Second

Perform

Keystroke Command Text String

Words _.

?rst I

.

.

.

.

.

.

.

.

.

.

.

.

..

._

:- Sentence capitalization I 1- Double caps correctiomf f- Shift lock detection

i

Word '

1750

Service

U.S. Patent

May 2, 2006

802

f2“

US RE39,090 E

Sheet 8 0f 30

801

/

804 r-J

e—r\ v————v

0 00000000 o O o O o ‘O 0 Processor O 0 O o O O O 00000000 0

Communications Bus

Main Memory L-ILJLJIIULIU

Secondary Memory 808

-

Hard

Disk Drive

Removable

Removable

‘Storage Drive

Storage Unit

Interface

Storage Unit

Removable

820 825 Communication interface

824

FIG.8

828

Qiziz

U.S. Patent

May 2, 2006

Sheet 9 0f 30

Enter Word

Activate Word /

US RE39,090 E

910

920

‘I

Display Pop-Up Menu \

Toggle 940

M

V

930

Highlight Selected Option

FIG.9

U.S. Patent

May 2, 2006

miKE

Sheet 10 0f 30

US RE39,090 E

Content Display System

330 To Application I

1020

U.S. Patent

May 2, 2006

Sheet 11 0f 30

——Productivity

US RE39,090 E

'

0 New CWs

0 Least used CWs

@ Mos}: iuisedi

,

l l>

[19] mwc 'E:\MWSoft\‘MWCrypt 1.0\MWCrypt.exe'

[10] exp

'C:\WlNDOWS\Stort Menu\Progroms\Windows Explo

[7]

cc

'C:\PROGRAM FlLES\ACllVEWORD BETA 1.0\AV

[7]

won

(close wlndow>n

['6]

no

'C:\WlNDOWS\Stort Menu\Progroms\Accessories

Keystrokes saved... in current session up to date

0 1226 Productlvlt CGl'ltl’Ol

——Tr0ining O In place punishment 0 Reminders only Current CWs under training cc

Control Center

9

exp

Windows Explorer

'

fn myc

GIBRAN v

MWSoft' Inc.

|Cllck View of CWsl

_

I Troinm; Centn?

S I'iTJ '

/

1120

FlG.ll

U.S. Patent

May 2, 2006

Sheet 12 0f 30

US RE39,090 E

1220

1210

r’

r‘)

,

Mosterlndex. =

Shared Wordbases

Common Names

Encyclopedia Architecture

Application/Items

User Profile

1240

/-123O Profile's

User Profile

Muster

Wordbuse \ 1235

\ wig-g) Masks

FIG. 12

- Pro?lev's

Master

Wordbose

U.S. Patent

May 2, 2006

Sheet 13 0f 30

US RE39,090 E

310 131C

L'\

.

i

Foremost Appl'cot'on

Perform some other function

Cursor

I

text string

i i

(not related to archive). T

'

Deliver the

l

substitution word

Text Archiver

Tagging - Time - Date

- Foremost app.

— Foremost doc. substitution

- 7X7 category

word

Store Text In The Archive

Code Words

Active Wordbose Service Dual Words Scripts Comments

\_.\

Text Archive

\_.\

340

1350

FIG. 13

U.S. Patent

May 2, 2006

Sheet 14 0f 30

En

:W@ 5?? 22.. my 6 _..._ g ,9a?gm25%:[email protected]@ @238

a:22% on:2:on:a:

a:3 0C

V A v m

on:

26 A A5.

US RE39,090 E

U.S. Patent

May 2, 2006

Sheet 15 0f 30

US RE39,090 E

Did you know...

The Advanced Find can help you find from one character of a word to several words in every field of the item. To search for more than one word just start the

search line with quotes (").

I2 [Show Ups on StartUpl

Next TiP

FIG. 15

Close

Semantic user interface

Oct 26, 2001 - 707/2, 3*6, 100, 101, 103 R, 104.1, 202, .... le.edu/homes/freeman/lifestreams.html, pp. .... pany/index.html, last visited Apr. 26, 1999, 2 pages.

4MB Sizes 6 Downloads 418 Views

Recommend Documents

Contextual Adaptive User Interface For Android ... - Semantic Scholar
Keywords—adaptive user interface; mobile phones; application usage .... Database: The database stores the contextual user data collected by the data ...

Colibri semantic core: Interface - GitHub
Aug 10, 2016 - (BEMS) and the semantic data store for all relevant information. ... monitoring data from BASs as well as other information from the Web or the smart grid. ..... In this example, the data service is able to host data values (i.e. pairs

ePub Designing the User Interface
Proceedings of the International Conference ‘Between Data and Senses .... air traffic control) and consumer examples (e.g. web services, e-government, ...

Task-Centered User Interface Design
1 The Task-Centered Design Process. 1. 1.1 Figure Out .... 5.4 Deciding What Data to Collect . ..... logical order the steps needed to design a good user interface. Chapter 1 ..... cycle, the interface can't be produced or analyzed at one point.

ePUB Designing the User Interface
A New Socio technical Model for Studying Health Information Technology in Complex Adaptive Healthcare ... The new edition provides updates on current HCI ...