Scaled text replacement of ink

IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII

US007848573B2

(12) United States Patent

Wecker et al.

(io) Patent No.: (45) Date of Patent:

US 7,848,573 B2 Dec. 7, 2010

(54) SCALED TEXT REPLACEMENT OF INK

(75) Inventors: David Brian Wecker, Redmond, WA (US); Richard I. Brass, Seattle, WA (US)

(73) Assignee: Microsoft Corporation, Redmond, WA (US)

( * ) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 U.S.C. 154(b) by 1183 days.

(21) Appl.No.: 10/725,604

(22) Filed: Dec. 3, 2003

(65) Prior Publication Data

US 2005/0135678 Al Jun. 23, 2005

Int. CI.

G06K9/18 (2006.01)

U.S. CI 382/186

Field of Classification Search 382/186,

382/187, 292 See application file for complete search history.

References Cited

U.S. PATENT DOCUMENTS

4,829,576 A 5/1989 Porter

4,866,778 A 9/1989 Baker

5,111,514 A * 5/1992 Ohta 382/177

5,151,950 A * 9/1992 Hullender 382/187

5,331,431 A * 7/1994 Jasinski 358/462

5,367,453 A * 11/1994 Capps et al 715/531

5,406,480 A 4/1995 Kanno

5,502,774 A 3/1996 Bellegarda et al.

5,513,278 A * 4/1996 Hashizume et al 382/187

5,517,578 A 5/1996 Altaian etal.

5,583,543 A 12/1996 Takahashi et al.

5,590,257 A 12/1996 Forcier

5,596,694 A 1/1997 Capps

5,615,378 A 3/1997 Nishinoetal.

5,649,027 A 7/1997 Mahajanetal.

(51)

(52) (58)

(56)

Systems, methods, and computer-readable media for processing electronic ink: (a) receive electronic ink input; (b) convert the input to machine-generated objects; and (c) render the objects such that their size substantially corresponds to the input's original size. The input ink may constitute text, and the machine-generated objects may correspond to words, lines, and/or other groupings of text generated by a handwriting recognizer. To enable quick and easy identification of recognizer errors, in at least some systems and methods, a user may select one or more words, which will cause the system to display the original ink corresponding to the selected word(s). Such systems also may display alternative words generated by the recognizer corresponding to the selected original ink and allow the user to select one of the alternatives to make corrections in the recognized text (akin to using a spell-checking or handwriting recognition program).

25 Claims, 8 Drawing Sheets

Page 2

2003/0215142 Al* 11/2003 Gounares et al 382/190

2003/0216913 Al 11/2003 Keely etal.

2003/0233237 Al 12/2003 Garside et al.

2005/0041834 Al * 2/2005 Wakeametal 382/100

2005/0100214 Al* 5/2005 Zhang et al 382/179

FOREIGN PATENT DOCUMENTS

EP 1363229 A2 11/2003

EP 1365349 A2 11/2003

JP 63095590 4/1988

JP 04290184 10/1992

OTHER PUBLICATIONS

OCR Master User's Guide, published by Micro forum, 1997, pp. 3-6,

3-7, 3-14, 3-15, and 5-2-5-5.

European Search Report dated Mar. 23, 2005.

Bill Camarda, "Using Microsoft Word 97", Que Corporation, pp.

54-55 and 199-200, 1997.

Wolfgang Hurst et al., "Error Repair in Human Handwriting—An Intelligent User Interface for Automatic On-Line Handwriting Recognition", IEEE Joint Symposia on Intelligence and Systems, pp. 389-395, 1998.

Ivan Poupyrev et al., "Virtual Notepad: Handwriting in Immersive VR," IEEE Virtual Reality Annual International Symposium, pp. 126-132, Mar. 14-18, 1998.

L. Schomaker, "From Handwriting Analysis to Pen-Computer Applications," Electronics and Communication Engineering Journal, vol. 10, No. 3, pp. 98-102, 1998.

U.S. Appl. No. 10/207,133, filed Jul. 30, 2002 (Marieke Iwema, et al.).

U.S. Appl. No. 10/734,305, filed Dec. 15, 2003 (Jian Wang, et al.).

Nicholas Baran, "Rough Gems: First Pen Systems Show Promise,

Lack Refinement," BYTE, pp. 212-222, Apr. 1992.

R. Zhao et al., "Pen-based Interfaces in Engineering Environments,"

Symbiosis of Human and Artifact, pp. 531-536, 1995.

C.G. Leedham, "Historical Perspectives of Handwriting Recognition

Systems," Proc. IEE Colloquium on Handwriting and Pen-Based

Input, Savoy Place, DigestNo. 1994/065,pp. 1/1-1/3, Mar. 1994 pp.

1-4.

Hirokazu Bandoh et al., "User Interfaces for Correcting Errors in Writing-box free Recognition of Handwritten Lext," IPSJ Journal, vol. 43, No. 6, pp. 1996-2005, Jun. 2002.

Zouheir Lrabelsi et al., "A Voice and Ink XML Multimodal Architecture for Mobile e-Commerce Systems," WMC '02, pp. 100-104, Sep. 2002.

Bernhard Suhm et al., "Multimodal Error Correction for Speech User Interfaces," ACM Transactions on Computer-Human Interaction, vol. 8, No. 1, pp. 60-98, Mar. 2001.

Bernhard Suhm et al., "Model-based and Empirical Evaluation of Multimodal Interactive Error Correction," ACM, pp. 584-591, 1999. Karen Kukich, "Techniques for Automatically Correcting Words in Text," ACM Computing Surveys, vol. 24, No. 4, pp. 377-439, Dec. 1992.

Michael A. Grasso et al., "The Integrality of Speech in Multimodal Interfaces," ACM Transactions on Computer-Human Interaction, vol. 5, No. 4, pp. 303-325, Dec. 1998.

* cited by examiner