Common annotation framework

IIIIIIIH

US007243301B2

(12) United States Patent

Bargeron et al.

(io) Patent No.: (45) Date of Patent:

US 7,243,301 B2 Jul. 10, 2007

(54) COMMON ANNOTATION FRAMEWORK

(75) Inventors: David M. Bargeron, Seattle, WA (US);

Anoop Gupta, Woodinville, WA (US)

(73) Assignee: Microsoft Corporation, Redmond, WA (US)

( * ) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 U.S.C. 154(b) by 544 days.

(21) Appl. No.: 10/119,544

(22) Filed: Apr. 10, 2002

(65) Prior Publication Data

US 2004/0205545 Al Oct. 14, 2004

Int. CI.

G06N3/00 (2006.01)

U.S. CI 715/512

Field of Classification Search 715/500,

715/512, 511, 513, 517, 523, 530 See application file for complete search history.

References Cited

U.S. PATENT DOCUMENTS

(51)

(52) (58)

(56)

A Common Annotation Framework includes, in an embodiment, an annotation having a context anchor that identifies a resource and a position in the resource that the annotation pertains to, and a content anchor that identifies data that is annotating the resource. The annotation can also be extended with client application-defined data and/or functionality, and the framework can be extended with one or more of application-defined objects, methods, and annotation stores.

45 Claims, 13 Drawing Sheets

FOREIGN PATENT DOCUMENTS

GB 2301260 11/1996

WO W09749251 12/1997

OTHER PUBLICATIONS

Marshall; "Annotation: from paper books to the digital library"; Proc. of Digital Libraries '97; (Philadelphia, PA, Jul. 1997) pp. 131-140.

Cadiz, et al.; "Using Web Annotations for Asynchronous Collaboration Around Documents"; Proc. of CSCW '00; (Philadelphia, PA, Dec. 2000); pp. 309-318.

Gronbaek, et al.; "Webvise: Browser and Proxy Support for Open Hypermedia Structuring Mechanisms on the WWW"; Proc. of the Fifth International World Wide Web Conference; (Loronto, May 1999); pp. 253-268.

Wilcox, et al.; "Dynomite: A Dynamically Organized Ink and Audio Notebook"; Proc. of CHI '97; (Atlanta, Georgia, Mar. 1997); pp. 186-193.

Laliberte, et al.; "A Protocol for Scalable Group and Public Annotations"; 1997 NCSA Lechnical Proposal; http://www.hypernews. org/18liberte/www/ scalable-annotations .html. Davis, et al; "NotePals: Lightweight Note Sharing by the Group, for the Group"; Proceedings of Human Factors in Computer Systems: CHI 99; Pittsburgh, PA; May 15-20, 1999; p. 338-345. Carrer, et al; "An Annotation Engine for Supporting Video Database Population"; Multimedia Tools and Applications 5; 1997; Lkuwer Academic Publishers; pp. 223-258.

"Webster's Encyclopedic Unabridged Dictionary of the English Language"; 1989; Portland House; 3 pages.

Chen, et al.; "(1996) Video and Audio: Organization and Retreival in the WWW"; WhitePaper, Available at http://vosaic.com/corp/ papers/www5 .html; Archived Jan. 28, 1998. "Synchronized Multimedia Integration Language (SMIL) 1.0 Specification;" W3C Recommendation; Jun. 15, 1998; http://www.w3. org/TR/1998/REC-SMIL-19980615.

Nerney; "RealNetworks unveils software line for Multimedia displays"; Network World; May 4, 1998; http://www.nwfusion.com/ news/0504real.html. 2 pages.

Booker; "Microsoft and RealNetworks Wage Media War"; InternetWeek; Jul. 10, 1998; http://www.techweb.com/wire/story/ TWB 19980710S0014. 2 pages.

Moseley, et al.; Microsoft Office 97, 2nd Ed.; Sybex Inc., 1997, pp. 756-763 and 812-816.

Neuwirth et al.; "Computer Support for Distributed Collaborative Writing: Defining Parameters of Interaction"; Proceedings of CSCW '94; Chapel Hill, NC, 1994; pp. 145-152. Stanford Online; "Masters in Electrical Engineering"; http://scpd. standford.edu/ce/telecom/onlinedegree.html, 4 pages, printed Nov. 3, 2000.

Weber, et al.; "Marquee: A Tool For Real-Time Video Logging"; Proceeding of CHI '94; Boston, MA; Apr. 1994; ACM Press; pp. 58-64.

WEI, "Media Weaver-A Distributed Media Authoring System for
Networked Scholarly Workspace"; Multimedia Tools and Applica-
tions; Jun. 2, 1997; Stanford University; pp. 1-21.
Roscheisen, et al; "Beyond Browsing: Shared Comments, SOAPs,
Trails and On-Line Communities"; Computer Networks and ISON
Systems 27 (1995); pp. 739-749.

Gould, et al; "Relativity Controller: Reflecting User Perspective in
Document Spaces"; Adjunct Proceedings of INTERCHI '93; ACM
Press; pp. 125-126.

Kim, et al; "VIRON: An Annotation-Based Video Information
Retrieval System"; Proceedings of COMPSAC '96; Seoul, South
Korea; Aug. 1996; IEEE Press; pp. 298-303.
"Third Voice Rips Holes in Web"; Story Location: http://wired./
com/news/technology/0,1282,20636.html.; Jul. 9, 1999.
Lawton, et al; "The Knowledge Weasel Hypermedia Annotation
System"; Proceedings of the Hypertext 93; Nov. 1993; ACM Press;
pp. 107-117.

Lee, et al.; "Video Indexing-An Approach Based on Moving Object and Track"; Proceedings of the SPIE; vol. 1908; 1993; pp. 25-36. Marshall; "Toward and ecology of hypertext annotation"; Proceedings of the Hypertext; Pittsburgh, PA; Jun. 1998; ACM Press; pp. 40-48.

Abowd, et al.; "Teaching and Learning as Multimedia Authoring: The Classroom 2000 Project"; Proceedings of the Multimedia '96; Boston MA; Nov. 1996; ACM Press; pp. 187-198. Bessler, et al.; "DIANE: A Multimedia Annotation System"; Proceedings of the ECMAST '97; Milan Italy; May 1997; 16 pages. Ovsiannikov, et al.; "Annotation Technology"; International Journal of Human Computer Studies; Apr. 1999; vol. 50; No. 4; pp. 329-362.

Calfonte, et al.; "Expressive Richness: AComparison of Speech and Text as Media for Revision"; Proceedings of the CHI '91; ACM Press; pp. 21-26; 1991.

Davis, et al.; "CoNote System Overview"; 1995; 3 pages; Available at http://www.cs.cornell.edu/home/dph/annotation/annotations. html.

Gaines, et al.; "Open Architecture Multimedia Documents"; Proceedings of the Multimedia '93; Anaheim CA; Aug. 1993; ACM Press; pp. 137-146.

Pizano, et al.; "Integrated Multimedia Messaging Concepts and
Applications"; Proceedings of the 1996 ACM Symposium on
Applied Computing; Philadelpha, Pennsylvania; ACM Press; pp.
12-16; 1996.

Lee, et al.; "Storage and Retrieval for Image and Video Databases";
Proceedings SPIE- The International Society for Optical Engineer-
ing; San Jose, CA; Feb. 2-3, 1993; vol. 1908; pp. 1-36.
Smith; "DynaText: An Electornic Publishing System"; Technical
Review; pp. 415-420.

Phelps, et al; "Multivalent Annotations"; Published in Proceedings of the First European Conference on Research and Advanced Technology for Digital Libraries; Sep. 1-3, 1997, Pisa, Italy; 15 pages.

Neuwirth, et al.; "Distributed Collaborative Writing: AComparison of Spoken and Written Modalities for Reviewing and Revising Documents"; Human Factors in Computing Systems; Apr. 24-38, 1994; Boston, Massachusetts; pp. 51-57.

Roscheisen, et al.; "Shared Web Annotations As a Platform for Third-Party Value-Added Information Providers: Architecture, Protocols, and Usage Examples"; Technical Report CSDTR/DLTR; Stanford University; 33 pages.

Schickler, et al.; "Pan-Browser Support for Annotations and Other Meta-Information on the World Wide Web"; Fifth International World Wide Web Conference; May 6-10, 1996; Paris, France; 14 pages.

Smith, et al.; "What Should a Wildebeest Say? Interactive Nature Films for High School Classrooms"; ACM Multimedia 97-Electronic Proceedings; Nov. 8-14, 1997; Seattle, WA; 18 pages. Phelps, et al.; "Robust Intra-document Locations"; Proceedings of the 9th World Wide Web Conference; Amsterdam; May 2000; 18 pages.

Wojahn, et al.; "Effects of Interfaces for Annotation on Communication in a Collaborative Task"; CHI Conference Proceedings; Apr. 18-23, 1998; pp. 456-463.

Golovchinsky, et al.; "Moving Markup: Repositioning Freeform Annotations"; Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology; Oct. 27-30, 2002; Paris France; vol. 4; Issue 2; pp. 21-29.

XML Linking Language (XLink) Version 1.0, W3C Recommendation; Steve DeRose et al., Editors; Jun. 27, 2001; 34 pages.

XML Schema Part 0: Primer, W3C Recommendation; David Fallside, Editor; May 2, 2001; 72 pages.

XML Schema Part 1; Structures, W3C Recommendation; Henry Thompson et al., Editors; May 2, 2001; 198 pages.

XML Schema Part 2: Datatypes, W3C Recommendation; Paul Biron et al., Editors; May 2, 2001; 144 pages.

* cited by examiner