WO2005072239A3 - Methods and systems for analyzing and summarizing video - Google Patents

Methods and systems for analyzing and summarizing video Download PDF

Info

Publication number
WO2005072239A3
WO2005072239A3 PCT/US2005/001859 US2005001859W WO2005072239A3 WO 2005072239 A3 WO2005072239 A3 WO 2005072239A3 US 2005001859 W US2005001859 W US 2005001859W WO 2005072239 A3 WO2005072239 A3 WO 2005072239A3
Authority
WO
WIPO (PCT)
Prior art keywords
region
board
blocks
content
analyzing
Prior art date
Application number
PCT/US2005/001859
Other languages
French (fr)
Other versions
WO2005072239A2 (en
Inventor
John R Kender
Tiecheng Liu
Original Assignee
Univ Columbia
John R Kender
Tiecheng Liu
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Columbia, John R Kender, Tiecheng Liu filed Critical Univ Columbia
Publication of WO2005072239A2 publication Critical patent/WO2005072239A2/en
Publication of WO2005072239A3 publication Critical patent/WO2005072239A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/738—Presentation of query results
    • G06F16/739—Presentation of query results in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/785—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using colour or luminescence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/786—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using motion, e.g. object motion or camera motion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Analysis (AREA)

Abstract

Methods and systems are provided for analyzing and summarizing instructional videos. According to certain embodiments, video frames are segmented into board background blocks, board content blocks, and irrelevant blocks, and are subsequently merged into a board background region, board content region, occlusion by instructor region, and irrelevant region. The number of chalk pixels in the content areas of each frame are used to define key frames. Mosaiced images are developed to compensate occlusions by an instructor. Additionally, the concept of semantic teaching units is presented, where such semantic units are detected by a model based on the recognition of actions of instructors, and on the measurement of temporal duration and spatial location of board content. Various alternate embodiments are also disclosed.
PCT/US2005/001859 2004-01-21 2005-01-21 Methods and systems for analyzing and summarizing video WO2005072239A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US53837404P 2004-01-21 2004-01-21
US60/538,374 2004-01-21

Publications (2)

Publication Number Publication Date
WO2005072239A2 WO2005072239A2 (en) 2005-08-11
WO2005072239A3 true WO2005072239A3 (en) 2006-05-11

Family

ID=34825974

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/001859 WO2005072239A2 (en) 2004-01-21 2005-01-21 Methods and systems for analyzing and summarizing video

Country Status (1)

Country Link
WO (1) WO2005072239A2 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8000533B2 (en) 2006-11-14 2011-08-16 Microsoft Corporation Space-time video montage
US8804005B2 (en) 2008-04-29 2014-08-12 Microsoft Corporation Video concept detection using multi-layer multi-instance learning
EP2956891B1 (en) 2013-02-18 2019-12-18 Tata Consultancy Services Limited Segmenting objects in multimedia data
US9886793B1 (en) 2016-10-03 2018-02-06 International Business Machines Corporation Dynamic video visualization
US10528251B2 (en) 2016-12-13 2020-01-07 International Business Machines Corporation Alternate video summarization
CN111144255B (en) * 2019-12-18 2024-04-19 华中科技大学鄂州工业技术研究院 Analysis method and device for non-language behaviors of teacher
CN113190710B (en) * 2021-04-27 2023-05-02 南昌虚拟现实研究院股份有限公司 Semantic video image generation method, semantic video image playing method and related devices

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4821335A (en) * 1985-04-05 1989-04-11 Ricoh Company, Limited Electronic blackboard
US5930473A (en) * 1993-06-24 1999-07-27 Teng; Peter Video application server for mediating live video services
US6185560B1 (en) * 1998-04-15 2001-02-06 Sungard Eprocess Intelligance Inc. System for automatically organizing data in accordance with pattern hierarchies therein
US20010049087A1 (en) * 2000-01-03 2001-12-06 Hale Janet B. System and method of distance education
US20020178223A1 (en) * 2001-05-23 2002-11-28 Arthur A. Bushkin System and method for disseminating knowledge over a global computer network
US6564263B1 (en) * 1998-12-04 2003-05-13 International Business Machines Corporation Multimedia content description framework
US20030234772A1 (en) * 2002-06-19 2003-12-25 Zhengyou Zhang System and method for whiteboard and audio capture
US20040002049A1 (en) * 2002-07-01 2004-01-01 Jay Beavers Computer network-based, interactive, multimedia learning system and process

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4821335A (en) * 1985-04-05 1989-04-11 Ricoh Company, Limited Electronic blackboard
US5930473A (en) * 1993-06-24 1999-07-27 Teng; Peter Video application server for mediating live video services
US6185560B1 (en) * 1998-04-15 2001-02-06 Sungard Eprocess Intelligance Inc. System for automatically organizing data in accordance with pattern hierarchies therein
US6564263B1 (en) * 1998-12-04 2003-05-13 International Business Machines Corporation Multimedia content description framework
US20010049087A1 (en) * 2000-01-03 2001-12-06 Hale Janet B. System and method of distance education
US20020178223A1 (en) * 2001-05-23 2002-11-28 Arthur A. Bushkin System and method for disseminating knowledge over a global computer network
US20030234772A1 (en) * 2002-06-19 2003-12-25 Zhengyou Zhang System and method for whiteboard and audio capture
US20040002049A1 (en) * 2002-07-01 2004-01-01 Jay Beavers Computer network-based, interactive, multimedia learning system and process

Also Published As

Publication number Publication date
WO2005072239A2 (en) 2005-08-11

Similar Documents

Publication Publication Date Title
CN110334610B (en) Multi-dimensional classroom quantification system and method based on computer vision
WO2005072239A3 (en) Methods and systems for analyzing and summarizing video
CN105578115B (en) A kind of Network teaching method with Speech Assessment function and system
WO2004086301A3 (en) System and method for vehicle detection and tracking
US8515258B2 (en) Device and method for automatically recreating a content preserving and compression efficient lecture video
WO2006023268A3 (en) Portable augmented reality device and method
EP1645315A3 (en) Pose detection method, video game apparatus pose detection program, and computer-readable medium containing program
WO2005029266A3 (en) Apparatus and method for presentation of portably-stored content on an high-definition display
WO2008091483A3 (en) Computer method and apparatus for processing image data
CN111242962A (en) Method, device and equipment for generating remote training video and storage medium
WO2005041579A3 (en) Method and system for processing captured image information in an interactive video display system
MY151680A (en) Storage medium storing interactive graphics stream, and reproducing apparatus and method
EP2154885A4 (en) A caption display method and a video communication system, apparatus
CN102096930A (en) Student standing and sitting detection method for intelligent recorded broadcasting system for teaching
CN101005574A (en) Video frequency virtual humance sign language compiling system
CN203588489U (en) A situational teaching device
CN106657850A (en) Lesson content recording method and system
Gowing et al. Enhanced visualisation of dance performance from automatically synchronised multimodal recordings
CN110490173B (en) Intelligent action scoring system based on 3D somatosensory model
CN105245817B (en) Video recording playback method and its device
JP2006270711A (en) Information providing device and control program of information providing device
WO2006060889A8 (en) Method and system for assessing viewership of a medium
KR20140042055A (en) E-learning system of providing video for improvement of study concentration
KR20100133730A (en) Language learning method
CN116311554A (en) Student classroom abnormal behavior identification method and system based on video target detection

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase