Suche Bilder Maps Play YouTube News Gmail Drive Mehr »
Anmelden
Nutzer von Screenreadern: Klicke auf diesen Link, um die Bedienungshilfen zu aktivieren. Dieser Modus bietet die gleichen Grundfunktionen, funktioniert aber besser mit deinem Reader.

Patentsuche

  1. Erweiterte Patentsuche
VeröffentlichungsnummerUS20030038796 A1
PublikationstypAnmeldung
AnmeldenummerUS 10/058,869
Veröffentlichungsdatum27. Febr. 2003
Eingetragen28. Jan. 2002
Prioritätsdatum15. Febr. 2001
Auch veröffentlicht unterUS8606782, US20050154763
Veröffentlichungsnummer058869, 10058869, US 2003/0038796 A1, US 2003/038796 A1, US 20030038796 A1, US 20030038796A1, US 2003038796 A1, US 2003038796A1, US-A1-20030038796, US-A1-2003038796, US2003/0038796A1, US2003/038796A1, US20030038796 A1, US20030038796A1, US2003038796 A1, US2003038796A1
ErfinderPetrus van Beek, Ahmet Ferman
Ursprünglich BevollmächtigterVan Beek Petrus J.L., Ferman Ahmet Mufit
Zitat exportierenBiBTeX, EndNote, RefMan
Externe Links: USPTO, USPTO-Zuordnung, Espacenet
Segmentation metadata for audio-visual content
US 20030038796 A1
Zusammenfassung
Descriptions of audio-visual material.
Bilder(11)
Previous page
Next page
Ansprüche(1)
1. A single description scheme for audiovisual content that includes both navigational information and searching information.
Beschreibung
    BACKGROUND OF THE INVENTION
  • [0001]
    The present invention relates to descriptions of audio-visual material.
  • [0002]
    Digital audiovisual material is becoming increasingly available to users through digital TV broadcast, digital video cameras, digital video discs, and personal computer based access to multimedia on the Internet or other network. In addition, persistent large-volume storage and non-linear access to audiovisual content is becoming available in consumer devices. Consequently, there is a need for rapid navigation and searching capabilities to enable users to efficiently discover and consume the contents of audiovisual material.
  • [0003]
    The extensive proliferation of audio-visual material available to users has the potential to overwhelm the consumer and lead to frustration at the inability to search and view content in an efficient manner. Viewing summaries of the content allows the consumer to skip irrelevant content and view the desired content quickly and easily. Further, multiple different summaries, if available, may provide the user with alternative views of a particular program that the user could choose from depending on personal preferences or usage conditions.
  • [0004]
    Limited summary selection capabilities are appearing more frequently in current technologies, such as the digital video disk (DVD). DVD movies normally provide “scene selections” or “chapter selections” that have a visual array of thumbnails and textual titles associated with each scene. This permits the user to click on the thumbnail of the desired scene, jump to that scene, and start playback. Playback typically continues until the end of the movie, unless the user makes another selection. While somewhat limited, these features provide the capability to index for the purpose of jumping to an arbitrary position and continue playback from that position.
  • [0005]
    Referring to FIG. 1, a system 10 may be used for the presentation of video, audio, or audiovisual information to a user. The information may be presented to the user using any suitable medium, such as for example, the Internet, a computer network, the radio, a personal computer, and a television. The user or the user's agent interacts with the system 10 to receive the information in a desirable manner and to define preferences as to what type of information is obtained. The term user is intended to refer to the recipient of the information, which may be for example, a person, a machine, or a software program operating on a machine.
  • [0006]
    To define these interactions, a set of description schemes containing data describing the content of the material may be used. User preferences 12 may be used in several different areas to maximize both the user's enjoyment and the system functionality. The preferences describing the topics and subject matter of interest to the user is used in both searching for and navigating the audiovisual programs 14. These two sets of data, the user preferences 12 and program descriptions 14, are correlated in the filtering and search engine 16 to identify the preferred programs.
  • [0007]
    The programs identified by the filtering and search engine 16 are then forwarded to a browsing module 18 along with the user's browsing preferences. Another output of the filtering and search engine 16 are preferred programs that the user has designated for storage. These are stored in the storage module 20. The programs selected by the user with the browsing module 18 are then sent to a display 22. The user may utilize multimedia title descriptions of preferred programs to navigate among the programs that the user wants to consume. Once a program is selected, a summary description of that particular program is correlated with user's browsing preferences to offer the user a preferred summary.
  • [0008]
    The display 22 receives the programs and displays them in accordance with the user's device preferences as to the operation of the display. User's device preferences may include, for example, device settings such as volume setting that may vary with the genre of the program that is being consumed. The display and user's interaction with the display, such as stopping a program before its end and consuming certain types of programs with certain device settings, also provides information in a manner analogous to a feedback loop to update and log the usage history 24. The usage history 24 may be mapped against the preferences by a mapping module 26. This information is then used in conjunction with user inputs by the user preference module 12.
  • [0009]
    These user preferences may be useful in many contexts, not just an audiovisual presentation system. User preferences and usage history may be transmitted to the provider of audiovisual programs 14 to receive selected programming or directly receive program segments that are preferred by the user. In the latter case, user preferences may be correlated with summary descriptions at the provider side to select and directly deliver summarized audiovisual programs to the user. The preferences may also be transferred to a “smart card” 28 or similar, portable storage and ultimately transferred to another system by the user.
  • [0010]
    However, it is noted that a framework for the description of the individual description schemes at the user, program, or device level are needed. As illustrated in FIG. 1, the audiovisual programs 14 includes descriptions of the programs in a description framework. The description framework can have several different types of descriptive structures, such as those described in MPEG-7, incorporated by reference herein. Referring to FIG. 2, one particular type of potential description scheme is related to searching. Searching includes information related to the content of the media, such as for example, actors, title, genre, etc. The searching description scheme, as described in MPEG-7, corresponds to a single video as a whole. A different searching description scheme is included for each video. Referring to the entire video is consistent with the desire of the user to quickly search the available videos for particular content related to the videos as a whole. Another type of description scheme is related to navigation. The navigation description scheme includes information related to navigating or otherwise selecting content for viewing, such as for example, table of contents, highlights, key frames, summaries, segments, etc. The navigation description scheme, as described in MPEG-7, corresponds to segments of the video. Referring to segments of the video is consistent with the desire of the user to navigate a particular video in a particular manner.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • [0011]
    [0011]FIG. 1 illustrates a system including preferences.
  • [0012]
    [0012]FIG. 2 illustrates a searching description scheme and a navigation description scheme.
  • [0013]
    [0013]FIG. 3 illustrates a combined searching and navigation description scheme.
  • [0014]
    [0014]FIG. 4 illustrates a generic hierarchical relationship.
  • [0015]
    [0015]FIG. 5 illustrates permitted grouping.
  • [0016]
    [0016]FIG. 6 illustrates alternative groups.
  • [0017]
    [0017]FIG. 7 illustrates a group and related segments.
  • [0018]
    [0018]FIG. 8 illustrates a table of contents presentation.
  • [0019]
    [0019]FIG. 9 illustrates a virtual program.
  • [0020]
    [0020]FIG. 10 illustrates a temporal time base for video.
  • [0021]
    [0021]FIG. 11 illustrates entity relationships.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
  • [0022]
    The present inventors came to the realization that the previously existing searching description scheme (segment description scheme in MPEG-7) and the navigation description scheme (summary description scheme in MPEG-7), as described in MPEG-7, are inconsistent with one another if it is desirable to navigate portions of a video and simultaneously obtain information regarding the content of those portions. In particular, MPEG-7 does not provide sufficient syntax structures to physically or logically link the segments identified by the navigation description scheme with the video identified by the searching description scheme. Referring to FIG. 3, a modified description scheme syntax incorporates both information related to the searching description scheme and the navigation description scheme (e.g., segmentation description scheme), both within a single description scheme. Moreover, the incorporation of both the searching description scheme and the navigation description scheme into a single description scheme eliminates some redundant information. Within an XML syntax structure both the searching and the navigational descriptions are associated with the same segment definition (e.g., specifies physical location of segment within the video).
  • [0023]
    The description scheme structure within MPEG-7 permits a hierarchical nesting structure for segment descriptions of the video and descriptions for groups of segments of the video. The permitted hierarchical nesting structure is very flexible and permits nearly any desirable interrelationship to be defined. Referring to FIG. 4, a sample hierarchical nesting structure is illustrated. While such a hierarchical nesting structure is flexible, it turns out to be extremely difficult determining the order to present the segments of video within such a structure. Within a particular level it is difficult to determine which segments to present first and is further complicated by determining which segment to present within the different hierarchical levels. Moreover, the parsing of such a structure is complex which reduces the computational efficiency of the system.
  • [0024]
    To overcome the non-deterministic nature of the hierarchical structure the preferred system imposes at least one or more of the following restrictions. A segment group may reference either other segments or other segment groups, but not both, as illustrated in FIG. 5. A segment group references other segments or other segment groups, but does not contain segments itself. In some cases a segment group may reference a single segment or otherwise contain a single segment, in which case it is considered a segment. In this manner, any particular segment group will either reference a set of segments which may be readily ordered, or one or more segment groups. Segments may not reference other segments or segment groups.
  • [0025]
    With the set of permissible interconnections limited a set of rules is useful in order to permit the user to view the available content in an organized manner or otherwise select a set of segments for presentation in a particular order. In this manner the playback, navigation, and presentation order may be unambiguously defined. Therefore different systems will interpret the segmentation data the same. One type of organizational technique is to define segments type “alternativeGroups” , which may not contain segments and shall only contain subgroups. The user may select one of the groups from the set of groups at the same hierarchical level originating from the same parent group. Referring to FIG. 6, for example, the user may select Group 1 or Group 2. If Group 1 is selected, then the user may select Group 3 or Group 4. Group 3 consists of one segment. If Group 4 is selected, then the set of segments referenced by Group 4 are made available to the user. If the user selects Group 4 the segments defined within Group 4 may be presented, as illustrated in FIG. 7. The order of presentation of the segments defined by a Group may be presented to the user in an order defined by the order listed within the Group, such as the first in the list is first played or the last in the list is first played.
  • [0026]
    Another type of organizational technique is to define a set of segments of type “tableOfContents”, which presents the groups and segments defined therein in an ordered manner such that the hierarchical order may be observed. For example, a portion of the ordered groups shown in FIG. 6 may be organized as a tableOfContents, as shown in FIG. 8. The tableOfContents representation facilitates the user being able to select portions of video content that may be of particular interest to the user in a convenient manner.
  • [0027]
    Portions of the hierarchical structure of segment groups may be designated as “alternativeGroups” and other portions of the hierarchical structure may be designated as “tableOfContents”. Preferably, the two different designations of the hierarchical structure are non-overlapping, but may be overlapping, if desired. These designations are preferably not directly associated with segments.
  • [0028]
    Existing video summarization systems provide segmentation data for each video and permit the selective viewing of each video according to the segmentation data. While beneficial, the present inventors determined that facilitating the grouping of segments from a plurality of different programs to be viewed within a single presentation defined by a single description scheme is beneficial and not previously possible. A “virtual program” consisting of segments from a plurality of different programs may be dynamically constructed and presented, without the need for physically creating the program on a persistent storage medium. Thus the description scheme syntax may facilitate the identification of the “virtual program” where the relevant segments may be located with multiple different segments of multiple different programs being identified within a single description scheme syntax, as illustrated in FIG. 9. Thus for example, it is possible to view various news reports from different news sources in a sequence without having to individually manually select each news report from each news source.
  • [0029]
    Principally, existing description schemes for audiovisual content permit linking to external content, such as a web site of a news article on a relevant topic or other material of related interest to the content. However, it was determined that more focused external content may be selected for the user if the content was associated with segments of the video, as opposed to the entire video. In this manner, a single video may include multiple links to external content, each link being associated with a different portion of the video.
  • [0030]
    Another issue that arises with respect to selecting segments within multiple different video streams is the different techniques that may be used to indicate “time”. For example, the frame rate is not always the same, with movie film typically being 24 frames per second and television being 30 frames per second (each frame consisting of two fields). In addition, the time base for MPEG-1, DVD's, MPEG-2, VCR, Movies, Internet based streaming media, etc., are not the same. Accordingly, the modified description scheme includes a time base indicator of the time base associated with the particular segment, as illustrated in FIG. 10. With the time base defined, either explicitly or implicitly, the beginning of the segment is defined together with an offset indicating the duration of the segment. The offset is in time units, such as seconds, minutes, frames, fields, etc., and may have a default or implicit definition.
  • [0031]
    The following may be used to describe the descriptive properties of segments:
    <complexType name=“BasicSegmentDescriptionType”>
     <sequence>
       <element name=“Title” type=“mpeg7:TitleType”
          minOccurs=“0” maxOccurs=“unbounded”/>
       <element name=“Synopsis” type=“tva:SynopsisType”
          minOccurs=“0” maxOccurs=“unbounded”/>
       <element name=“Keywords” = “mpeg7:KeywordAnnotationType”
          minOccurs=“0” maxOccurs=“1”/>
       <element name=“RelatedMaterial” type=“tva:RelatedMaterialType”
          minOccurs=“0” maxOccurs=“unbounded”/>
     </sequence>
    </complexType>
  • [0032]
    The terms and definitions may be as follows:
    BasicSegmentDescriptionType Defines basic segment description.
    Tittle A title of the segment (optional).
    A segment can have several titles
    when necessary, e.g. in different
    languages.
    Synopsis A synopsis of textual description of
    the segment (optional). A segment can
    have several synopses when necessary,
    e.g. in different languages or lengths.
    Keywords A keyword associated with the
    segment (optional). A segment can have
    several keywords when necessary, e.g.
    in different languages.
    RelatedMaterial A link to external material related to
    the segment (optional). A segment can
    have multiple links.
  • [0033]
    The following element and complex type may be used to define a segment.
    <element name=“Segment Information”
       type=“tva:SegmentInformationType”/>
    <complexType name=“SegmentInformationType”>
      <sequence>
           <element name=“ProgramRef type=“tva:CRIDRefType” minOccurs=”0”/>
           <element name=“Description”
             type=“tva:BasicSegmentDescriptionType” minOccurs=“0”/>
           <element name=“SegmentLocator” type=“mpeg7:MediaTimeType”/>
           <element name=“KeyFrameLocator” type=“mpeg7:MediaTimeType”
             minOccurs=“0” maxOccurs=“unbounded”/>
      </sequence>
           <attribute name=“segmentId” type=“xsd:ID” use=“required”/>
           <attribute name=“version” type=“xsd:integer” use=“optional”/>
    </complexType>
  • [0034]
    The terms and definitions may be as follows:
    SegmentInformation An element that instantiates the
    SegmentInformationType.
    SegmentInformationType Defines an individual segment.
    ProgramRef A reference to the program this segment
    belongs to. When the ProgramRef element
    is not instantiated within a segment,
    the program that the segment
    belongs to is specified by the
    ProgramRef element of its parent
    segment group(s).
    Description A description of the content of the segment.
    SegmentLocator Locates the segment within a program
    (instance) in terms of start time and duration
    (optional). Defined as an MPEG-7 datatype,
    MediaTimeType (See Sec. 6.3.9 of MPEG-7
    for a detailed description). If the duration
    is not specified, the segment ends at the end of
    the program. If the timeBase and/or timeUnit
    attributes for the SegmentLocator element are
    instantiated, they override the default or global
    time base and time unit definitions provided
    with the SegmentInformationTable description.
    KeyFrameLocator Locates a key frame of the segment within a
    program in terms of a time point (optional).
    Defined as an MPEG-7 datatype,
    MediaTimeType (See Sec. 6.3.9 of MPEG-7
    for a detailed description). MediaDuration and
    MediaIncrDuration elements of a
    KeyFrameLocator element should not be used.
    Multiple key frames may be associated with a
    single segment. If the timeBase and/or timeUnit
    attributes for the KeyFrameLocator element
    are instantiated, they override the default or
    global time base and time unit definitions
    provided with the SegmentInformationTable
    description.
    segmentId The unique identifier of the segment.
    version The version number of the segment
    information (optional).
  • [0035]
    The following element and complex types may be used to define segment grouping.
    <element name=“SegmentGroupInformation”
        type=“tva:SegmentGroupInformationType”/>
    <complexType> name=“SegmentGroupInformationType”>
        <sequence>
           <element name=“ProgramRef” type=”tva:CRIDRefType”/>
           <element name=“Description”type=“tva:BasicSegmentDescriptionType”
               minOccurs=“0”/>
           <element name=“GroupInterval” minOccurs=“0”>
               <complexType>
                  <attribute name=“ref” type=xsd:IDREF”/>
               </complexType>
           </element>
           <choice minOccurs=“0” maxOccurs=“1”>
               <element name=“Segments”>
                  <complexType>
                     <attribute name=“refList”
                     type=xsd:IDREFS=“use“required”/>
                  </complexType>
               </element>
           <element name=“Groups”
               <complexType>
                     <attribute name=“refList”
                     type=xsd:IDREFS” use=“required”/>
               </complexType>
           </element>
        <choice>
    </sequence>
        <element name=“KeyFrameLocator” type=“mpeg7:MediaTimeType”
           minOccurs=“0”maxOccurs=“unbounded”/>
        <attribute name=“groupId” type=“xsd:ID”
           use=“required”/>
        <attribute name=“groupType” type=“tva:SegmentGroupTypeType”
           use=“required”/>
        <attribute name=“ordered” type=“xsd:boolean”
           use=“optional”/>
        <attribute name=“numberOfSegments” type=“xsd:positiveInteger”
           use=“optional”/>
        <attribute name=“numberOfKeyFrames” type=“xds:positiveInteger”
           use=“optional”/>
        <attribute name=“numberOfKeyFrames” type=“xsd:positiveInteger”
           use=“optional”/>
        <attribute name=“duration” type=“mpeg7:mediaDurationType”
           use=“optional”/>
        <attribute name=“topLevel” type=“xsd:boolean”
           use=“optional”/>
        <attribute name=“version”type=“xsd:integer”
           use=“optional”/>
    </complexType>
    <simpleType name=“SegmentGroupTypeType”>
     <list>
        <simpleType>
        <restriction base=“xsd:string”>
        <enumeration value=“highlights”/>
        <enumeration value=“highlights/objects”/>
        <enumeration value=“highlights/events”/>
        <enumeration value=“bookmarks”/>
        <enumeration value=“bookmards/objects”/>
        <enumeration value=“bookmarks/events”/>
        <enumeration value=“themeGroup”/>
        <enumeration value=“preview”/>
        <enumeration value=“preview/title”/>
        <enumeration value=“preview/slideshow”/>
        <enumeration value=“tableOfContents”/>
        <enumeration value=“synopsis”/>
        <enumeration value=“shots”/>
        <enumeration value=“alternativeGroups”/>
        <enumeration value=“other”/>
       </restrlction>
      </simpleType>
     </list>
    </simpleType>
  • [0036]
    The names and definitions may be as follows:
    SegmentGroupInformation An element that instantiates
    the SegmentGroupInformationType.
    SegmentGroupInformationType Defines an individual segment group.
    ProgramRef A reference to the program this segment
    belongs to. When the member
    segments/groups are collected from
    different programs (e.g. to create a
    “virtual program”) the ProgramRef
    element references a group CRID that is
    resolved into the individual programs
    CRIDs.
    Description A description of the content of the
    segment group.
    GroupInterval References a single segment that defines
    the temporal range of the segment
    group.
    Segments Defines the segments that are part of
    this group by providing a list of
    references to the identifiers of elements
    of type SegmentInformationType
    (optional). The order of the references
    to segments in this list determines the
    ordering of segments within this group.
    Groups Defines the segment groups that are
    subgroups of this group by providing a
    list of references to the identifiers of
    elements of type
    SegmentGroupInformationType
    (optional). The order of the references
    to segment groups in this list determines
    their ordering within this group.
    KeyFrameLocator Locates a key frame of the segment
    group within a program in terms of a
    time point (optional). Defined as an
    MPEG-7 datatype, MediaTimeType
    (See Sec. 6.3.9 of MPEG-7 for a
    detailed description). MediaDuration
    and MediaIncrDuration elements of a
    KeyFrameLocator element should not
    be used. Multiple key frames may be
    associated with a single segment
    group.
    groupID The unique identifier of the
    segment group.
    groupType The type of the segment group. A list of
    the valid segment group types is defined
    by SegmentGroupTypeType.
    ordered Specifies whether the given segment
    group presents an ordered list (i.e.
    whether order of the segment or
    segment groups within the given
    segment group is significant) (optional).
    numberOfSegments The number of segments in the segment
    group (optional). The value of this
    attribute specifies only the segments
    that are direct members of the
    segment group.
    numberOfKeyFrames The number of key frames in the
    segment group (optional). The value of
    this attribute specifies only the key
    frames of the segments that are direct
    members of the segment group.
    duration The sum of the durations of the
    segments contained within this group
    (optional). This duration corresponds to
    the sum of the durations of the segments
    that are direct members of the segment
    group.
    topLevel Specifies whether the given segment
    group is a top-level group (optional).
    version The version number of the segment
    group (optional).
    SegmentGroupTypeType A simple type that specifies
    the valid types of segment groups.
  • [0037]
    The allowed types may be defined as follows:
  • [0038]
    highlights—The group of segments represents selected highlights from one or more programs. The segments that constitute a highlight group are presented seamlessly in sequence, without any temporal interruptions.
  • [0039]
    highlights/objects—The group of segments represents selected highlights from a program (or programs) that share a common object or objects (e.g. Seinfeld highlights with Kramer).
  • [0040]
    highlights/events—The group of segments represents selected highlights from a program (or programs) that share a common event or events (e.g. touchdowns in the Super Bowl).
  • [0041]
    bookmarks—The segment group defines a set of access points to a program. If the member segments of a segment group of type bookmarks contain segment duration information, this duration information shall be ignored, and the segments shall be treated as “open-ended”.
  • [0042]
    bookmarks/objects—The segment group defines a set of access points to a program, where the selected access points share a common object or objects. If the member segments of a segment group of type bookmarks/objects contain segment duration information, this duration information shall be ignored, and the segments shall be treated as “open-ended.”
  • [0043]
    bookmarks/events—The segment group defines a set of access points to a program, where the selected access points share a common event or events. If the member segments of a segment group of type bookmarks/events contain segment duration information, this duration information shall be ignored, and the segments shall be treated as “open-ended.”
  • [0044]
    themeGroup—The segment group comprises segments that share a common topic or theme. The common theme can be specified in the segment group description. A theme group does not necessarily require direct continuous playback.
  • [0045]
    preview—The segment group defines a preview of a program.
  • [0046]
    preview/title—The segment group defines a preview of a program, where the preview serves as a promotional title or trailer for the program.
  • [0047]
    preview/slideshow—The segment group defines a preview of a program, where the preview serves as a compact slideshow of the program content.
  • [0048]
    tableOfContents—The segment group defines a navigable table of contents for the program.
  • [0049]
    synopsis—The segment group provides a summary or synopsis of the program.
  • [0050]
    shots—The segment group provides a list of the shots in the program.
  • [0051]
    alternativeGroups—Each member of this type of segment group provides an alternative view of representation, with the same functionality but different durations or levels of detail.
  • [0052]
    other—The functionality of the segment group does not fit into any of the other types defined.
  • [0053]
    Various validity constraints may be imposed on the proposed description scheme to ensure that (i) it fits the data model of FIG. 11, and (ii) the sequence and relationships of the various segments and segment groups are unambiguously defined. These constraints, which are implicit in the description schemes, are outlined below for clarity:
  • [0054]
    (a) A segment group may contain either segments, or subgroups, but not both.
  • [0055]
    (b) A segment group of type “alternativeGroups” may not contain segments and shall only contain subgroups.
  • [0056]
    (c) A segment group of any type other than “tableOfContents” and “alternativeGroups” may only contain segments. A group of type “tableOfContents” may contain other segment groups of type “tableOfContents”.
  • [0057]
    These validity constraints reduce the complexity of the resulting descriptions by limiting the degree of nesting in the hierarchy. The navigation order of segments or segment groups is determined by the order of references to the segments in a segment group.
  • [0058]
    The entities may be defined as follows:
    Program The program entity represents an editorially coherent
    audiovisual content.
    Program Program Location provides a physical location where
    Location the program is available. A program may be available at
    multiple program locations; however, the time lines of the
    different instances of a program are preferably identical.
    Segment A segment is a continuous fragment of a program. A
    particular segment should belong to a single program, but it
    may be a member of multiple segment groups.
    Segment A segment group is a collection of segments that are grouped
    Group together, for a particular purpose or due to a shared property.
    A segment group may contain segments, or other
    segment groups.
  • [0059]
    The entity relationships may be defined, as follows.
    Program-to-Segment A Segment is part of a single
    program. A Program may contain
    multiple segments.
    Segment-to-Segment Group A Segment may belong to zero or
    more Segment Groups. A Segment
    Group may contain zero or more
    Segments (possibly from multiple
    Programs).
    Segment Group-to-Segment Group A Segment Group may be a member
    of zero or more Segment Groups, and
    it may contain zero or more Segment
    Groups. A Segment Group may
    contain either segments, or
    subgroups, but not both.
  • [0060]
    The following element and complex type define a structure for holding segmentation-related metadata.
    <element name=“SegmentInformationTable”
       type=“tva:SegmentInformationTableType”/>
    <complexType name=“SegmentInformationTableType”>
       <sequence>
           <element name=“SegmentList”>
              <complexType>
                 <sequence>
                   <element ref=“tva:SegmentInformation”
                    minOccurs=“0”maxOccurs=“unbounded”/>
                 </sequence>
              </complexType>
           </element>
    <element name=“SegmentGroupList”
       <complexType>
           <sequence>
              <element ref=“tva:SegmentGroupInformation”
              minOccurs=“0” maxOccurs=”unbounded”/>
           </sequence>
       </complexType>
    </element>
    <element name=“TimeBase Reference” minOccurs=“0” maxOccurs=“unbounded”/>
       <complexType>
        <choice>
           <element name=“RefMediaTime” type=“mpeg7:mediaTimePointType”/>
           <element name=“RefURI” type=“xsd:anyURI”/>
       </choice>
       </complexType>
    </element>
    </sequence>
       <attribute name=“timeUnit” type=“mpeg7:mediaDurationType”
           use=“default” value=“PT1N1000F”/>
       <attribute name=“version” type=“xsd:integer” use=“optional”/>
    </complexType>
  • [0061]
    The names and definitions may be as follows:
    SegmentInformationTable An element that instantiates the
    SegmentInformationTableType.
    SegmentInformationTableType Defines a structure for holding
    segmentation-related metadata.
    SegmentList The list of the segments in the
    SegmentInformationTable
    SegmentGroupList The list of the segment groups in the
    SegmentInformationTable
    TimeBaseReference Defines the time base reference(s) for
    the current description. Multiple time
    base references can be specified for a
    single SegmentInformationTable. These
    references can be referred to by the
    timeBase attributes of the
    SegmentLocator and KeyFrameLocator
    elements of the description. If no
    TimeBaseReference is provided in the
    description, the time base is taken to
    be the start point of the program
    identified by the associated CRID. If a
    single TimeBaseReference element is
    specified, this element specifies the
    time base for all the segments in the
    description.
    RefMediaTime Specifies the time base reference using
    an element of MPEG-7 type
    mediaTimePointType (See Sec. 6.3.9 of
    MPEG-7 for a detailed description).
    RefURI Specifies the time base reference using
    an element of type any URI.
    timeUnit Specifies the duration of the time
    intervals used in the incremental
    specifications of relative time points
    and duration. Default time unit is
    milliseconds.
    version The version number of the segment
    information table (optional).
  • [0062]
    The terms and expressions employed in the foregoing specification are used therein as terms of description and not of limitation, and there is no intention in the use of such terms and expressions of excluding equivalents of the features shown and described or portions thereof, it being recognized that the scope of the invention is defined and limited only by the claims that follow.
Patentzitate
Zitiertes PatentEingetragen Veröffentlichungsdatum Antragsteller Titel
US4183056 *23. Mai 19778. Jan. 1980Kewp Electronic Systems, Inc.Apparatus and method for monitoring sports contests
US4253108 *4. Juni 197924. Febr. 1981Zenith Radio CorporationControl for color killer and automatic color limiter
US4937685 *2. Dez. 198326. Juni 1990Lex Computer And Management CorporationMethod of display presentation for video editing
US5027400 *16. Aug. 198925. Juni 1991Hitachi Ltd.Multimedia bidirectional broadcast system
US5109482 *19. Febr. 199128. Apr. 1992David BohrmanInteractive video control system for displaying user-selectable clips
US5200825 *1. Juli 19926. Apr. 1993Beam Laser Systems, Inc.Commercial insertion system remotely controlling multiple video switches
US5223924 *27. Mai 199229. Juni 1993North American Philips CorporationSystem and method for automatically correlating user preferences with a T.V. program information database
US5333091 *8. Jan. 199326. Juli 1994Arthur D. Little Enterprises, Inc.Method and apparatus for controlling a videotape player to automatically scan past recorded commercial messages
US5339393 *15. Apr. 199316. Aug. 1994Sony Electronics, Inc.Graphical user interface for displaying available source material for editing
US5424770 *15. Sept. 199413. Juni 1995Cable Service Technologies, Inc.Method and apparatus for automatic insertion of a television signal from a remote source
US5521841 *31. März 199428. Mai 1996Siemens Corporate Research, Inc.Browsing contents of a given video sequence
US5600364 *2. Dez. 19934. Febr. 1997Discovery Communications, Inc.Network controller for cable television delivery systems
US5600573 *2. Dez. 19944. Febr. 1997Discovery Communications, Inc.Operations center with video storage for a television program packaging and delivery system
US5635982 *27. Juni 19943. Juni 1997Zhang; Hong J.System for automatic video segmentation and key frame extraction for video sequences having both sharp and gradual transitions
US5654769 *7. Juni 19955. Aug. 1997Texas Instruments IncorporatedDigital color control and chroma killer device
US5659350 *2. Dez. 199319. Aug. 1997Discovery Communications, Inc.Operations center for a television program packaging and delivery system
US5717923 *3. Nov. 199410. Febr. 1998Intel CorporationMethod and apparatus for dynamically customizing electronic information to individual end users
US5732216 *2. Okt. 199624. März 1998Internet Angles, Inc.Audio message exchange system
US5734853 *2. Dez. 199331. März 1998Discovery Communications, Inc.Set top terminal for cable television delivery systems
US5751953 *29. Aug. 199612. Mai 1998U.S. Philips CorporationInteractive entertainment personalisation
US5758257 *29. Nov. 199426. Mai 1998Herz; FrederickSystem and method for scheduling broadcast of and access to video programs and other data using customer profiles
US5774357 *6. Juni 199530. Juni 1998Hoffberg; Steven M.Human factored interface incorporating adaptive pattern recognition based controller apparatus
US5774666 *18. Okt. 199630. Juni 1998Silicon Graphics, Inc.System and method for displaying uniform network resource locators embedded in time-based medium
US5778108 *7. Juni 19967. Juli 1998Electronic Data Systems CorporationMethod and system for detecting transitional markers such as uniform fields in a video signal
US5798785 *2. Dez. 199325. Aug. 1998Discovery Communications, Inc.Terminal for suggesting programs offered on a television program delivery system
US5857190 *27. Juni 19965. Jan. 1999Microsoft CorporationEvent logging system and method for logging events in a network system
US5861881 *8. Febr. 199619. Jan. 1999Actv, Inc.Interactive computer system for providing an interactive presentation with personalized video, audio and graphics responses for multiple viewers
US5867386 *6. Juni 19952. Febr. 1999Hoffberg; Steven M.Morphological pattern recognition based controller system
US5875107 *9. Sept. 199723. Febr. 1999Mitsubishi Denki Kabushiki KaishaInverter apparatus
US5875108 *6. Juni 199523. Febr. 1999Hoffberg; Steven M.Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
US5901246 *6. Juni 19954. Mai 1999Hoffberg; Steven M.Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
US5903454 *23. Dez. 199111. Mai 1999Hoffberg; Linda IreneHuman-factored interface corporating adaptive pattern recognition based controller apparatus
US5920300 *13. Okt. 19956. Juli 1999Semiconductor Energy Laboratory Co., Ltd.Active matrix liquid crystal display device
US5920477 *6. Juni 19956. Juli 1999Hoffberg; Steven M.Human factored interface incorporating adaptive pattern recognition based controller apparatus
US5923365 *6. Dez. 199613. Juli 1999Orad Hi-Tech Systems, LtdSports event video manipulating system for highlighting movement
US5933811 *20. Aug. 19963. Aug. 1999Paul D. AnglesSystem and method for delivering customized advertisements within interactive communication systems
US6014183 *6. Aug. 199711. Jan. 2000Imagine Products, Inc.Method and apparatus for detecting scene changes in a digital video stream
US6052554 *10. Sept. 199618. Apr. 2000Discovery Communications, Inc.Television program delivery system
US6055018 *4. Nov. 199725. Apr. 2000Ati Technologies, Inc.System and method for reconstructing noninterlaced captured content for display on a progressive screen
US6055569 *27. Jan. 199825. Apr. 2000Go Ahead Software Inc.Accelerating web access by predicting user action
US6064449 *31. Okt. 199716. Mai 2000Webtv Networks, Inc.Automatic characterization of a television signal
US6081750 *6. Juni 199527. Juni 2000Hoffberg; Steven MarkErgonomic man-machine interface incorporating adaptive pattern recognition based control system
US6100941 *28. Juli 19988. Aug. 2000U.S. Philips CorporationApparatus and method for locating a commercial disposed within a video data stream
US6169542 *14. Dez. 19982. Jan. 2001Gte Main Street IncorporatedMethod of delivering advertising through an interactive video distribution system
US6181335 *21. Sept. 199830. Jan. 2001Discovery Communications, Inc.Card for a set top terminal
US6195497 *24. Okt. 199427. Febr. 2001Hitachi, Ltd.Associated image retrieving apparatus and method
US6201536 *2. Dez. 199413. März 2001Discovery Communications, Inc.Network manager for cable television system headends
US6216129 *12. März 199910. Apr. 2001Expanse Networks, Inc.Advertisement selection system supporting discretionary target market characteristics
US6219837 *23. Okt. 199717. Apr. 2001International Business Machines CorporationSummary frames in video
US6230501 *3. Mai 199915. Mai 2001Promxd Technology, Inc.Ergonomic systems and methods providing intelligent adaptive surfaces and temperature control
US6233590 *5. Dez. 199715. Mai 2001Venson M. ShawServer apparatus for distributed communications supporting multiple user/application environment
US6236395 *26. Apr. 199922. Mai 2001Sharp Laboratories Of America, Inc.Audiovisual information management system
US6252544 *25. Jan. 199926. Juni 2001Steven M. HoffbergMobile communication device
US6275268 *4. Aug. 199914. Aug. 2001United Video Properties, Inc.Electronic television program guide with remote product ordering
US6342904 *17. Dez. 199829. Jan. 2002Newstakes, Inc.Creating a slide presentation from full motion video
US6353444 *2. März 19995. März 2002Matsushita Electric Industrial Co., Ltd.User interface apparatus and broadcast receiving apparatus
US6363160 *22. Jan. 199926. März 2002Intel CorporationInterface using pattern recognition and tracking
US6418168 *23. März 20009. Juli 2002Sony CorporationMotion vector detection apparatus, method of the same, and image processing apparatus
US6549643 *30. Nov. 199915. Apr. 2003Siemens Corporate Research, Inc.System and method for selecting key-frames of video data
US6556767 *8. Juni 200129. Apr. 2003Hitachi LtdVideo capture device
US6594699 *10. Okt. 199715. Juli 2003Kasenna, Inc.System for capability based multimedia streaming over a network
US6597859 *16. Dez. 199922. Juli 2003Intel CorporationMethod and apparatus for abstracting video data
US6675158 *7. Nov. 20006. Jan. 2004Sony CorporationMethod and apparatus for organizing data pertaining to audiovisual content
US6678635 *23. Jan. 200113. Jan. 2004Intel CorporationMethod and system for detecting semantic events
US6691126 *14. Juni 200010. Febr. 2004International Business Machines CorporationMethod and apparatus for locating multi-region objects in an image or video database
US6724933 *28. Juli 200020. Apr. 2004Microsoft CorporationMedia segmentation system and related methods
US6741655 *5. Mai 199825. Mai 2004The Trustees Of Columbia University In The City Of New YorkAlgorithms and system for object-oriented content-based video search
US7003792 *30. Nov. 199921. Febr. 2006Index Systems, Inc.Smart agent based on habit, statistical inference and psycho-demographic profiling
US7055168 *22. Sept. 200030. Mai 2006Sharp Laboratories Of America, Inc.Method for interpreting and executing user preferences of audiovisual information
US7185355 *4. März 199827. Febr. 2007United Video Properties, Inc.Program guide system with preference profiles
US7199798 *20. Jan. 20003. Apr. 2007International Business Machines CorpMethod and device for describing video contents
US7249366 *5. Aug. 199924. Juli 2007International Business Machines CorporationControl of a system for processing a stream of information based on information content
US7380262 *12. Juni 200127. Mai 2008Thomson LicensingMethod and apparatus for generating a list of suggested scheduled television programs
US20020013943 *24. Apr. 200131. Jan. 2002Seth HabermanSystem and method for simultaneous broadcast for personalized messages
US20020018594 *20. Apr. 200114. Febr. 2002Mitsubishi Electric Research Laboratories, Inc.Method and system for high-level structure analysis and event detection in domain specific videos
US20020069218 *23. Juli 20016. Juni 2002Sanghoon SullSystem and method for indexing, searching, identifying, and editing portions of electronic multimedia files
US20020080162 *30. März 200127. Juni 2002Hao PanMethod for automatic extraction of semantically significant events from video
US20020083473 *21. Dez. 200027. Juni 2002Philips Electronics North America CorporationSystem and method for accessing a multimedia summary of a video program
US20020087967 *16. Jan. 20014. Juli 2002G. Colby ConkwrightPrivacy compliant multiple dataset correlation system
US20020093591 *25. Okt. 200118. Juli 2002Nec Usa, Inc.Creating audio-centric, imagecentric, and integrated audio visual summaries
US20020104087 *5. Dez. 20001. Aug. 2002Philips Electronics North America Corp.Method and apparatus for selective updating of a user profile
US20020108112 *1. Febr. 20028. Aug. 2002Ensequence, Inc.System and method for thematically analyzing and annotating an audio-visual sequence
US20030001880 *1. Aug. 20022. Jan. 2003Parkervision, Inc.Method, system, and computer program product for producing and distributing enhanced media
US20030081937 *23. Mai 20021. Mai 2003Baoxin LiSummarization of video content
US20030084448 *26. Okt. 20011. Mai 2003Koninklijke Philips Electronics N.V.Automatic viewing-history based television control system
US20030084450 *11. Okt. 20021. Mai 2003Thurston Nathaniel J.Method and system for presenting personalized television program recommendation to viewers
US20030088872 *4. Nov. 20028. Mai 2003Nds LimitedAdvanced television system
US20040017389 *27. Sept. 200229. Jan. 2004Hao PanSummarization of soccer video content
US20040088289 *15. März 20026. Mai 2004Li-Qun XuImage processing
US20040125124 *18. Febr. 20031. Juli 2004Hyeokman KimTechniques for constructing and browsing a hierarchical video structure
US20050028194 *2. Sept. 20043. Febr. 2005Elenbaas Jan HermanusPersonalized news retrieval system
US20050055713 *9. Sept. 200410. März 2005Samsung Electronics Co., Ltd.Apparatus and method for sharing recommended programs using digital set-top boxes
US20050131906 *19. Nov. 200416. Juni 2005Samsung Electronics Co., Ltd.Method and apparatus for managing data written in markup language and computer-readable recording medium for recording a program
US20060129544 *14. Febr. 200615. Juni 2006Lg Electronics, Inc.User preference information structure having multiple hierarchical structure and method for providing multimedia information using the same
US20070011148 *31. Aug. 200611. Jan. 2007Accenture LlpSystem, method and article of manufacture for advanced information gathering for targetted activities
USD348251 *9. Dez. 199228. Juni 1994Discovery Communications, Inc.Menu control panel for a universal remote control unit
USD354059 *3. Dez. 19923. Jan. 1995Discovery Communications, Inc.Remote control unit
USD368263 *12. Juli 199426. März 1996Discovery Communications, Inc.Remote control unit
USD381991 *12. Juli 19945. Aug. 1997Discovery Communications, Inc.Remote control unit
Referenziert von
Zitiert von PatentEingetragen Veröffentlichungsdatum Antragsteller Titel
US8151194 *26. März 20093. Apr. 2012Google Inc.Visual presentation of video usage statistics
US9218051 *27. Febr. 201222. Dez. 2015Google Inc.Visual presentation of video usage statistics
US9426411 *26. März 201323. Aug. 2016Electronics And Telecommunications Research InstituteMethod and apparatus for generating summarized information, and server for the same
US20030182627 *10. März 200325. Sept. 2003Samsung Electronics Co., Ltd.Reproducing method and apparatus for interactive mode using markup documents
US20040243927 *11. März 20042. Dez. 2004Samsung Electronics Co. Ltd.Reproducing method and apparatus for interactive mode using markup documents
US20040247292 *11. März 20049. Dez. 2004Samsung Electronics Co. Ltd.Reproducing method and apparatus for interactive mode using markup documents
US20050028199 *24. Febr. 20043. Febr. 2005Borden George R.Personal video recorder user interface
US20080065693 *11. Sept. 200613. März 2008Bellsouth Intellectual Property CorporationPresenting and linking segments of tagged media files in a media services network
US20080189754 *9. März 20067. Aug. 2008Kyoung-Ro YoonPod Identification Method in Digital Content Providing System
US20140132836 *26. März 201315. Mai 2014Electronics And Telecommunications Research InstituteMethod and apparatus for generating summarized information, and server for the same
Juristische Ereignisse
DatumCodeEreignisBeschreibung
11. Apr. 2002ASAssignment
Owner name: SHARP LABORATORIES OF AMERICA, INC., WASHINGTON
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:VAN BEEK, PETRUS J.L.;FERMAN, AHMET MUFIT;REEL/FRAME:012780/0169
Effective date: 20020204