WO2006093426A1

WO2006093426A1 - Methods of multimedia data and multimedia applications processing and systems therefore

Info

Publication number: WO2006093426A1
Application number: PCT/RU2005/000145
Authority: WO
Inventors: Aleksey Grigorevich Girin; Alexander Victorovich Belenov
Original assignee: Obshestvo S Ogranichennoy Otvetstvennostju 'active Video'
Priority date: 2005-03-03
Filing date: 2005-03-29
Publication date: 2006-09-08
Also published as: RU2005105976A; EP1854101A1

Abstract

A method of multiversion reproduction of multimedia applications and/or fragments thereof and composing new multimedia applications, comprising a plurality of multimedia applications, marks of transition source and destination, logically linked with information fragments of one or more multimedia application, a transition tool, performing a logical transition from transition source mark to transition destination mark, means for the transition tool activation. A system of multimedia information and multimedia applications control and a system of multimedia applications for multiversion demonstration, including one or more multimedia applications, marks of transition source and destination, logically linked with information fragments of multimedia applications, transition tools, comprising tools for collecting and processing of statistical and other information, performing logical transition from marks of transition source to marks of transition destination, means for transition tool activation. In a case of video applications the system presents controlled video illustration of an object or event.

Description

Methods of multimedia data and multimedia applications processing and systems therefore.

DESCRIPTION

The field of the present invention relates generally to video production - television, films, advertising; audio production,- pop & classic music, spoken word compositions, other kinds of applications dealing with multimedia information processing. The aim of the present invention is to get a technology and particular means for development:

• interactive tutors used in the areas of new knowledge acquiring and skills forming;

• interactive textbooks, lectures, visual manuals presenting information in hypermedia form (the next generation of multimedia - the natural way for a human being to acquire knowledge about the world), where an explanatory object of support is activated via the direct impact on the object of interest;

• interactive video manuals of goods use, assemblage or repair;

• video guides: video tours of cities, museums, exhibitions etc.;

• video advertising of any goods and services;

• interactive news, allowing a viewer to selectively watch the very set of episodes of interest just for him. Watching an episode a viewer can obtain additional information about objects on the screen interesting for him, the viewer can look through previous episodes, obtain other additional information;

• films, offering additional creative abilities - in addition to passive observation of events a viewer can play an active role therein; a viewer can learn an actors' biography, acquire information about a character, a literary source, learn prehistory of film script creation, obtain other information.

The invention relates generally to processing of video, audio and graphical information and combinations thereof, executed applications, fully or partly resulting video,-audio, - graphical or the like information (hereinafter - multimedia information), and particularly to the methods of multimedia information demonstration control via a preliminary created script as r well as by direct user's (operator's) influence to the demonstration process.

Methods, used for launching and demonstration control of multimedia applications, known in the art are the following: 1) preliminary hyperlinks setting in connection with certain objects within the image and switching to another application launching on their activation, with/without returning to the initial episode after the another application completion.

2) integration of synchronously created video applications, composing panoramic, hemispherical or spherical video image around the operator, allowing to show the whole image from top to bottom and around the operator or any part of the image.

"Multimedia" as used hereinafter means a particular tool on the basis of computer technologies, allowing to use a plurality of information areas: video, graphics, text, photo, animation, audio effects, audio accompaniment and corresponding tools - simultaneously and/or separately.

The US Patent N°5,684,715 (November 4, 1997, Palmer) describes a video system, allowing to assign an object within the image, link it logically with one or more applications and launch them, if necessary. The video object description generator is suggested, allowing to assign objects within the image and track their displacement. The generator work results are recorded to the auxiliary file strongly synchronized with the video file.

The shortcomings of the method are limited use thereof only for assignment of hyperlinks and the like, use thereof only within the video image, scantiness of methods of interaction with 3external applications, impossibility of complex structure building from a set of multimedia applications or fragments thereof.

The technical result of the present invention comprises the widening of multimedia information control abilities, achievement of plurality and flexibility of fragments selection.

Known methods fail to achieve said technical result. The said technical result is achieved via a method comprising setting up of marks of transition source and destination in connection with one or commonly two or more multimedia applications or with fragments and/or objects and/or spatial and/or parametric characteristics of the same or different multimedia applications. Said marks are connected via a transition tool. The transition tool is activated by an viewer's commands or from the preliminary created batch file, with the advent of a mark of transition source during the video application demonstration. Transition tool executes a transition to a mark of transition destination, set up in connection with a fragment or spatial or parametric characteristics of commonly different multimedia application and launches the destination multimedia application from the marked fragment.

The declared technical result is achieved by using a system, consisting of one or commonly more multimedia files, marked in connection with spatial or parametric characteristics thereof. For example, a position on the screen, movement of object images on the screen, the appointed pattern of movement and the like can serve as spatial characteristics for marks establishment. Spatial characteristics for marks setting up may, for example, be the duration of the episode demonstration from the beginning, the list of pre-demonstrated applications and/or fragments thereof etc.

Marks of transition source and destination are logically linked by a transition tool, designed for activation by a viewer's command input devices or by a command from a batch (command) file.

BRIEF DESCRIPTION OF THE DRAWINGS.

The essence of the declared methods and systems is illustrated on Fig. Ia, Fig. Ib, Fig. 2, Fig. 3a, Fig. 3b and Fig. 4.

Fig. Ia and Fig. Ib illustrate realization of transition within one multimedia application in forward (Ia) and reverse (Ib) directions.

Fig. 2 explains a method of realization of bidirectional demonstration of multimedia files, each allowing only one direction of demonstration.

Fig. 3 a and Fig. 3b illustrate realization of transitions from a plurality of marks to one mark or from one mark to many.

Fig. 4 illustrates a grid-type structure, formed by multimedia applications and transition tools.

Fig. 5 a and Fig. 5b illustrate converging and dilative structures, formed by multimedia applications and transition tools.

Fig 6 illustrates a volumetric (3-D) structure, formed by multimedia applications and transition tools.

Fig 7a and fig. 7b illustrate a closed structure formed by multimedia applications and transition tools.

Fig.8a and fig.8b illustrate structures of mathematical graph and mathematical stack types.

DETAILED DESCRIPTION OF THE INVENTION

The essence of the method comprises setting up marks of transitions source (1) and destination in connection with one or commonly two or more multimedia applications (fig. 4) or with fragments and/or objects and/or spatial and/or parametric characteristics of the same (fig. Ia and fig. Ib) or different multimedia applications (4). Marks are linked by transition tools (2). Transition tools are activated by a viewer's commands or from the preliminary created batch file, with the advent of a transition source mark (1) during the multimedia application fragment demonstration. A transition tool performs a transition to the transition destination mark set up in connection with a fragment or spatial or parametric characteristics of commonly different multimedia application and launches the destination multimedia application from the marked fragment. At the same time the execution of an initial multimedia application may be stopped or may be continued. The transition to another fragment within the same application may be performed as forwardly (Fig. Ia) coinciding with the demonstration direction, or backwardly (Fig. Ib). The transition tool may comprise means for collecting and logical and/or mathematical processing of supplemental information, concerning, for example, the history of fragment demonstration, the selected priority direction of plotline development, the general subject trend of the composed product (application), statistic information etc., and thus the transition tool can define (or suggest for selection) the list of applications or fragments thereof for the transition destination. A transition tool can perform a transition from one transition source mark to one or more destination transition marks (Fig. 3b). Additionally a transition tool can perform a transition from one or more transition source marks simultaneously to one destination transition mark (Fig. 3a). A transition tool can also perform a transition from one or more transition source marks to one or more transition destination marks simultaneously.

Marks are set up in connection with objects on the demonstration medium (screen), events, taking place in episode, product or episode general themes, work of art etc. Transition tools are set up in connection with multimedia applications or fragments thereof connected by any type of link - logical or subject or thematic or objective etc. A structure consisted of multimedia applications and transition tools results, which allows to organize a multiversion demonstration of composing applications and fragments thereof, repeated playback of fragments, rearrange fragments at own discretion and get in that way new products (applications).

Transitions can be set within one application including as forward (fig. Ia) direction, in the line of demonstration, or backward (fig. Ib).

Transition tools can be set and deleted preliminarily, as well as during multimedia application execution by the command from an external application or from a viewer's commands input device or from a script file.

A transition in return direction can be performed via the transition tool for forward direction i.e. a transition tool can be adapted for bidirectional transitions.

If the beginning of the forward transition coincides with the end of the return (backward, reverse) transition, they are labelled by the same mark.

Transition tool activation is performed by the command from a batch file or by a viewer's command input device. A transition can be set up between logically and/or subjectively and/or objectively and/or thematically concerned fragments.

Applications and fragments thereof (4) and transitions can be plotted and may interact according to the rules of construction and interaction of mathematical graph elements (fig. 8a). It means, that destination application, started as a result of the transition is stopped after completing thereof with the further transition performing if necessary.

Applications and fragments thereof (4) and transitions (1) can be constructed and interact according to the rules of construction and interaction of mathematical stack elements (fig. 8b). It means, that after completing of destination application, started in the result of a transition, a return transition to the initial mark of the initial application is performed. The order of fragments and transitions demonstration during transition tools activation is shown by arrows (5).

Consecution of reverse transitions and continuation of demonstration is shown by arrows (6). Execution of the initial application is stopped at the execution of the first transition and continues at returning to the same (initial) mark.

Transitions can be established from one mark to a plurality thereof (many ones) (fig 3b), from a plurality of marks to one (fig 3 a), as well as from a plurality of marks to plurality thereof.

Transition tool can perform gathering (collection) and logical and/or mathematical processing of statistical, logical, spatial-parametric information, concerning, for example, objects selection, activation thereof, computation of supplemental transition parameters, selection of transition destination and transition conditions.

At re-execution of the same transition, a transition tool can cause the execution of another application than at its primary activation, if the alternative exists.

There is the sort of applications, which execution is possible in only one direction without violation of spatiotemporal correlations or without entire or partial distortion of an application object. A system consisted of two applications with identical contents, having opposite directions of demonstration, is organized for bidirectional demonstration of contents of said sort of applications. Said couple of applications is logically linked at one or more points (according to logically connected fragments) by means of transition tools (fig.2).

The described method allows a multi- version reproduction of multimedia applications and/or fragments thereof and thus creation of new multimedia applications from existent ones by consecutive activation of transition tools in selected marked places and selection of the next application or fragment from several possible options to be launched. Disclosed herein is the system of the present invention, consisting of one (fig. Ia and fϊg.lb) or, commonly, a plurality of multimedia files (fig.3a, fig.3b, fig.4) in connection with spatial or parametric characteristics of which the marks are set up. The spatial characteristics for marks setting up, for example, may be the position on the screen, the movement of image objects on the screen, particular law of motion etc. Duration of demonstration from the beginning of an episode, a list of previously demonstrated applications or their fragments etc. can be a parametric characteristics for marks placing.

Marks of source and destination of transitions (1) are logically linked by a transition tool (2), fit for activation via an viewer's command input device or from the command file. A transition tool (2) can logically link one mark of transition source with a plurality marks of transition destination for transition performing (Fig.3b). Also a transition tool (2) can logically connect a plurality of marks of transition source with one mark of transition destination for transition performing. Also a transition tool (2) can logically connect a plurality of marks of transition source with a plurality of marks of transition destination for transition performing.

Marks and transition tools can be established or deleted from the system during work of the system.

Transition tools have means for logical and/or mathematical processing of a supplemental information.

A mark of the transition source to another application or a fragment can also be a mark of transition destination from another application or fragment.

The system can include an viewer's command input device for activation of a transition tool.

Application fragments and transition tools can form grid-type structures (fig.4), converging structures (fig 5a), dilative structures (fig. 5b), volumetrical structures (fig. 6), closed structures (fig.7a and fig. 7b) and combinations thereof.

To demonstrate a plot in two directions with applications, adapted for the only direction of demonstration without violation of cause-effect relations of plot events, two applications, describing the same plot in opposite directions, logically linked with each other spatially and parametrically by means of transition tools or via logically concerned objects, are used (fig.2).

The examples of such plots may be the demonstration of movement along the street as well as all-round sight-seeing without forward moving, for example city square or museum hall.

A transition tool can perform a transition in one or two opposite directions. Component multimedia application and/or fragments can have a common object and/or a common operation and/or a common area of knowledge and/or a common theme with at least one other multimedia application.

Each of said fragment can present an individual plot or a part of plot.

The described system allows to select from two or more fragments during the demonstration and perform a transition to a fragment for further demonstration and in this way allows to control the demonstration of multimedia application as well as create new products.

Claims

1. A method of multimedia information processing, comprising: at least one multimedia application; transition source marks and transition destination marks, logically linked with information fragments of at least one multimedia application; a transition tool for performing at least one logical transition from transition source mark to transition destination mark on activation of said transition tool;

- a tool for activation of the transition tool; further comprising the following preliminary steps: o source and destination of transition are set up; o transition source marks and transition destination marks are logically linked by transition tools; o transition tools are tuned, if necessary,

- further comprising the following steps during the actual execution of the multimedia application or a fragment thereof:

- on activation of a logic transition tool during the marked fragment execution, linked with a transition source mark, and a transition to transition destination mark, linked with an application-addressee or its fragment, is performed;

- at least a statistic information is collected and logically and/or mathematically processed by a transition tool;

- the multimedia application-addressee is launched by a transition tool starting from the fragment, marked as transition destination.

2. A method of multi version demonstration of multimedia applications and/or fragments thereof and a new multimedia applications composition, comprising the use of: a set of multimedia applications;

- marks attached to fragments or objects of one or more multimedia applications, comprising the said set; transition tools, logically linking said marks;

- further comprising performing of the following operations: o setting up marks in connection with spatial and/or parametric characteristics of applications or objects therein; o logical linking of marks by transition tools; o composing new multimedia application via consecutive activation of transition tools in selected marked fragments and on option selection of the next application or fragment from a set thereof for the further demonstration.

3. The method, as recited in claims 1 or 2, where composing multimedia applications and/or fragments thereof are logically linked with at least one alternative multimedia application on the basis of common or logically concerned objects and/or a common or logically concerned operation and/or a common or logically concerned area of knowledge and/or a common theme.

4. The method, as recited in claims 1 or 2, where a transition is performed within one application.

5. The method, as recited in claims 1 or 2, where a transition tool is set up and/or deleted by a command from an external application or a script.

6. The method, as recited in claims 1 or 2, where a mark is set up and/or deleted by a command from an external application or a script.

7. The method, as recited in claims 1 or 2, where a transition in return direction is performed by the same transition tool.

8. The method, as recited in claims 1 or 2, where the same mark is used as the source and the destination of a transition.

9. The method, as recited in claims 1 or 2, where activation is performed by the command from a data input device.

10. The method, as recited in claims 1 or 2, where activation is performed by the command from a preliminary created script.

11. The method, as recited in claims 1 or 2, where a transition is set up between logically concerned fragments.

12. The method, as recited in claims 1 or 2, where fragments or applications and transitions therebetween comprise the structure like directed or undirected mathematical graph.

13. The method, as recited in claims 1 or 2, where fragments or applications and transitions therebetween comprise the structure like mathematical stack.

14. The method, as recited in claims 1 or 2, where a transition from one transition source mark to one or more of a plurality of transition destination marks is performed by a transition tool.

15. The method, as recited in claims 1 or 2, where a transition from one or more of a plurality of transition source marks to one transition destination mark is performed by a transition tool.

16. The method, as recited in claims 1 or 2, where a transition from one or more of a plurality of transition source marks to one or more of a plurality of transition destination marks is performed by a transition tool.

17. The method, as recited in claims 1 or 2, where tuning of a logical transition tool is performed by tuning of at least logical and/or mathematical operations to select the mode and/or addressee, and/or other transition parameters.

18. The method, as recited in claims 1 or 2, where the initial application execution at lasted on starting an application-addressee.

19. The method, as recited in claims 1 or 2, where the initial application is stoped on starting an application-addressee.

20. The method, as recited in claims 1 or 2, where an alternative application, if available, is activated by a transition tool during reiteration of the same transition.

21. The method, as recited in claims 1 or 2, where process control is realized by commands from the preliminary created script.

22. The method, as recited in claims 1 or 2, where process control is realized by a viewer's commands.

23. The method, as recited in claims 1 or 2, where bidirectional demonstration of multimedia application, allowing only one direction of demonstration is organized by setting up transitions between two applications with identical contents, having opposite directions of demonstration, between logically concerned fragments.

24. A system of multimedia information, comprising:

- at least one multimedia application;

- transition source and/or destination marks, logically linked with information fragments of at least one multimedia application; said transition source and transition destination marks are set up in connection with spatial-parametric characteristics of multimedia application;

- transition tools set up between said marks;

- means for activation of a transition tool; said transition tools comprise the means for collecting and logical and/or mathematical processing of at least statistic information.

25. A system of multimedia applications, comprising: one or more multimedia applications, having a common object and/or a common area of knowledge and/or a common themes and/or a common executed action with at least one other multimedia application; marks, set up in connection with spatial or parametric characteristics of multimedia applications or fragments thereof; transition tools connecting said marks, comprising tools for collecting and logical and/or mathematical processing of at least statistic information, and a tool for launching the application-addressee. - means for activation of a transition tool.

26. The system, as recited in claims 24 or 25, where a transition tool is set up and/or deleted during the work of the system.

27. The system, as recited in claims 24 or 25, where the mark is set up and/or deleted during the work of the system.

28. The system, as recited in claims 24 or 25, where the mark of transition source to another application or a fragment thereof is at the same time the mark of transition destination from another application or fragment thereof.

29. The system, as recited in claims 24 or 25, where the transition tool provides transition from one to a plurality of marks.

30. The system, as recited in claims 24 or 25, where the transition tool provides transition from a plurality of marks to one.

31. The system, as recited in claims 24 or 25, where the transition tool provides an opportunity of transition from a plurality of marks to a plurality thereof.

32. The system, as recited in claims 24 or 25, where the transition activation means is the viewer's command input device.

33. The system, as recited in claims 24 or 25, where the transition tool provides direct and return transitions.

34. The system, as recited in claims 24 or 25, further comprising a system of two applications with identical contents, and opposite directions of demonstration and transition tools set up between logically concerned fragments thereof.

35. The system, as recited in claims 24 or 25, where multimedia applications, linked by transition tools, form a grid-type structure.

36. The system, as recited in claims 24 or 25, where multimedia applications, linked by transition tools, form a converging structure.

37. The system, as recited in claims 24 or 25, where multimedia applications, linked by transition tools, form an dilative structure.

38. The system, as recited in claims 24 or 25, where multimedia applications, linked by transition tools, form a volumetric structure.

39. The system, as recited in claims 24 or 25, where multimedia applications, linked by transition tools, form a closed structure.

40. The system, as recited in claims 24 or 25, where video applications are used, said video application is formed as controlled from outside video illustration of an object or event, which parts are presented in comprising video applications and/or fragments thereof.

41. The system, as recited in claim 40, without displaying of the mark or features thereof on the screen in the same pane with the demonstrated application.

42. The system, as recited in claims 24 or 25, where every set of multimedia application fragments or transition tools compose an independent plot.

43. The system, as recited in claims 24 or 25, where the transitions structure and the set of multimedia applications are determined by the sort of the composing information.

44. The system, as recited in claims 24 or 25, where the transitions structure and the set of multimedia applications are adapted for description of the particular area of knowledge.

45. The system, as recited in claims 24 or 25, where the transitions structure and the set of multimedia applications are adapted for description of the particular object and parts thereof.

46. The system, as recited in claims 24 or 25, where the transitions structure and the set of multimedia applications are adapted for description of the particular sequence of operations with an object.

47. The system, as recited in claims 24 or 25, where the transitions structure and the set of multimedia applications are adapted for description of the particular objects logically concerned with the object not representing however parts of the same object.