CA2246736C - Video hyperlinks - Google Patents
Video hyperlinks Download PDFInfo
- Publication number
- CA2246736C CA2246736C CA002246736A CA2246736A CA2246736C CA 2246736 C CA2246736 C CA 2246736C CA 002246736 A CA002246736 A CA 002246736A CA 2246736 A CA2246736 A CA 2246736A CA 2246736 C CA2246736 C CA 2246736C
- Authority
- CA
- Canada
- Prior art keywords
- video
- data
- viewer
- network
- map
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000012545 processing Methods 0.000 claims abstract description 3
- 230000004044 response Effects 0.000 claims description 5
- 238000000034 method Methods 0.000 abstract description 10
- PEDCQBHIVMGVHV-UHFFFAOYSA-N Glycerine Chemical compound OCC(O)CO PEDCQBHIVMGVHV-UHFFFAOYSA-N 0.000 description 10
- 238000012360 testing method Methods 0.000 description 10
- 101000942586 Homo sapiens CCR4-NOT transcription complex subunit 8 Proteins 0.000 description 7
- 101001094629 Homo sapiens Popeye domain-containing protein 2 Proteins 0.000 description 7
- 101000608230 Homo sapiens Pyrin domain-containing protein 2 Proteins 0.000 description 7
- 102100035482 Popeye domain-containing protein 2 Human genes 0.000 description 7
- 150000002500 ions Chemical class 0.000 description 7
- 238000012546 transfer Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 241000406668 Loxodonta cyclotis Species 0.000 description 4
- 238000010276 construction Methods 0.000 description 4
- 102100035475 Blood vessel epicardial substance Human genes 0.000 description 3
- 101001094636 Homo sapiens Blood vessel epicardial substance Proteins 0.000 description 3
- 101000608194 Homo sapiens Pyrin domain-containing protein 1 Proteins 0.000 description 3
- 101000595404 Homo sapiens Ribonucleases P/MRP protein subunit POP1 Proteins 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- QWZQKTKRYJMEKY-UHFFFAOYSA-N Edulane Natural products O1C(C)(C)CCC2=C1C=C1OCC3C4=CC=C(OC)C=C4OC3C1=C2OC QWZQKTKRYJMEKY-UHFFFAOYSA-N 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- NLZUEZXRPGMBCV-UHFFFAOYSA-N Butylhydroxytoluene Chemical compound CC1=CC(C(C)(C)C)=C(O)C(C(C)(C)C)=C1 NLZUEZXRPGMBCV-UHFFFAOYSA-N 0.000 description 1
- 241000282693 Cercopithecidae Species 0.000 description 1
- 101001094649 Homo sapiens Popeye domain-containing protein 3 Proteins 0.000 description 1
- 101000608234 Homo sapiens Pyrin domain-containing protein 5 Proteins 0.000 description 1
- 101000578693 Homo sapiens Target of rapamycin complex subunit LST8 Proteins 0.000 description 1
- 102100035477 Popeye domain-containing protein 3 Human genes 0.000 description 1
- 241000283080 Proboscidea <mammal> Species 0.000 description 1
- 241000428533 Rhis Species 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 244000145841 kine Species 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000002957 persistent organic pollutant Substances 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/74—Browsing; Visualisation therefor
- G06F16/748—Hypervideo
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/93—Document management systems
- G06F16/94—Hypermedia
Abstract
A network data processing system is disclosed that uses novel methods and apparatus to hyperlink from full motion videos. The present invention can be used with any standard video file by adding a header identifying a video map location and a script location identifying where the hyperlinks are associated with the video file for any given frame. The present invention includes a new viewer (31) that reads the header and issues the header information, X-coordinate, Y-coordinate, and time coordinate for a particular hyperlink selection made by a user via a computer pointing device. An HTTP Server (33) and video script (34) operate in conjunction to obtain corresponding map (35) and identify a network address for coordinate provided by the viewer (31).
Description
WO 97/37497 rCT~US97/04333 VIDEO ~lY~ h T T~E,s BAC~.ROU~ OF TPF. INVENTION
Internet access is incre~qin~ly based on browser technology.
The internet is a cu~ ul,el- net~,vork built upon the nelwwk of telephone lines that e~ist worldwide. C'omputers connected to the internet can ~ch~n~e inform~ion with any other connected computer. ~igure 1 is a simplified rendition of the irlternet At the heart of the internet is the so-called "Internet Backbone," at the center of Figure 1. The backbone is founded ûn the set of major 10 telephone conduits that exist across the world. These are the long-distance telephone provider's conduits ~lefii~n~d to move large volumes of data traffic quickly. For e~mple, the triangle in the center of Figure 1 may represent the three major telephone conduits that e~ist between Washington, Los Angeles, and New 15 York.
Each of the major conduits termin~tefi at a router. The routers are large, fast switching ~y~ellls ~at SOIt the large volume of incoming data for local routing, much as large Post Offices sort mail for local delivery. Each router is connected to additional, more 20 local, routers. Some of the local routers are called "points of presence" (or "POPs"') ~d are designed to bring backbone access to more localized regions. Thus, for e~nrle, the backbone termin~ion router that exists in W~ in~ton may have point of presence routers connected in Baltimore, Alexandria, etc.
Internet access is incre~qin~ly based on browser technology.
The internet is a cu~ ul,el- net~,vork built upon the nelwwk of telephone lines that e~ist worldwide. C'omputers connected to the internet can ~ch~n~e inform~ion with any other connected computer. ~igure 1 is a simplified rendition of the irlternet At the heart of the internet is the so-called "Internet Backbone," at the center of Figure 1. The backbone is founded ûn the set of major 10 telephone conduits that exist across the world. These are the long-distance telephone provider's conduits ~lefii~n~d to move large volumes of data traffic quickly. For e~mple, the triangle in the center of Figure 1 may represent the three major telephone conduits that e~ist between Washington, Los Angeles, and New 15 York.
Each of the major conduits termin~tefi at a router. The routers are large, fast switching ~y~ellls ~at SOIt the large volume of incoming data for local routing, much as large Post Offices sort mail for local delivery. Each router is connected to additional, more 20 local, routers. Some of the local routers are called "points of presence" (or "POPs"') ~d are designed to bring backbone access to more localized regions. Thus, for e~nrle, the backbone termin~ion router that exists in W~ in~ton may have point of presence routers connected in Baltimore, Alexandria, etc.
2~ backbone router can connect as many point of presence routers as the constraints of its switching systems and the capacity of the bac~bone will permit.
In addition to point of presence routers, Commercial Internet ~.~ch~nFes (CIX in Figure 1) and Global Internet F~rrh~nges (GIX
5 in Figure 1) also connect to the backbone routers. These ~ch~nges transfer data between internet service providers nationally and intern~tion~lly. When data originates on one U.S. internet service provider with a destination on another U.S. internet service provider, the data first routes to the Commercial Internet F~ch~n~e 10 where it makes the transfer between providers. A ,simil~r situation occurs when data originates in one country, bound for another country. The data first passes through the Global Internet F.~chz.nge whe~e it is transferred from one provide:r to another.
In theory, still further, even more localized, point of presence 15 routers could connect off of the point of presence routers shown in Figure 1. Typically, however, the point of presence routers (POP1, POP2, POP3, etc.) provide the direct local connection point for various types of computers to connect to the internet.
A common method in which personal home computers 20 connect to the point of presence is through a local internet carrier.
As shown at POP2 in Figure 1, the local internet calTier obtains a direct line to the POP2, and then provides a modern connection for home computer users to dial for connection. When the home computer connects to the modem of the local inter:net carrier, the 2~ carrier switches the computer through to the POP2, which in turn switches it onto the internet backbone.
Another method of connecting computers to the internet is by direct connection through a LAN system to the point of presence.
This example is shown as I.AN#1 and LAN#2 com~lections to, W O g7/37497 PCTAJS97/04333 respectively, POP1 and POP2. Specifically, the LAN connects to the point of presence through a leased data line ~dedicated phone connection). The computers (PCs in Figure 1) are < onnected to the ~AN and receive and tr~n~mit data to the point of presence through 5 the control of the LAN. Also attached to the LAN are a va~iety of di~iel-t servers, three of which are shown in Figure 1. The File Server conn-scts to the LAN and cont~qin~ the commt-n data files used by the PCs, LAN, and other Servers. The HTTP Server processes incoming and outgoing data to and from the internet by 10 assuring that the data is written and received according to certain internet commllnic~tjor protocols, called the HyperText Transport Protocol (HTTP). The Electronic Mail Server processes E-Mail data that is written to or received from the internet.
As shown in Figure 1, the internet provides a conduit 15 essentially interconn~cting every computer on the internet with every other computer on the internet. LAN#1, for example, can provide certain data (called internet pages) from its File Server to the HTTP server to make the pages available to any other computer on the internet. An HTI P Server that makes internet pages 20 available on the internet usually includes a so-called "home page,"
which is the starting point for outside users to navigate through the underlying internet pages serviced by the HTTP Server. When a user, such as the user of the UHome PC" (em~n~t.in~ from POP2 in Figure 1), wants to view a home page, such as LAN#1's home page, 25 it can do so by calling for the data from LAN#1. In response, L.AN#1 pulls the internet page data from its File Server and instructs its HTTP Server to write the data, addressed to Home PC, onto the internet. The data travels from the local ISDN to the POP1, through the internet backbone (and respective routers), W O97/37497 PCT~US97/04333 through the CIX or IIX (if necessary), through POP2, through the local internet carrier, and into the modem of the Home PC. The request for the data from the Home PC to the LAN#1, of course, travels along the opposite path.
To insure that data is sent to and received by the appropriate systems on the internet, every "device" (i.e., PC workstation, HTTP
Server, File Server, etc.), when it is communicating on the internet, has ~R.ci~ne-l to it a unique address, called an IP Address. The IP
Address can be analogized to a personal phone number that can be called by another phone to make a connection (through a series of telephone routers) between them. The IP Address is presently a sixteen bit binary address, which is fine for computers to read, ~ut is cumbersome for a human user to memorize or use. As a result, the IP Addresses are ~si~ned pneumonics to make them more "user-friendly.~ One pnelln onic of particular importance is the "host name," which i8 the IP Address for any HTTP where a home internet page resides (as a result of convention, the host name is usually assigned the pnellmonic WWW ). The IP Address for the internet site (for example, the LAN) supporting the HTTP Server is called a ~domain name.~
~igure 2 shows an address line written in the standard protocol used lby internet components to address each other. The protocol is referred to as a 'IJniform Resource Locator~ (URL) and this terminology appears as the opening argument in the address of 26 Figure 2. In Figure 2, the Uniform Resource Locator indicates that the request is for "~ " formatted data (i.e., a internet page as opposed to, for example, an e-mail message). The home page for the data resides on the "vrww" HTTP Server on the "ucla.edu~ LAN (or WO 97/37497 PCTrJS97/04333 rlom~in). The name of the file (to be found most likely in the File Server supported by the ucla.edu LAN) is ~homepage.htl."
If, for example, the ucla.edu LAN is LAN#1 of Figure 1 and a user of a PC at LAN#2 wants to view the ~homepage.htl" file, the user send~ the address shown in Fi~re 2 to LAN#1 through the internet channels shown in Figure 1. Upon receipt of the address, LAN#1 returns to the user the Uhomepage.htl" file through a reverse path of the internet ~h~nnel~.
Once a user has received an "HTML~ formatted file (any internet page)~ the text of the file may prompt the user to request additional information contained in different internet page files.
The prompts are referred to as Uhypertext~ and usu~lly show up on a home page (or other internet page) in a different color than normal text, thus disting~ hin~ them as hypertext links. As an example, a user requesting a local zoo homepage may see several different hypertext links to files cont~inin~ information on various z~nim~ls at the zoo, a map of the zoo, operating times, etc. By rli~kin~ a computer pointer on the prompt, the user can autom~tir~lly move from a current internet page to a new one.
The computer pointing device can be a Umouse," a touchscreen, a remote control, a light pen, etc.
When the user clicks on a hypertext link, the user's data processor records the position of the computer pointer when the click occurred. The processor then uses a look-up table of x-y 2~ coordinates versus URLs to identify a new URL address assigned to the position of the computer pointer. The URL acldress may be serviced by the same domain or a different one, depending on the info~nation contained in the look-up table. VVhen clicked, a browser (discussed in more detail below) requests a connection to the HTTP
W 097/37497 PCTrUS97/04333 Server hosting the file, and it also requests from the HTTP Server the file identified by the URL. Once the Hl~P Server accepts the connection requested by the browser, the HTTP Server transmits back to the browser the requested file. Once the browser receives 5 the requested file, it delivers or presents the content of the file to the requesting user.
Hypertext links can be assigned to textual i:nformation, such as, in the example of the zoo page, ~ci~ning links to the words "moIlk~y" and ~elephant" appearing on the internet page screen.
10 They can also be assigned to photographs on the internet page screen, such as on a picture of a monkey or an elephant. Then, by placing the point.ing device on the text or picture and clicking the pointing device, the user is taken from a current internet page to a new internet page assigned to the particular text or picture 15 selected. Thus, for example, çlicking on the elephant may take a user from a local zoo page to a page supported by .a elephant conservation association or, alternatively, to another local zoo page cont~;ninE pictures of the elephants kept at the zoo. In either the text or picture ~ mples, the internet page is embedded with 20 specially ~si~n~d ~hot spots," located at x-y coordinates on the page. When the browser detects a pointing device click over a "hotspot", or linked location, it finds the associated URL and sends the filename portion of the URL to the server loca.ted at the domain name portion of the URL. A picture may further be flagged as 25 having a "map" associated with it. If it does, the relative coordinates of the click within the picture are sent to the server as well. The server then determines which page to return, based on the location of the click.
Browsers are used by the internet user at the local PC to convert information received from the HTTP Server into a format that can be displayed by the browser on the video screen (or through the audio speakers) of the PC. The browser is thus an 5 application program that runs on a local PC and acts as a translator of HTML inform~.ion to be presentable at the local PC.
Several ~ e~ellt comm~rcial browsers are available that can be incorporated into the present invention, including, for example, the Netscape Navigator browser.
The browser is also used to recognize clicks on the screen made by a user with the computer pointing device. When the user positions the computer pointing device on a portion of the text of the screen associated with a hypertext link, the browser recognizes the user's action as a request to get a file from a web site identified by 1~ the URL thereby obt~in;ng new data files from an IP address on the internet. Then, as discussed above, when the data is returned from the HTTP Server, the server delivers the data to t:he browser, which tr~n~l~tss it into a format presentable at the PC and presents it to the user.
On occasion, the information that is returned from the HTTP
Server (and subsequently to the browser) is of a type not presentable by the particular browser being used. This occurs, for example, when video data is returned to the browser and the browser does not have the a~pro~,iate application software to 2~ display the video to the PC user. In these instances, the browser enlists a helper application resident on the PC to display the incoming data. For example, when the browser receives video data from the internet, it frequently opens a viewer, which appears as a W 097/37497 PCTrUS97tO4333 window on the screen of the PC user, which will process the incoming video data through the browser and display the video to the user on the PC screen.
SUhl MARy OF T~ INVENTION
Internet pages are not li~nited to text and picture inform~t:ion1 but can include full-motion video, audio, and other time-c~nFin~ data. Traditionally, these types of data are presented to a user via a "viewer" assigned specifically to the task of presenting the time-chP.nging data to the user. Thus, for example, viewers are available for displaying video and playing audio.
l~ull-motion video/audio data files are av~ le on the internet and are usually obtained by a user's Browser program, which automatically opens a viewer program to present the information (i.e., play the video/audio) to the user. Thus, for 1~ example, if a user requests a full-motion video file from a site on the internet, the browser vrill receive the file from the HTTP Server, open a video viewer, and download the video file to the video viewer for display on the screen of the user's data processor (PC). The browser knows which viewer is needed for a particular file based on a Multipurpose Internet Mail Extension (MIME) extension attached to the file name.
Hyperlinks are not embedded in full motion video data, like they are in text and picture data, since to do so would require reworking (for example, re-editing) a video to superimpose the hot spot locations onto the video data. The present invention provides hyperlinks on full-motion video, real-time audio or any other time-based data, without ~ewoll~ing the data file. The hyperlinks WO 97/37497 PCT~US97104333 as~ociated with the present time-based data files are particularly suitable f¢r use on the internet since they permit a user to view a time-based data file ~such as a video), click on a portion of the display, and be moved automatically to another, related, internet 5 page.
For simplicity, this disclosure shall hereafter refer to "video~
data, although the artisan will be able to appreciate that any time-based data can be substituted for the video data described. For instance, a still image, an image representing buttons, etc. can be 10 used as a hot spot area, along with a sound file. When the image is clicked, the time into the sound file is sent, along with the x and y position, to the server According to the present invention, when a user positions a computer pointing device on a moving video and cLicks the pointer, 15 data representing the position of the pointer (x- and y- coordinates) and data representing the time of the click are recorded. A three-~imen~ional lookup table is then consulted to determine which URL
is to be issued for the recorded x-, y-, and time ~limen~ions.
Video data files used by the present invention are not altered 20 in their video data content, but include a header identifying the video data as conforming to the present invention. Any standard, video data can be converted into video data according to the present invention simply by adding the header referred to above and described in greater detail below. A data file that has been 25 converted to include the header is referred to herein as a BTV file since these files have been ~ ed a file name MIME suffix of ".btv" as a convention.
The header also tells the viewer a location where it can find the script or program needed to use the look-up table. It also WO 97/37497 PCT~US97/04333 identifies the location of the three-dimen~ion~l lookup table (also known as the map) associated with the video file and the location of the standard video data (~refelably in .avi format, although any other video format can be used) to be displayed on the viewer.
BRIEF DF~CRIPTION OF T~ D~R~WIN(~.S
The purpose and advantages gained by the present invention will be understood by careful study of the following detailed description of the presently ~fefe~,ed embodiment with particular reference to the accompanying drawings.
FIGURE 1 is a schematic diagram of an internet network;
FIGURE 2 is a internet address breakdown;
FIGURE 3 is a schematic diagram of one embodiment of the present invention;
FIGURE 4 is a schem~l-c diagram of the operating system 1~ and video screen acco, lillg to the embodiment of Figure 3;
FIGURE 5 is a s-~hem~t.ic diagram of another embodiment of the present invention;
FIGURE 6 is a schematic diagram of the operating system and video screen according to the embodiment of Figure 5;
W O 97t37497 PCTrUS97/04333 FIGURE 7 is a flowchart of an example operation of the viewer of Figures 3-6;
FIGURE 8 is a flowchart of an example operation of the video script of Figures 3-6; and FIGURE 9 is a .BTV file he~fler utility according to one aspect of the inventio~
D~T~T-F.n ~ESCR~PTION OF T~
PR~;F~NTLY ~ P ~Rl;.n ~.MRODTM~
The present invention can be realized in a variety of different 10 ways, including in the several embodiments described with respect to Figs. 3 through 9 in the context of the network shown in Fig. 1.
The embodiment of Fig. 3 has a data processor 30, which can be any standard PC having a microprocessor, memory, a video screen, etc., and including a variety of ~oftware components described below.
16 Alternatively, the data processor 30 may be divided into multiple separate hardware components rather than the single hardware component shown in Fig. 3. In the embodiment of Fig. 3, the viewer 31 and the browser 32 are the principal connections between the user and the inform~t.ion on the network (such as that shown in 20 Fig. 1). The present invention is described in connection with the internet of Figure 1 but can be applied to any network of devices, public or private.
In the internet embodiment, in particular, the browser 32 receives information from the internet network ~ia the HTTP
W 097/37497 PCT~US97104333 Server 33 and translates that data from the language used on the internet (called the HTML data format~ into a screen display that the user can recognize. When the browser 32 receives HTML data from the HTTP Server 33 in a MIME format that requires the 5 browser 32 to enlist the assistance of a viewer 31 to display the information to the user, the browser 32 initiates the opening of the viewer 31 and the downloading of the data file to the viewer 31, as shown in Fig. 3. With the data file from the browser 32, the viewer 31 then interprets the data and translates it into a format that the 10 user can sense. Thus, for example, the browser 3 2 may enlist the assistance of the viewer 31 to play a video by opening the viewer 31 and downloading the HTML video data file to the viewer 31. The viewer 31 then translates the video data file into a video screen that the user can watch.
In the embodiment of the present invention shown in Fig. 3, the viewer 31 is a specialized viewer that will accept and process BTV MIME files. The BTV MIME file is a video data file (l~refelably converted from a .avi MIME format) which permits the user to make hyperlink selections in both position and time 20 domains from full motion ndeo that the user watches. Fig. 4 shows the operating system 40, together with the viewe:r 31 and browser 32. Also shown in Fig. 4 are the screens that the user would see when using the browser 32 and viewer 31 in accordance with one aspect of the present invention. In particular, the browser 32 is 25 software, and prepares as part of its routine a screen 42 displaying information for the user to see. .~imil~rly, the viewer 31 is also software and prepares a screen 41 for the user to see.
In the embodiment shown in Fig. 4, the screen 42 of the browser 32 includes a hypertext word that, when clicked on by the W 097/37497 PCT~US97/04333 user, causes the browser 32 to issue a URL request to the HTTP
Server to obtain a data file from some IP address on the internet shown in Fig. 1. In the emborlimçnt of Fig. 4, the URL ~igned to the hypertext in the screen 42 of the bl o~er 32 causes a video data 5 file to be retrieved. When the video data file is received by the browser 32 from the HTTP Server 33 (Fig. 3 or Fig. 1), the browser 32 reco~ni7.e,s from the MIME ~in this case the .BTV MIME), that it needs to open the BTV viewer 31 and download the BIV data file to the viewer 31 for display to the user on the screen 41.
Once the viewer 31 has the BTV file and is displaying it to the viewer, the user is then able to point and click onto portions of the full motion video, which causes the viewer 31 to issue a URL
address to the browser, which requests the filename specified in the URL from the ~om~in in the URL. It also passes on the x, y, and t information (described in more detail below). When the viewer 31 receives the requested data file, the viewer 31 then opens either another browser or another viewer (depending on the MIME type of the hyperlinked data received) to display the data to the user. This display is shown as linked screen 43 in Fig. 4.
The present viewers thus display the data requested by the browser, and in addition, have the processing capabilities necessary to permit a user to hyperlink from some subject matter on the viewer screen 41 to other data from another URI. file to be displayed on linked screen 43. A description of how the viewer 31 operates to permit the user to hyperlink from a screen 41 to a screen 43 follows.
In reference again to Fig. 3, when the user points the pointing device at a particular portion of the video playing on the viewer screen 41 of the viewer 31 ("selection" in Fig. 3), the viewer CA 02246736 l998-08-20 W 097/37497 PCTrUS97/04333 31 sends so-called (x,y,t) data to the browser 32 for proces.qin~ into a URL code. Typically when a user positions a computer point:in~
device at a portion of a browser screen (such as text or a still image~
the browser uses the X and Y coordinates of the pointing device to 5 determine that the user has requested additionalL data originating at a particular URL location. With the viewer 31 of the present invention, however, the video pictures are moving and ~h~n~ing over time causing the X and Y coordinate system to be insufficient for user selections of time-based data files. This happens, for 10 example, because a screen which is showing one subject matter at one moment (on which the user may wish to click and move to a data file related to that particularly displayed subject matter) will be different than the video display on the viewer screen 41 that occurs sometime after the original display. As a result, the user 15 who clicks on an X-Y coordinate at time to will be çlickin~ on a di~rellt picture (or text) than if the user clicks at the exact same X-Y coordinates at a later time tl.
To accommodate the time element of the video display 41 when the user clicks on a particular object, the viewer 31 sends to 20 the browser 32 as part of the (x,y,t) data, the X position of the click, the Y position of the click, and a time element when the click occurred. With video data, the time elem~nt is rnost easily obtained by recording the frame number of the video that is playing. In this embodiment, when the user clicks on a particular spot of the video 25 display, the viewer 31 sends X0, Y0, and to information to the browser 32. If, the user then clicks on exactly the same position on the screen 41 of the viewer 31 at a time tl later, the viewer 31 would then send X0, Y0, and tl information to the browser 32. In the audio embodiment, the time coordinate may be a two-dimensional W 097/37497 PCT~US97104333 item: a tracl~ number and a time from the start of the track. Of course, it might be an actual time, from some fixed starting point (such as midnight) or it may be a variable starting time (such as the beFinnin~ of a selection).
The ~x,y,t) data sent by the viewer 31 to the browser 32 also includes two additional pieces of information: the location of a CGI
script file and the location of a image map file. The viewer 31 obtains these two pieces of infor nz~t.ion from the header on the .BTV
formatted video dsta which it receives from the browser 32.
Alternatively, the browser 32 itself can obtain the CGI scripted file and the video map file from the .BTV he~tler.
The hea~ler, from which the viewer 31 obtair-s the script and map files, is al~ that is added to a video file to convert it into a .BTV
file. The present invention is not limited to any particular video file format, but preferably, the format is the .AVI format. In addition, because the present invention adds just a header to the video data, virtually sny data format can be used. A typical header added to a .AVI formatted video file to convert it into a .BTV video file is as follows:
START-BTV
VER 1.0 IJRL http://host.tl()rn~in/cgi-script V~IL /c/director/image.map END-BTV
2~ Each of the items between the START and END staternents are mandatory att~çhments to the .A~TI file to convert it to a .BTV file.
Additional optional information, such as that collected via the interface shown in Figure 9 (and described in greater detail below), can be included in the heading. The VER statement identifies the CA 02246736 l998-08-20 W 097/37497 PCTrUS97/04333 current program version. The URL statement ident.ifies the locat~on and name of the CGI script that will coordinate the X-Y
coordinates, time coor-lin~tes and image map to return an associated URL address. The VHL statement is the location and 5 name of the image map. The URL and VHL st~tf!ments are the two additional pieces of information that the viewer 31 sends to the browser 32, in addition to the position and time data corresponding to the user's selection.
Once a user makes a selection, the browser 32 then transmits 10 the VHL (from the he~rler), X and Y coor-lin~te.s, and time coordinate to the HTYP Server 33 specified in the CGI URL (from the header). The Hl~P Server 33 uses the URL statement to retrieve the script file 34 from a local file server. The video map script 34 then uses the VHL st~tçment to locate and load the 15 appropriate video map 35 identified by the viewer 31 when the user made the selection. The video map script 34 is prefe~ably a C
language program that takes the X, Y, and time c oordinates from the HTTP Server 33 (originally from the viewer 31), retrieves the appropriate ~HL video map 35 and looks up the coordinate data on 20 the map 35 to retrieve a URL address associated with the selection made by the user on the viewer 31.
The method by which the video map script; 34 conducts this lookup operation can be appreciate~ by consider~ng an example video map filLe, as follows. The map file is created manually using a 2~ MS Windows-based map m~kinE utility to assist in the file creation.
The person originally m~kin~ the map (the "map maker") navigates through a video using the play, step, rewind, etc. buttons, or using a frame number and go to button, to observe the moving objects that occur in the .AVl formatted ~ideo. When a video image appears WO 97t37497 PCT~US97104333 during the course or range of frames, the map maker pauses the video and marks the locations on the video where hyperlinks will be recognized. Using a mapping utility, the ~RiFnment of these hyperlinks (also called hot spots) can be done simply by rlickin~ on the various spots on the video image until all desired hot spots for all desired objects have been logged. Then, the map maker can advance to the next subject matter in the video to which hot spots are to be attached and continue the process.
Importantly, the utility does not alter the video data file 10 itself, but instead creates a map file (which will ult.imz.tely be stored in map 35 of Fig. 3) which records the location of the hot spots for each frame of the video. The following is a sample map file for a video of a comet crossing the face of a moon:
Frame 2 Spot 9 10 25 26 41 moon html Spot 17 18 19 comet.html Default default.html Frame 4 Spot 9 10 25 26 41 moon.html Spot 18 19 20 comet.html Default default.html Frame 6 Spot 9 10 25 26 41 moon.html Spot 19 20 21 comet.html Default default.html (Etc. ~
In the above map file, as the comet moves every two frames, the hot spots associated with the comet change with it. This particular map maker has decided that the hot spots can accurately W 097/37497 PCTrUS97/04333 track the position of the comet on the screen if the hot spots change every two frames. The moon is not moving in this particular video and the remainder of the picture is simply space. Essentially what the above map file provides i9 a series of physical coorrlin~te~ (hot 5 spots) and URLs, grouped by frame number. The following key words appear in the above file:
Frame: marks the last frame for which the group that follows is valid.
Spot: marks the hot spot numbers for a particular object.
Default: marks a default URL if no file is specified for the hot spot selected.
The frame state~nent is in the following format: Frame frame-number, where "frame" is the word and 'Y;rame-number" is the last frame number to which the section following it is valid.
15 Thus, for example, if the first frame statement is ~ame 5, then the argllment~s following that frame statement will be valid for frames 0-5. If the next frame st~ternent is frame 15, then the arguments following frame 15 will be valid for frame 6 through 15.
~ollowing the frame st~tement i~ a series of rect statements 20 and one default statement. The rect and default statements specify the hot spots for the frames greater than the previous frame statement through the current frame-number. The rect statements take the format of: spot hot spots URL where "spot" is the word and the hot spots are the parameters that specify the one or more 25 hot spots that will cause the particular URL to be selected. The hot spots can be X-Y coordinates or can be a series of pre-numbered rectangles, for example, each being 10 x 10 pixels in a grid that covers the video. In the example image map above, the W 097/37497 PCT~US97104333 embodiment of pre-numbered rect~nFles is utilized, as discussed in more detail below.
The default statement is in the format of: Default URL, where ~Default" is the word and URL i~; the URL that is to be 5 returned if none of the previous spot argnment,,s are found. The above sample image map contains each of the above described st~t~men~. Lines 1, 5, and 9 are frame statements indicating that the hot spots are grouped into frames 0-2, 3-4, and 5-6. The three ar~lment~ following each of the frame groupings are, respectively, 10 a spot argument for the moon image, a spot argument for the comet image, and a default statement. The map maker has identified that the moon during frame 0-2 is located in pixel blocks (10 x 10 pixels) 9, 10, 25, 26, and 41. If, during the frame 0-2, the user clicks in any one of those pixel blocks, the URL "moon.html" is to be sent to the HTTP Server. Similarly, if during frame 0-2 any pixel block 17, 18, or 19 is selected, the third line indicates that comet.html is to be sent.
As can be seen in lines 6 and 10, the pixels identifying the location of the moon do not change since the moon is not moving 20 during advances in the video frames. On the other hand, the comet is moving one pixel block per every two frames. Thus, in frames 3 and 4, the comet occupies positions 18, 19 and 20, while in frames 5 and 6 the comet occupies pixel blocks 19, 20 and 21. The map maker has identified each of these pixel blocks as hot spots for the 25 comet during the respectively described frame groups. If the user clicks on any hot spot other than those indicated by the ~spot"
st~tements, the default statement wil] be executed, returning the URL "space.html," in the sample image map described above.
W 097137497 PCTrUS97/04333 The present invention is not lim~ted to the above described map format, but may take any type of for~at in which the X, Y, and time coordinates can be identified for a particular URL. Thus, for example, the map may take the form of.
Frame frame number Spot Hl'TP://URL 36, 37, 38, 52 Default HTTP:/ldefault.URL
(Etc.) In this example, the hot spot identifiers are in the format of: spot URL hot spots. Many other different types of formats can also be utilized to identify the hot spots and time for particular URLs.
What is important is that the script 34 be capable of retrieving the map 35 and rlmnin~ its program on the map data to be able to identify an assigned URL for a particular X/YItime based hot spot.
The script 34 is a C program ~esign~d to take the image map 35 and use the data contained in the map to identify which URL
should be returned for a particular XlY/time set of coordinates. As shown in Fig. 3J the video map script 34 receives the (x,y,t) data (the X, Y, and time coorflin~tes) from the HTTP Server 33 for a particular hot spot selected by the user on the viewer 31. With the (x,y,t) dataJ the video map script 34 takes the ~HL data" received from the header of the .BTV file, uses it to look up the map 35 corresponding to that .BlrV file. The video map script 34 then runs the (x,y,t) data through the map 36 to determine which UR~ should 2~ be returned to the Hl~P Server 33 for issuance onto the internet (Fig. 1) to retrieve the next desired data file.
For example, suppose the BTV viewer 31 is playing a BTV
file having a header of URI.=HTTP://domain.com/script and a V~IL=c:video.map. Furthermore, the video map located at the VHL
location is the video map in the example described above. Then, when the user uses the browser 32 to run the Bl~r file, the browser 32 opens the viewer 31 and begins shov.~ing the video. If, during the 5 third frame of the video showing, the user uses the computer poin~ing device to click on the comet in pixel box number 19, the viewer 31 sends the (x,y,t) information, including the VHL, the CGI
URL, pixel box 19, and frame number 3 to the browser 32, which sends all of the information except the CGI URL to the HTTP
10 Server 33 specified in the tlom~in name portion of the CGI URL.
The server runs the filename portion of the URL, which is the video map script 34.
The video map script 34 uses the VHL to locate the map 35 at the location of C:\video.map, downloads the map 36 and applies 1~ the (x,y,t) information to the map as follows: First, the video map script reads line 1 of the map and identifies that the first group of hot spots is valid only through frame #2. The video map script 34 then moves to line #5 to determine that the next group of frames is valid through frame #4 and thus recognizes that the current (x,y,t~
20 data frame number (3) is within the range of frames from frame 3 through frame 4, thus mzlking the arguments in lines 6, 7 and 8 valid for the current frame. The video map script; 34 then reads line 6 to determine whether the current pixel block (19) falls within the "spot" comm~ntl and reco~ni7es that it does not. The script 34 then 25 goes to line 7 where it recognizes that the line 7 "spot" comm:~nd is valid for pixel 19 and the~ero~e retums the assigned URL
"comet.html" to the HTTP Server 33.
The HTTP Server 33 then issues the URL "comet.html" onto the internet l Fig. 1) to return the data file associated with the WO 97137497 PCT~US97104333 "comet.html" IJRL. When that data has been received, the HTTP
Server 33 returns the data to the browser 32 which reads the MIME of the "comet.html" data and displays the data to the user either on its own screen or by openin~ another viewer (depen-ling 5 on the data MIME).
At the end of the above ~ mple, the user's screen will appear as in Fig. 4 in which the browser 32 is open and rllnning the video on the viewer 31. Also on the screen will be the linked screen 43 which will be playing the acomet.html" display for the user via 10 either the browser or another viewer.
The flowcharts for the above-described operations of the viewers and script are shown in Figs. 7 and 8. In Fig. 7, the operation of the viewer 31 is described and in Fig. 8, the operation of the script 34 is described. In Fig. 7, the viewer 31 is playing data given to it by the browser 32 at step 70 At step 71, the viewer 31 detects whether or not a user has clicked on the viewing screen with a co,ll~uter pointer. If the user has not clicked on the screen, the viewer continues to play the data for the user at step 70. If at step 71, the viewer detects a click by the user, the viewer 31 records at 20 step 72 the frame number of the video during which the click occurred. The viewer 31 then records the positional coordinates of the pointing device when the click occurred, all at step 73. If necessary, at step 74, the viewer 31 then converts the X, Y
coordinate positions into a pixel block or a hot spot--alternatively, 25 the viewer 31 can send the raw X-Y coordinate positions. It then sends the frame information, the hot spot information, the URL and VHL (from the .BTV header) to the browser 32, as shown as the "(x,y,t) data" in Fig. 3. The viewer must interface with the Application Program Interface (API) of the browser being used in W O 97/37497 PCTrUS97/04333 such a way that it can commlmi~t& all of this information to the browser and server in order to get the next hyperlink. The API
connection is platform and l~low~er dependent. For example, on a Microsoft Windows platform, with a Netscape Nangator browser, 5 either DDE (dynamic data e~r~h~n~e) or OLE (object l;nking and embedding) may be used.
Browser 32 then transfers the information to the HTTP
Server 33 which transfers the information to the video map script 34, which operates in accordance with the chart shown in Fig. 8.
10 The video map script 34 receives the (x,y,t) data (the frame, the hot spot and the VHL) at step 80. At step 81, the script 34 reads the VHL address and locates and retrieves the VHL map 35. At step 82, the video map script 34 reads the map and identifies the correct frame group for the f~ame number in the (x,y,t) data. At step 83, 15 the video script 34 tests the hot spot locations to determine if any hot spot locations match the "spot" statements in the identified frame group of the image map. If matching hot spots are identified by the script 34, the ~ igned IJRL is returned to the HTTP Server 33 at step 84. If not, the video map script 34 returns the default 20 URL to the HTTP Server 33 at step 85. The videomap script should follow the well-known rules for a CGI script, i.e., it must accept comm~nrl line arguments from the server and respond with a file that the browser can understand, a filename, or a well-formed HTML page. The HTTP Server 33 then retrieves the data assigned 25 to the returned URL from the internet ~ l?ig. 1).
The data files returned by the HTTP Server can be a document, another videolaudio, or some internet system capability (such as a Gopher menu, Telnet, a File Transfer Protocol, Usenet news, etc.).
W O 97/37497 PCT~US97~4333 As an alternative, the browser can return a map file alias to the Server, which will look up the actual map file in another file.
This will allow the server to hide the actual location of the map file from the viewer and also to easily move the file if mecessary.
Figs. ~ and 6 illustrate another embodiment of the present invention in which the functions of the viewer 31 are incorporated into the browser 32. As shown in Fig. 5, the hardware and s~)rLware are identical to that shown in Fig. 3, except that the viewer 31 is omitted. All of the operations of the hardware and software in the 10 embodiment of Fig. 5 are the same as that described in Fig. 3, with the following exceptions. In the embodiment of Fig. 5, the browser 32 includes the function~lity of playing the full motion video (or other time-based data) on the browser screen 42 (Fig. 6). The user then makes his hyperlink selections directly on the browser 32, 15 which then records the frame, coordinate, URL and VHL (from the .~TV header) information and returns it directly to the HTTP
Server 33.
The operating system 40 (Fig. 6) is the same as is shown in Fig. 4. The browser 32 is operating in the operating system 40 and 20 composes the browser screen 42 for the user. In the browser screen 42, a plug-in viewer 60 is being operated by the browser 32. The plug-in viewer 60 creates the plug-in screen 61 which plays the full motion video directly in the browser screen 42. In the plug-in screen 61, the hyperlinks are present, just as the hyperlinks were 25 present for the videos played by the viewer 31 in :Fig. 3. As a result, the user can click within the plug-in screen 61 on particular objects playing in the video on the screen 61, causing the browser 32 to record the (x,y,t) data for the particular click, send that data to the HTTP Server 33, which transfers it to the script '34, which pulls the 2~i appropriate map 35 and returns the corresporlding URL to the HTTP Server 33. The HTTP Server 33 then obtains the data from the internet (Fig. 1) for the URL and returns that data to the browser 32, which opens screen 43 (Fig. 6) to display the returned 5 data. Again, the screen 43 can be either another browser screen or could be a viewer screen.
An advantage of the embo~liment of Figure 5 over Figure 3 is the m~mo~y space ~equile~ ntQ~ Since the viewer must separate the video from the header in the .btv format, the .btv file must be 10 copied to a separate file for display in the embofliment of Figure 3.
On the other hand, the plug-in embo-liment of Figure 5 has no such re~ui~ e~ent.
Fig. 9 illustrates a utility for converting a standard video file into a .BTV file. As described previously, the .BTV file is simply a 15 .AVI file (or simil~r video file) with an associated header. The information for the he~r~er is shown in Fig. 9 and includes three m~ntl~tory pieces of inform~tion: the aCGI URLn l'the URL where the HTTP Server 33 can find the video map script 34), the amap location" (the file path where the script 34 can find the map 35), 20 and the ~AVI file" (the location of the original, unaltered video file in the .AVI MIME format).
The header may also include a number of options, as shown in Fig. 9. If these options are selected, a~roE,~;ate command lines will be inserted into the .BTV header between the "START" and 25 "END" statements in the example BTV header described above.
The options include pe~ g the local user to pause or stop. With this option, the viewer can allow the user to pause the video, or prevent him from doing so. The options also inchlde starting the video immediately upon receipt, or waiting until the user presses W O 97/37497 PCT~US97/04333 the ~play~ button. Another option specifies whether the video will pause or continue after a click. There are also options for the viewer to ignore clicks (such as to s~nple the number of clicks that are received), and to store and send the (x,y,t) data after any number of clicks ~lesign~te~ Storing a number oiE clicks allows the user to save several clicks and return them in one response, or to return each click as it is rece*ed. The viewer can disallow coInm~n~g such as saving video files or pausing video playings.
This may be valuable for transmitting copyrighted information or 10 for giving tests. The BTV options can also include different looping options for the video, which tell the viewer whether and how to loop the video at the end of a video playing. Finally, a new viewer can be started each time a new video file is retrieved, or the same viewer can stop one video to play a subsequent one. The present 15 invention is not limited to the above-listed options and other options or lesser options will be recognized by those skilled in the art.
The present invention is valuable in a number of different contexts, only a few of which are now described.
Shopping o~er t~e Internet: A ~deo clip (with sound) of sale items can be displayed first by describing categories of products or services. When one is selected, items in that category can be shown in a follow-up clip of video c~ cc~ing menus. An elr~mple could be in the context of resort rentals. An introductory movie could show a 25 fly-by of the resort area, with available houses having the rental agent's logo on the roof. When a user is interested in a house, he could click on the house and receive either a stat;ic page or a walkthrough video describing that house. There may also be overlaid "buttons" on the screen that a user could select at any W O 97137497 PCTrUS97/04333 time. One button may say ~show neighborhood" wrhich would bring up a page, a series of pages, or a custom movie, showing all houses in the neighhorhood on the screen.
Contests: Contests are a good way for bllcinesses to attract 5 ~tt.ontion and possible buyers. There are many ways to adapt the video hyperlink me(~h~ni~mc to contests.
One example is to inte~ ~else a promotional video with a series of brief appearances by an ~nim~te~ mascot. The viewer must click on for example, the mascot's waving arm each time it 10 appears. The clicks are sent back to an alternate video map script, which does not return a page but instead stores a record of how accurate the user was, along with the name, address, etc.
inform~t.;on The winner is the most accurate customer.
Timed ~-~minP~ Some tests, such as psycholoFicP.l tests, 15 require that a person respond quickly, and not think about the answers. A test (spoken or textual) could be presented on screen and the viewer given an a~,o~,iate time to answ er before the next question is presented.
Other tests that may benefit from timed responses include:
~ Intelligence tests ~ Spatial skills tests (selecting a certain feature in an engineering drawing) Memory tests (show a scene, followed by a slightly different scene, and ask the user to find the difference) ~ Observation skills tests (sho~h a clip, then ask questions about the clip) There are many related uses in education, especially in improving skills tested in the previous list.
W 097/37497 PCT~US97104333 Video Aoai~nce: The present invention would be ideal for walking a user through a form or menu. Currently, lengthy text is needed to fully explain each item in a menu in order to keep a user from getting lost. Sometimes long labels need to be associated with each item in a form, to pL~ve~lt wrong information from being entered. This could be replaced vrith a short video expl~inin~ the choices, along with hot spots on the possible choices. The user could select a hot spot at any time, which would stop the video and perhaps start the download of the next one, based on his previous choice.
'rhis might be implemented as an adjunct to current menus or forms, via a ~Novice~ link on the HTML page, so an experienced user would not have to download videos. The Novice link could appear in several places, so an experienced user who needs help in a specific place can use the video ~si~t~n~e. This could be used anywhere an existing menu or form is used. It could also be used for new services, such as an on-line stock market assistant. It has a multitude of uses within a hotel setting, although with a different interface (video remote control, rather than a computer pointjnE
20 device):
~ as an adjunct to video on ~lem~nd ~ as an assistant with video checkout ~ as a hotel services directory, possibly with a telephone tie-in, e.g., someone selects the aConcierge~ and the concierge is notified and a phone link is made ~ to show local maps of restaurants, special events, etc.
Hand~man Helper: This is a promising tool for someone doing a variety of construction tasks, such as home construction or woodworking. Here's an example of how a building project might be 30 implemented:
~ To start, a bill of materials and engineering drawings might be shown on a standard HTML page.
~ A VideoHyperlink would download a walkaround of the fin;Rhed project, or, for a complex project, a series of walkarounds ai'ter different phases of the project.
By using walkarourids, rather than a ~ le~how, the viewer can keep track of what part of the finiRhed product he is seeing.
~ The user could pause the video to ~mine details of the construction and hyperlinks would be embedded at any complex joints or unusual details, that the user could select to get additional details on an HTML page.
This might include details on a particular technique, or a pattern for a woodcarving.
Beyond Netnc~pe: Video Hyperlinks can stand alone, for many applications. A good egample is in the const.ruction manual, shown above. A pre-packaged video and a modified viewer could walk a user through the construction, using the same hyperlinks as above, but using them to jump to other portions oi the video, or to 20 other local video clips. For a large project, or for other training materials, the videos and viewer would be delivered on a CD-ROM.
While the invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not to be 25 limited to the disclosed embodiment, but on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended cl~ums.
In addition to point of presence routers, Commercial Internet ~.~ch~nFes (CIX in Figure 1) and Global Internet F~rrh~nges (GIX
5 in Figure 1) also connect to the backbone routers. These ~ch~nges transfer data between internet service providers nationally and intern~tion~lly. When data originates on one U.S. internet service provider with a destination on another U.S. internet service provider, the data first routes to the Commercial Internet F~ch~n~e 10 where it makes the transfer between providers. A ,simil~r situation occurs when data originates in one country, bound for another country. The data first passes through the Global Internet F.~chz.nge whe~e it is transferred from one provide:r to another.
In theory, still further, even more localized, point of presence 15 routers could connect off of the point of presence routers shown in Figure 1. Typically, however, the point of presence routers (POP1, POP2, POP3, etc.) provide the direct local connection point for various types of computers to connect to the internet.
A common method in which personal home computers 20 connect to the point of presence is through a local internet carrier.
As shown at POP2 in Figure 1, the local internet calTier obtains a direct line to the POP2, and then provides a modern connection for home computer users to dial for connection. When the home computer connects to the modem of the local inter:net carrier, the 2~ carrier switches the computer through to the POP2, which in turn switches it onto the internet backbone.
Another method of connecting computers to the internet is by direct connection through a LAN system to the point of presence.
This example is shown as I.AN#1 and LAN#2 com~lections to, W O g7/37497 PCTAJS97/04333 respectively, POP1 and POP2. Specifically, the LAN connects to the point of presence through a leased data line ~dedicated phone connection). The computers (PCs in Figure 1) are < onnected to the ~AN and receive and tr~n~mit data to the point of presence through 5 the control of the LAN. Also attached to the LAN are a va~iety of di~iel-t servers, three of which are shown in Figure 1. The File Server conn-scts to the LAN and cont~qin~ the commt-n data files used by the PCs, LAN, and other Servers. The HTTP Server processes incoming and outgoing data to and from the internet by 10 assuring that the data is written and received according to certain internet commllnic~tjor protocols, called the HyperText Transport Protocol (HTTP). The Electronic Mail Server processes E-Mail data that is written to or received from the internet.
As shown in Figure 1, the internet provides a conduit 15 essentially interconn~cting every computer on the internet with every other computer on the internet. LAN#1, for example, can provide certain data (called internet pages) from its File Server to the HTTP server to make the pages available to any other computer on the internet. An HTI P Server that makes internet pages 20 available on the internet usually includes a so-called "home page,"
which is the starting point for outside users to navigate through the underlying internet pages serviced by the HTTP Server. When a user, such as the user of the UHome PC" (em~n~t.in~ from POP2 in Figure 1), wants to view a home page, such as LAN#1's home page, 25 it can do so by calling for the data from LAN#1. In response, L.AN#1 pulls the internet page data from its File Server and instructs its HTTP Server to write the data, addressed to Home PC, onto the internet. The data travels from the local ISDN to the POP1, through the internet backbone (and respective routers), W O97/37497 PCT~US97/04333 through the CIX or IIX (if necessary), through POP2, through the local internet carrier, and into the modem of the Home PC. The request for the data from the Home PC to the LAN#1, of course, travels along the opposite path.
To insure that data is sent to and received by the appropriate systems on the internet, every "device" (i.e., PC workstation, HTTP
Server, File Server, etc.), when it is communicating on the internet, has ~R.ci~ne-l to it a unique address, called an IP Address. The IP
Address can be analogized to a personal phone number that can be called by another phone to make a connection (through a series of telephone routers) between them. The IP Address is presently a sixteen bit binary address, which is fine for computers to read, ~ut is cumbersome for a human user to memorize or use. As a result, the IP Addresses are ~si~ned pneumonics to make them more "user-friendly.~ One pnelln onic of particular importance is the "host name," which i8 the IP Address for any HTTP where a home internet page resides (as a result of convention, the host name is usually assigned the pnellmonic WWW ). The IP Address for the internet site (for example, the LAN) supporting the HTTP Server is called a ~domain name.~
~igure 2 shows an address line written in the standard protocol used lby internet components to address each other. The protocol is referred to as a 'IJniform Resource Locator~ (URL) and this terminology appears as the opening argument in the address of 26 Figure 2. In Figure 2, the Uniform Resource Locator indicates that the request is for "~ " formatted data (i.e., a internet page as opposed to, for example, an e-mail message). The home page for the data resides on the "vrww" HTTP Server on the "ucla.edu~ LAN (or WO 97/37497 PCTrJS97/04333 rlom~in). The name of the file (to be found most likely in the File Server supported by the ucla.edu LAN) is ~homepage.htl."
If, for example, the ucla.edu LAN is LAN#1 of Figure 1 and a user of a PC at LAN#2 wants to view the ~homepage.htl" file, the user send~ the address shown in Fi~re 2 to LAN#1 through the internet channels shown in Figure 1. Upon receipt of the address, LAN#1 returns to the user the Uhomepage.htl" file through a reverse path of the internet ~h~nnel~.
Once a user has received an "HTML~ formatted file (any internet page)~ the text of the file may prompt the user to request additional information contained in different internet page files.
The prompts are referred to as Uhypertext~ and usu~lly show up on a home page (or other internet page) in a different color than normal text, thus disting~ hin~ them as hypertext links. As an example, a user requesting a local zoo homepage may see several different hypertext links to files cont~inin~ information on various z~nim~ls at the zoo, a map of the zoo, operating times, etc. By rli~kin~ a computer pointer on the prompt, the user can autom~tir~lly move from a current internet page to a new one.
The computer pointing device can be a Umouse," a touchscreen, a remote control, a light pen, etc.
When the user clicks on a hypertext link, the user's data processor records the position of the computer pointer when the click occurred. The processor then uses a look-up table of x-y 2~ coordinates versus URLs to identify a new URL address assigned to the position of the computer pointer. The URL acldress may be serviced by the same domain or a different one, depending on the info~nation contained in the look-up table. VVhen clicked, a browser (discussed in more detail below) requests a connection to the HTTP
W 097/37497 PCTrUS97/04333 Server hosting the file, and it also requests from the HTTP Server the file identified by the URL. Once the Hl~P Server accepts the connection requested by the browser, the HTTP Server transmits back to the browser the requested file. Once the browser receives 5 the requested file, it delivers or presents the content of the file to the requesting user.
Hypertext links can be assigned to textual i:nformation, such as, in the example of the zoo page, ~ci~ning links to the words "moIlk~y" and ~elephant" appearing on the internet page screen.
10 They can also be assigned to photographs on the internet page screen, such as on a picture of a monkey or an elephant. Then, by placing the point.ing device on the text or picture and clicking the pointing device, the user is taken from a current internet page to a new internet page assigned to the particular text or picture 15 selected. Thus, for example, çlicking on the elephant may take a user from a local zoo page to a page supported by .a elephant conservation association or, alternatively, to another local zoo page cont~;ninE pictures of the elephants kept at the zoo. In either the text or picture ~ mples, the internet page is embedded with 20 specially ~si~n~d ~hot spots," located at x-y coordinates on the page. When the browser detects a pointing device click over a "hotspot", or linked location, it finds the associated URL and sends the filename portion of the URL to the server loca.ted at the domain name portion of the URL. A picture may further be flagged as 25 having a "map" associated with it. If it does, the relative coordinates of the click within the picture are sent to the server as well. The server then determines which page to return, based on the location of the click.
Browsers are used by the internet user at the local PC to convert information received from the HTTP Server into a format that can be displayed by the browser on the video screen (or through the audio speakers) of the PC. The browser is thus an 5 application program that runs on a local PC and acts as a translator of HTML inform~.ion to be presentable at the local PC.
Several ~ e~ellt comm~rcial browsers are available that can be incorporated into the present invention, including, for example, the Netscape Navigator browser.
The browser is also used to recognize clicks on the screen made by a user with the computer pointing device. When the user positions the computer pointing device on a portion of the text of the screen associated with a hypertext link, the browser recognizes the user's action as a request to get a file from a web site identified by 1~ the URL thereby obt~in;ng new data files from an IP address on the internet. Then, as discussed above, when the data is returned from the HTTP Server, the server delivers the data to t:he browser, which tr~n~l~tss it into a format presentable at the PC and presents it to the user.
On occasion, the information that is returned from the HTTP
Server (and subsequently to the browser) is of a type not presentable by the particular browser being used. This occurs, for example, when video data is returned to the browser and the browser does not have the a~pro~,iate application software to 2~ display the video to the PC user. In these instances, the browser enlists a helper application resident on the PC to display the incoming data. For example, when the browser receives video data from the internet, it frequently opens a viewer, which appears as a W 097/37497 PCTrUS97tO4333 window on the screen of the PC user, which will process the incoming video data through the browser and display the video to the user on the PC screen.
SUhl MARy OF T~ INVENTION
Internet pages are not li~nited to text and picture inform~t:ion1 but can include full-motion video, audio, and other time-c~nFin~ data. Traditionally, these types of data are presented to a user via a "viewer" assigned specifically to the task of presenting the time-chP.nging data to the user. Thus, for example, viewers are available for displaying video and playing audio.
l~ull-motion video/audio data files are av~ le on the internet and are usually obtained by a user's Browser program, which automatically opens a viewer program to present the information (i.e., play the video/audio) to the user. Thus, for 1~ example, if a user requests a full-motion video file from a site on the internet, the browser vrill receive the file from the HTTP Server, open a video viewer, and download the video file to the video viewer for display on the screen of the user's data processor (PC). The browser knows which viewer is needed for a particular file based on a Multipurpose Internet Mail Extension (MIME) extension attached to the file name.
Hyperlinks are not embedded in full motion video data, like they are in text and picture data, since to do so would require reworking (for example, re-editing) a video to superimpose the hot spot locations onto the video data. The present invention provides hyperlinks on full-motion video, real-time audio or any other time-based data, without ~ewoll~ing the data file. The hyperlinks WO 97/37497 PCT~US97104333 as~ociated with the present time-based data files are particularly suitable f¢r use on the internet since they permit a user to view a time-based data file ~such as a video), click on a portion of the display, and be moved automatically to another, related, internet 5 page.
For simplicity, this disclosure shall hereafter refer to "video~
data, although the artisan will be able to appreciate that any time-based data can be substituted for the video data described. For instance, a still image, an image representing buttons, etc. can be 10 used as a hot spot area, along with a sound file. When the image is clicked, the time into the sound file is sent, along with the x and y position, to the server According to the present invention, when a user positions a computer pointing device on a moving video and cLicks the pointer, 15 data representing the position of the pointer (x- and y- coordinates) and data representing the time of the click are recorded. A three-~imen~ional lookup table is then consulted to determine which URL
is to be issued for the recorded x-, y-, and time ~limen~ions.
Video data files used by the present invention are not altered 20 in their video data content, but include a header identifying the video data as conforming to the present invention. Any standard, video data can be converted into video data according to the present invention simply by adding the header referred to above and described in greater detail below. A data file that has been 25 converted to include the header is referred to herein as a BTV file since these files have been ~ ed a file name MIME suffix of ".btv" as a convention.
The header also tells the viewer a location where it can find the script or program needed to use the look-up table. It also WO 97/37497 PCT~US97/04333 identifies the location of the three-dimen~ion~l lookup table (also known as the map) associated with the video file and the location of the standard video data (~refelably in .avi format, although any other video format can be used) to be displayed on the viewer.
BRIEF DF~CRIPTION OF T~ D~R~WIN(~.S
The purpose and advantages gained by the present invention will be understood by careful study of the following detailed description of the presently ~fefe~,ed embodiment with particular reference to the accompanying drawings.
FIGURE 1 is a schematic diagram of an internet network;
FIGURE 2 is a internet address breakdown;
FIGURE 3 is a schematic diagram of one embodiment of the present invention;
FIGURE 4 is a schem~l-c diagram of the operating system 1~ and video screen acco, lillg to the embodiment of Figure 3;
FIGURE 5 is a s-~hem~t.ic diagram of another embodiment of the present invention;
FIGURE 6 is a schematic diagram of the operating system and video screen according to the embodiment of Figure 5;
W O 97t37497 PCTrUS97/04333 FIGURE 7 is a flowchart of an example operation of the viewer of Figures 3-6;
FIGURE 8 is a flowchart of an example operation of the video script of Figures 3-6; and FIGURE 9 is a .BTV file he~fler utility according to one aspect of the inventio~
D~T~T-F.n ~ESCR~PTION OF T~
PR~;F~NTLY ~ P ~Rl;.n ~.MRODTM~
The present invention can be realized in a variety of different 10 ways, including in the several embodiments described with respect to Figs. 3 through 9 in the context of the network shown in Fig. 1.
The embodiment of Fig. 3 has a data processor 30, which can be any standard PC having a microprocessor, memory, a video screen, etc., and including a variety of ~oftware components described below.
16 Alternatively, the data processor 30 may be divided into multiple separate hardware components rather than the single hardware component shown in Fig. 3. In the embodiment of Fig. 3, the viewer 31 and the browser 32 are the principal connections between the user and the inform~t.ion on the network (such as that shown in 20 Fig. 1). The present invention is described in connection with the internet of Figure 1 but can be applied to any network of devices, public or private.
In the internet embodiment, in particular, the browser 32 receives information from the internet network ~ia the HTTP
W 097/37497 PCT~US97104333 Server 33 and translates that data from the language used on the internet (called the HTML data format~ into a screen display that the user can recognize. When the browser 32 receives HTML data from the HTTP Server 33 in a MIME format that requires the 5 browser 32 to enlist the assistance of a viewer 31 to display the information to the user, the browser 32 initiates the opening of the viewer 31 and the downloading of the data file to the viewer 31, as shown in Fig. 3. With the data file from the browser 32, the viewer 31 then interprets the data and translates it into a format that the 10 user can sense. Thus, for example, the browser 3 2 may enlist the assistance of the viewer 31 to play a video by opening the viewer 31 and downloading the HTML video data file to the viewer 31. The viewer 31 then translates the video data file into a video screen that the user can watch.
In the embodiment of the present invention shown in Fig. 3, the viewer 31 is a specialized viewer that will accept and process BTV MIME files. The BTV MIME file is a video data file (l~refelably converted from a .avi MIME format) which permits the user to make hyperlink selections in both position and time 20 domains from full motion ndeo that the user watches. Fig. 4 shows the operating system 40, together with the viewe:r 31 and browser 32. Also shown in Fig. 4 are the screens that the user would see when using the browser 32 and viewer 31 in accordance with one aspect of the present invention. In particular, the browser 32 is 25 software, and prepares as part of its routine a screen 42 displaying information for the user to see. .~imil~rly, the viewer 31 is also software and prepares a screen 41 for the user to see.
In the embodiment shown in Fig. 4, the screen 42 of the browser 32 includes a hypertext word that, when clicked on by the W 097/37497 PCT~US97/04333 user, causes the browser 32 to issue a URL request to the HTTP
Server to obtain a data file from some IP address on the internet shown in Fig. 1. In the emborlimçnt of Fig. 4, the URL ~igned to the hypertext in the screen 42 of the bl o~er 32 causes a video data 5 file to be retrieved. When the video data file is received by the browser 32 from the HTTP Server 33 (Fig. 3 or Fig. 1), the browser 32 reco~ni7.e,s from the MIME ~in this case the .BTV MIME), that it needs to open the BTV viewer 31 and download the BIV data file to the viewer 31 for display to the user on the screen 41.
Once the viewer 31 has the BTV file and is displaying it to the viewer, the user is then able to point and click onto portions of the full motion video, which causes the viewer 31 to issue a URL
address to the browser, which requests the filename specified in the URL from the ~om~in in the URL. It also passes on the x, y, and t information (described in more detail below). When the viewer 31 receives the requested data file, the viewer 31 then opens either another browser or another viewer (depending on the MIME type of the hyperlinked data received) to display the data to the user. This display is shown as linked screen 43 in Fig. 4.
The present viewers thus display the data requested by the browser, and in addition, have the processing capabilities necessary to permit a user to hyperlink from some subject matter on the viewer screen 41 to other data from another URI. file to be displayed on linked screen 43. A description of how the viewer 31 operates to permit the user to hyperlink from a screen 41 to a screen 43 follows.
In reference again to Fig. 3, when the user points the pointing device at a particular portion of the video playing on the viewer screen 41 of the viewer 31 ("selection" in Fig. 3), the viewer CA 02246736 l998-08-20 W 097/37497 PCTrUS97/04333 31 sends so-called (x,y,t) data to the browser 32 for proces.qin~ into a URL code. Typically when a user positions a computer point:in~
device at a portion of a browser screen (such as text or a still image~
the browser uses the X and Y coordinates of the pointing device to 5 determine that the user has requested additionalL data originating at a particular URL location. With the viewer 31 of the present invention, however, the video pictures are moving and ~h~n~ing over time causing the X and Y coordinate system to be insufficient for user selections of time-based data files. This happens, for 10 example, because a screen which is showing one subject matter at one moment (on which the user may wish to click and move to a data file related to that particularly displayed subject matter) will be different than the video display on the viewer screen 41 that occurs sometime after the original display. As a result, the user 15 who clicks on an X-Y coordinate at time to will be çlickin~ on a di~rellt picture (or text) than if the user clicks at the exact same X-Y coordinates at a later time tl.
To accommodate the time element of the video display 41 when the user clicks on a particular object, the viewer 31 sends to 20 the browser 32 as part of the (x,y,t) data, the X position of the click, the Y position of the click, and a time element when the click occurred. With video data, the time elem~nt is rnost easily obtained by recording the frame number of the video that is playing. In this embodiment, when the user clicks on a particular spot of the video 25 display, the viewer 31 sends X0, Y0, and to information to the browser 32. If, the user then clicks on exactly the same position on the screen 41 of the viewer 31 at a time tl later, the viewer 31 would then send X0, Y0, and tl information to the browser 32. In the audio embodiment, the time coordinate may be a two-dimensional W 097/37497 PCT~US97104333 item: a tracl~ number and a time from the start of the track. Of course, it might be an actual time, from some fixed starting point (such as midnight) or it may be a variable starting time (such as the beFinnin~ of a selection).
The ~x,y,t) data sent by the viewer 31 to the browser 32 also includes two additional pieces of information: the location of a CGI
script file and the location of a image map file. The viewer 31 obtains these two pieces of infor nz~t.ion from the header on the .BTV
formatted video dsta which it receives from the browser 32.
Alternatively, the browser 32 itself can obtain the CGI scripted file and the video map file from the .BTV he~tler.
The hea~ler, from which the viewer 31 obtair-s the script and map files, is al~ that is added to a video file to convert it into a .BTV
file. The present invention is not limited to any particular video file format, but preferably, the format is the .AVI format. In addition, because the present invention adds just a header to the video data, virtually sny data format can be used. A typical header added to a .AVI formatted video file to convert it into a .BTV video file is as follows:
START-BTV
VER 1.0 IJRL http://host.tl()rn~in/cgi-script V~IL /c/director/image.map END-BTV
2~ Each of the items between the START and END staternents are mandatory att~çhments to the .A~TI file to convert it to a .BTV file.
Additional optional information, such as that collected via the interface shown in Figure 9 (and described in greater detail below), can be included in the heading. The VER statement identifies the CA 02246736 l998-08-20 W 097/37497 PCTrUS97/04333 current program version. The URL statement ident.ifies the locat~on and name of the CGI script that will coordinate the X-Y
coordinates, time coor-lin~tes and image map to return an associated URL address. The VHL statement is the location and 5 name of the image map. The URL and VHL st~tf!ments are the two additional pieces of information that the viewer 31 sends to the browser 32, in addition to the position and time data corresponding to the user's selection.
Once a user makes a selection, the browser 32 then transmits 10 the VHL (from the he~rler), X and Y coor-lin~te.s, and time coordinate to the HTYP Server 33 specified in the CGI URL (from the header). The Hl~P Server 33 uses the URL statement to retrieve the script file 34 from a local file server. The video map script 34 then uses the VHL st~tçment to locate and load the 15 appropriate video map 35 identified by the viewer 31 when the user made the selection. The video map script 34 is prefe~ably a C
language program that takes the X, Y, and time c oordinates from the HTTP Server 33 (originally from the viewer 31), retrieves the appropriate ~HL video map 35 and looks up the coordinate data on 20 the map 35 to retrieve a URL address associated with the selection made by the user on the viewer 31.
The method by which the video map script; 34 conducts this lookup operation can be appreciate~ by consider~ng an example video map filLe, as follows. The map file is created manually using a 2~ MS Windows-based map m~kinE utility to assist in the file creation.
The person originally m~kin~ the map (the "map maker") navigates through a video using the play, step, rewind, etc. buttons, or using a frame number and go to button, to observe the moving objects that occur in the .AVl formatted ~ideo. When a video image appears WO 97t37497 PCT~US97104333 during the course or range of frames, the map maker pauses the video and marks the locations on the video where hyperlinks will be recognized. Using a mapping utility, the ~RiFnment of these hyperlinks (also called hot spots) can be done simply by rlickin~ on the various spots on the video image until all desired hot spots for all desired objects have been logged. Then, the map maker can advance to the next subject matter in the video to which hot spots are to be attached and continue the process.
Importantly, the utility does not alter the video data file 10 itself, but instead creates a map file (which will ult.imz.tely be stored in map 35 of Fig. 3) which records the location of the hot spots for each frame of the video. The following is a sample map file for a video of a comet crossing the face of a moon:
Frame 2 Spot 9 10 25 26 41 moon html Spot 17 18 19 comet.html Default default.html Frame 4 Spot 9 10 25 26 41 moon.html Spot 18 19 20 comet.html Default default.html Frame 6 Spot 9 10 25 26 41 moon.html Spot 19 20 21 comet.html Default default.html (Etc. ~
In the above map file, as the comet moves every two frames, the hot spots associated with the comet change with it. This particular map maker has decided that the hot spots can accurately W 097/37497 PCTrUS97/04333 track the position of the comet on the screen if the hot spots change every two frames. The moon is not moving in this particular video and the remainder of the picture is simply space. Essentially what the above map file provides i9 a series of physical coorrlin~te~ (hot 5 spots) and URLs, grouped by frame number. The following key words appear in the above file:
Frame: marks the last frame for which the group that follows is valid.
Spot: marks the hot spot numbers for a particular object.
Default: marks a default URL if no file is specified for the hot spot selected.
The frame state~nent is in the following format: Frame frame-number, where "frame" is the word and 'Y;rame-number" is the last frame number to which the section following it is valid.
15 Thus, for example, if the first frame statement is ~ame 5, then the argllment~s following that frame statement will be valid for frames 0-5. If the next frame st~ternent is frame 15, then the arguments following frame 15 will be valid for frame 6 through 15.
~ollowing the frame st~tement i~ a series of rect statements 20 and one default statement. The rect and default statements specify the hot spots for the frames greater than the previous frame statement through the current frame-number. The rect statements take the format of: spot hot spots URL where "spot" is the word and the hot spots are the parameters that specify the one or more 25 hot spots that will cause the particular URL to be selected. The hot spots can be X-Y coordinates or can be a series of pre-numbered rectangles, for example, each being 10 x 10 pixels in a grid that covers the video. In the example image map above, the W 097/37497 PCT~US97104333 embodiment of pre-numbered rect~nFles is utilized, as discussed in more detail below.
The default statement is in the format of: Default URL, where ~Default" is the word and URL i~; the URL that is to be 5 returned if none of the previous spot argnment,,s are found. The above sample image map contains each of the above described st~t~men~. Lines 1, 5, and 9 are frame statements indicating that the hot spots are grouped into frames 0-2, 3-4, and 5-6. The three ar~lment~ following each of the frame groupings are, respectively, 10 a spot argument for the moon image, a spot argument for the comet image, and a default statement. The map maker has identified that the moon during frame 0-2 is located in pixel blocks (10 x 10 pixels) 9, 10, 25, 26, and 41. If, during the frame 0-2, the user clicks in any one of those pixel blocks, the URL "moon.html" is to be sent to the HTTP Server. Similarly, if during frame 0-2 any pixel block 17, 18, or 19 is selected, the third line indicates that comet.html is to be sent.
As can be seen in lines 6 and 10, the pixels identifying the location of the moon do not change since the moon is not moving 20 during advances in the video frames. On the other hand, the comet is moving one pixel block per every two frames. Thus, in frames 3 and 4, the comet occupies positions 18, 19 and 20, while in frames 5 and 6 the comet occupies pixel blocks 19, 20 and 21. The map maker has identified each of these pixel blocks as hot spots for the 25 comet during the respectively described frame groups. If the user clicks on any hot spot other than those indicated by the ~spot"
st~tements, the default statement wil] be executed, returning the URL "space.html," in the sample image map described above.
W 097137497 PCTrUS97/04333 The present invention is not lim~ted to the above described map format, but may take any type of for~at in which the X, Y, and time coordinates can be identified for a particular URL. Thus, for example, the map may take the form of.
Frame frame number Spot Hl'TP://URL 36, 37, 38, 52 Default HTTP:/ldefault.URL
(Etc.) In this example, the hot spot identifiers are in the format of: spot URL hot spots. Many other different types of formats can also be utilized to identify the hot spots and time for particular URLs.
What is important is that the script 34 be capable of retrieving the map 35 and rlmnin~ its program on the map data to be able to identify an assigned URL for a particular X/YItime based hot spot.
The script 34 is a C program ~esign~d to take the image map 35 and use the data contained in the map to identify which URL
should be returned for a particular XlY/time set of coordinates. As shown in Fig. 3J the video map script 34 receives the (x,y,t) data (the X, Y, and time coorflin~tes) from the HTTP Server 33 for a particular hot spot selected by the user on the viewer 31. With the (x,y,t) dataJ the video map script 34 takes the ~HL data" received from the header of the .BTV file, uses it to look up the map 35 corresponding to that .BlrV file. The video map script 34 then runs the (x,y,t) data through the map 36 to determine which UR~ should 2~ be returned to the Hl~P Server 33 for issuance onto the internet (Fig. 1) to retrieve the next desired data file.
For example, suppose the BTV viewer 31 is playing a BTV
file having a header of URI.=HTTP://domain.com/script and a V~IL=c:video.map. Furthermore, the video map located at the VHL
location is the video map in the example described above. Then, when the user uses the browser 32 to run the Bl~r file, the browser 32 opens the viewer 31 and begins shov.~ing the video. If, during the 5 third frame of the video showing, the user uses the computer poin~ing device to click on the comet in pixel box number 19, the viewer 31 sends the (x,y,t) information, including the VHL, the CGI
URL, pixel box 19, and frame number 3 to the browser 32, which sends all of the information except the CGI URL to the HTTP
10 Server 33 specified in the tlom~in name portion of the CGI URL.
The server runs the filename portion of the URL, which is the video map script 34.
The video map script 34 uses the VHL to locate the map 35 at the location of C:\video.map, downloads the map 36 and applies 1~ the (x,y,t) information to the map as follows: First, the video map script reads line 1 of the map and identifies that the first group of hot spots is valid only through frame #2. The video map script 34 then moves to line #5 to determine that the next group of frames is valid through frame #4 and thus recognizes that the current (x,y,t~
20 data frame number (3) is within the range of frames from frame 3 through frame 4, thus mzlking the arguments in lines 6, 7 and 8 valid for the current frame. The video map script; 34 then reads line 6 to determine whether the current pixel block (19) falls within the "spot" comm~ntl and reco~ni7es that it does not. The script 34 then 25 goes to line 7 where it recognizes that the line 7 "spot" comm:~nd is valid for pixel 19 and the~ero~e retums the assigned URL
"comet.html" to the HTTP Server 33.
The HTTP Server 33 then issues the URL "comet.html" onto the internet l Fig. 1) to return the data file associated with the WO 97137497 PCT~US97104333 "comet.html" IJRL. When that data has been received, the HTTP
Server 33 returns the data to the browser 32 which reads the MIME of the "comet.html" data and displays the data to the user either on its own screen or by openin~ another viewer (depen-ling 5 on the data MIME).
At the end of the above ~ mple, the user's screen will appear as in Fig. 4 in which the browser 32 is open and rllnning the video on the viewer 31. Also on the screen will be the linked screen 43 which will be playing the acomet.html" display for the user via 10 either the browser or another viewer.
The flowcharts for the above-described operations of the viewers and script are shown in Figs. 7 and 8. In Fig. 7, the operation of the viewer 31 is described and in Fig. 8, the operation of the script 34 is described. In Fig. 7, the viewer 31 is playing data given to it by the browser 32 at step 70 At step 71, the viewer 31 detects whether or not a user has clicked on the viewing screen with a co,ll~uter pointer. If the user has not clicked on the screen, the viewer continues to play the data for the user at step 70. If at step 71, the viewer detects a click by the user, the viewer 31 records at 20 step 72 the frame number of the video during which the click occurred. The viewer 31 then records the positional coordinates of the pointing device when the click occurred, all at step 73. If necessary, at step 74, the viewer 31 then converts the X, Y
coordinate positions into a pixel block or a hot spot--alternatively, 25 the viewer 31 can send the raw X-Y coordinate positions. It then sends the frame information, the hot spot information, the URL and VHL (from the .BTV header) to the browser 32, as shown as the "(x,y,t) data" in Fig. 3. The viewer must interface with the Application Program Interface (API) of the browser being used in W O 97/37497 PCTrUS97/04333 such a way that it can commlmi~t& all of this information to the browser and server in order to get the next hyperlink. The API
connection is platform and l~low~er dependent. For example, on a Microsoft Windows platform, with a Netscape Nangator browser, 5 either DDE (dynamic data e~r~h~n~e) or OLE (object l;nking and embedding) may be used.
Browser 32 then transfers the information to the HTTP
Server 33 which transfers the information to the video map script 34, which operates in accordance with the chart shown in Fig. 8.
10 The video map script 34 receives the (x,y,t) data (the frame, the hot spot and the VHL) at step 80. At step 81, the script 34 reads the VHL address and locates and retrieves the VHL map 35. At step 82, the video map script 34 reads the map and identifies the correct frame group for the f~ame number in the (x,y,t) data. At step 83, 15 the video script 34 tests the hot spot locations to determine if any hot spot locations match the "spot" statements in the identified frame group of the image map. If matching hot spots are identified by the script 34, the ~ igned IJRL is returned to the HTTP Server 33 at step 84. If not, the video map script 34 returns the default 20 URL to the HTTP Server 33 at step 85. The videomap script should follow the well-known rules for a CGI script, i.e., it must accept comm~nrl line arguments from the server and respond with a file that the browser can understand, a filename, or a well-formed HTML page. The HTTP Server 33 then retrieves the data assigned 25 to the returned URL from the internet ~ l?ig. 1).
The data files returned by the HTTP Server can be a document, another videolaudio, or some internet system capability (such as a Gopher menu, Telnet, a File Transfer Protocol, Usenet news, etc.).
W O 97/37497 PCT~US97~4333 As an alternative, the browser can return a map file alias to the Server, which will look up the actual map file in another file.
This will allow the server to hide the actual location of the map file from the viewer and also to easily move the file if mecessary.
Figs. ~ and 6 illustrate another embodiment of the present invention in which the functions of the viewer 31 are incorporated into the browser 32. As shown in Fig. 5, the hardware and s~)rLware are identical to that shown in Fig. 3, except that the viewer 31 is omitted. All of the operations of the hardware and software in the 10 embodiment of Fig. 5 are the same as that described in Fig. 3, with the following exceptions. In the embodiment of Fig. 5, the browser 32 includes the function~lity of playing the full motion video (or other time-based data) on the browser screen 42 (Fig. 6). The user then makes his hyperlink selections directly on the browser 32, 15 which then records the frame, coordinate, URL and VHL (from the .~TV header) information and returns it directly to the HTTP
Server 33.
The operating system 40 (Fig. 6) is the same as is shown in Fig. 4. The browser 32 is operating in the operating system 40 and 20 composes the browser screen 42 for the user. In the browser screen 42, a plug-in viewer 60 is being operated by the browser 32. The plug-in viewer 60 creates the plug-in screen 61 which plays the full motion video directly in the browser screen 42. In the plug-in screen 61, the hyperlinks are present, just as the hyperlinks were 25 present for the videos played by the viewer 31 in :Fig. 3. As a result, the user can click within the plug-in screen 61 on particular objects playing in the video on the screen 61, causing the browser 32 to record the (x,y,t) data for the particular click, send that data to the HTTP Server 33, which transfers it to the script '34, which pulls the 2~i appropriate map 35 and returns the corresporlding URL to the HTTP Server 33. The HTTP Server 33 then obtains the data from the internet (Fig. 1) for the URL and returns that data to the browser 32, which opens screen 43 (Fig. 6) to display the returned 5 data. Again, the screen 43 can be either another browser screen or could be a viewer screen.
An advantage of the embo~liment of Figure 5 over Figure 3 is the m~mo~y space ~equile~ ntQ~ Since the viewer must separate the video from the header in the .btv format, the .btv file must be 10 copied to a separate file for display in the embofliment of Figure 3.
On the other hand, the plug-in embo-liment of Figure 5 has no such re~ui~ e~ent.
Fig. 9 illustrates a utility for converting a standard video file into a .BTV file. As described previously, the .BTV file is simply a 15 .AVI file (or simil~r video file) with an associated header. The information for the he~r~er is shown in Fig. 9 and includes three m~ntl~tory pieces of inform~tion: the aCGI URLn l'the URL where the HTTP Server 33 can find the video map script 34), the amap location" (the file path where the script 34 can find the map 35), 20 and the ~AVI file" (the location of the original, unaltered video file in the .AVI MIME format).
The header may also include a number of options, as shown in Fig. 9. If these options are selected, a~roE,~;ate command lines will be inserted into the .BTV header between the "START" and 25 "END" statements in the example BTV header described above.
The options include pe~ g the local user to pause or stop. With this option, the viewer can allow the user to pause the video, or prevent him from doing so. The options also inchlde starting the video immediately upon receipt, or waiting until the user presses W O 97/37497 PCT~US97/04333 the ~play~ button. Another option specifies whether the video will pause or continue after a click. There are also options for the viewer to ignore clicks (such as to s~nple the number of clicks that are received), and to store and send the (x,y,t) data after any number of clicks ~lesign~te~ Storing a number oiE clicks allows the user to save several clicks and return them in one response, or to return each click as it is rece*ed. The viewer can disallow coInm~n~g such as saving video files or pausing video playings.
This may be valuable for transmitting copyrighted information or 10 for giving tests. The BTV options can also include different looping options for the video, which tell the viewer whether and how to loop the video at the end of a video playing. Finally, a new viewer can be started each time a new video file is retrieved, or the same viewer can stop one video to play a subsequent one. The present 15 invention is not limited to the above-listed options and other options or lesser options will be recognized by those skilled in the art.
The present invention is valuable in a number of different contexts, only a few of which are now described.
Shopping o~er t~e Internet: A ~deo clip (with sound) of sale items can be displayed first by describing categories of products or services. When one is selected, items in that category can be shown in a follow-up clip of video c~ cc~ing menus. An elr~mple could be in the context of resort rentals. An introductory movie could show a 25 fly-by of the resort area, with available houses having the rental agent's logo on the roof. When a user is interested in a house, he could click on the house and receive either a stat;ic page or a walkthrough video describing that house. There may also be overlaid "buttons" on the screen that a user could select at any W O 97137497 PCTrUS97/04333 time. One button may say ~show neighborhood" wrhich would bring up a page, a series of pages, or a custom movie, showing all houses in the neighhorhood on the screen.
Contests: Contests are a good way for bllcinesses to attract 5 ~tt.ontion and possible buyers. There are many ways to adapt the video hyperlink me(~h~ni~mc to contests.
One example is to inte~ ~else a promotional video with a series of brief appearances by an ~nim~te~ mascot. The viewer must click on for example, the mascot's waving arm each time it 10 appears. The clicks are sent back to an alternate video map script, which does not return a page but instead stores a record of how accurate the user was, along with the name, address, etc.
inform~t.;on The winner is the most accurate customer.
Timed ~-~minP~ Some tests, such as psycholoFicP.l tests, 15 require that a person respond quickly, and not think about the answers. A test (spoken or textual) could be presented on screen and the viewer given an a~,o~,iate time to answ er before the next question is presented.
Other tests that may benefit from timed responses include:
~ Intelligence tests ~ Spatial skills tests (selecting a certain feature in an engineering drawing) Memory tests (show a scene, followed by a slightly different scene, and ask the user to find the difference) ~ Observation skills tests (sho~h a clip, then ask questions about the clip) There are many related uses in education, especially in improving skills tested in the previous list.
W 097/37497 PCT~US97104333 Video Aoai~nce: The present invention would be ideal for walking a user through a form or menu. Currently, lengthy text is needed to fully explain each item in a menu in order to keep a user from getting lost. Sometimes long labels need to be associated with each item in a form, to pL~ve~lt wrong information from being entered. This could be replaced vrith a short video expl~inin~ the choices, along with hot spots on the possible choices. The user could select a hot spot at any time, which would stop the video and perhaps start the download of the next one, based on his previous choice.
'rhis might be implemented as an adjunct to current menus or forms, via a ~Novice~ link on the HTML page, so an experienced user would not have to download videos. The Novice link could appear in several places, so an experienced user who needs help in a specific place can use the video ~si~t~n~e. This could be used anywhere an existing menu or form is used. It could also be used for new services, such as an on-line stock market assistant. It has a multitude of uses within a hotel setting, although with a different interface (video remote control, rather than a computer pointjnE
20 device):
~ as an adjunct to video on ~lem~nd ~ as an assistant with video checkout ~ as a hotel services directory, possibly with a telephone tie-in, e.g., someone selects the aConcierge~ and the concierge is notified and a phone link is made ~ to show local maps of restaurants, special events, etc.
Hand~man Helper: This is a promising tool for someone doing a variety of construction tasks, such as home construction or woodworking. Here's an example of how a building project might be 30 implemented:
~ To start, a bill of materials and engineering drawings might be shown on a standard HTML page.
~ A VideoHyperlink would download a walkaround of the fin;Rhed project, or, for a complex project, a series of walkarounds ai'ter different phases of the project.
By using walkarourids, rather than a ~ le~how, the viewer can keep track of what part of the finiRhed product he is seeing.
~ The user could pause the video to ~mine details of the construction and hyperlinks would be embedded at any complex joints or unusual details, that the user could select to get additional details on an HTML page.
This might include details on a particular technique, or a pattern for a woodcarving.
Beyond Netnc~pe: Video Hyperlinks can stand alone, for many applications. A good egample is in the const.ruction manual, shown above. A pre-packaged video and a modified viewer could walk a user through the construction, using the same hyperlinks as above, but using them to jump to other portions oi the video, or to 20 other local video clips. For a large project, or for other training materials, the videos and viewer would be delivered on a CD-ROM.
While the invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not to be 25 limited to the disclosed embodiment, but on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended cl~ums.
Claims (15)
1. A video viewer for use by a user on a data processor associated with a video screen, the data processor communicating on a network via a network server, comprising:
a video player application to play a video data set on the video screen, including, a header application to read a header associated with the video data set to identify a video map address on the network corresponding to the video data on the video screen, the video map address identifying a video map including:
a plurality of frame groups each including:
data identifying a set of video frames from the video data on the video screen, a set of physical coordinates corresponding to a portion of the video data in the set of video frames, and a network address corresponding to the set of physical coordinates; and a recording application to record, when prompted on the video screen by the user during the playing of the video data set, coordinate data including data identifying where said prompt occurred on the video screen and when said prompt occurred on the video screen; and a communication application to 1) communicate the recorded coordinate data and the video map address to the network server, and 2) receive and display data returned by the network server in response to the recorded coordinate data and the video map address.
a video player application to play a video data set on the video screen, including, a header application to read a header associated with the video data set to identify a video map address on the network corresponding to the video data on the video screen, the video map address identifying a video map including:
a plurality of frame groups each including:
data identifying a set of video frames from the video data on the video screen, a set of physical coordinates corresponding to a portion of the video data in the set of video frames, and a network address corresponding to the set of physical coordinates; and a recording application to record, when prompted on the video screen by the user during the playing of the video data set, coordinate data including data identifying where said prompt occurred on the video screen and when said prompt occurred on the video screen; and a communication application to 1) communicate the recorded coordinate data and the video map address to the network server, and 2) receive and display data returned by the network server in response to the recorded coordinate data and the video map address.
2. A video viewer as in claim 1, further including:
a browser application for communicating with the network server and for translating information received from the network server into a pattern on the video screen.
a browser application for communicating with the network server and for translating information received from the network server into a pattern on the video screen.
3. A video viewer as in claim 1, wherein the prompts are received from a computer pointing device identifying HTML-formatted hyperlinks.
4. A video viewer as in claim 1 further including:
a script application 1) for looking up the recorded coordinate data on the map file and 2) for issuing to the network server, based on the look-up, a network address corresponding to the recorded coordinate data.
a script application 1) for looking up the recorded coordinate data on the map file and 2) for issuing to the network server, based on the look-up, a network address corresponding to the recorded coordinate data.
5. A video viewer as in claim 1, wherein the video map is located in the data processor.
6. A video data set for use on a network browser running on a data processor having memory and a video screen and communicating on a network, comprising:
video information for loading into the memory for display on the network browser; and an address header identifying a location on the network of a map file corresponding to the video information, said map file comprising:
a plurality of frame groups each including:
data identifying a set of video frames from the video information, a set of physical coordinates corresponding to a portion of the video information in the set of video frames, and a network address corresponding to the set of physical coordinates.
video information for loading into the memory for display on the network browser; and an address header identifying a location on the network of a map file corresponding to the video information, said map file comprising:
a plurality of frame groups each including:
data identifying a set of video frames from the video information, a set of physical coordinates corresponding to a portion of the video information in the set of video frames, and a network address corresponding to the set of physical coordinates.
7. A video data set as in claim 6, wherein the address header further includes a location of a script to read the map file and to coordinate a set of physical coordinates and a video frame with said frame groups in said map file.
8. A video data set as in claim 6, wherein at least one frame group includes a plurality of sets of physical coordinates on said video screen corresponding to a plurality of portions of the video information in the set of video frames.
9. A data processing system for a user, having a microprocessor, memory, and a video screen, the system for communicating on a network of devices having associated device addresses and using a network language to hyperlink between said devices, comprising;
a network server, in electrical communication with the network to 1) deliver device addresses onto the network and 2) accept data from said network in response to the delivered device addresses;
a file server, in electrical communication with the network server, containing, at a map file address, a map file for a video data set, including:
a plurality of frame groups each including:
data identifying a set of video frames, a set of physical coordinates identifying locations where said hyperlinks. reside for the set; of video frames, and a device address corresponding to the set of physical coordinates;
a browser application, run by the microprocessor, to translate said network language into a pattern on said video screen;
a viewer application, run by the microprocessor, in communication with said browser application to 1) display the video data set on the video screen, 2) read the map file address from said video data, 3) when prompted by said user, record coordinate data including physical coordinates on the video screen where the prompt occurred and a time coordinate when the prompt occurred, and 4) return the recorded coordinate data and the map file address to the network server;
a script application, called by the browser application, to 1) receive the map file and recorded coordinate data, and 2) return a device address from. said map file based on the recorded coordinate data to the network server;
whereby the network server delivers to the network the device address received from the script application, and receives from the network and delivers to the browser the data corresponding to the device address received from the script application, and whereby the browser translates the data corresponding to the device address from said map file into a pattern on said video screen.
a network server, in electrical communication with the network to 1) deliver device addresses onto the network and 2) accept data from said network in response to the delivered device addresses;
a file server, in electrical communication with the network server, containing, at a map file address, a map file for a video data set, including:
a plurality of frame groups each including:
data identifying a set of video frames, a set of physical coordinates identifying locations where said hyperlinks. reside for the set; of video frames, and a device address corresponding to the set of physical coordinates;
a browser application, run by the microprocessor, to translate said network language into a pattern on said video screen;
a viewer application, run by the microprocessor, in communication with said browser application to 1) display the video data set on the video screen, 2) read the map file address from said video data, 3) when prompted by said user, record coordinate data including physical coordinates on the video screen where the prompt occurred and a time coordinate when the prompt occurred, and 4) return the recorded coordinate data and the map file address to the network server;
a script application, called by the browser application, to 1) receive the map file and recorded coordinate data, and 2) return a device address from. said map file based on the recorded coordinate data to the network server;
whereby the network server delivers to the network the device address received from the script application, and receives from the network and delivers to the browser the data corresponding to the device address received from the script application, and whereby the browser translates the data corresponding to the device address from said map file into a pattern on said video screen.
10. A system according to claim 9, wherein. the viewer application also returns a device address associated with said script application.
11. A system according to claim 10, wherein the script application resides on a different device address than does the viewer application.
12. A system according to claim 9, wherein the viewer application and the browser application are combined into a single application.
13. A system according to claim 9, wherein the script application retrieves the map from the file server.
14. A system according to claim 9, wherein the browser uses another viewer application to display the data corresponding to the device address from said map file into a pattern on the video screen.
15. A system according to claim 9, wherein the map file address read by the viewer application is an alias used by the network server to obtain the map file received by the script application.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US08/624,224 US5918012A (en) | 1996-03-29 | 1996-03-29 | Hyperlinking time-based data files |
US08/624,224 | 1996-03-29 | ||
PCT/US1997/004333 WO1997037497A1 (en) | 1996-03-29 | 1997-03-19 | Video hyperlinks |
Publications (2)
Publication Number | Publication Date |
---|---|
CA2246736A1 CA2246736A1 (en) | 1997-10-09 |
CA2246736C true CA2246736C (en) | 2001-10-16 |
Family
ID=24501157
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA002246736A Expired - Fee Related CA2246736C (en) | 1996-03-29 | 1997-03-19 | Video hyperlinks |
Country Status (8)
Country | Link |
---|---|
US (1) | US5918012A (en) |
EP (1) | EP0891675B1 (en) |
JP (1) | JP2001519974A (en) |
AU (1) | AU2333397A (en) |
CA (1) | CA2246736C (en) |
DE (1) | DE69738449T2 (en) |
ES (1) | ES2300112T3 (en) |
WO (1) | WO1997037497A1 (en) |
Families Citing this family (164)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6240555B1 (en) * | 1996-03-29 | 2001-05-29 | Microsoft Corporation | Interactive entertainment system for presenting supplemental interactive content together with continuous video programs |
US6025837A (en) | 1996-03-29 | 2000-02-15 | Micrsoft Corporation | Electronic program guide with hyperlinks to target resources |
US5961603A (en) * | 1996-04-10 | 1999-10-05 | Worldgate Communications, Inc. | Access system and method for providing interactive access to an information source through a networked distribution system |
US6108655A (en) * | 1996-07-19 | 2000-08-22 | Cisco Technology, Inc. | Method and apparatus for transmitting images and other objects over a computer network system |
US6570587B1 (en) * | 1996-07-26 | 2003-05-27 | Veon Ltd. | System and method and linking information to a video |
US7155451B1 (en) * | 1996-09-03 | 2006-12-26 | Torres Damon C | Automated browsing system for publishers and users on networks serving internet and remote devices |
US6377978B1 (en) | 1996-09-13 | 2002-04-23 | Planetweb, Inc. | Dynamic downloading of hypertext electronic mail messages |
US6584498B2 (en) | 1996-09-13 | 2003-06-24 | Planet Web, Inc. | Dynamic preloading of web pages |
US5774666A (en) * | 1996-10-18 | 1998-06-30 | Silicon Graphics, Inc. | System and method for displaying uniform network resource locators embedded in time-based medium |
CN1110190C (en) * | 1996-11-01 | 2003-05-28 | 国际商业机器公司 | Indicating method of heat connection in visual frequency |
US6078951A (en) * | 1996-11-27 | 2000-06-20 | Intel Corporation | Method and apparatus for automating a software delivery system by locating, downloading, installing, and upgrading of viewer software |
US6421726B1 (en) * | 1997-03-14 | 2002-07-16 | Akamai Technologies, Inc. | System and method for selection and retrieval of diverse types of video data on a computer network |
US6209028B1 (en) | 1997-03-21 | 2001-03-27 | Walker Digital, Llc | System and method for supplying supplemental audio information for broadcast television programs |
GB2325537B8 (en) * | 1997-03-31 | 2000-01-31 | Microsoft Corp | Query-based electronic program guide |
WO1998044435A1 (en) * | 1997-04-02 | 1998-10-08 | International Business Machines Corporation | Method and apparatus for integrating hyperlinks in video |
US6070185A (en) * | 1997-05-02 | 2000-05-30 | Lucent Technologies Inc. | Technique for obtaining information and services over a communication network |
US6353929B1 (en) * | 1997-06-23 | 2002-03-05 | One River Worldtrek, Inc. | Cooperative system for measuring electronic media |
US6018774A (en) | 1997-07-03 | 2000-01-25 | Yobaby Productions, Llc | Method and system for creating messages including image information |
US6567980B1 (en) * | 1997-08-14 | 2003-05-20 | Virage, Inc. | Video cataloger system with hyperlinked output |
US6360234B2 (en) * | 1997-08-14 | 2002-03-19 | Virage, Inc. | Video cataloger system with synchronized encoders |
US7325077B1 (en) * | 1997-08-21 | 2008-01-29 | Beryl Technical Assays Llc | Miniclient for internet appliance |
US6564250B1 (en) | 1997-08-21 | 2003-05-13 | Planetweb, Inc. | Miniclient for internet appliance |
US6542923B2 (en) | 1997-08-21 | 2003-04-01 | Planet Web, Inc. | Active electronic mail |
JP2001515246A (en) * | 1997-09-02 | 2001-09-18 | トーレス、デイモン、シー. | Automated content scheduling and display devices |
US6684211B1 (en) * | 1998-04-01 | 2004-01-27 | Planetweb, Inc. | Multimedia communication and presentation |
US6426778B1 (en) * | 1998-04-03 | 2002-07-30 | Avid Technology, Inc. | System and method for providing interactive components in motion video |
US7139970B2 (en) | 1998-04-10 | 2006-11-21 | Adobe Systems Incorporated | Assigning a hot spot in an electronic artwork |
JP4064060B2 (en) | 1998-05-15 | 2008-03-19 | ユニキャスト・コミュニケーションズ・コーポレイション | Technology for implementing network-distributed interstitial web advertisements that are initiated by the browser and invisible to the user using ad tags embedded in reference web pages |
AU4196299A (en) * | 1998-05-23 | 1999-12-13 | Eolas Technologies, Incorporated | Identification of features of multi-dimensional image data in hypermedia systems |
US6154771A (en) * | 1998-06-01 | 2000-11-28 | Mediastra, Inc. | Real-time receipt, decompression and play of compressed streaming video/hypervideo; with thumbnail display of past scenes and with replay, hyperlinking and/or recording permissively intiated retrospectively |
JP2000029905A (en) * | 1998-07-10 | 2000-01-28 | Aoyama Planning Arts:Kk | Media link system |
US7536706B1 (en) * | 1998-08-24 | 2009-05-19 | Sharp Laboratories Of America, Inc. | Information enhanced audio video encoding system |
US6833865B1 (en) * | 1998-09-01 | 2004-12-21 | Virage, Inc. | Embedded metadata engines in digital capture devices |
US6286031B1 (en) * | 1999-01-21 | 2001-09-04 | Jerry Richard Waese | Scalable multimedia distribution method using client pull to retrieve objects in a client-specific multimedia list |
FI106322B (en) * | 1999-02-02 | 2001-01-15 | Ericsson Telefon Ab L M | Addressing in the Internet |
US6693649B1 (en) | 1999-05-27 | 2004-02-17 | International Business Machines Corporation | System and method for unifying hotspots subject to non-linear transformation and interpolation in heterogeneous media representations |
US6988138B1 (en) | 1999-06-30 | 2006-01-17 | Blackboard Inc. | Internet-based education support system and methods |
US7908602B2 (en) | 1999-06-30 | 2011-03-15 | Blackboard Inc. | Internet-based education support system, method and medium providing security attributes in modular, extensible components |
AUPQ312299A0 (en) * | 1999-09-27 | 1999-10-21 | Canon Kabushiki Kaisha | Method and system for addressing audio-visual content fragments |
US7325245B1 (en) | 1999-09-30 | 2008-01-29 | Intel Corporation | Linking to video information |
US7139813B1 (en) | 1999-11-01 | 2006-11-21 | Nokia Networks Oy | Timedependent hyperlink system in videocontent |
US6856331B2 (en) | 1999-11-12 | 2005-02-15 | International Business Machines Corporation | System and method of enriching non-linkable media representations in a network by enabling an overlying hotlink canvas |
US6848004B1 (en) | 1999-11-23 | 2005-01-25 | International Business Machines Corporation | System and method for adaptive delivery of rich media content to a user in a network based on real time bandwidth measurement & prediction according to available user bandwidth |
EP1107128A1 (en) * | 1999-12-03 | 2001-06-13 | Hyundai Electronics Industries Co., Ltd. | Apparatus and method for checking the validity of links in a computer network |
US7057612B2 (en) * | 2000-01-12 | 2006-06-06 | Balfour Technologies Llc | Method and system for a four-dimensional temporal visualization data browser |
US7057635B1 (en) * | 2000-01-27 | 2006-06-06 | Atheros Communications, Inc. | High-speed RF link for a multi-user meeting |
US20020016969A1 (en) * | 2000-02-03 | 2002-02-07 | International Business Machines Corporation | Media on demand system and method |
US7343617B1 (en) | 2000-02-29 | 2008-03-11 | Goldpocket Interactive, Inc. | Method and apparatus for interaction with hyperlinks in a television broadcast |
US7120924B1 (en) | 2000-02-29 | 2006-10-10 | Goldpocket Interactive, Inc. | Method and apparatus for receiving a hyperlinked television broadcast |
US7367042B1 (en) * | 2000-02-29 | 2008-04-29 | Goldpocket Interactive, Inc. | Method and apparatus for hyperlinking in a television broadcast |
US7320025B1 (en) | 2002-03-18 | 2008-01-15 | Music Choice | Systems and methods for providing a broadcast entertainment service and an on-demand entertainment service |
US7200640B1 (en) | 2000-03-16 | 2007-04-03 | Cole James M | Continuously tunable, graphic internet navigation tool |
JP2001282857A (en) * | 2000-03-31 | 2001-10-12 | Aoyama Planning Arts:Kk | Multimedia link system |
US7962948B1 (en) | 2000-04-07 | 2011-06-14 | Virage, Inc. | Video-enabled community building |
US8171509B1 (en) | 2000-04-07 | 2012-05-01 | Virage, Inc. | System and method for applying a database to video multimedia |
US7222163B1 (en) * | 2000-04-07 | 2007-05-22 | Virage, Inc. | System and method for hosting of video content over a network |
US7260564B1 (en) * | 2000-04-07 | 2007-08-21 | Virage, Inc. | Network video guide and spidering |
US7475404B2 (en) | 2000-05-18 | 2009-01-06 | Maquis Techtrix Llc | System and method for implementing click-through for browser executed software including ad proxy and proxy cookie caching |
US8086697B2 (en) | 2005-06-28 | 2011-12-27 | Claria Innovations, Llc | Techniques for displaying impressions in documents delivered over a computer network |
US20050050163A1 (en) * | 2000-05-24 | 2005-03-03 | Cole James M. | Continuously tunable, graphic internet navigation tool |
US7162696B2 (en) * | 2000-06-08 | 2007-01-09 | Franz Wakefield | Method and system for creating, using and modifying multifunctional website hot spots |
US20060122917A1 (en) * | 2000-08-14 | 2006-06-08 | Urbanpixel Inc | Real-time collaborative commerce in a multiple browser environment |
US7512665B1 (en) * | 2000-08-17 | 2009-03-31 | International Business Machines Corporation | Chained uniform resource locators |
TW528967B (en) | 2000-08-29 | 2003-04-21 | Ibm | System and method for locating on a physical document items referenced in an electronic document |
TW494323B (en) * | 2000-08-29 | 2002-07-11 | Ibm | System and method for locating on a physical document items referenced in another physical document |
WO2002019719A1 (en) * | 2000-08-30 | 2002-03-07 | Watchpoint Media, Inc. | A method and apparatus for hyperlinking in a television broadcast |
US7207006B1 (en) * | 2000-09-01 | 2007-04-17 | International Business Machines Corporation | Run-time hypervideo hyperlink indicator options in hypervideo players |
US20020128999A1 (en) | 2000-09-25 | 2002-09-12 | Fuisz Richard C. | Method, apparatus and system for providing access to product data |
US6804700B1 (en) * | 2000-10-04 | 2004-10-12 | Microsoft Corporation | Methods and systems for assigning human-readable and unique uniform resource locators to objects |
US6693648B1 (en) * | 2000-11-22 | 2004-02-17 | Campus Crusade For Christ, Inc. | Pointer interactive apparatus |
US20020083006A1 (en) * | 2000-12-14 | 2002-06-27 | Intertainer, Inc. | Systems and methods for delivering media content |
US7870592B2 (en) | 2000-12-14 | 2011-01-11 | Intertainer, Inc. | Method for interactive video content programming |
JP2002207774A (en) * | 2001-01-10 | 2002-07-26 | Nec Corp | Internet dynamic image link system |
US7116682B1 (en) * | 2001-03-19 | 2006-10-03 | Cisco Technology, Inc. | Methods and apparatus for dynamic bandwidth adjustment |
US6925469B2 (en) * | 2001-03-30 | 2005-08-02 | Intertainer, Inc. | Digital entertainment service platform |
US20020144283A1 (en) * | 2001-03-30 | 2002-10-03 | Intertainer, Inc. | Content distribution system |
US20020161909A1 (en) * | 2001-04-27 | 2002-10-31 | Jeremy White | Synchronizing hotspot link information with non-proprietary streaming video |
JP2002335518A (en) * | 2001-05-09 | 2002-11-22 | Fujitsu Ltd | Control unit for controlling display, server and program |
US20030110272A1 (en) * | 2001-12-11 | 2003-06-12 | Du Castel Bertrand | System and method for filtering content |
US20030117378A1 (en) | 2001-12-21 | 2003-06-26 | International Business Machines Corporation | Device and system for retrieving and displaying handwritten annotations |
KR100804519B1 (en) * | 2002-10-10 | 2008-02-20 | 인터내셔널 비지네스 머신즈 코포레이션 | System and method for selecting, ordering and accessing copyrighted information from physical documents |
US7603341B2 (en) | 2002-11-05 | 2009-10-13 | Claria Corporation | Updating the content of a presentation vehicle in a computer network |
DE10255831A1 (en) * | 2002-11-29 | 2004-06-09 | Supernovae Gmbh & Co. Kg | Automatic selection, allocation, storage, evaluation of identified objects/symbols/locations from messages/recordings involves determining transmission/recording time profile using time marks, tables |
US20040143848A1 (en) * | 2003-01-17 | 2004-07-22 | Kerri Yu Kwok Ying | Method of organizing and playing back multimedia files stored in a data storage media and a data storage media stored with such multimedia files |
KR100513294B1 (en) * | 2003-04-09 | 2005-09-09 | 삼성전자주식회사 | Method, apparatus and system for providing information of an object included in multimedia content |
US7310779B2 (en) | 2003-06-26 | 2007-12-18 | International Business Machines Corporation | Method for creating and selecting active regions on physical documents |
EP1503299A1 (en) * | 2003-07-31 | 2005-02-02 | Alcatel | A method, a hypermedia communication system, a hypermedia server, a hypermedia client, and computer software products for accessing, distributing, and presenting hypermedia documents |
US8745222B2 (en) * | 2003-08-15 | 2014-06-03 | Blackboard Inc. | Content system and associated methods |
KR101102639B1 (en) * | 2003-11-12 | 2012-01-04 | 파나소닉 주식회사 | Recording medium, playback apparatus and method, recording method, and computer-readable medium |
US8078602B2 (en) | 2004-12-17 | 2011-12-13 | Claria Innovations, Llc | Search engine for a computer network |
US8255413B2 (en) | 2004-08-19 | 2012-08-28 | Carhamm Ltd., Llc | Method and apparatus for responding to request for information-personalization |
US8600989B2 (en) | 2004-10-01 | 2013-12-03 | Ricoh Co., Ltd. | Method and system for image matching in a mixed media environment |
US8184155B2 (en) | 2007-07-11 | 2012-05-22 | Ricoh Co. Ltd. | Recognition and tracking using invisible junctions |
US8276088B2 (en) | 2007-07-11 | 2012-09-25 | Ricoh Co., Ltd. | User interface for three-dimensional navigation |
US8385589B2 (en) | 2008-05-15 | 2013-02-26 | Berna Erol | Web-based content detection in images, extraction and recognition |
US9530050B1 (en) | 2007-07-11 | 2016-12-27 | Ricoh Co., Ltd. | Document annotation sharing |
US7970171B2 (en) | 2007-01-18 | 2011-06-28 | Ricoh Co., Ltd. | Synthetic image and video generation from ground truth data |
US8086038B2 (en) | 2007-07-11 | 2011-12-27 | Ricoh Co., Ltd. | Invisible junction features for patch recognition |
US8156427B2 (en) | 2005-08-23 | 2012-04-10 | Ricoh Co. Ltd. | User interface for mixed media reality |
US9373029B2 (en) | 2007-07-11 | 2016-06-21 | Ricoh Co., Ltd. | Invisible junction feature recognition for document security or annotation |
US7812986B2 (en) * | 2005-08-23 | 2010-10-12 | Ricoh Co. Ltd. | System and methods for use of voice mail and email in a mixed media environment |
US9171202B2 (en) | 2005-08-23 | 2015-10-27 | Ricoh Co., Ltd. | Data organization and access for mixed media document system |
US8856108B2 (en) | 2006-07-31 | 2014-10-07 | Ricoh Co., Ltd. | Combining results of image retrieval processes |
US9405751B2 (en) | 2005-08-23 | 2016-08-02 | Ricoh Co., Ltd. | Database for mixed media document system |
US8144921B2 (en) | 2007-07-11 | 2012-03-27 | Ricoh Co., Ltd. | Information retrieval using invisible junctions and geometric constraints |
US8521737B2 (en) | 2004-10-01 | 2013-08-27 | Ricoh Co., Ltd. | Method and system for multi-tier image matching in a mixed media environment |
US8156116B2 (en) | 2006-07-31 | 2012-04-10 | Ricoh Co., Ltd | Dynamic presentation of targeted information in a mixed media reality recognition system |
US7702673B2 (en) | 2004-10-01 | 2010-04-20 | Ricoh Co., Ltd. | System and methods for creation and use of a mixed media environment |
US8332401B2 (en) | 2004-10-01 | 2012-12-11 | Ricoh Co., Ltd | Method and system for position-based image matching in a mixed media environment |
US8949287B2 (en) | 2005-08-23 | 2015-02-03 | Ricoh Co., Ltd. | Embedding hot spots in imaged documents |
US8369655B2 (en) | 2006-07-31 | 2013-02-05 | Ricoh Co., Ltd. | Mixed media reality recognition using multiple specialized indexes |
US8825682B2 (en) | 2006-07-31 | 2014-09-02 | Ricoh Co., Ltd. | Architecture for mixed media reality retrieval of locations and registration of images |
US8156115B1 (en) | 2007-07-11 | 2012-04-10 | Ricoh Co. Ltd. | Document-based networking with mixed media reality |
US8195659B2 (en) * | 2005-08-23 | 2012-06-05 | Ricoh Co. Ltd. | Integration and use of mixed media documents |
US8838591B2 (en) | 2005-08-23 | 2014-09-16 | Ricoh Co., Ltd. | Embedding hot spots in electronic documents |
US8176054B2 (en) | 2007-07-12 | 2012-05-08 | Ricoh Co. Ltd | Retrieving electronic documents by converting them to synthetic text |
US8868555B2 (en) | 2006-07-31 | 2014-10-21 | Ricoh Co., Ltd. | Computation of a recongnizability score (quality predictor) for image retrieval |
US8510283B2 (en) | 2006-07-31 | 2013-08-13 | Ricoh Co., Ltd. | Automatic adaption of an image recognition system to image capture devices |
US8335789B2 (en) | 2004-10-01 | 2012-12-18 | Ricoh Co., Ltd. | Method and system for document fingerprint matching in a mixed media environment |
US9384619B2 (en) | 2006-07-31 | 2016-07-05 | Ricoh Co., Ltd. | Searching media content for objects specified using identifiers |
US7693863B2 (en) | 2004-12-20 | 2010-04-06 | Claria Corporation | Method and device for publishing cross-network user behavioral data |
GB2423841A (en) * | 2005-03-04 | 2006-09-06 | Mackenzie Ward Res Ltd | Method and apparatus for conveying audio and/or visual material |
US8073866B2 (en) | 2005-03-17 | 2011-12-06 | Claria Innovations, Llc | Method for providing content to an internet user based on the user's demonstrated content preferences |
US20060218618A1 (en) * | 2005-03-22 | 2006-09-28 | Lorkovic Joseph E | Dual display interactive video |
US8326659B2 (en) * | 2005-04-12 | 2012-12-04 | Blackboard Inc. | Method and system for assessment within a multi-level organization |
WO2006138620A2 (en) | 2005-06-15 | 2006-12-28 | Music Choice | Systems and methods for facilitating the acquisition of content |
US7620914B2 (en) * | 2005-10-14 | 2009-11-17 | Microsoft Corporation | Clickable video hyperlink |
US8370455B2 (en) * | 2006-03-09 | 2013-02-05 | 24/7 Media | Systems and methods for mapping media content to web sites |
US9063952B2 (en) | 2006-07-31 | 2015-06-23 | Ricoh Co., Ltd. | Mixed media reality recognition with image tracking |
US8073263B2 (en) * | 2006-07-31 | 2011-12-06 | Ricoh Co., Ltd. | Multi-classifier selection and monitoring for MMR-based image recognition |
US9176984B2 (en) | 2006-07-31 | 2015-11-03 | Ricoh Co., Ltd | Mixed media reality retrieval of differentially-weighted links |
US8201076B2 (en) | 2006-07-31 | 2012-06-12 | Ricoh Co., Ltd. | Capturing symbolic information from documents upon printing |
US8489987B2 (en) * | 2006-07-31 | 2013-07-16 | Ricoh Co., Ltd. | Monitoring and analyzing creation and usage of visual content using image and hotspot interaction |
US9020966B2 (en) | 2006-07-31 | 2015-04-28 | Ricoh Co., Ltd. | Client device for interacting with a mixed media reality recognition system |
US8676810B2 (en) | 2006-07-31 | 2014-03-18 | Ricoh Co., Ltd. | Multiple index mixed media reality recognition using unequal priority indexes |
JP4200173B2 (en) | 2006-10-30 | 2008-12-24 | 株式会社コナミデジタルエンタテインメント | Moving picture selection device and program |
US8661096B2 (en) * | 2007-11-05 | 2014-02-25 | Cyberlink Corp. | Collaborative editing in a video editing system |
CN101911062A (en) * | 2007-12-31 | 2010-12-08 | 星克跃尔株式会社 | Method and apparatus for path search through web browsing |
US7885951B1 (en) * | 2008-02-15 | 2011-02-08 | Lmr Inventions, Llc | Method for embedding a media hotspot within a digital media file |
US20100064220A1 (en) * | 2008-03-27 | 2010-03-11 | Verizon Data Services India Private Limited | Method and system for providing interactive hyperlinked video |
US10282391B2 (en) | 2008-07-03 | 2019-05-07 | Ebay Inc. | Position editing tool of collage multi-media |
US9043726B2 (en) * | 2008-07-03 | 2015-05-26 | Ebay Inc. | Position editing tool of collage multi-media |
US11017160B2 (en) | 2008-07-03 | 2021-05-25 | Ebay Inc. | Systems and methods for publishing and/or sharing media presentations over a network |
US8893015B2 (en) | 2008-07-03 | 2014-11-18 | Ebay Inc. | Multi-directional and variable speed navigation of collage multi-media |
TW201004339A (en) * | 2008-07-09 | 2010-01-16 | Univ Nat Taiwan | Method and system for processing synthetic graphic images on digital video file |
US8086526B2 (en) | 2008-07-23 | 2011-12-27 | Ebay Inc. | Hybrid account |
US20100042535A1 (en) * | 2008-08-15 | 2010-02-18 | Ebay Inc. | Currency display |
EP2377318A1 (en) * | 2008-10-24 | 2011-10-19 | Brixgate International AB | Advertising control system and method for motion media content |
US20100275120A1 (en) * | 2009-04-22 | 2010-10-28 | Nicholas Pappas | Processing of fields in motion picture videos or still photos |
US8385660B2 (en) | 2009-06-24 | 2013-02-26 | Ricoh Co., Ltd. | Mixed media reality indexing and retrieval for repeated content |
US8572603B2 (en) * | 2009-09-04 | 2013-10-29 | Adobe Systems Incorporated | Initializing an application on an electronic device |
US20110145108A1 (en) * | 2009-12-14 | 2011-06-16 | Magnus Birch | Method for obtaining information relating to a product, electronic device, server and system related thereto |
US10674230B2 (en) * | 2010-07-30 | 2020-06-02 | Grab Vision Group LLC | Interactive advertising and marketing system |
DE102011079587A1 (en) * | 2011-03-04 | 2012-09-06 | Klickfilm UG (haftungsbeschränkt) | Apparatus and method for accessing digital media |
US9058331B2 (en) | 2011-07-27 | 2015-06-16 | Ricoh Co., Ltd. | Generating a conversation in a social network based on visual search results |
GB2497071A (en) * | 2011-11-21 | 2013-06-05 | Martin Wright | A method of positioning active zones over media |
AU2013202129A1 (en) * | 2012-04-04 | 2013-10-24 | John Forrester | Systems and methods for monitoring media interactions |
US9197937B1 (en) | 2012-04-26 | 2015-11-24 | Music Choice | Automatic on-demand navigation based on meta-data broadcast with media content |
GB2504270A (en) * | 2012-07-23 | 2014-01-29 | Wirewax Ltd | Synchronising hyperlink and associated object positions using frame numbers encoded as pixel data |
EP2835982B1 (en) * | 2013-08-06 | 2017-12-20 | THEO Technologies | A method for playing a media stream in a browser application |
US10219027B1 (en) | 2014-10-24 | 2019-02-26 | Music Choice | System for providing music content to a user |
US11432046B1 (en) * | 2015-06-12 | 2022-08-30 | Veepio Holdings, Llc | Interactive, personalized objects in content creator's media with e-commerce link associated therewith |
US10951683B2 (en) * | 2015-07-13 | 2021-03-16 | Projector.Is, Inc. | Systems and methods for remote interaction |
US11593843B2 (en) * | 2020-03-02 | 2023-02-28 | BrandActif Ltd. | Sponsor driven digital marketing for live television broadcast |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5227863A (en) * | 1989-11-14 | 1993-07-13 | Intelligent Resources Integrated Systems, Inc. | Programmable digital video processing system |
US5276789A (en) * | 1990-05-14 | 1994-01-04 | Hewlett-Packard Co. | Graphic display of network topology |
WO1993010495A1 (en) * | 1991-11-22 | 1993-05-27 | Cabletron Systems, Inc. | Method and apparatus for monitoring the status of non-pollable devices in a computer network |
US5539871A (en) * | 1992-11-02 | 1996-07-23 | International Business Machines Corporation | Method and system for accessing associated data sets in a multimedia environment in a data processing system |
US5555354A (en) * | 1993-03-23 | 1996-09-10 | Silicon Graphics Inc. | Method and apparatus for navigation within three-dimensional information landscape |
US5689641A (en) * | 1993-10-01 | 1997-11-18 | Vicor, Inc. | Multimedia collaboration system arrangement for routing compressed AV signal through a participant site without decompressing the AV signal |
GB2288507A (en) * | 1994-03-23 | 1995-10-18 | Multimedia Corp Ltd | Multimedia video viewing system |
EP0964576B1 (en) * | 1994-04-15 | 2004-03-03 | Koninklijke Philips Electronics N.V. | Method and arrangement for receiving digital video signals |
US5563648A (en) * | 1994-04-28 | 1996-10-08 | Thomson Consumer Electronics, Inc. | Method for controlling execution of an audio video interactive program |
US5586264A (en) * | 1994-09-08 | 1996-12-17 | Ibm Corporation | Video optimized media streamer with cache management |
US5481312A (en) * | 1994-09-12 | 1996-01-02 | At&T Corp. | Method of and apparatus for the transmission of high and low priority segments of a video bitstream over packet networks |
DE69521575T2 (en) * | 1994-09-12 | 2002-05-16 | Adobe Systems Inc | Method and arrangement for displaying electronic documents |
US5530852A (en) * | 1994-12-20 | 1996-06-25 | Sun Microsystems, Inc. | Method for extracting profiles and topics from a first file written in a first markup language and generating files in different markup languages containing the profiles and topics for use in accessing data described by the profiles and topics |
US5623589A (en) * | 1995-03-31 | 1997-04-22 | Intel Corporation | Method and apparatus for incrementally browsing levels of stories |
US5649186A (en) * | 1995-08-07 | 1997-07-15 | Silicon Graphics Incorporated | System and method for a computer-based dynamic information clipping service |
US5572643A (en) * | 1995-10-19 | 1996-11-05 | Judson; David H. | Web browser with dynamic display of information objects during linking |
US5633810A (en) * | 1995-12-14 | 1997-05-27 | Sun Microsystems, Inc. | Method and apparatus for distributing network bandwidth on a media server |
US5627936A (en) * | 1995-12-21 | 1997-05-06 | Intel Corporation | Apparatus and method for temporal indexing of multiple audio, video and data streams |
-
1996
- 1996-03-29 US US08/624,224 patent/US5918012A/en not_active Expired - Lifetime
-
1997
- 1997-03-19 AU AU23333/97A patent/AU2333397A/en not_active Abandoned
- 1997-03-19 EP EP97916064A patent/EP0891675B1/en not_active Expired - Lifetime
- 1997-03-19 DE DE69738449T patent/DE69738449T2/en not_active Expired - Lifetime
- 1997-03-19 CA CA002246736A patent/CA2246736C/en not_active Expired - Fee Related
- 1997-03-19 ES ES97916064T patent/ES2300112T3/en not_active Expired - Lifetime
- 1997-03-19 JP JP53529797A patent/JP2001519974A/en active Pending
- 1997-03-19 WO PCT/US1997/004333 patent/WO1997037497A1/en active IP Right Grant
Also Published As
Publication number | Publication date |
---|---|
EP0891675A4 (en) | 1999-06-30 |
JP2001519974A (en) | 2001-10-23 |
WO1997037497A1 (en) | 1997-10-09 |
ES2300112T3 (en) | 2008-06-01 |
US5918012A (en) | 1999-06-29 |
DE69738449D1 (en) | 2008-02-21 |
CA2246736A1 (en) | 1997-10-09 |
DE69738449T2 (en) | 2009-01-02 |
EP0891675A1 (en) | 1999-01-20 |
EP0891675B1 (en) | 2008-01-09 |
AU2333397A (en) | 1997-10-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2246736C (en) | Video hyperlinks | |
US6496205B1 (en) | User interface for controlling audio functions in a web browser | |
US5923736A (en) | Hypertext markup language based telephone apparatus | |
US6085199A (en) | Method for distributing a file in a plurality of different file formats | |
US6456699B1 (en) | Web-based generation of telephony-based interactive voice response applications | |
JP4514965B2 (en) | Convergence enable DVD and web system | |
USRE43849E1 (en) | Information retrieval apparatus and method | |
EP1030504B1 (en) | Web-based call center system with web document annotation | |
WO1997007467A1 (en) | Computer system for identifying local resources | |
KR100291136B1 (en) | Systems and methods for accessing data files on a computer network | |
GB2317070A (en) | Voice processing/internet system | |
US7290204B1 (en) | Remote slide show system using a browser | |
GB2383918A (en) | Collecting user-interest information regarding a picture | |
KR100268027B1 (en) | Information providing system | |
US20020005866A1 (en) | Method and system for creation of a spatially referenced multimedia relational database that can be transmitted among users or published to internet | |
EP0844572A1 (en) | User interface for controlling audio functions in a web browser | |
WO2004080037A2 (en) | System and method for facilitating ip telephony applications | |
JP4101394B2 (en) | Web information providing method and web server | |
JP4022544B2 (en) | System and method for selecting and retrieving information from an audiovisual presentation | |
JP2005010992A (en) | Method for explaining and advertising web page using synthesized voice | |
JPH0962687A (en) | Information processor and information providing system | |
JPH10187571A (en) | Network address input device and computer readable recording medium recording network address input program | |
JP2001251437A (en) | Method and device for information access | |
KR20020012669A (en) | Method for Visual Display by Internet of Offline Magazine | |
JP2001101117A (en) | Information register in information notice system and recoreding medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
EEER | Examination request | ||
MKLA | Lapsed |
Effective date: 20140319 |
|
MKLA | Lapsed |
Effective date: 20140319 |