WO2003004969A1

WO2003004969A1 - System and method for position marking/stamping of digital pictures in real time

Info

Publication number: WO2003004969A1
Application number: PCT/SE2002/001291
Authority: WO
Inventors: Henrik Groth
Original assignee: Telia Ab (Publ)
Priority date: 2001-07-02
Filing date: 2002-06-28
Publication date: 2003-01-16
Also published as: SE0102367L; SE0102367D0

Abstract

System and procedure for positioning/positioning for/position marking of digital pictures, at which a picture is registered/recorded by a digital camera (1); a position inquiry is transmitted/transferred from the digital camera to a mobile communication terminal (2), which can be integrated (12) with, or separate from, the digital camera, and which cooperates with a stationary communication network (7); the mobile communication terminal is positioned by means of positioning devices (8) arranged in the stationary communication network; and where picture data related to the registered/recorded picture are stored (10,11) in combination with the position data from the positioning device. The positioning of the mobile communication terminal consequently is executed as a positioning of the mobile terminal in relation to base station terminals in the stationary communication network. The system and the procedure consequently offers position 20 marking/stamping of digital pictures.

Description

SYSTEM AND METHOD FOR POSITION MARKING/STAMPING OF DIGITAL PICTURES IN REAL TIME

TECHNICAL FIELD The present invention relates to systems and methods for position marking/stamping of digital pictures/photos. More exactly is related to solutions at which a picture registration/recording device in form of a digital camera is positioned in a cellular communication system, via a mobile communication terminal.

PRIOR ART

Since a long time back there have been cameras available in the market which offer the possibility to time stamp the pictures which are registered/recorded. For analog cameras, by which here are meant traditional cameras which register pictures on a light-sensitive surface, one solution for time registration is to reflect a time indication into the optical path, and let the time indication be exposed on the film surface. For digital cameras the time indication can be seen separately or directly in the registered picture, and in certain cases one can select if one wants to see the time indication in the picture or not, even afterwards. A technical problem with the digital pictures/photos of today, however, is that they do not include any information about where the pictures have been taken. This means that the person who is using a digital camera to take pictures, afterwards does not automatically know where respective picture is taken. If it would be possible to store this information in connection to the picture, it would be possible for the photographer to, by means of the information about where respective picture is taken, sort out pictures according to certain geographical places. This would in the long run make it possible to replace traditional photo albums, and make it easier to look at and find right pictures afterwards.

In prior art a number of different solutions have been presented within the field. JP10143520 describes a solution where position data are obtained by/derived from a GPS-device at registration of a picture. The picture and position data then are transmitted by a mobile telephone to a communicating party. JP8097927 shows a solution where a GPS-device is used to obtain position data at a place where an object is observed, at which a video camera is used to register pictures. Based on the video pictures, a still is generated, and this still is then transmitted together with the position data by means of a mobile telephone to a remotely located computer.

JP10239055 ^'.relates to the problem to provide distance and direction information of/for a picture. According to the suggested solution a digital camera includes a direction detector and a distance detector, and detected distance and direction are transmitted/transferred to a receiver unit to which also the picture is transmitted. The position of the digital camera is obtained by a GPS-device, and by means of the position data, the direction data and the distance data the position of the picture object can be ^'calculated. The picture data and the position data of the picture object are later on transmitted by a mobile telephone to a central unit.

Further solutions for positioning of picture objects are presented in JP9105775 and JP10276382, and both these use, like the above mentioned documents, GPS to obtain position data. This, however, requires from the presented solutions that a GPS-receiver must be available to make the suggested systems work.

The present invention relates to systems and procedures for time marking/stamping of digital pictures, which overcomes the disadvantages of the prior art. SUMMARY OF THE INVENTION

In order to fulfill above mentioned aim, the present invention relates according to a first aspect to a system for positioning of digital pictures, which system includes a digital camera for registration/recording of pictures, a storing device for storing of picture data which represent a registered picture, and a mobile communication terminal which cooperates with a stationary communication network. The system is characterized in that positioning devices are arranged for positioning of said communication terminal in the communication network. In one preferred embodiment said positioning is realized by the position of the mobile communication terminal being appointed in relation to base station terminals in the stationary communication network. In one embodiment a device is arranged including both the digital camera and the communication terminal. Preferably said digital camera and said communication terminal further include means for data communication between them. The earlier mentioned storing device for storing of digital picture data is in one embodiment arranged in the digital camera itself. In the embodiments where a device includes both the digital camera and the communication terminal, the storing device likewise can be arranged in said device. In one alternative embodiment the storing device is arranged in the stationary communication network.

The mobile communication terminal is preferably arranged to receive position data via wireless data transmission from said stationary communication network. The position data received/obtained from said positioning device at registration/recording of the picture are preferably stored in said storing device together with the picture data for said picture.

In one embodiment the system further includes time registration device arranged to register time data related to the point of time of/for registration of a picture by said digital camera. In one embodiment the system further includes device for data storing of the picture data for/of said registered picture in combination with the time data obtained/received by the time registration device in said storing device.

The present invention relates according to a second aspect to a system for positioning of digital pictures, including a device which holds a digital camera for registration of pictures, and a mobile communication terminal which cooperates with a stationary communication network. The digital camera and the communication terminal are, from a data communication point of view, connected, and the communication terminal includes device for wireless transmission of picture data which represent one by the digital camera registered picture to the communication network. The communication network further includes a positioning device for positioning of the mobile communication terminal, and storing device for storing of picture data in combination with position data related to the position of the communication terminal at registration/ recording of the picture.

Said device preferably includes time registration device arranged to register time data related to point of time for registration of said picture, and said storing devices are preferably arranged to store said time data in combination with said picture data.

The communication network in the system according to any embodiment of the first or second aspect of the present invention is preferably a cellular radio communication network, such as GSM (Global System for Mobile

Communication) , UMTS (Universal Mobile Telecommunications System) or the like.

The present invention relates according to a third aspect to a system for positioning of digital pictures, including a digital camera for registration of a picture, from a data communication point of view connected to a mobile communication terminal which cooperates with a stationary communication network. The fixed communication network includes positioning devices for positioning of and transmitting position data to the mobile communication terminal. The digital camera further includes storing device for storing of picture data in combination with said position data, related to the position of the communication terminal at registration/recording of the picture.

According to a fourth aspect, the present invention relates to a procedure for positioning of digital pictures, including the steps to:

Register/record a picture by a digital camera; transmit a position inquiry from the digital camera to a mobile communication terminal which cooperates with a stationary communication network; position the communication terminal by means of positioning devices arranged in the communication network; store picture data related to the registered/recorded picture in combination with position data from the positioning device. The procedure preferably further includes the steps to: register time data related to the point of time for the registration/recording of the picture; - store the time data in combination with the picture data and the position data. In one embodiment said position inquiry is transmitted in an internal communication inside a device including the digital camera and the communication terminal. Said position inquiry can in one embodiment be transmitted wirelessly between the digital camera and the communication terminal. In such an embodiment the position inquiry is preferably transmitted via a radio communication system adapted for short transmission distances, such as bluetooth. In an alternative embodiment the digital camera and the communication terminal are connected to/with each other via a cable or similar signaling circuit, over which said position inquiry is transmitted.

Said positioning is preferably executed by a positioning of the position of the mobile communication terminal in relation to base station terminals in the stationary communication network. This stationary communication network is preferably a cellular radio communication system, such as GSM/GPRS (General Packet Radio Service), UMTS or the like. In one embodiment said time data is derived from the stationary communication network by said mobile communication terminal.

In one embodiment of the procedure according to the present invention the steps are included: to transmit said picture data to the stationary communication network, and to store the picture data in storing devices connected to that. In an alternative embodiment the picture data are stored in the storing device which is arranged in the digital camera.

BRIEF DESCRIPTION OF THE DRAWINGS

Further aims, advantages and distinctive features of the present invention are presented in the detailed description of preferred embodiments below, with reference to the enclosed drawings, in which

Figure 1 schematically illustrates units which are parts of, or relate to, the system according to a present embodiment of the invention; Figure 2 illustrates the flow chart for/of a procedure according to a preferred embodiment of the invention.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

The invention is intended to be used in cooperation between a device which can be positioned by/with present and/or future mobile positioning technologies and a digital camera. According to the invention, a system and a procedure to mark/stamp digital pictures with a geographic position and, when applicable, time, is provided. The procedure can be used in a terminal where the positioning unit is integrated with the camera or in combination with two terminals where one of them attends to positioning, and the other photography. The sequence of events of the method preferably is: Photographing, Communicating, Positioning, Appointing time, and Storing picture. With reference to Figure 1, below preferred embodiment of the system and the procedure according to the present invention is described. First photography of an object 3 according to the figure is executed. Photography is executed with/by a digital camera which either is a freestanding unit 1, alternatively built in into a terminal or device 12 with multifunctionality . The picture is stored for the time being in the camera in storing device 10.

After the picture has been taken, the camera 1 has to communicate with the unit/units which shall decide/appoint the position respective the time. This communication can be made either within the unit, when time/position information exists in the unit, or with one or more other units when time/position information is located in other units. The communication within a unit is preferably managed by a software, and communication with other units, connected by wire or wirelessly, also with a software. The software keeps count of when a picture has been taken and after that requests information about position and time to store these in connection to the picture. The cooperating unit/units which has/have been given the task to appoint the position makes this via a wireless network, for instance bluetooth, GSM/GRPS or UMTS. The cooperating units include, as is evidently seen in Figure 1, a mobile communication terminal 2 arranged for communication in a cellular radio communication system. This radio communication system includes a stationary communication network 7, with a plurality of stationary base station terminals 4,5,6, with which the mobile terminal 2 communicates in a known way. Preferably the stationary communication network 7 also includes device 8 for positioning of mobile communication terminals 2. The device 8 of course can be connected to one of the base station terminals, or be distributed in the network. Preferably the positioning device 8 includes a computer program product arranged to calculate the position of the mobile terminal 2 in relation to the base station terminals 4,5,6 on basis of the signals which are exchanged between the mobile and the stationary terminals. A plurality of different procedures of positioning mobile terminals in mobile telephone systems have been presented, and the specific solution is not relevant to/for the present invention. Some examples which can be mentioned, however, are, E-OTD (Enhanced Observed Time Difference) , AOA (Angle of Arrival) and TOA (Time of Arrival) . In common for these solutions is that the positioning of the mobile communication terminal 2 is executed by and in the communication system 7 to which the communication terminal 2 belongs. If the position information is transmitted from the stationary communication network 7 to the mobile terminal 2, it is preferably forwarded to the digital camera 1 by earlier mentioned software.

The units which have been given the task to appoint the time, make this via the terminal or via a wireless network, for instance bluetooth, GSM/GPR, GPS or UMTS. Also the time information is after that forwarded by the software when applicable.

When the picture information or the picture data have been registered, and the position data and, when applicable, the time data have been received/obtained, the total information shall be stored. In one embodiment the storing can be made in the terminal 2, or in the device 12 which holds both the digital camera 1 and the mobile communication terminal 2. In another embodiment the data can be stored in a storing device 10 arranged in the digital camera itself. In yet another embodiment the data are transmitted, before or after having been collected, to a storing device 11 arranged in the stationary communication network 7. Where the picture data and the belonging information shall be stored is in one preferred embodiment determined by the user of the system, by a parameter setting on the digital camera 1, the communication terminal 2 or the device 12. Possibly this parameter setting can have been made in advance via a computer (not shown) connected directly or indirectly to the digital camera 1 or the mobile communication terminal 2, for instance via bluetooth. In Figure 2 a preferred embodiment of a procedure according to the present invention is shown in form of a flow chart. The flow starts at 21, and at 22 a picture is registered/recorded by the digital camera 1. At next step 23 the digital camera communicates with the mobile communication terminal 2, which, according to earlier description, can be integrated with the digital camera 1 in a device 12. At step 24, the communication terminal 2 is positioned in the stationary communication network 7, by means of dedicated software in a positioning device 8 and signals which are exchanged between, the mobile terminal 2 and in the stationary communication network 7 included base station terminals 4,5,6. At step 25, which can but need not be included, the point of time of the picture registration is registered, for instance by means of a time registration device arranged in the digital camera 1, the terminal 2 or the device 12, or by a time registration device arranged in the stationary network 7. At step 26 the picture is stored, together with the position data and, if any, the time data. The procedure ends at 27.. In one exemplified embodiment, the device 12 is a mobile telephone with a built-in digital camera 1. The communication at step 23 consequently is executed as an internal communication in the device 12. The mobile telephone 2, 12 belongs to a third generation mobile telephone system, for instance UMTS, and is in contact with a stationary communication network 12 via base stations

4,5,6. Position data consequently are obtained/received by positioning device 8. Time data are preferably derived from the terminal 2. The picture data are later on transmitted via the UMTS-network 7 and are at that stored on a server 11 connected to the fixed network 7.

In this embodiment the position data consequently need not be transmitted to the mobile terminal 2,12 but can be combined with the picture data when the latter are transmitted to the stationary communication network 7 for storing in the storing device 11 at the step 26.

In another example of embodiment the digital camera 1 for picture registration and the mobile communication terminal 2 are separate units. A picture of an object 3 accordingly is registered by the digital camera 1 at step 22, and the digital camera after that communicates with the mobile communication terminal 2 at step 23. This communication of course can take place directly after registration of a picture, whereas alternative embodiments can be so arranged that a predetermined number of pictures are registered before communication with the communication terminal 2. In one embodiment the communication is executed wirelessly, for instance via bluetooth, but in alternative embodiments the communication of course likewise can be executed via cable. At the step 23 the mobile communication terminal 2 is positioned in the belonging communication system by means of the in the stationary communication network 7 included base station terminals 4,5,6 and positioning devices arranged at the stationary network 7. The mobile communication system can be a second generation mobile system, such as GSM. In the example in question the picture data which have been registered by the digital camera 1 are not transmitted to the stationary communication network 7 at the step 24, but it will be sufficient with a request from the mobile communication terminal 2 to the stationary network 7 to execute positioning by positioning device 8. From the positioning obtained position data for the mobile communication terminal 2 are after that transmitted from the stationary communication system 7 to said mobile communication terminal 2. At step 25 are, whenever applicable, the point of time for registration of the picture registered, for instance, by time registration devices arranged in the stationary communication network 7, and transmitted together with the position data. At the step 26 the registered picture is stored, according to present example, in a storing device 10 arranged in the digital camera 1, together with the position data obtained/received from the mobile communication terminal 2, and, whenever applicable, the time data. Of course, the picture, that is the piqture data, can be stored in storing device 10 in the digital camera 1 directly after registration of the picture. These picture data later on can, as a consequence of the steps 24 and 25, be completed with the position data and, whenever applicable, the time data. If it shall be possible to show the pictures on another terminal than the one by which they have been created, is required that the pictures are transmitted/transferred to the other terminal. If the pictures are stored in the terminal by which they have been created, .they are transmitted wirelessly or via cable to the terminal on which they shall be shown. If the pictures are stored on the server 11, they are transmitted wirelessly or via cable, for instance from Internet, to the terminal on which they shall be shown. When the pictures once have been taken and stored, the user shall have possibility to look at these and sort according to the position of the pictures and/or the point of time when they have been taken. This can be made in two ways: either via a software in the user's computer or via a web interface. A software in the computer is used preferably when the pictures are stored in the computer or locally in any other terminal. A web interface is primarily used when the pictures are stored on a server. Via software or the web interface the user can look at his/her own pictures and sort them according to time or place, for instance to create albums .

When the user shall sort his/her pictures according to a specific position, the information in form of coordinates is of course not of great interest. For it is generally coordinates in some form that are received back from the positioning system. According to the present invention a possibility is offered to the user to associate certain coordinates with/to names of places. The names are obtained as suggestions via the server, alternatively that the user can indicate/specify own names. Suggestions of names via the server can be obtained by the user transmitting a picture and/or coordinates, and the server translates these into a place, for instance Farsta. If the user wants, it shall be possible for him/her to rename places (for instance Farsta - The job) and when a place has been given a name, coming pictures with the same or closely located coordinates will be associated with/to this place.

In corresponding way, naming of different time episodes can be done/made. If, for instance, the user has been abroad in different places during a certain period of time, he/she shall have possibility to name that time episode. To make it possible to name a time episode is required that the user indicates a start and an expiration time for the episode.

There are occasions for which it is conceivable that position and/or time information will not be available or is incorrect. This can for instance occur when the positioning unit is out of its coverage area or if the clock in the terminal is showing incorrect time. In the cases the position and/or time information is incorrect, it is difficult for the system to discover this, and the incorrect values will be stored. In the cases position and/or time information is not accessible, a fault code is instead stored together with the picture which makes the system interpret this as if the information has not been available at the point of time of the photography. When no or wrong places have been indicated on the picture, it therefore should be possible for the user to allocate position and/or time afterwards. After that, the system can suggest qualified guesses about time/position on other pictures. One example can be if a number of pictures have been taken in sequence, and only the first picture has a position. If the user then allocates a position to the last picture, the system can ask if the pictures in between also shall have this position.

Since the position of the pictures are stored, there is a good chance that the user wants to make some pictures accessible to the public. It may, for instance, be about - attractions and things worth seeing which different companies and users want to share with others, to make it possible for others to see them. For that reason a search engine, for instance a web reader, should be possible to connect to a picture/video library. In this way, for instance, different tourist attractions should be possible to search for, and it would be possible for people to have a look at them before visiting the place in question. One also can imagine that users perhaps want to publish pictures of their home digitally to show to others what the neighborhood may look like.

In order to illustrate the functionality of the invention, two examples are described below. According to a first example Peter has just arrived home from a skiing vacation in Salen. During the journey he has taken some photographs with/by his mobile terminal which among other things includes a UMTS-telephone and a digital camera. Since the terminal has a limited storage capacity, he has used Telia's service for storing and stamping of pictures. This means that each time he has taken a picture, the terminal has been positioned, the time been appointed, and the picture been transmitted via the UMTS-network to a server. When Peter arrives home, the takes his software/hardware surfing device, surfs in on Telia's photo service via Internet, and has all the pictures he has taken during the last two weeks shown/presented. Because he just now is interested in the pictures from Salen, he can sort out the pictures which have been taken there. According to a second example, Cajsa is a freelance photographer and travels all over the country photographing. She has just succeeded in finding the latest digital camera in the market with a very high solution, large storage capacity and bluetooth. Her new camera she just need to put beside her computer and push a button and all pictures are wirelessly transmitted to the computer. Since she also has a telephone with bluetooth and a Telia- subscription, it has been possible for her to utilize Telia's service for position stamping of pictures. This has resulted in that each time she has taken a picture, position (and time) information has been stored for/about each picture. When she now sits down to have a run-through of the photographs from her latest journey, she quickly can get a survey of where respective picture has been taken. The present invention consequently offers a method for connection of position and time with a digital picture, which results in that the user will have more information from each picture than before. The method makes possible to search for pictures taken at a certain place or during a certain period of time, both from one's own album as well as from shared pictures on the Internet. Characteristic of the invention is that described advantages are achieved without that a separate or built-in GPS-receiver need to be used.

Preferred embodiments have been described in detail, at the same time as the expert realizes that modifications are possible within the scope of protection that is offered by the enclosed patent claims .

Claims

PATENT CLAIMS

1. System for positioning/positioning for/position marking of digital pictures, including a digital camera (1) for registration/recording of pictures, a storing device (10,11) for storing of picture data which represent a registered/recorded picture, and a mobile communication terminal (2) which cooperates with a stationary communication network (7), c h a r a c t e r ! z e d in that positioning devices (8) arranged for positioning of said communication terminal in said communication network.

2. System as claimed in patent claim 1, at which said positioning is based on the position of the mobile communication terminal in relation to base station terminals (4,5,6) in the stationary communication network.

3. System as claimed in patent claim 2, including a device (12) which contains/holds the digital camera and the communication terminal.

4. System as claimed in any of the previous patent claims, at which said digital camera and said communication terminal include means (9) for data communication between them.

5. System as claimed in any of the previous patent claims, where said storing device is arranged in said digital camera .

6. System as claimed in patent claim 3, where said storing device is arranged in said device.

7. System as claimed in patent claim 3, where said storing device is arranged in said stationary communication network.

8. System as claimed in any of the previous patent claims, where said communication terminal is arranged to obtain/receive position data via wireless data transmission from said communication network.

9. System as claimed in any of the previous patent claims, further including device for data storing of the picture data for/of said picture in combination with position data obtained/received by said positioning device at registration/recording of the picture, in said storing device .

10. System as claimed in any of the previous patent claims, further including time registration devices arranged to register time data related to point of time for registration/recording of a picture by/with said digital camera .

11. System as claimed in patent claim 10, further including device for data storing of the picture data for/of said registered/recorded picture in combination with the time data obtained/received by said time registration device at registration/recording of the picture, in said storing device .

12. System for positioning/positioning for/position marking of digital pictures, including a device (12) which includes/holds a digital camera (1) for registration/ recording of pictures, and a mobile communication terminal (2) which cooperates with a stationary communication network (7) , which digital camera and communication terminal are interconnected from a data communication point of view (9), which communication terminal includes device to wirelessly transmit picture data which represent one by the digital camera registered/recorded picture to the communication network, which communication network includes positioning device (8) to position the mobile communication terminal, and storing device (11) for storing of picture data in combination with position data related to the position of the communication terminal at registration/ recording of the picture.

13. System as claimed in patent claim 12, at which said device includes time registration devices arranged to register time data related to the point of time of/for registration/recording of said picture, and where said storing devices are arranged to store said time data in combination with said picture data.

14. System for positioning/positioning for/position marking of digital pictures, including a digital camera (1) for registration/recording of a picture, from a data communication point of view connected (9) to a mobile communication terminal (2) which cooperates with a stationary communication network (7), which communication network includes positioning device (8) to position and transmit position data to the mobile communication terminal and which digital camera include storing device (10) for storing of picture data in combination with said position data, related to the position of the communication terminal at registration/ recording of the picture.

15. System as claimed in patent claim 14, at which said communication network includes time registration devices arranged to register time data related to point of time for registration/recording of said picture, and device to transmit said time data to the communication terminal, and where said storing devices are arranged to store said time data in combination with said picture data.

16. System as claimed in any of the previous patent claims, where said communication network is a cellular radio communication network.

17. Procedure for positioning/positioning for/position marking of digital pictures, including the steps to:

- register/record a picture by a digital camera (22);

- transmit/transfer a position inquiry from the digital camera to a mobile communication terminal which cooperates with a stationary communication network (23) ;

- position the communication terminal by means of positioning devices arranged in the communication network

(24);

- store picture data related to the registered/recorded picture in combination with position data from the positioning device (26) .

18. Procedure as claimed in patent claim 17, further including the steps to: - register time data related to the point of time for the registration/recording of the picture (25) ;

- store the time data in combination with the picture data and the position data.

19. Procedure as claimed in patent claim 17, at which said position inquiry is transmitted/transferred in an internal communication in a device including the digital camera and the communication terminal.

20. Procedure as claimed in patent claim 17, at which said position inquiry is transmitted wirelessly between the digital camera and the communication terminal.

21. Procedure as claimed in patent claim 20, at which said position inquiry is transmitted via a radio communication system adapted for short distance transmissions.

22. Procedure as claimed in patent claim 17, at which said positioning inquiry is transmitted over a cable between the digital camera and the communication terminal.

23. Procedure as claimed in patent claim 17, at which said positioning is executed by a positioning of the position of the mobile communication terminal in relation to base station terminals in the stationary communication network.

24. Procedure as claimed in patent claim 23, at which said communication network is a cellular radio communication system.

25. Procedure as claimed in patent claim 18, at which said time data are obtained/received from said mobile communication terminal.

26. Procedure as claimed in patent claim 18, at which said time data are derived/obtained from the stationary communication network by said mobile communication terminal .

27. Procedure as claimed in patent claim 17, further including the steps to: - transmit said picture data to the stationary communication network, and to

- store the picture data in storing devices connected to that.

28. Procedure as claimed in patent claim 17, at which picture data are stored in storing devices arranged in the digital camera.