WO2002025926A1

WO2002025926A1 - Portable unit for sending digital images

Info

Publication number: WO2002025926A1
Application number: PCT/GB2001/004213
Authority: WO
Inventors: Richard Michael Taylor
Original assignee: Fifteenseven Limited
Priority date: 2000-09-20
Filing date: 2001-09-20
Publication date: 2002-03-28
Also published as: GB0023034D0

Abstract

A portable unit (10) for sending digital images to an Internet web server (8) comprises a solide state memory reader (31) for reading out compressed digital images stored in a solid state memory (6), each image being read out a portion at a time. Decompression/recompression means are provided for decompressing each image portion read out and for then recompressing the decompressed portion but using increased compression so as to produce a compressed version of said portion which is smaller in size than as originally stored in the solid state memory (6), A MODEM (29) is provided for sending each recompressed image portion, in turn, to the Internet web server (8).

Description

PORTABLE UNIT FOR SENDING DIGITAL IMAGES

The present invention relates to a portable unit for sending digital images, obtained using a digital camera, over the Internet .

One of the most attractive features of digital cameras is the ease with which the images can be sent electronically or used on web pages. However, this feature is only available when the camera is plugged into a PC and the images transferred onto the PC for subsequent transmission over its MODEM to a web site. This mode of operation is sufficient when the camera is being used at home and there is easy access to a PC. However, if the digital camera is being used away from easy access to a PC for an extended period then there is a need for a product that is able to send images directly to the Internet without use of a PC. For instance, the user may be away on holiday or business and wish to send photographs back to friends and family. This would be like an e-mail postcard that is received near instantaneously after being sent . A laptop PC could be used for this purpose but the majority of consumers do not have a laptop- computer and, in any case, they are unlikely to carry one simply for this purpose.

Modern digital cameras have mega-pixel image sensors that provide very high quality images comparable with those produced by a 35mm chemical camera. These high-resolution images are required in order to produce high quality paper prints. However, these images require as much as 750Kbytes of space even when compressed. It requires a significant amount of time to transmit these images at that resolution even with a V.90 MODEM. A 750Kbyte image would take approximately 5 minutes to transmit at 33.6Kbps, the maximum upload speed for a V.90 connection.

It is an aim of the present invention to avoid or minimize one or more of the foregoing disadvantages.

The present invention provides a portable unit for sending digital images to an Internet web server, the unit comprising:

Solid state memory reading means for reading out compressed digital images stored in a solid state memory means accessible to the unit in use thereof, each said image being read out a portion at a time;

Decompression/recompression means for decompressing each said image portion read out by the solid state memory reading means and recompressing the decompressed portion using increased compression so as to produce a compressed version of said portion which is smaller in size than as originally stored in the solid state memory means; and

MODEM means for sending each said recompressed image portion, in turn, to an Internet web server.

While, as above-mentioned, a 750Kbyte image would take approximately 5 minutes to transmit at 33.6 Kbps with a V.90 MODEM, the on-screen quality of the decompressed images is sufficient (for viewing purposes) at much higher levels of image compression. A full quality (i.e. high-resolution) image is only really required for printing. Most images on Internet websites are less than 25Kbytes in size, to facilitate fast download times. One of the main advantages of the present invention is that because it takes images from a solid state memory means which may, for example, be a FLASH memory card, and compresses them more heavily to reduce their size prior to transmission to the web server, the resultant decompressed images are still of sufficiently high quality for on-screen viewing.

The decompression/recompression means preferably achieves the increased compression of each image portion by re- scaling each decompressed portion, preferably using a linear interpolation technique, so as to decrease the physical size of the uncompressed image, and recompressing the re-scaled portion. Alternatively, or preferably additionally, the increased compression comprises recompressing the decompressed portion using a higher compression rate, for example a higher ratio of JPEG compression, than that which was used to compress the original digital images for storage on the solid state memory means.

The solid state memory reading means preferably comprises a flash memory card reader.

The portable unit may incorporate a flash card slot for receiving a removable flash card having compressed digital images stored thereon, said flash card reader therefore being configured to read out the compressed images from the FLASH card located in the slot . It will be understood that the flash card would have been previously inserted in a complementary slot provided for such a card in a digital camera which takes digital images and stores them, in compressed form, on the flash card. The card can then be removed from the camera and inserted into the portable unit .

Alternatively, the portable unit may include serial connection means, for example a USB connector, for connecting directly to a solid state memory means, for example a flash card, located in a digital camera, and the solid state memory reading means comprises software configured to read out compressed digital images from the solid state memory means of the camera, via said serial connection means.

The portable unit may further include user control means for controlling the decompression/recompression means. The user control means may be configured for enabling a user to control the amount of increased compression applied by the recompression means . Preferably, the control means is configured to enable the user to bypass the decompression/recompression means, if desired, so as to allow the original compressed images stored on the solid state memory means to be read out directly therefrom to the web server. The compressed images stored on the solid state memory means can then be deleted therefrom, thereby providing space thereon for storage of additional photographs to be taken with the digital camera.

The portable unit preferably includes a LCD display means for displaying representations of the images stored on the solid state memory means. The unit preferably further includes user input means, conveniently in the form of a small keypad, for enabling a user to control basic functions and/or set various parameters in the unit. For example, the user input means may allow the user to select which image, or group of images, from the solid state memory means is to be sent to the web server.

The MODEM means may include output connection means for connecting to a telephone socket accessible to the portable unit in use thereof. Additionally, the MODEM means may include wireless output means, for example infra-red connection means, for wirelessly connecting the MODEM means to another wireless MODEM means which may, for example, be incorporated in a mobile telephone. This allows images to be sent wirelessly from the portable unit to the mobile telephone.

According to another aspect of the invention, there is provided a system for sending and accessing digital images over the Internet, the system comprising: at least one portable unit for sending digital images to an Internet web server, as above-described; and web server means for storing digital images received from said at least one portable unit, said web server being configured to make the stored images available for access on an Internet website.

The web server may be configured to provide a link from an Internet access device, used to access the images, to the images on the website and/or may be configured to send the images to the Internet access device as an e-mail, or an attachment to an e-mail. Alternatively, or additionally, the web server may be configured to fax the images from the website to the Internet access device, or to a fax machine.

The Internet access device used to access the images on the Internet website may, for example, be a personal computer (PC) located at the user's home or place of work, a portable PC, palm-top or personal digital assistant (PDA) , or a mobile phone having Internet access capability, or a set-top box having Internet access capability.

Preferred embodiments of the invention will now be described, by way of example only, and with reference to the accompanying drawings in which:

Fig. 1 is a schematic diagram illustrating a system for sending digital photographs, taken using a digital camera, to a website on the Internet for access therefrom;

Fig. 2 is a flow diagram of a decompression/recompression process carried out by a portable unit of the system of Fig.l, and also shows an image in its original uncompressed form, its final uncompressed form when accessed from the web site-, and showing a portion of the original image and a corresponding scanline in the final image; and

Fig.3 is a block diagram of a portable unit of the system of Fig.l.

Fig. 1 shows a system for sending digital images, obtained from a digital camera 1, over the Internet 2, to an Internet access device which may, for example, be in the form of a home or work PC 3 , a portable PC, or a TV set-top box (having Internet access capability) . The system incorporates a portable unit 10 which is hereinafter referred to as the

"FlashMailer ' . The FlashMailer 10 sends images to a specific remote web server 8 directly from a flash memory card 6. The majority of digital cameras on the market have a SmartMedia or CompactFlash slot for storing photographs . The images are stored in the compressed JPEG format using a standard DOS filing system. The FlashMailer 10 is able to read this format in order to send the images. Once the FlashMailer sends images they are held on the web server 8 which makes the images available for access on a website. In effect the FlashMailer is a dedicated delivery platform for sending images to a web site. The site acts as the consumer's online photo album. An FTP or HTTP transfer between the FlashMailer and the web site is set up in order to transfer the image data. The photographs are then available immediately to the recipient .

The images are held in an area of the web site requiring a password held by the consumer. Within that area the consumer is able to manage the images from a PC 3 (or other internet access device) , including the deletion of images or the sorting of images into categories. Further images may also be uploaded from a PC and images previously sent from the FlashMailer to the web server 8 may be downloaded onto a PC. Areas of the web site can be opened up to others by giving them password access or the consumer can open areas of their photo album to all. The images are presented on a standard web site so that they can be viewed by anyone with Internet access using a home/work PC 3 or even access via a digital set-top box or WebTV. When images are sent to specific individuals they receive an e-mail indicating that a picture is available for view. The image can either be sent as an attachment or the Internet access device can send a link to the pictures on the web site. A further feature which could be provided in the system, if desired, would be to allow the faxing of an image from the web site to a particular recipient . In this case the image would be suitably dithered to provide a monochrome representation of the image .

The FlashMailer unit 10, schematically illustrated in Fig.3, is effectively a combination of a MODEM 29 and a flash card reader 21, with additional processing functions. It is a small portable unit, no larger than a mobile phone, that is either battery or AC adapter powered. It contains slots 12 for popular flash card formats, namely CompactFlash and SmartMedia (and possibly MMC and MemoryStick in the future) . FlashMailer plugs into a standard telephone socket via which it is able to connect to an ordinary ISP. It is designed to send images previously stored on the flash card 6 by the digital camera 1. The images are sent using the FTP or HTTP protocols onto the remote web server 8. Once images have been made available on the web server, e-mails can be sent (to individuals) containing the images or pointing to the images on the web site. The unit has a small keypad 16 to control basic functions and to set various parameters, and this keypad can be used to select the e-mail address to which a selected image (or images) is to be sent by the web server (this is described further below) .

As shown in the Fig.3, the FlashMailer 10 has a small bitmapped LCD display 15 of approximately the same size and resolution as a mobile phone. Desirable resolutions would be 128 x 96 or 160 x 100 pixels. This display allows representations of the images on the flash card 6 to be shown. The resolution and monochrome^' nature of the display means that the images are not particularly clear but are sufficient to allow the user to select which picture, or group of pictures, is to be transmitted. If necessary the user can cross reference against the pictures shown on the camera display. The FlashMailer 10 may conveniently show the pictures in time order, using file time stamps in the DOS filing system. Once an image has been selected an e- mail destination to which the image is to be sent (by the web server 8) can also be chosen. The FlashMailer has an internal address book of recipients (held in a first memory 20) . These are initially set up on a configuration page on the web site and are then downloaded to the FlashMailer. New e-mail addresses can be set up if required on the unit itself, but that is a more tortuous process due to the lack of a full keyboard on the FlashMailer unit 10.

One of the key features of the FlashMailer is that it can automatically take images from a flash card and compress them more heavily to reduce their size for transmission, without affecting the original file on the card. It does this using a combination of reduction of the overall resolution (this is done by re-scaling the image using linear interpolation) and increasing the level of JPEG compression applied. This process is described in further detail below, with reference to Fig.2. The resultant images are still of sufficiently high quality for on-screen viewing. By way of example the images may be compressed down to approximately 5OK bytes, allowing a transmission time of approximately one minute using a relatively slow V.32bis (14.4Kbps) MODEM. The user can choose the amount of extra compression applied, this choice being effected using the keypad 16 via which the user can control a controller 25 in the portable unit 10, the controller being programmed to control the JPEG compression ratio. Additionally, the controller can bypass the decompression/recompression process, if this option is selected by the user (using the keypad 16) . This option would be selected if the user wishes to send the compressed images stored on the card 6 directly to the web server 8, without reducing their file size. This allows the user to then delete the stored images from the flash card 6 to leave more space to store additional photographs to be subsequently taken by the camera. The FlashMailer output 30 connects to any hotel room telephone socket in the same way as a laptop PC. Moreover, the FlashMailer could be used with the same global ISPs (such as EarthLink) that provide local call access in just about every country in the world.

Fig. 2 is a flow diagram illustrating the decompression/recompression process carried out by the FlashMailer, showing how a compressed digital photograph is read from the flash card 6 inserted in the unit 10 and decompressed, re-scaled, and recompressed for transmission to the web server 8.

The unit 10 (more specifically, a preprogrammed processor provided in the unit 10) prepares a JPEG picture for transmission to the web server 8 by reducing the file size of the file containing the compressed picture Cl which is read out from the flash card 6 by the flash card reader in . -lithe unit 10. This reduction of file size is accomplished by first reducing both the physical image size by re-scaling the image using a linear interpolation technique (many suitable such techniques are known from the field of image compression in general) , and reducing the image quality by re-encoding (i.e. recompressing) the image with a higher JPEG compression ratio.

The unit 10 may minimise the amount of memory needed in the unit 10 for this process by only reading out (using a flash card reader 24 in the unit 10) and decoding (i.e. decompressing, using a JPEG decompressor 26 in the unit 10) from the compressed image Cl (on the card 6) at any time the minimum number of scan lines of the original image II needed for the linear interpolation of a single new scan line in the final image 12. Thus, in this case the FlashMailer unit 10 need only have enough memory 22 for storing this minimum number of scanlines (representing a portion Pi of the image II) which are read out at any time (in addition to any other memory 20 required for other purposes, as mentioned above) . The resulting interpolated scan lines (the interpolation is carried out by an interpolation processing block 27) are re- encoded by a JPEG encoder 28 in the unit 10 at the higher JPEG compression ratio as soon as they are completed. Any , scan lines decoded from the original image that are not needed to complete the interpolation of the next scan line in the final image are then discarded.

Fig.2 also shows the original image II as taken by the camera 1, and the final image 12 as decoded by the Internet access device used to view the reduced file size compressed image C2 held on the web server 8. A portion Pi of the original image 11 and comprising several scan lines, and a final scanline corresponding thereto in the final (decoded) image 12, are also shown.

The FlashMailer product is designed for portable use, away from a PC, but its ease of use also allows it to compete when a PC is more readily available. For example, the FlashMailer unit 10 can be left in the house permanently connected to a telephone line, perhaps next to the user's telephone answer machine. The Unit 10 can be used quickly and simply for sending a photograph to a particular recipient . Use of the unit is a straightforward as that of a fax machine for sending a paper document . Performing the same process of sending an image using a PC would take much longer. The PC would need to be booted and an appropriate photo application launched. The camera then needs to be connected to the PC and the image downloaded. It must then be re-scaled and compressed appropriately to produce a suitable image size for transfer. Finally, an e-mail/FTP package must be launched to transfer the image. Although application software could be developed to integrate all these functions, for the purposes of sending an image, use of a PC would be more time consuming than use of the dedicated FlashMailer unit.

Various modifications and improvements to the above- described embodiments are possible without departing from the scope of the invention. For example, a message can also be sent along with the image. One option is to send the message in audio form. A small microphone (not shown) provided in the FlashMailer 10 would allow a short message to be recorded and captured by the FlashMailer and compressed into telephone quality sound. This is uploaded to the web site along with the images and can be accessed by the recipient in the same way, either as an e-mail attachment sent from the web site or as a link to the web site. Alternatively, a text-input means is provided by the FlashMailer to allow short messages to be typed in. The lack of a full keypad makes this a reasonably slow process and is only really suitable for short messages.

It will be appreciated that as well as the mass digital camera consumer market there are various other applications

• for the FlashMailer. For instance, photojournalists could use the FlashMailer system to directly send photos to a publication quickly and simply without the need to carry around a laptop PC. There are also applications in sales and insurance where images have to be sent from various locations to a central office. Various additional services can also be made available through the web site. If higher resolution images are uploaded to the web site then other products could be ordered, including prints of selected images and novelty gift items such as prints onto T-shirts or mugs etc. These services could be ordered directly from the FlashMailer. An additional service could allow the physical fulfillment of a postcard so that the image is printed on a postal card along with the message and then mailed locally in the destination country.

There are a number of possible flash card interfaces that could be provided in the FlashMailer 10. The two most popular formats for digital cameras are SmartMedia and CompactFlash. Support will preferably be provided for both of those formats, either in the same unit 10 using two slots 12, or via variants of the manufactured unit. Some cameras are starting to appear with MMC and MemoryStick cards. Slots for those formats could alternatively, or additionally, be provided in the manufactured units 10.

A further possibility is to provide a direct connection to the camera 1 using a serial or UGB connection. This would allow direct download of images to the FlashMailer without the need to remove the flash card 6 from the camera. This could only be supported on a limited range of currently available cameras due to the present lack of protocol standardisation for host to camera communication. A direct connection may also allow images to be selected from a colour LCD on the camera. It is not expected that serial connections would be provided as well as flash card slots within the same unit. If A USB device connection is provided to the FlashMailer then it can also be used as a card reader given suitable PC software.

A further enhancement to the FlashMailer would be the addition of an infra-red (irDA) connection. This would allow the unit to connect with mobile phones that include an infra-red MODEM. This allows images to be sent wirelessly. The data speed of 9600bps for standard mobile phones is quite limiting but the FlashMailer option of compressing images further to reduce time would allow short transmission times for low quality images. It will be generally appreciated that internally the FlashMailer could be based on an ARM processor running an embedded operating system (such as Linux) supporting the necessary protocol stacks . The MODEM could be implemented as a soft MODEM solution, such as V.32bis, to reduce manufacturing costs if required. It is expected that the manufacturing cost for the FlashMailer could be less than $60.

The target market for FlashMailer is new and existing digital camera users. FlashMailer is an attractive accessory product that should appeal to a wide range of digital camera users . It makes the digital camera a much more portable and connected platform. It is expected that a significant proportion of FlashMailer units would be bundled with new digital camera sales . Alternatively the product can be targeted at operators of web sites that host customer photographs and provide value-added services. FlashMailer may be used as a custom delivery platform that will send images directly from the customer to their web site. In this model the cost of the FlashMailer may be subsidised by ongoing subscriptions to the web site services.

Claims

1. A portable unit for sending digital images to an Internet web server, the unit comprising:

Solid state memory reading means for reading out compressed digital images stored in a solid state memory means accessible to the unit in use thereof, each said image being read out a portion at a time; Decompression/recompression means for decompressing each said image portion read out by the solid state memory reading means and recompressing the decompressed portion using increased compression so as to produce a compressed version of said portion which is smaller in size than as originally stored in the solid state memory means; and

2. A portable unit as claimed in claim 1, wherein the decompression/recompression means achieves the increased compression of each image portion by re-scaling each decompressed portion so as to decrease the physical size of the uncompressed image, and recompressing the re-scaled portion.

3. A portable unit as claimed in claim 2, wherein the decompression/recompression means uses a linear interpolation technique.

4. A portable unit as claimed in any one of claims 1-3, wherein the increased compression comprises recompressing the decompressed portion using a higher compression rate than that which was used to compress the original digital images for storage on the solid state memory means .

5. A portable unit as claimed in any preceding claim, including a flash card slot for receiving a removable flash card having compressed digital images stored thereon, said flash card reader being configured to read out the compressed images from the FLASH card located in the slot.

6. A portable unit as claimed in any one of claims 1-4, including serial connection means for connecting directly to a solid state memory means located in a digital camera, and the solid state memory reading means comprises software configured to read out compressed digital images from the solid state memory means of the camera, via said serial connection means.

7. A portable unit as claimed in any preceding claim, including user control means for controlling the decompression/recompression means .

8. A portable unit as claimed in claim 7, wherein the user control means is configured for enabling a user to control the amount of increased compression applied by the recompression means .

9. A portable unit as claimed in claim 7, wherein the control means is configured to enable the user to bypass the decompression/recompression means so as to allow the original compressed images stored on the solid state memory means to be read out directly therefrom to the web server.

10. A system for sending and accessing digital images over the Internet, the system comprising: at least one portable unit as claimed in any preceding claim for sending digital images to an Internet web server; and web server means for storing digital images received from said at least one portable unit, said web server being configured to make the stored images available for access on an Internet website.

11. A system as claimed in claim 10, wherein the web server is ■ configured to provide a link from an Internet access device, used to access the images, to the images on the website and/or is configured to send the images to the Internet access device as at least part of an e-mail.

12. A system as claimed in claim 11, wherein the web server is configured to fax the images from the website to the Internet access device, or to a fax machine.