US7840634B2 - System and method for managing images over a communication network - Google Patents

System and method for managing images over a communication network Download PDF

Info

Publication number
US7840634B2
US7840634B2 US09/891,474 US89147401A US7840634B2 US 7840634 B2 US7840634 B2 US 7840634B2 US 89147401 A US89147401 A US 89147401A US 7840634 B2 US7840634 B2 US 7840634B2
Authority
US
United States
Prior art keywords
user
media file
service provider
party
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US09/891,474
Other versions
US20020198936A1 (en
Inventor
Dale F. McIntyre
Kenneth A. Parulski
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Monument Peak Ventures LLC
Original Assignee
Eastman Kodak Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eastman Kodak Co filed Critical Eastman Kodak Co
Priority to US09/891,474 priority Critical patent/US7840634B2/en
Assigned to EASTMAN KODAK COMPANY reassignment EASTMAN KODAK COMPANY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PARULSKI, KENNETH A., MCINTYRE, DALE F.
Priority to JP2002184380A priority patent/JP4554876B2/en
Publication of US20020198936A1 publication Critical patent/US20020198936A1/en
Priority to US12/903,611 priority patent/US8621047B2/en
Application granted granted Critical
Publication of US7840634B2 publication Critical patent/US7840634B2/en
Assigned to CITICORP NORTH AMERICA, INC., AS AGENT reassignment CITICORP NORTH AMERICA, INC., AS AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: EASTMAN KODAK COMPANY, PAKON, INC.
Assigned to KODAK REALTY, INC., QUALEX INC., LASER-PACIFIC MEDIA CORPORATION, KODAK PHILIPPINES, LTD., FAR EAST DEVELOPMENT LTD., PAKON, INC., FPC INC., NPEC INC., KODAK (NEAR EAST), INC., CREO MANUFACTURING AMERICA LLC, KODAK AVIATION LEASING LLC, EASTMAN KODAK COMPANY, KODAK AMERICAS, LTD., KODAK IMAGING NETWORK, INC., EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC., KODAK PORTUGUESA LIMITED reassignment KODAK REALTY, INC. PATENT RELEASE Assignors: CITICORP NORTH AMERICA, INC., WILMINGTON TRUST, NATIONAL ASSOCIATION
Assigned to INTELLECTUAL VENTURES FUND 83 LLC reassignment INTELLECTUAL VENTURES FUND 83 LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: EASTMAN KODAK COMPANY
Priority to US14/104,018 priority patent/US9979683B2/en
Assigned to MONUMENT PEAK VENTURES, LLC reassignment MONUMENT PEAK VENTURES, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: INTELLECTUAL VENTURES FUND 83 LLC
Assigned to MONUMENT PEAK VENTURES, LLC reassignment MONUMENT PEAK VENTURES, LLC RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: INTELLECTUAL VENTURES FUND 83 LLC
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/08Annexed information, e.g. attachments
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • H04L69/322Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
    • H04L69/329Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00Record carriers by type
    • G11B2220/20Disc-shaped record carriers
    • G11B2220/25Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537Optical discs
    • G11B2220/2562DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00Record carriers by type
    • G11B2220/60Solid state media
    • G11B2220/61Solid state media wherein solid state memory is used for storing A/V content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1101Session protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]

Definitions

  • the present invention is directed to automatically managing digital image files over a communication network.
  • a user must select a photofinishing order option on the film processing envelope that includes the digitization and uploading of the high resolution film images to a secure website where they are stored.
  • a photofinishing order option on the film processing envelope that includes the digitization and uploading of the high resolution film images to a secure website where they are stored.
  • the user Upon receiving and paying for the printed photofinishing order, the user receives a coupon that includes information for accessing the digital images on the website. Subsequently, the user must return to their home and using a computer with a conventional Internet browser must navigate to the website indicated by the coupon.
  • the user Upon arrival at the website and entry of the supplied information, the user finally is able to view their digital images.
  • the user can electronically share their images with third parties.
  • they can choose to send digitized images as image file attachments via electronic mail. This entails knowing the electronic address of those third parties which is usually stored and managed by a different software application on the user's computer.
  • image file attachments can cause an electronic mailbox to exceed a predetermined storage capacity especially if the user desires to share several images.
  • Another method of electronically sharing that attempts to solve the dilemma of sharing several images involves, sending an electronic link embedded in an electronic mail message that when clicked by the receiver, causes the receiving computer to locate and access the website containing the entire digitized order.
  • a problem with this method is that the receiver must have an Internet browser that is compatible with the electronic mail application to automatically launch the internet browser to the site of the digitized images. Furthermore, the receiver must enter information to view the images at the site. Access must also be given for each and every film order processed and uploaded.
  • the user desires to retrieve a copy of the digitized image for use on their own computer, they can encounter additional problems. For example, the user must follow several time consuming steps that often incur an additional charge or fee beyond the initial photofinishing order fee, to retrieve the high resolution image file that is stored at the online photoservice provider. In other cases some photoservice providers do not allow the user to download the high resolution image file at all.
  • Another common service provided by online photoservice providers is the ability for a user to use a computer to upload a digitized image already in the possession of the user such as image files created by a scanner, a digital camera, or a digitized film product such as the PictureCDTM produced by the Eastman Kodak Company.
  • These online photoservice providers store high resolution image files uploaded by users typically for producing printed images. Electronically sharing of these images is similar to those being placed at a website automatically by a photofinisher and similar problems are encountered by a user using such a service. The user must, for example, take the time to upload each and every image that he or she wishes to print or electronically share.
  • a system for managing digital images comprising:
  • a method for managing digital images by a service provider on a user computer over a communication network comprising:
  • FIG. 1 is a schematic diagram of a system made in accordance with the present invention showing the relationship of a user desiring to share digital images with a third party as permitted by a service provider;
  • FIG. 2 is a flow chart which shows the steps in creating a user account and image storage file in accordance with the invention
  • FIG. 3 is a flow chart which shows the steps in automatically sharing digital images with an authorized third party in accordance with the invention
  • FIG. 4 is a schematic diagram showing the relationship of a film processing photofinisher desiring to download digitized film images with a user as permitted by a service provider;
  • FIG. 5 is a modified system made in accordance with the present invention showing the relationship of a user desiring to share digital images with a third party as permitted by a service provider;
  • FIG. 6 is a flow chart which shows the steps of the method of operation of the system of FIG. 5 ;
  • FIG. 7 is a flow chart which shows the steps of another method of operation of the system of FIG. 5 ;
  • FIG. 8 is a flow chart which shows another method of sharing images using the system of FIG. 1 or FIG. 5 ;
  • FIG. 9 is a flow chart which shows yet another method of sharing images using the system of FIG. 1 or FIG. 5 ;
  • FIG. 10 a is partial view of a display screen illustrating an image from which an image content identifier is obtained
  • FIG. 10 b is an enlarged view of the image content identifier of FIG. 10 a;
  • FIG. 11 is a flow chart of still another method of operation of the system of FIG. 5 ;
  • FIG. 12 is a flow chart which illustrates the process of tracking an individual low resolution image file used to produce goods and/or services
  • FIG. 13 is a chart illustrating an example of one way revenues can be distributed among various parties
  • FIG. 14 is a flow chart of a method for restoring a high resolution image on a user device
  • FIG. 15 is another modified system made in accordance with the present invention showing the relationship of a user desiring to share digital images with a third party as permitted by a service provider;
  • FIG. 16 is a flow chart illustrating another method of operation of the systems of FIGS. 1 , 5 and 15 ;
  • FIG. 17 is a screen shot of a display screen showing an image and an electronic instruction/order form.
  • FIG. 18 is a flow chart illustrating another method of operation of the systems of FIGS. 1 , 5 and 15 ;
  • FIG. 19 is a block diagram of an electronic camera 23 ;
  • FIG. 20 depicts a rear view of the electronic camera incorporating the features of FIG. 19 ;
  • FIG. 21 is a flow chart of a method of using the electronic camera of FIG. 20 ;
  • FIG. 22 shows a flow chart that illustrates another method of operation of the system of FIG. 1 ;
  • FIG. 23 illustrates a flow chart which shows another method of operation of the system of FIG. 1
  • System 18 includes a user computer 10 operably connected through a communication service provider (CSP) 20 and a communication network 50 (such as the Internet) to a service provider 80 . Also included in system 18 is a third party computer 16 operably connected to the communication network 50 and service provider 80 via a CSP 22 .
  • User computer 10 is also operably connected to an electronic camera 12 and a storage drive 14 .
  • the electronic camera 12 can be a digital still camera such as the Kodak DC280 digital camera manufactured by the Eastman Kodak Company or it can be a digital motion camera such as the Kodak MC3 portable multimedia device which records motion and sound in addition to still capture and sound reproduction.
  • low resolution files are formed from the high resolution image files by sub-sampling, which in the case of digital still image files, involves reducing the number of image pixels and effectively lowering the resolution.
  • Such low-resolution, or “thumbnail” size images can be created as described in commonly-assigned U.S. Pat. No. 5,164,831 “ELECTRONIC STILL CAMERA PROVIDING MULTI-FORMAT STORAGE OF FULL AND REDUCED RESOLUTION IMAGES” to Kuchta, et. al., the disclosure of which is herein incorporated by reference.
  • low resolution files can include the discarding of frames and/or pixels within a frame. Such techniques are well known in the art and facilitate the transportation of images across any communication network 50 such as the Internet.
  • the storage drive 14 is illustrated as being removable.
  • the storage drive 14 can be an integral part of user computer 10 and can use removable storage media (not shown).
  • the electronic camera 12 can connect to the user computer 10 via a cable employing a common interface such as a Universal Serial Bus (USB) interface.
  • USB Universal Serial Bus
  • electronic camera 12 can connect to the user computer 10 in a wireless mode employing any number of conventional interfaces such as the radio frequency standard commonly described by BluetoothTM Specification V1.0 or Wireless Personal Area Network IEEE Standard 802.15.
  • removable storage drive 14 is operably connected to user computer 10 and permits the storage of high resolution image files such as digital still or digital motion images and associated metadata that can, for example, further include audio information.
  • an image media file includes a digital image file (high or low resolution) and can also include additional data such as associated audio or metadata.
  • the user selects the location for the storage of the high resolution image media files either internally to the user computer 10 or on removable storage drive 14 , such as computer disc, CD, etc.
  • high resolution image media files can be arranged in a user storage file such as a database.
  • the user computer 10 is provided with appropriate software for allowing controlled access to a high resolution image media collection, such as a database, stored on memory storage device 14 .
  • the high resolution image media collection comprises at least one high resolution image media file and as previously discussed can include associated digital data.
  • a low resolution copy of each high resolution digital image file along with any associated meta data/information (the combination of both files hereinafter referred to as the user low resolution image collection) is electronically sent to the service provider 80 for storage at the service provider 80 and is associated with the user.
  • an image can be associated with a user is the addition of metadata to the image media files(s) that reflects a specific user identifier such as a user account number, a user provided identifier with any combination of alphanumeric characters, or any other construct in the form of metadata.
  • Another form of association with the user can be accomplished by creating a storage system that allocates file storage based on a user identifier such as a relational database. This association creates a low resolution user image collection of the digital image files at the service provider 80 . While the digital image files and associated data files can be forwarded by the user, these files can be automatically retrieved by the service provider 80 . For example, the user has a database identified for access by the service provider 80 .
  • the service provider 80 can automatically, on a routine schedule, determine if the user computer 10 is available over the communication network 50 . If the user computer 10 is available for communication, the service provider 80 will then automatically review the database on the user computer 10 where the high resolution media files are stored to determine if any new digital image files or associated files have been added to the database. If new files have been added or changed, then a low resolution image file is formed for each new image and data changes are appropriately communicated to the service provider 80 for storage and association with the user low resolution image collection.
  • this information can be used to identify who can have access to the low resolution image and information that describes the content of the images.
  • this information can include information relating to the data storage structure of the high resolution images stored on image storage device 14 .
  • the data storage structure information includes parameters that reflect the storage locations of the high resolution image media files on the physical media such as track and sector information associated with hard disk memory architecture. This information can be used to assist in the rebuilding of a damaged directory in the event of a failure of storage device 14 and can be automatically updated on a routine communication interval by the service provider 80 .
  • damaged directories on hard disks can render a disk drive unreadable when the actual file data is still valid.
  • Software running on the user computer 10 such as the commercially available Norton Utilities offered by Symantec Inc. can restore the accessibility of high resolution image media files using the data storage structure information related to the low resolution image media files stored by service provider 80 as later discussed herein with respect to FIG. 14 .
  • Service provider 80 can provide this additional service for a fixed or recurring fee. This can provide valuable assistance in reconstructing damaged digital image files on user computer 10 .
  • an image icon 202 can be used as a content identifier to first identify content of images forwarded to the service provider 80 .
  • the image icon 202 is in the form of the face of an individual taken from image 206 of FIG. 10 a .
  • face recognition software programs such as described in co-pending U.S. pending patent application entitled A METHOD AND SYSTEM FOR CATALOGING IMAGES, of John R. Squilla and Dale Fredrick McIntyre, Ser. No. 09/640,938, filed Aug.
  • the identification information can be used to identify who can view this image at the service provider 80 or even provide an automatic forwarding of the image to a specified individual. While the images can be automatically analyzed for such information, the user can also specify that a particular icon 202 be associated with a particular image.
  • the icon 202 has been shown for use in identifying other individuals found within digital images to which said images are to be forwarded, the present invention is not so limited.
  • the icon 202 can also be used to identify images that the user wishes to be sent to him.
  • the icon 202 can represent the face of the user and that when the icon 202 is sent to a third party it can be used to identify images that include the user.
  • the icon 202 can also be provided with information, such as a Universal Resource Locator (URL) address, where the image is to be sent.
  • the icon 202 can be sent to specific third parties wherein the third party would provide consent to have their images reviewed for forwarding to the user who provides the icon 202 .
  • URL Universal Resource Locator
  • the service provider 80 upon request from the user providing the icon 202 , can search the low resolution image collections of other users for occurrences of the icon 202 applied to their images. Upon finding images of other users that have applied the icon 202 of the user providing the icon 202 , service provider 80 can automatically forward these images to the user providing the icon 202 . Furthermore, service provider 80 keeps a log or record of the other users who have used the icon 202 provided by the user. Thus the service provider can monitor access and/or use of digital media files associated with the icon 202 .
  • service provider 80 automatically updates the icon 202 for those users found in the log associated with the use of the specific updated icon 202 .
  • the updated icon 202 can replace the existing icon 202 or it can be simply added to the database of icons 202 . Allowing the two icons 202 to coexist permits the recognition of high resolution image files that can be scanned and provided at a substantially later date.
  • the icon 202 can also be used to access public sites that have images that can be used freely or for a price. While the icon 202 has been described as recognizing images containing a particular individual, the icon 202 can represent any theme, for example, any sports, hobby, or item. Images that have been identified with any such theme can be automatically forwarded by service provider 80 to the image collection of a special interest group that a user may belong to. Such preferences for forwarding are stored at service provider 80 as previously discussed.
  • loyalty points can be associated with the user by the service provider 80 in response to interactions with the system 18 or the system 200 ( FIG. 5 ).
  • loyalty points shall be considered discounts, credits or other value assessed on behalf of the user which are credited toward the purchase or sale of goods and/or services.
  • a user who shares at least one of the low resolution image media files with an authorized third party can earn loyalty points from service provider 80 , if the authorized third party orders image based goods and/or services from service provider 80 that are derived from the shared low resolution image media files.
  • Service provider 80 can award more points to a user who shares with an authorized third party that doesn't currently have an existing relationship with service provider 80 .
  • Incentives in this case, are placed on encouraging additional users to develop relationships with service provider 80 .
  • service provider 80 can maintain a log or record of all accesses to images maintained in a user's image collection. This arrangement has the added benefit of providing a tracking mechanism in the event that an authorized third party misuses an image file provided by a user. Loyalty points can be redeemed at service provider 80 or fulfillment provider 70 for image related goods and/or services. See FIG. 12 for a more complete description of this operation.
  • Another process of earning loyalty points will be discussed later with respect to FIG. 18 and can include authorized third parties performing extended services such as cataloging by matching the user's content identifiers to the user's digital images to be cataloged. Rewarding an authorized third party with loyalty points for matching the user's content identifiers to the user's images relieves service provider 80 from the image processing burden.
  • Service provider 80 includes a server 82 for interfacing with the communications network 50 such as the Internet or a virtual private network (VPN).
  • server 82 transfers information to computer system 86 which manages information associated with various users.
  • Computer system 86 includes an account manager 84 which is software operating in accordance with the invention to permit the creation and management of individual user accounts.
  • Information associated with user accounts is stored in relational database(s) 88 .
  • User account information includes personal information such as name and address, billing information such as credit card information, network information such as personal electronic location information and authorization information which controls access to the user's images by third parties.
  • relational database(s) 88 which store low resolution user image files, related metadata and other information relevant to providing services to the user.
  • One such example, but not by way of limitation, is a defect and directory map of the user's physical storage device to aid in the recovery of damaged image media files stored on the storage device 14 .
  • Fulfillment provider 70 which provides image-based goods and/or services to users and third parties.
  • Fulfillment provider 70 includes a fulfillment web server 72 , a digital printer 78 and a fulfillment computer system 76 that further includes a commerce manager 74 and a fulfillment manager 75 .
  • Fulfillment requests received from service provider 80 , user computer 10 or third party computer 16 are handled by commerce manager 74 initially before handing the requests off to the fulfillment manager 75 .
  • the fulfillment manager 75 determines which equipment is used to fulfill the ordered good(s) such as a digital printer 78 .
  • the ordered goods are returned to the ordering party by a delivery means for example, but not by way of limitation, a transportation vehicle 68 .
  • FIG. 2 is a flow chart of the operation of the system 18 .
  • the user establishes an account with the service provider 80 .
  • various information is provided, for example, but not limited to, name, address, electronic address, credit card information, names of individuals or business establishments that have permission to access image media files, names of any particular files of grouped images and authorized viewer, the type of access granted, name of a preferred fulfillment service provider for the providing of goods and/or services and automatic forwarding instructions per selected criteria. It is of course to be understood that any other relevant information and/or instructions can be provided as desired or that which the service provider is cable of providing.
  • the user identifies or establishes the high resolution media collection.
  • low resolution digital image files are formed from the high resolution digital image files in the collection and are forwarded to the service provider 80 along with any appropriate associated data files (user low resolution image collection) over the communication network 50 .
  • the verification that the service provider 80 has received the low resolution media files is completed. If the transfer of the low resolution media collection was not successful, the user is advised of this non-successful transmission in step 38 and repeats the transmission of the low resolution media collection in step 34 until successful.
  • the service provider 80 at step 40 creates a low resolution media collection where these low resolution media collections are stored and associated with the user.
  • step 40 the instructions previously provided by the user are reviewed and implemented. For example, if a third party has been designated to automatically receive selected media files as identified, these media files will be forwarded over the communication network 50 to the designated third party at step 42 . As illustrated by FIG. 1 , this can be a third party computer 16 . Alternatively, the selected media files can be forwarded to a fulfillment provider 70 location for fulfillment of a service or product, such as producing a print for delivering to a designated individual from a fulfillment provider 70 .
  • the fulfillment provider 70 can use the low resolution media file for the fulfilling of the requested goods and/or services, often, the fulfillment provider 70 needs the high resolution digital image.
  • the provider 80 can directly access the high resolution files directly from the user or have them provided through the service provider 80 .
  • the fulfillment provider 70 comprises a facility for printing or producing images from digital media files that have been provided by users and delivering them to designated locations.
  • the fulfillment provider 70 can deliver any goods or services that they are capable of providing.
  • the goods can include T-shirts, mugs, cakes, or any other goods or services that incorporate images provided by the user.
  • a third party can access the low resolution image collection over the communication network 50 using third party computer 16 .
  • the service provider 80 can produce and transmit a report to the user that monitor the details of which media files were shared or accessed by which third parties.
  • FIG. 4 there is illustrated a flow chart representing a process used by service provider 80 for automatically updating the low resolution image collection associated with a user during a regular and periodic update or replication procedure.
  • service provider 80 establishes a connection with user computer 10 (step 52 ).
  • the connection can either be established by the user computer 10 initiating communication or by the service provider 80 initiating the communication.
  • the service provider 80 then checks to see if the high resolution image collection has been modified (step 54 ).
  • Modifications to the high resolution image collection can include the addition or modification of at least one image media file, additions and/or modifications to metadata, modifications to the user account information such as the addition or deletion of authorized third parties, or any other desired changes to the user account information.
  • service provider 80 makes the appropriate changes (step 56 ) to the user account and/or low resolution image collection. Relational database(s) 88 are updated with the updated information. If no modifications to the high resolution image collection are detected (step 54 ), the service provider 80 concludes the communication in step 58 .
  • FIG. 5 there is illustrated a modified system 200 made in accordance with the present invention.
  • System 200 is similar to system 18 with like numerals indicating like parts and operation as previously discussed.
  • a photofinisher 90 is provided for processing of photographic film 92 .
  • the photofinisher 90 can be a retail establishment by itself or operating in association with a wholesale photofinishing establishment.
  • the photofinisher 90 includes a film processor 94 for developing of the images on photographic film 92 .
  • a film scanner 96 is provided for scanning of images formed on the processed film for obtaining high resolution digital image files that are forwarded to a memory device 98 as high resolution image files.
  • the photofinisher 90 also includes an appropriate computer 100 for managing of the various equipment and various operations of the photofinishing system.
  • One such operation is the attachment of metadata to the high resolution image file that identifies the specific photofinisher via a pre-assigned unique business identifier.
  • the photofinisher 90 is a wholesale photofinisher operating in association with a retailer
  • separate business identifiers are attached as metadata to the high resolution image media files linking both wholesale photofinisher and retailer to the specific photographic film 92 and the processed images associated therewith.
  • Another operation of computer 100 is the providing of information to a server 102 for communicating over the communication network 50 to various third parties.
  • the photofinisher 90 also includes an appropriate printer 104 for printing of images that have been scanned onto an appropriate media, for example, photographic paper, thermal media, etc. It is, of course, understood that any other appropriate output device can be provided for producing prints or other products incorporating images that have been obtained from the scanning of the developed photographic film 92 .
  • FIG. 6 there is illustrated a flow chart of one method of the operation of the system 200 of FIG. 5 .
  • a roll of exposed, undeveloped photographic film 92 provided, for example, in a film cartridge 93 is forwarded to the photofinisher 90 (Step 106 ) in association with the user.
  • the photofinisher 90 develops the film 92 and scans the developed images for producing high resolution image files that are temporarily stored on memory device 98 with metadata identifying the photofinisher 90 as the retailer or separably as the retailer and photofinisher as discussed earlier.
  • the photofinisher 90 in the embodiment illustrated, further associates a unique identification (ID) 110 that is provided on the film 92 with the scanned images and hence, the high resolution image files.
  • ID unique identification
  • Such a unique ID 110 can also be attached to a user order in a variety of ways.
  • the unique ID 110 can be associated with a photofinishing envelope (not shown), the film cartridge 93 , pre-exposed on the film 92 itself, by random assignment, or any other appropriate way to associate the film 92 and the user.
  • Unique ID 110 can be appended as metadata to the high resolution image media file upon scanning to associate the digital image with the user.
  • Commercially available film products manufactured by the Eastman Kodak Company under the AdvantixTM brand are examples of film cartridges 93 having the unique ID 110 associated with them.
  • these high resolution media files and unique ID 110 are transferred via communication network 50 to the service provider 80 in association with the user at an appropriate time (step 112 ).
  • service provider 80 (step 114 ) checks to see if the unique ID 110 has been registered with specific processing instructions.
  • service provider 80 creates low resolution copies of each of the newly received high resolution files in step 118 . These low resolution copies are then added to the user's existing low resolution image collection in step 120 .
  • the high resolution files are temporarily stored at the service provider 80 until they are transferred to the user's high resolution image collection on the user computer 10 at the next routine communication interval or non-scheduled communication (step 122 ).
  • service provider 80 can store the high resolution image files for an ordering period that makes ordering of image goods and/or services by the user or authorized third parties more convenient. The storing of the high resolution image files for the ordering period is in addition to transferring the high resolution files to the user computer 10 .
  • the high resolution image files are automatically converted to low resolution copies and added to the user's low resolution image collection. This would be particularly useful to a service provider, in that, initial interest in obtaining prints or other image products/services usually occurs in a relatively short time after obtaining the image. Thus, making the need to obtain the high resolution file from user computer 10 unnecessary during this ordering period.
  • instructions associated with the registration are carried out by the service provider 80 in step 116 .
  • These instructions can include for example, but not by way of limitation, the directions to print, automatically transmit to various third parties and deliver various image-based goods and/or services to the user or third parties designated in the instructions.
  • Third parties that have similar arrangements for low resolution image media collections maintained by service provider 80 will receive the automatically transmitted low resolution image media files as additions to their low resolution image media collections.
  • these low resolution image media files are automatically transferred to the third parties' computers 16 .
  • Software running on each third party computer 16 causes newly transferred image media files to be presented to the third party without needing to use the process of attaching/detaching operations found in traditional electronic mail protocols. This process will be discussed in further detail with respect to FIG. 11 later in this specification.
  • service provider 80 After completing the registered instructions, service provider 80 creates low resolution copies of each of the newly received high resolution image files in step 118 . These low resolution copies are then added to the user's existing low resolution image collection in step 120 .
  • the high resolution image files are temporarily stored at the service provider 80 until they are transferred to the user's high resolution image collection on the user computer 10 at the next routine communication interval. It is of course to be understood that any associated digital files can also be communicated to user computer 10 .
  • FIG. 7 Another method of operating the system 200 is shown as a flow chart in FIG. 7 .
  • photographic film 92 associated with the user is forwarded to the photofinisher 90 in step 124 .
  • the photofinisher 90 in step 126 processes the photographic film 92 , reads the unique ID 110 , scans the developed film images, forms high resolution image files and temporarily stores them in memory device 98 associated with the user and the photofinisher 90 as discussed earlier.
  • photofinisher 90 establishes a communication connection via communication network 50 to service provider 80 and passes the unique ID 110 to service provider 80 to see if the photographic film 92 has been registered and has instructions pertaining to the ordering of image related goods and/or services. If the photographic film 92 had been registered, photofinisher 90 carries out the instructions (step 130 ) which can by way of example, but not limitation, include printing additional copies of the high resolution image media files to be forwarded to a third party via delivery vehicle 68 .
  • the photofinisher 90 can transfer (step 134 ) the high resolution image files from the memory device 98 to the user computer 10 .
  • the updated high resolution media image collection on user computer 10 will be detected and the appropriate low resolution image files formed and transferred to the low resolution image media collection maintained by service provider 80 at the next routine communication interval.
  • the photofinisher 90 reaches the conclusion of the activity in step 136 .
  • photofinisher 90 transfers the high resolution digital image files to the service provider 80 (step 138 ).
  • the service provider 80 then creates low resolution image file copies of each high resolution digital image file (step 140 ), adds them to the low resolution image media collection associated with the user (step 142 ) and transfers the high resolution digital image files to the user computer 10 (step 144 ) at the next communication.
  • service provider 80 can additionally implement the steps marked at point “A” illustrated in FIG. 9 to the conclusion of that flow chart. These additional steps, as shown by FIG. 9 , compare the newly digitized and transferred high resolution image files with the content identifiers for the automatic routing of and adding information to form image media files based on identified content within the high resolution image files.
  • the flow chart of FIG. 8 shows another method for sharing of the media collection wherein the user has provided information regarding the content of the files to be shared using software operable on user computer 10 .
  • the information has been stored as metadata associated with the image file within the high resolution image media collection on the user computer 10 or storage drive 14 .
  • a connection is automatically established between service provider 80 and the user computer 10 .
  • Optional step 149 reflects system 200 permitting the user to turn “on” or “off” the feature of automatically routing an image media file to a third party. If the autoroute feature is turned off, the rest of this flow chart doesn't apply, ending the process in step 162 .
  • service provider 80 determines if a new media file has been added to the high resolution image media collection on the user computer 10 .
  • service provider 80 examines the metadata associated with the new high resolution image media file for specific sharing metadata at step 152 .
  • a high resolution image media file that is a still image of “John” has been annotated by the user as “John”.
  • “John” has been correlated to an electronic mail address as john.doe@service.com. Sharing this image media file (step 158 ) causes an electronic mail message to be generated and forwarded to john.doe@service.com.
  • “John” also has an account and low resolution image media collection with service provider 80 .
  • Sharing (step 158 ) in this alternative example, is accomplished by a direct file transfer from the low resolution image media collection of the user to the low resolution image media collection of “John”.
  • Intermediate steps 154 and 156 allow service provider 80 to aggregate multiple image media files to be shared with the same third party.
  • the new image media files within the high resolution image media collection are updated (step 160 ) with the metadata of which third party they were shared with.
  • system 200 analyzes the content of the image media files and automatically shares those image media files with authorized third parties in accordance with instructions stored at service provider 80 in association with the user.
  • System 200 additionally stores information associated with recognized content as metadata with the image media files.
  • system 200 checks the high resolution image media collection for new added files (step 168 ). If no new files have been added, the current process ends in step 184 .
  • the computer system 86 of service provider 80 loads user content identifiers (step 170 ) from relational databases 88 associated with the user.
  • step 172 computer system 86 processes the newly added files against the user content identifiers in accordance with the aforementioned U.S. patent application of John R. Squilla and Dale Fredrick McIntyre, Ser. No. 09/640,938, previously discussed.
  • the processed high resolution image files with recognized content have metadata appended to them as determined by the content identifiers.
  • Steps 174 , 176 and 178 iteratively examine the processed image files for recognized content, add the information associated with the recognized content as metadata and create a sharing image media file that can include a plurality of the processed image files to be shared with a single third party.
  • the sharing file is sent to a third party identified by the associated content identifier in step 180 following which, the image files have “sent to” metadata stored in association with the specific image file (step 182 ) both in the low resolution image media collection stored at the service provider 80 and the high resolution image media collection stored in the user computer 10 or storage device 14 .
  • FIG. 10 is a partial view of the display screen 204 of user computer 10 wherein a representative image 206 of the high resolution image media file is displayed.
  • Dotted line “L” indicates selected image content identifier and results from an action taken by software running on the user computer 10 in response to a user acting with a selection device such as a computer mouse or in response to an algorithm for identifying content.
  • the selected image content identifier forms the image icon 202 as shown by FIG. 10 b which is a form of content identifier.
  • service provider 80 establishes a connection with third party computer 16 over communication network 50 for the purposes of transferring low resolution image media files sent to the third party by the user.
  • service provider 80 downloads the low resolution image media files to third party computer 16 (step 252 ) which detects the newly shared low resolution image media files, (step 254 ) and launches a low resolution image media file browser such as standard slide show software (step 256 ) thus eliminating the need to detach an image media file from an e-mail message and launch an image viewing application.
  • a low resolution image media file browser such as standard slide show software
  • FIG. 12 a flow chart illustrates the process of tracking an individual low resolution image media file associated with a user when it is used by an authorized third party for producing image based goods and/or services and awarding loyalty points to the user.
  • an authorized third party places an order for image based goods and/or services with service provider 80 based on a low resolution image media file shared by the user.
  • the authorized third party also provides a form of electronic payment such as a credit card to service provider 80 in a manner well understood in the art for electronic commerce transactions.
  • Service provider 80 needs the high resolution image media file to forward to fulfillment provider 70 .
  • service provider 80 determines the user who shared the low resolution image media file that the third party is using to place an image based order. This can be accomplished by looking at the metadata associated with the low resolution image media file as discussed earlier.
  • the service provider 80 determines if the user computer 10 associated with the low resolution image media file is connected to the communication network 50 . If user computer 10 is not available, the service provider 80 places a request (step 242 ) for the associated high resolution image media file with the account manager 84 for retrieval at the next routine communication interval indicated by the dotted line “M”. Optionally, service provider 80 can send an e-mail message to the user to alert him/her that a high resolution image media file is required to fulfill an order. In yet another method of notification, service provider 80 can send an automated phone message to the user instructing him/her to make user computer 10 available.
  • the associated high resolution image media file is retrieved and forwarded to the fulfillment provider 70 in step 234 .
  • the user's account is then updated with loyalty points (step 236 ) assigned as a result of the transaction of the third party.
  • the loyalty points can be assigned as a function of a dynamic look-up table managed by service provider 80 . For example, a 4 ⁇ 6 hard copy print might earn 10 loyalty points, an album page 100 points and a Compact Disc (CD) 200 points and so on and so forth for other goods and/or services that can be offered by service provider 80 or fulfillment provider 70 .
  • the loyalty points can be dynamically adjusted by the service provider 80 in response to market conditions or levels of user orders. Similarly, new products might be offered with a temporary higher level of loyalty points to encourage their trial and use.
  • Fulfillment provider 70 completes the order placed by the third party and delivers the image based goods and/or services in step 238 .
  • account manager 84 assigns loyalty points (step 240 ) to the account of the third party based on this order.
  • service provider 80 distributes revenues (step 244 ) collected from the third party to those providers associated with the developing, scanning, processing, printing etc. where such providers have contributed to the production of the ordered goods and/or services.
  • An example of revenue distribution amongst various contributing providers is illustrated in the table of FIG. 13 .
  • the service provider 80 If the service provider 80 also completes the fulfillment of the ordered goods, then the service provider 80 earns the designated percentage “D” that would normally have been distributed to fulfillment provider 70 .
  • a retail store for example, could process, print and scan negatives earning the combined designated percentages of “B” and “C” of the revenue collected by service provider 80 . It is of course to be understood that the amount of percentages can be any desired value.
  • FIG. 14 there is illustrated a process for restoring data structure information for high resolution image files stored on storage device 14 in the event of a user device malfunction.
  • the user has received a disk read error while trying to view or otherwise use an image from the high resolution image media collection stored on storage device 14 .
  • Setting a disk drive service flag (step 262 )
  • the user is asked (step 264 ) by software running on the user computer 10 , if they desire to back up the high resolution image collection onto removable storage media prior to servicing the malfunctioning disk drive.
  • the user optionally can choose (step 266 ) to back up the high resolution image media collection at home onto a storage device operably connected to user computer 10 or via service provider 80 uploading all of the high resolution image files that did't previously backed up.
  • step 272 the user has chosen to back up the high resolution image media files at home whereby software running on user computer 10 causes the appropriate high resolution image media files to be written to removable storage media supplied by the user. If backing up the high resolution image media files at home is not possible, then the user can request service provider 80 to perform this task in exchange for a service fee.
  • service provider 80 uploads (step 268 ) all the high resolution image media files not previously backed up.
  • service provider 80 writes the uploaded high resolution image media files to an appropriate removable media which was previously agreed to by the user. After completing the writing and verifying of high resolution image media files, service provider 80 causes the written removable media to be sent to the user and deletes (step 270 ) the uploaded high resolution image media files. Of course, the user can choose to pay an additional fee and keep all the high resolution image media files stored at service provider 80 . Following the completion of backing up high resolution image media files, service provider 80 downloads (step 274 ) data storage parameters to the user computer 10 which are updated at each communication or on a periodic basis. Finally in step 276 , software running on the user computer 10 uses the data storage parameters to restore the integrity of the storage device 14 .
  • FIG. 15 there is illustrated another modified system 300 made in accordance with the present invention.
  • System 300 is similar to system 18 with like numerals indicating like parts and operation as previously discussed.
  • user computer 10 permits the storage of high resolution image media files provided from a number of image media file sources on storage device 14 .
  • High resolution image media files can be provided by photofinisher 90 , as previously discussed, which provides high resolution image media files associated with the user to service provider 80 for eventual transferring to the user computer 10 .
  • image media files associated with the user can be provided to service provider 80 for transfer to the user computer 10 .
  • high resolution image media files captured by a cellular wireless electronic (digital) camera 23 can be transferred to service provider 80 through a common telecommunications network 25 , as described in commonly-assigned U.S. patent application Ser. No. 09/718,018, “SYSTEM AND CAMERA FOR TRANSFERRING DIGITAL IMAGES TO A SERVICE PROVIDER” filed by Endsley, et. al., the disclosure of which is herein incorporated by reference.
  • Each transfer through the telecommunications network 25 can generate a transfer fee to be charged to the user through service provider 80 .
  • service provider 80 can process the high resolution image media file from the cellular wireless electronic camera 23 with respect to content identifiers associated with the user as previously discussed with respect to FIGS.
  • service provider 80 can send a return message to the cellular wireless camera 23 prompting the user to verify the content identified by service provider 80 .
  • the verification prompt message can be displayed on the color LCD image display 332 and the user operating push buttons 372 - 376 shown in FIG. 19 can respond to validate or invalidate the identified content. Such validation is advantageous while the user has just captured the image and his memory of the image content is still fresh.
  • a kiosk 15 such as the Kodak Picture MakerTM kiosk that includes a scanner for producing a high resolution image media file of a hardcopy print. Connected to the communications network 50 , the kiosk 15 can, for a fee, provide high resolution image media files to service provider 80 that are eventually transferred to the user computer 10 .
  • a process for operating the systems 18 , 200 and 300 is shown which permits the user to request an extended service in association with a particular high resolution image media file.
  • the user electronically tags (identifies) a high resolution image media file with an extended service indicia.
  • the extended service indicia causes software running on the user computer 10 to retrieve an electronic form (See FIG. 17 ) that is associated with the requested extended service.
  • the electronic form can be stored on the user computer 10 as part of a service agreement with service provider 80 or it can be actively retrieved from the service provider 80 . In either case, the electronic form is retrieved and filled out (step 282 ) by the user.
  • service provider 80 Upon establishing communication (step 284 ) either immediately or at the routine communication interval, service provider 80 determines (step 286 ) if any extended services have been requested. If not, service provider 80 completes the typical processing done at the routine communication interval (step 288 ) as has been previously discussed ending the process in step 294 . If extended services have been requested, service provider 80 uploads (step 290 ) the completed electronic form associated with the high resolution image media file. Following this step, service provider 80 executes (step 292 ) the extended service request as indicated by the instructions on the electronic form shown in FIG. 17 , with the process ending in step 294 .
  • FIG. 17 a screen shot 310 of user computer 10 is shown that includes a visual representation 316 of a high resolution image media file to which an extended service request form is attached.
  • An instruction block 312 contains information for the service provider 80 to follow in the execution of the requested extended service.
  • the user has indicated that the high resolution image media file is to be placed for sale which can be one type of extended service offered by service provider 80 .
  • the italicized word “BOAT” can be the result of the user selecting a word from a list or it can be the result of applying the user's content identifiers to this specific high resolution image media file.
  • Information block 314 includes keywords that can be input by the user and useful in the execution of the requested extended service.
  • Other extended services include posting the visual representation 316 of the high resolution image media file to a website that uses such visual representations 316 to aid in the selling of goods or to aid in the finding of a seller of such goods.
  • an extended service is the use of the high resolution image media file to represent an item insured by a third party such as an insurance business.
  • a third party such as an insurance business.
  • high resolution image media files help the user get insurance rates that reflect the actual belongings depicted in the high resolution image media file.
  • the user provides specific information about the specific household belonging depicted by the high resolution image media file such as manufacturer, purchase price, purchase date, serial number and any other information necessary to providing insurance on such a belonging. Additionally, the user provides authorization to service provider 80 for the third party insurance business to view specific high resolution image media files.
  • Tagging a high resolution image media file for adding to an insured item list or deleting from an insured item list permits an automatic update of insurance coverage and can result in an added fee or credit applied to the user by the third party insurance business.
  • Service provider 80 can charge a fee from a third party business for permitting the third party business such as an insurance business to view image media files depicting household objects belonging to the user.
  • An additional third party such as the retailer of the item sold, can be used for validation of ownership and sale of the particular item.
  • extended services includes a service performed by a non-professional third party user or peer (a free lance individual) operable in the systems 18 , 200 and 300 by the processes shown in FIGS. 16 and 18 .
  • the process of FIG. 18 describes an example of a detailed process used by service provider 80 in step 292 of FIG. 16 .
  • the user has provided unlimited third party authorized access to a high resolution image media file or group of high resolution image media files on the extended service request form for the purposes of restoring a scanned high resolution image file created from an older, damaged hardcopy print.
  • Information on the extended service request form can include an amount of money that requesting user is willing to pay in exchange for the service.
  • account manager 84 can provide account credits to the third party providing the service. These account credits can be used when the third party requests extended services from other users.
  • Account manager 84 can also provide account credits in the form of loyalty points or reduced account fees.
  • service provider 80 retrieves the high resolution image media file from the user computer 10 and stores the high resolution image media file in a memory of computer system 86 . While this is the preferred embodiment, the retrieval of the high resolution image media file from user computer 10 need not happen until after third party user accepts the service request in step 558 .
  • service provider 80 adds the extended service request form including a low resolution image file to a list of service requests on a web page whose access and display is managed by web server 82 and account manager 84 .
  • Third party users access (step 554 ) the list of extended service request and decide to accept or not accept an extended service request in step 556 .
  • Third party users can counter offer (step 566 ) to perform the extended service for terms differing from what was originally offered. For example, the third party user can raise the required amount of money from that originally offered to complete the service.
  • the user requesting the service can choose to accept (step 568 ) the revised terms of service or end the negotiation in step 570 . If terms agreed upon, the third party user retrieves (step 558 ) the high resolution image file to perform the service on from either service provider 80 or directly from the requesting user by accessing the high resolution image media file on user computer 10 .
  • the third party user performs (step 560 ) the extended service requested, which in this example is an image restoration, by using commonly available tools such as PhotoshopTM produced by Adobe Systems Inc.
  • the third party modified high resolution image media file is converted to a low resolution image file for review by the user requesting the extended service. If the user requesting the extended service accepts (step 562 ) the work of the third party user, service provider 80 assigns (step 564 ) credits to the third party user less a fee for brokering the service and debits to the user requesting the extended service with the process ending in step 570 .
  • Cataloging images is another extended service that can be provided by third party users or peers in this manner.
  • FIG. 19 a block diagram of an electronic (digital) camera 23 which captures high resolution image files that are stored on the removable memory card 350 .
  • FIG. 20 depicts a rear view of the electronic camera 23 of FIG. 19 .
  • the electronic camera 23 is powered by rechargeable batteries 344 that connect to power supply 346 which supplies power to the camera circuits depicted in FIG. 19 .
  • a charger input 348 is provided as an external connection (which can be included as part of interface connection 342 ) so that the rechargeable batteries 344 can be recharged by an external power source.
  • the electronic camera 23 includes a zoom lens 352 having zoom and focus motor drives 360 and an adjustable aperture and shutter (not shown).
  • the user composes the image using the optical viewfinder 341 and the zoom lens control 334 and then depresses the shutter button 331 to begin capture of a still image.
  • the zoom lens 352 focuses light from a scene (not shown) on an image sensor 354 , for example, a single-chip color CCD image sensor, using the well-known Bayer color filter pattern.
  • the image sensor 354 is controlled by clock drivers 366 .
  • the zoom and focus motors 360 and the clock drivers 366 are controlled by control signals supplied by a control processor and timing generator circuit 364 .
  • the control processor and timing generator circuit 364 receives inputs from autofocus and auto-exposure detectors 368 and controls a flash 362 .
  • the analog output signal from the image sensor 354 is amplified and converted to digital data by the analog signal processing (ASP) and analog-to-digital (A/D) converter circuit 356 .
  • the digital data is stored in a Dynamic Random Access Memory (DRAM) buffer memory 358 and subsequently processed by a processor 320 controlled by the firmware stored in the firmware memory 328 , which can be flash Erasable Programmable Read Only Memory (EPROM).
  • DRAM Dynamic Random Access Memory
  • EPROM flash Erasable Programmable Read Only Memory
  • the processed high resolution image file is provided to a memory card interface 324 which stores the high resolution image file on the removable memory card 350 .
  • Removable memory cards 350 are one type of removable image digital storage medium and are available in several different physical formats.
  • the removable memory card 350 can include memory cards adapted to the Personal Computer Memory Card International Association (PCMCIA) card interface standard, as described in the PC Card Standard, Release 2.0, published by the Personal Computer Memory Card International Association, Sunnyvale, Calif., September 1991.
  • the removable memory card 350 can also be adapted to the Compact Flash interface standard, such as described in the CompactFlash Specification Version 1.3, published by the CompactFlash Association, Palo Alto, Calif., Aug. 5, 1998, or to the well-known SmartMedia, MemoryStick or SD memory card formats.
  • Other types of removable image digital storage media such as magnetic hard drives, magnetic tape, or optical disks, can alternatively be used to store the digital images.
  • the processor 320 performs color interpolation followed by color and tone correction, in order to produce rendered sRGB image data.
  • the rendered sRGB image data is then JPEG compressed and stored as a JPEG image file on the removable memory card 350 .
  • the JPEG file uses the so-called “Exif” image format defined in “Digital Still Camera Image File Format (Exif)” version 2.1, July 1998 by the Japan Electronics Industries Development Association (JEIDA), Tokyo, Japan.
  • This format includes an Exif application segment that stores particular image metadata, for example the date and time the picture was captured, the lens f/number and other camera settings and image captions or comments that can be selected or entered by the camera user.
  • the electronic camera 23 also includes a modem 390 connected to an RF antenna 392 .
  • the modem 390 is preferably a cellular modem using, for example CDMA (Code Division Multiple Access) or TDMA (Time Division Multiple Access) technologies.
  • the modem 390 communicates with communication network 50 via a wide area cellular network, such as the 1900 MHz CDMA network deployed by Sprint PCS in the U.S.A.
  • An interface connection 342 can be used to connect between an interface 322 in the electronic camera 23 and a corresponding camera interface in the user computer 10 .
  • the interface connection 342 may conform to, for example, the well-known universal serial bus (USB) interface specification, or to many other standard interfaces.
  • the interface connection 342 can be used to transfer images from removable memory card 350 to the user computer 10 .
  • the interface connection 342 can also be used to transfer data from the user computer 10 to firmware memory 328 in electronic camera 23 . In particular, it can optionally be used to transfer phone numbers, e-mail addresses, Internet URLs, etc. to firmware memory 328 , as described in commonly-assigned U.S. Ser. No. 09/004,046 filed Jan. 7, 1998 entitled “NETWORK CONFIGURATION FILE FOR AUTOMATICALLY TRANSMITTING IMAGES FROM AN ELECTRONIC STILL CAMERA” to Ward et. al., the disclosure of which is herein incorporated by reference.
  • the graphical user interface displayed on the color LCD image display 332 is controlled by mode control 370 and push buttons 372 - 376 shown in FIG. 19 .
  • the user places the mode control 370 in the “capture” position prior to capturing images.
  • the user places the mode control 370 in the “review” position in order to review the captured images, delete undesirable images and transfer images via modem 390 , using push buttons 372 - 376 .
  • An optional microphone 394 connected control processor and timing generator circuit 364 via audio codec 396 , can be used to receive voice commands, as described in described in commonly-assigned U.S. Pat. No.
  • FIG. 21 depicts a flow chart of a method of using the electronic camera 23 in order to transfer high resolution image files captured by the electronic camera 23 to a user's high resolution image collection, automatically email images to one or more people depicted in the captured images and order copies of high resolution image files from fulfillment provider 70 .
  • the user registers their electronic camera 23 with the service provider 80 and provides information such as was described earlier in relation to step 30 of FIG. 2 .
  • the service provider 80 provides a service ID and network configuration information which is stored in the firmware memory 328 of electronic camera 23 . This can be done when the electronic camera 23 is purchased or rented from the service provider 80 , as described in commonly-assigned U.S. patent application Ser. No.
  • the user content identifiers described earlier in relation to FIGS. 9-10 are stored in the firmware memory 328 of electronic camera 23 . This enables the electronic camera 23 to recognize user content present in any captured high resolution image files.
  • the user fulfillment preferences are stored in firmware memory 328 of electronic camera 23 . These preferences may stored using a service account information file as described in commonly-assigned U.S. patent application Ser. No. 09/576,288 entitled “METHOD FOR PROVIDING CUSTOMIZED PHOTO PRODUCTS OVER A NETWORK” to Parulski, the disclosure of which is herein incorporated by reference.
  • This service account information file can be created when the user purchases or rents the electronic camera 23 , in response to user selections of preferred photo products, such as service prints, album pages and the like, that the user is likely to purchase from the fulfillment provider 70 .
  • the electronic camera 23 is ready to capture high resolution images.
  • the user captures a group of high resolution images using the electronic camera 23 .
  • the high resolution images are processed as described earlier and temporarily stored on memory card 350 .
  • the captured high resolution images are optionally examined to determine if one or more are recognized as including user content, using the user content identifiers provided in step 404 .
  • Each user content identifier includes at least one e-mail address.
  • the images are marked for automatic transfer to the e-mail address(s) corresponding to the recognized image icon 202 .
  • This image marking can be implemented, for example, by creating a Digital Print Order Format (DPOF) version 1.1 “auto transfer” file which includes the e-mail address and the file names of the images which have been recognized as including the image icon 202 .
  • This auto transfer file is preferably an ASCII text file named AUTXFER.MRK, in accordance with the DPOF specification.
  • step 414 the user optionally reviews the captured high resolution images and orders photo products, such as enlargements and album pages, using the captured high resolution image files.
  • the switches 372 - 376 are used to select high resolution image files to be printed to produce these photo products and the number of copies to be made.
  • step 416 the electronic camera 23 creates an image utilization file, as described in commonly-assigned U.S. Ser. No. 09/004,046 filed Jan. 7, 1998 entitled “NETWORK CONFIGURATION FILE FOR AUTOMATICALLY TRANSMITTING IMAGES FROM AN ELECTRONIC STILL CAMERA” to Ward et. al., the disclosure of which is herein incorporated by reference.
  • This image utilization file is preferably an ASCII text file named AUTOPRNT.MRK, in accordance with the Digital Print Order Format (DPOF) specification.
  • DPOF Digital Print Order Format
  • the captured high resolution image files and the optional DPOF auto transfer and print order files are transmitted to the service provider 80 via modem 390 and are temporarily stored at the service provider 80 .
  • the transmission begins when the electronic camera 23 provides an ID that identifies the user account and the instructions provided by the user during the registration process. These instructions normally include the address of the user's high resolution collection.
  • the instructions can also include default photo product requests, that can be used instead of, or in addition to, the DPOF print order file.
  • the instructions can specify that one 4 ⁇ 6 inch print (10.16 cm ⁇ 15.24 cm) of each uploaded image should be produced and mailed to a user specified address. In this case, the DPOF print order file is used only when the user wishes to override this “default” instruction.
  • step 420 low resolution copies of each uploaded high resolution image file are added to the low resolution image collection associated with the ID provided by the electronic camera 23 .
  • These low resolution copies are normally stored at the service provider 80 so that they can be accessed by authorized third parties as described earlier in relation to step 44 of FIG. 1 .
  • step 422 the high resolution image files are transferred from the service provider 80 to the user's high resolution image collection (normally located on the user computer 10 ) as described earlier in step 120 of FIG. 6 . This transfer can occur during the next routine communication interval, or during a non-scheduled communication.
  • step 424 the high resolution image files are e-mailed to the email addresses provided in the DPOF AUTXFER.MRK file described earlier in relation to step 412 .
  • step 426 the high resolution image files are transferred from the service provider 80 to the fulfillment provider 70 , where they are used to produce the default photo products defined in the instructions provided by the user in step 400 , or in the DPOF AUTPRINT.MRK file described earlier in relation to step 416 .
  • service provider 80 can store the high resolution image files for a fixed period of time such as 90 days to facilitate product reordering. After such a fixed period, the high resolution image files are converted to low resolution image files and added to the user's low resolution collection as previously discussed.
  • FIG. 22 there is shown a flow chart which shows another method of operation of the system of FIG. 1 .
  • the low resolution images are maintained on user computer 10 , rather than being provided by the service provider 80 .
  • the user establishes an account with the service provider 80 and establishes account data flow parameters, as described earlier in reference to step 30 of FIG. 2 .
  • the user identifies an image collection, as described earlier in reference to step 32 of FIG. 2 .
  • a low resolution image database is created on the user computer 10 , so that low resolution images can be provided to authorized third parties.
  • an on-line connection is established using CSP 20 and communication network 50 , between the user's home computer 10 and the service provider 80 , to indicate that the user is now on-line.
  • the service provider 80 determines which, if any, authorized third parties are currently on-line and wish to view the images in the low resolution image collection of the user.
  • the low resolution images are transferred from the user computer 10 to the computer 16 of the authorized third party using CSP 20 , communication network 50 and CSP 22 .
  • step 512 the third party views the low resolution images transferred from the user computer 10 on the third party computer 16 .
  • step 514 the third party requests the high resolution version of one or more low resolution images transferred from the user computer 10 .
  • step 516 the high resolution images are transferred from the user computer 10 to the third party computer 16 .
  • an authorized third party views the low resolution images of a first user. These low resolution images may be provided by the service provider 80 , as described in relation to FIG. 2 and FIG. 6 , or may be provided from the first user computer 10 , as described in relation to FIG. 21 .
  • the authorized third party selects one or more low resolution images from the first user's collection, for inclusion in a photo product, such as a photo album or a photo montage, containing numerous pictures. Such pictures might, for example, be of the same event attended by the first user, a second user and an authorized third party.
  • the authorized third party views the low resolution images of the second user. Again, these low resolution images may be provided by the service provider 80 , as described in relation to FIG. 2 and FIG. 6 , or may be provided from the second user's computer, as described in relation to FIG. 21 .
  • the authorized third party selects one or more low resolution images from the second user's collection, for inclusion in the same photo product.
  • step 527 the authorized third party places an order with the fulfillment provider 70 , via service provider 80 , for the photo product, which includes the selected images from the first user's collection and the second user's collection.
  • step 528 high resolution versions of the images selected by the authorized third party are transferred from the first user's high resolution collection to the fulfillment provider 70 . This may occur immediately if the first user is currently on-line, or at a later time at the next routine communication interval.
  • high resolution versions of the images selected by the authorized third party are transferred from the second user's high resolution collection to the fulfillment provider 70 .
  • step 532 the fulfillment provider 70 produces and ships the photo product selected by the authorized third party to the designated address provided by the authorized third party and bills the authorized third party for the photo product.
  • step 534 loyalty points are assigned to the first and second users, for providing the digital images which were used in the photo product.

Abstract

A system and method for creating an electronic icon containing information unique to a particular user including information allowing access with respect to a particular digital media file having the icon associated therewith over a communication network by a third party.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
U.S. Ser. No. 09/892,042, filed Jun. 26, 2001, entitled “METHOD AND SYSTEM FOR MANAGING IMAGES OVER A COMMUNICATION NETWORK”;
U.S. Ser. No. 09/891,351, filed Jun. 26, 2001, entitled “A METHOD AND SYSTEM FOR MANAGING IMAGES OVER A COMMUNICATION NETWORK”;
U.S. Ser. No. 09/892,044, filed Jun. 26, 2001, entitled “A SYSTEM AND METHOD FOR MANAGING IMAGES OVER A COMMUNICATION NETWORK”;
U.S. Ser. No. 09/891,546, filed Jun. 26, 2001, entitled “METHOD AND SYSTEM FOR ASSISTING IN THE RECONSTRUCTION OF AN IMAGE DATABASE OVER A COMMUNICATION NETWORK”;
U.S. Ser. No. 09/892,043, filed Jun. 26, 2001, entitled “METHOD AND SYSTEM FOR MANAGING IMAGES OVER A COMMUNICATION NETWORK USING USER PROVIDED INSTRUCTIONS”;
U.S. Ser. No. 09/891,543, filed Jun. 26, 2001, entitled “A METHOD FOR MANAGING IMAGES OVER A COMMUNICATION NETWORK”;
U.S. Ser. No. 09/891,562, filed Jun. 26, 2001, entitled “AN ELECTRONIC CAMERA AND SYSTEM FOR TRANSMITTING DIGITAL OVER A COMMUNICATION NETWORK”;
FIELD OF THE INVENTION
The present invention is directed to automatically managing digital image files over a communication network.
BACKGROUND OF THE INVENTION
Currently, there are many providers of online imaging services. One such example is the Kodak PhotoNet Online service offered by the Eastman Kodak Company. In such a system, a user must select a photofinishing order option on the film processing envelope that includes the digitization and uploading of the high resolution film images to a secure website where they are stored. Upon receiving and paying for the printed photofinishing order, the user receives a coupon that includes information for accessing the digital images on the website. Subsequently, the user must return to their home and using a computer with a conventional Internet browser must navigate to the website indicated by the coupon. Upon arrival at the website and entry of the supplied information, the user finally is able to view their digital images.
At this point, the user can electronically share their images with third parties. Depending on the skill of the user, they can choose to send digitized images as image file attachments via electronic mail. This entails knowing the electronic address of those third parties which is usually stored and managed by a different software application on the user's computer. Furthermore, image file attachments can cause an electronic mailbox to exceed a predetermined storage capacity especially if the user desires to share several images.
Another method of electronically sharing that attempts to solve the dilemma of sharing several images involves, sending an electronic link embedded in an electronic mail message that when clicked by the receiver, causes the receiving computer to locate and access the website containing the entire digitized order. A problem with this method is that the receiver must have an Internet browser that is compatible with the electronic mail application to automatically launch the internet browser to the site of the digitized images. Furthermore, the receiver must enter information to view the images at the site. Access must also be given for each and every film order processed and uploaded.
If the user desires to retrieve a copy of the digitized image for use on their own computer, they can encounter additional problems. For example, the user must follow several time consuming steps that often incur an additional charge or fee beyond the initial photofinishing order fee, to retrieve the high resolution image file that is stored at the online photoservice provider. In other cases some photoservice providers do not allow the user to download the high resolution image file at all.
Another common service provided by online photoservice providers is the ability for a user to use a computer to upload a digitized image already in the possession of the user such as image files created by a scanner, a digital camera, or a digitized film product such as the PictureCD™ produced by the Eastman Kodak Company. These online photoservice providers store high resolution image files uploaded by users typically for producing printed images. Electronically sharing of these images is similar to those being placed at a website automatically by a photofinisher and similar problems are encountered by a user using such a service. The user must, for example, take the time to upload each and every image that he or she wishes to print or electronically share.
Another disadvantage with prior art systems is that the owner of the image often loses control of the high resolution image as this is typically stored at the service provider. Additionally, it is also undesirable to keep an entire copy of the high resolution images at a service provider as charges are often associated with such storage. In addition if the service provider loses the image it can be very difficult to regain the original high resolution image. It is therefore desirable to be able to restore the high resolution images at the user computer.
In situations where the high resolution images are stored on user computer memory storage devices, such as a hard drive, there exists the possibility of a memory failure with respect to the stored images. Thus, there is also a need to be able to provide a system to assist in reestablishing the high resolution images at the user computer with little or no cost to the user in the event of a failure of a user memory storage device.
SUMMARY OF THE INVENTION
In accordance with one aspect of the present invention there is provided a system for managing digital images, comprising:
a device for creating an electronic icon containing information unique to a particular user including information allowing access with respect to a particular digital media file having the icon associated therewith over a communication network by a third party.
In accordance with another aspect of the present invention there is provided a method for managing digital images by a service provider on a user computer over a communication network, comprising:
    • creating an electronic icon containing information unique to the user that includes information for allowing controlled access by a designated third party to a particular digital media file stored on the computer;
    • the service provider accessing the user computer over the communication network and locating digital media files having the icon associated therewith and allowing access to the digital media files by the designated third party.
These and other aspects, objects, features and advantages of the present invention will be more clearly understood and appreciated from a review of the following detailed description of the preferred embodiments and appended claims and by reference to the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
In the detailed description of the preferred embodiments of the invention presented below, reference is made to the accompanying drawings in which:
FIG. 1 is a schematic diagram of a system made in accordance with the present invention showing the relationship of a user desiring to share digital images with a third party as permitted by a service provider;
FIG. 2 is a flow chart which shows the steps in creating a user account and image storage file in accordance with the invention;
FIG. 3 is a flow chart which shows the steps in automatically sharing digital images with an authorized third party in accordance with the invention;
FIG. 4 is a schematic diagram showing the relationship of a film processing photofinisher desiring to download digitized film images with a user as permitted by a service provider;
FIG. 5 is a modified system made in accordance with the present invention showing the relationship of a user desiring to share digital images with a third party as permitted by a service provider;
FIG. 6 is a flow chart which shows the steps of the method of operation of the system of FIG. 5;
FIG. 7 is a flow chart which shows the steps of another method of operation of the system of FIG. 5;
FIG. 8 is a flow chart which shows another method of sharing images using the system of FIG. 1 or FIG. 5;
FIG. 9 is a flow chart which shows yet another method of sharing images using the system of FIG. 1 or FIG. 5;
FIG. 10 a is partial view of a display screen illustrating an image from which an image content identifier is obtained;
FIG. 10 b is an enlarged view of the image content identifier of FIG. 10 a;
FIG. 11 is a flow chart of still another method of operation of the system of FIG. 5;
FIG. 12 is a flow chart which illustrates the process of tracking an individual low resolution image file used to produce goods and/or services;
FIG. 13 is a chart illustrating an example of one way revenues can be distributed among various parties;
FIG. 14. is a flow chart of a method for restoring a high resolution image on a user device;
FIG. 15 is another modified system made in accordance with the present invention showing the relationship of a user desiring to share digital images with a third party as permitted by a service provider;
FIG. 16 is a flow chart illustrating another method of operation of the systems of FIGS. 1, 5 and 15;
FIG. 17 is a screen shot of a display screen showing an image and an electronic instruction/order form.
FIG. 18 is a flow chart illustrating another method of operation of the systems of FIGS. 1, 5 and 15;
FIG. 19 is a block diagram of an electronic camera 23;
FIG. 20 depicts a rear view of the electronic camera incorporating the features of FIG. 19;
FIG. 21 is a flow chart of a method of using the electronic camera of FIG. 20;
FIG. 22 shows a flow chart that illustrates another method of operation of the system of FIG. 1; and
FIG. 23 illustrates a flow chart which shows another method of operation of the system of FIG. 1
DETAILED DESCRIPTION OF THE INVENTION
Referring to FIG. 1, there is illustrated a system 18 made in accordance with the present invention. System 18 includes a user computer 10 operably connected through a communication service provider (CSP) 20 and a communication network 50 (such as the Internet) to a service provider 80. Also included in system 18 is a third party computer 16 operably connected to the communication network 50 and service provider 80 via a CSP 22. User computer 10 is also operably connected to an electronic camera 12 and a storage drive 14. The electronic camera 12 can be a digital still camera such as the Kodak DC280 digital camera manufactured by the Eastman Kodak Company or it can be a digital motion camera such as the Kodak MC3 portable multimedia device which records motion and sound in addition to still capture and sound reproduction. For the simplification of discussion, digital images originally created by either digital still, digital motion electronic cameras, or by scanning film, will be referred to as high resolution image files. Likewise, low resolution files are formed from the high resolution image files by sub-sampling, which in the case of digital still image files, involves reducing the number of image pixels and effectively lowering the resolution. Such low-resolution, or “thumbnail” size images, can be created as described in commonly-assigned U.S. Pat. No. 5,164,831 “ELECTRONIC STILL CAMERA PROVIDING MULTI-FORMAT STORAGE OF FULL AND REDUCED RESOLUTION IMAGES” to Kuchta, et. al., the disclosure of which is herein incorporated by reference. In the case of digital motion files, low resolution files can include the discarding of frames and/or pixels within a frame. Such techniques are well known in the art and facilitate the transportation of images across any communication network 50 such as the Internet.
In the particular embodiment illustrated, the storage drive 14 is illustrated as being removable. However the present invention is not limited to such a configuration. For example, the storage drive 14 can be an integral part of user computer 10 and can use removable storage media (not shown). The electronic camera 12 can connect to the user computer 10 via a cable employing a common interface such as a Universal Serial Bus (USB) interface. Alternatively, electronic camera 12 can connect to the user computer 10 in a wireless mode employing any number of conventional interfaces such as the radio frequency standard commonly described by Bluetooth™ Specification V1.0 or Wireless Personal Area Network IEEE Standard 802.15. Likewise, removable storage drive 14 is operably connected to user computer 10 and permits the storage of high resolution image files such as digital still or digital motion images and associated metadata that can, for example, further include audio information. For the purposes of the present invention, an image media file includes a digital image file (high or low resolution) and can also include additional data such as associated audio or metadata. The user selects the location for the storage of the high resolution image media files either internally to the user computer 10 or on removable storage drive 14, such as computer disc, CD, etc. In general, high resolution image media files can be arranged in a user storage file such as a database.
The user computer 10 is provided with appropriate software for allowing controlled access to a high resolution image media collection, such as a database, stored on memory storage device 14. The high resolution image media collection comprises at least one high resolution image media file and as previously discussed can include associated digital data. A low resolution copy of each high resolution digital image file along with any associated meta data/information (the combination of both files hereinafter referred to as the user low resolution image collection) is electronically sent to the service provider 80 for storage at the service provider 80 and is associated with the user. One way in which an image can be associated with a user is the addition of metadata to the image media files(s) that reflects a specific user identifier such as a user account number, a user provided identifier with any combination of alphanumeric characters, or any other construct in the form of metadata. Another form of association with the user can be accomplished by creating a storage system that allocates file storage based on a user identifier such as a relational database. This association creates a low resolution user image collection of the digital image files at the service provider 80. While the digital image files and associated data files can be forwarded by the user, these files can be automatically retrieved by the service provider 80. For example, the user has a database identified for access by the service provider 80. The service provider 80 can automatically, on a routine schedule, determine if the user computer 10 is available over the communication network 50. If the user computer 10 is available for communication, the service provider 80 will then automatically review the database on the user computer 10 where the high resolution media files are stored to determine if any new digital image files or associated files have been added to the database. If new files have been added or changed, then a low resolution image file is formed for each new image and data changes are appropriately communicated to the service provider 80 for storage and association with the user low resolution image collection.
As previously discussed, in addition to the low resolution images stored at the service provider 80, there can be stored various other data/information related to these images. This information can be used to identify who can have access to the low resolution image and information that describes the content of the images. In addition, this information can include information relating to the data storage structure of the high resolution images stored on image storage device 14. The data storage structure information includes parameters that reflect the storage locations of the high resolution image media files on the physical media such as track and sector information associated with hard disk memory architecture. This information can be used to assist in the rebuilding of a damaged directory in the event of a failure of storage device 14 and can be automatically updated on a routine communication interval by the service provider 80. Oftentimes, damaged directories on hard disks can render a disk drive unreadable when the actual file data is still valid. Software running on the user computer 10 such as the commercially available Norton Utilities offered by Symantec Inc. can restore the accessibility of high resolution image media files using the data storage structure information related to the low resolution image media files stored by service provider 80 as later discussed herein with respect to FIG. 14. Service provider 80 can provide this additional service for a fixed or recurring fee. This can provide valuable assistance in reconstructing damaged digital image files on user computer 10.
Further information can be provided to the service provider 80 for assisting in identifying content of the images and/or individuals that can have access to the images. For example, an image icon 202, such as illustrated in FIG. 10 b can be used as a content identifier to first identify content of images forwarded to the service provider 80. In the embodiment illustrated, the image icon 202 is in the form of the face of an individual taken from image 206 of FIG. 10 a. Thus face recognition software programs, such as described in co-pending U.S. pending patent application entitled A METHOD AND SYSTEM FOR CATALOGING IMAGES, of John R. Squilla and Dale Fredrick McIntyre, Ser. No. 09/640,938, filed Aug. 17, 2000 which is hereby incorporated in its entirety by reference, can be used to review the images to be forwarded and identify the images with such content identifiers. When such images are identified, the identification information is recorded as metadata and stored in association with that image. The identification information can be used to identify who can view this image at the service provider 80 or even provide an automatic forwarding of the image to a specified individual. While the images can be automatically analyzed for such information, the user can also specify that a particular icon 202 be associated with a particular image.
While the icon 202 has been shown for use in identifying other individuals found within digital images to which said images are to be forwarded, the present invention is not so limited. The icon 202 can also be used to identify images that the user wishes to be sent to him. For example, the icon 202 can represent the face of the user and that when the icon 202 is sent to a third party it can be used to identify images that include the user. The icon 202 can also be provided with information, such as a Universal Resource Locator (URL) address, where the image is to be sent. The icon 202 can be sent to specific third parties wherein the third party would provide consent to have their images reviewed for forwarding to the user who provides the icon 202. The service provider 80, upon request from the user providing the icon 202, can search the low resolution image collections of other users for occurrences of the icon 202 applied to their images. Upon finding images of other users that have applied the icon 202 of the user providing the icon 202, service provider 80 can automatically forward these images to the user providing the icon 202. Furthermore, service provider 80 keeps a log or record of the other users who have used the icon 202 provided by the user. Thus the service provider can monitor access and/or use of digital media files associated with the icon 202. When the user updates their icon 202, for example, when their appearance changes due to aging, modifications to hair style or color, modifications to facial hair etc., service provider 80 automatically updates the icon 202 for those users found in the log associated with the use of the specific updated icon 202. The updated icon 202 can replace the existing icon 202 or it can be simply added to the database of icons 202. Allowing the two icons 202 to coexist permits the recognition of high resolution image files that can be scanned and provided at a substantially later date. The icon 202 can also be used to access public sites that have images that can be used freely or for a price. While the icon 202 has been described as recognizing images containing a particular individual, the icon 202 can represent any theme, for example, any sports, hobby, or item. Images that have been identified with any such theme can be automatically forwarded by service provider 80 to the image collection of a special interest group that a user may belong to. Such preferences for forwarding are stored at service provider 80 as previously discussed.
Further information such as loyalty points can be associated with the user by the service provider 80 in response to interactions with the system 18 or the system 200 (FIG. 5). For the purpose of the present invention, loyalty points shall be considered discounts, credits or other value assessed on behalf of the user which are credited toward the purchase or sale of goods and/or services. For example, a user who shares at least one of the low resolution image media files with an authorized third party, can earn loyalty points from service provider 80, if the authorized third party orders image based goods and/or services from service provider 80 that are derived from the shared low resolution image media files. Service provider 80 can award more points to a user who shares with an authorized third party that doesn't currently have an existing relationship with service provider 80. Incentives, in this case, are placed on encouraging additional users to develop relationships with service provider 80. To award loyalty points, service provider 80 can maintain a log or record of all accesses to images maintained in a user's image collection. This arrangement has the added benefit of providing a tracking mechanism in the event that an authorized third party misuses an image file provided by a user. Loyalty points can be redeemed at service provider 80 or fulfillment provider 70 for image related goods and/or services. See FIG. 12 for a more complete description of this operation.
Another process of earning loyalty points will be discussed later with respect to FIG. 18 and can include authorized third parties performing extended services such as cataloging by matching the user's content identifiers to the user's digital images to be cataloged. Rewarding an authorized third party with loyalty points for matching the user's content identifiers to the user's images relieves service provider 80 from the image processing burden.
Service provider 80 includes a server 82 for interfacing with the communications network 50 such as the Internet or a virtual private network (VPN). In addition to interfacing to the communications network 50, server 82 transfers information to computer system 86 which manages information associated with various users. Computer system 86 includes an account manager 84 which is software operating in accordance with the invention to permit the creation and management of individual user accounts. Information associated with user accounts is stored in relational database(s) 88. User account information includes personal information such as name and address, billing information such as credit card information, network information such as personal electronic location information and authorization information which controls access to the user's images by third parties. Also associated with user accounts are relational database(s) 88 which store low resolution user image files, related metadata and other information relevant to providing services to the user. One such example, but not by way of limitation, is a defect and directory map of the user's physical storage device to aid in the recovery of damaged image media files stored on the storage device 14.
Also shown in FIG. 1 is fulfillment provider 70 which provides image-based goods and/or services to users and third parties. Fulfillment provider 70 includes a fulfillment web server 72, a digital printer 78 and a fulfillment computer system 76 that further includes a commerce manager 74 and a fulfillment manager 75. Fulfillment requests received from service provider 80, user computer 10 or third party computer 16 are handled by commerce manager 74 initially before handing the requests off to the fulfillment manager 75. The fulfillment manager 75 determines which equipment is used to fulfill the ordered good(s) such as a digital printer 78. After fulfillment, the ordered goods are returned to the ordering party by a delivery means for example, but not by way of limitation, a transportation vehicle 68.
In order to better understand the present invention, a description of the operation of the system 18 will be discussed. FIG. 2 is a flow chart of the operation of the system 18. In the first step 30, the user establishes an account with the service provider 80. As a part of establishing an account, various information is provided, for example, but not limited to, name, address, electronic address, credit card information, names of individuals or business establishments that have permission to access image media files, names of any particular files of grouped images and authorized viewer, the type of access granted, name of a preferred fulfillment service provider for the providing of goods and/or services and automatic forwarding instructions per selected criteria. It is of course to be understood that any other relevant information and/or instructions can be provided as desired or that which the service provider is cable of providing. In the next step 32, the user identifies or establishes the high resolution media collection. In the next step 34, low resolution digital image files are formed from the high resolution digital image files in the collection and are forwarded to the service provider 80 along with any appropriate associated data files (user low resolution image collection) over the communication network 50. At the next step 36, the verification that the service provider 80 has received the low resolution media files is completed. If the transfer of the low resolution media collection was not successful, the user is advised of this non-successful transmission in step 38 and repeats the transmission of the low resolution media collection in step 34 until successful. Upon successful receipt of the low resolution media collection, the service provider 80 at step 40 creates a low resolution media collection where these low resolution media collections are stored and associated with the user.
Referring to FIG. 3, there is illustrated a flow chart of one way in which the media files stored at the service provider 80 can be used. In step 40, the instructions previously provided by the user are reviewed and implemented. For example, if a third party has been designated to automatically receive selected media files as identified, these media files will be forwarded over the communication network 50 to the designated third party at step 42. As illustrated by FIG. 1, this can be a third party computer 16. Alternatively, the selected media files can be forwarded to a fulfillment provider 70 location for fulfillment of a service or product, such as producing a print for delivering to a designated individual from a fulfillment provider 70. While the fulfillment provider 70 can use the low resolution media file for the fulfilling of the requested goods and/or services, often, the fulfillment provider 70 needs the high resolution digital image. In such case, the provider 80 can directly access the high resolution files directly from the user or have them provided through the service provider 80. Typically the fulfillment provider 70 comprises a facility for printing or producing images from digital media files that have been provided by users and delivering them to designated locations. However, the fulfillment provider 70 can deliver any goods or services that they are capable of providing. For example, but not by way of limitation, the goods can include T-shirts, mugs, cakes, or any other goods or services that incorporate images provided by the user.
In another form of the present invention, at step 44 a third party can access the low resolution image collection over the communication network 50 using third party computer 16. Optionally in Step 46, the service provider 80 can produce and transmit a report to the user that monitor the details of which media files were shared or accessed by which third parties.
Turning now to FIG. 4, there is illustrated a flow chart representing a process used by service provider 80 for automatically updating the low resolution image collection associated with a user during a regular and periodic update or replication procedure. At an agreed upon routine communication interval, service provider 80 establishes a connection with user computer 10 (step 52). The connection can either be established by the user computer 10 initiating communication or by the service provider 80 initiating the communication. The service provider 80 then checks to see if the high resolution image collection has been modified (step 54). Modifications to the high resolution image collection can include the addition or modification of at least one image media file, additions and/or modifications to metadata, modifications to the user account information such as the addition or deletion of authorized third parties, or any other desired changes to the user account information. Once this information has been obtained, service provider 80 makes the appropriate changes (step 56) to the user account and/or low resolution image collection. Relational database(s) 88 are updated with the updated information. If no modifications to the high resolution image collection are detected (step 54), the service provider 80 concludes the communication in step 58.
Turning now to FIG. 5, there is illustrated a modified system 200 made in accordance with the present invention. System 200 is similar to system 18 with like numerals indicating like parts and operation as previously discussed. In system 200, a photofinisher 90 is provided for processing of photographic film 92. It should be noted that the photofinisher 90 can be a retail establishment by itself or operating in association with a wholesale photofinishing establishment. In the particular embodiment illustrated, the photofinisher 90 includes a film processor 94 for developing of the images on photographic film 92. A film scanner 96 is provided for scanning of images formed on the processed film for obtaining high resolution digital image files that are forwarded to a memory device 98 as high resolution image files. The photofinisher 90 also includes an appropriate computer 100 for managing of the various equipment and various operations of the photofinishing system. One such operation is the attachment of metadata to the high resolution image file that identifies the specific photofinisher via a pre-assigned unique business identifier. In the case where the photofinisher 90 is a wholesale photofinisher operating in association with a retailer, separate business identifiers are attached as metadata to the high resolution image media files linking both wholesale photofinisher and retailer to the specific photographic film 92 and the processed images associated therewith. Another operation of computer 100 is the providing of information to a server 102 for communicating over the communication network 50 to various third parties. The photofinisher 90 also includes an appropriate printer 104 for printing of images that have been scanned onto an appropriate media, for example, photographic paper, thermal media, etc. It is, of course, understood that any other appropriate output device can be provided for producing prints or other products incorporating images that have been obtained from the scanning of the developed photographic film 92.
Referring to FIG. 6, there is illustrated a flow chart of one method of the operation of the system 200 of FIG. 5. A roll of exposed, undeveloped photographic film 92 provided, for example, in a film cartridge 93 is forwarded to the photofinisher 90 (Step 106) in association with the user. In the next step 108, the photofinisher 90 develops the film 92 and scans the developed images for producing high resolution image files that are temporarily stored on memory device 98 with metadata identifying the photofinisher 90 as the retailer or separably as the retailer and photofinisher as discussed earlier. The photofinisher 90, in the embodiment illustrated, further associates a unique identification (ID) 110 that is provided on the film 92 with the scanned images and hence, the high resolution image files. Such a unique ID 110 can also be attached to a user order in a variety of ways. For example, but not by way of limitation, the unique ID 110 can be associated with a photofinishing envelope (not shown), the film cartridge 93, pre-exposed on the film 92 itself, by random assignment, or any other appropriate way to associate the film 92 and the user. Unique ID 110 can be appended as metadata to the high resolution image media file upon scanning to associate the digital image with the user. Commercially available film products manufactured by the Eastman Kodak Company under the Advantix™ brand are examples of film cartridges 93 having the unique ID 110 associated with them.
Continuing on with FIG. 6, these high resolution media files and unique ID 110 are transferred via communication network 50 to the service provider 80 in association with the user at an appropriate time (step 112). Following receipt of the high resolution media files, service provider 80 (step 114) checks to see if the unique ID 110 has been registered with specific processing instructions. A more complete description on one method of registering film with a service provider can be found in co-pending U.S. patent application entitled A Kit For Organizing A Plurality Of Images, Ser. No. 09/470,938, filed Dec. 22, 1999 by Dale Fredrick McIntyre and Joseph Anthony Manico which is hereby incorporated in its entirety. If the photographic film 92 is not registered, service provider 80 creates low resolution copies of each of the newly received high resolution files in step 118. These low resolution copies are then added to the user's existing low resolution image collection in step 120. The high resolution files are temporarily stored at the service provider 80 until they are transferred to the user's high resolution image collection on the user computer 10 at the next routine communication interval or non-scheduled communication (step 122). In an alternate embodiment of steps 118, 120 and 122, service provider 80 can store the high resolution image files for an ordering period that makes ordering of image goods and/or services by the user or authorized third parties more convenient. The storing of the high resolution image files for the ordering period is in addition to transferring the high resolution files to the user computer 10. After the expiration of the ordering period, the high resolution image files are automatically converted to low resolution copies and added to the user's low resolution image collection. This would be particularly useful to a service provider, in that, initial interest in obtaining prints or other image products/services usually occurs in a relatively short time after obtaining the image. Thus, making the need to obtain the high resolution file from user computer 10 unnecessary during this ordering period.
If the photographic film 92 is registered, instructions associated with the registration are carried out by the service provider 80 in step 116. These instructions can include for example, but not by way of limitation, the directions to print, automatically transmit to various third parties and deliver various image-based goods and/or services to the user or third parties designated in the instructions. Third parties that have similar arrangements for low resolution image media collections maintained by service provider 80 will receive the automatically transmitted low resolution image media files as additions to their low resolution image media collections. At the next routine communication interval for these third parties, these low resolution image media files are automatically transferred to the third parties' computers 16. Software running on each third party computer 16 causes newly transferred image media files to be presented to the third party without needing to use the process of attaching/detaching operations found in traditional electronic mail protocols. This process will be discussed in further detail with respect to FIG. 11 later in this specification.
After completing the registered instructions, service provider 80 creates low resolution copies of each of the newly received high resolution image files in step 118. These low resolution copies are then added to the user's existing low resolution image collection in step 120. The high resolution image files are temporarily stored at the service provider 80 until they are transferred to the user's high resolution image collection on the user computer 10 at the next routine communication interval. It is of course to be understood that any associated digital files can also be communicated to user computer 10.
Another method of operating the system 200 is shown as a flow chart in FIG. 7. In this embodiment, photographic film 92 associated with the user is forwarded to the photofinisher 90 in step 124. The photofinisher 90 in step 126 processes the photographic film 92, reads the unique ID 110, scans the developed film images, forms high resolution image files and temporarily stores them in memory device 98 associated with the user and the photofinisher 90 as discussed earlier. In step 128, photofinisher 90 establishes a communication connection via communication network 50 to service provider 80 and passes the unique ID 110 to service provider 80 to see if the photographic film 92 has been registered and has instructions pertaining to the ordering of image related goods and/or services. If the photographic film 92 had been registered, photofinisher 90 carries out the instructions (step 130) which can by way of example, but not limitation, include printing additional copies of the high resolution image media files to be forwarded to a third party via delivery vehicle 68.
If the photofinisher 90 has been determined to be an authorized third party in step 132, the photofinisher 90 can transfer (step 134) the high resolution image files from the memory device 98 to the user computer 10. The updated high resolution media image collection on user computer 10 will be detected and the appropriate low resolution image files formed and transferred to the low resolution image media collection maintained by service provider 80 at the next routine communication interval. At this point, the photofinisher 90 reaches the conclusion of the activity in step 136.
If the photofinisher 90 is not an authorized third party (step 132), photofinisher 90 transfers the high resolution digital image files to the service provider 80 (step 138). The service provider 80 then creates low resolution image file copies of each high resolution digital image file (step 140), adds them to the low resolution image media collection associated with the user (step 142) and transfers the high resolution digital image files to the user computer 10 (step 144) at the next communication. Optionally, after step 138, service provider 80 can additionally implement the steps marked at point “A” illustrated in FIG. 9 to the conclusion of that flow chart. These additional steps, as shown by FIG. 9, compare the newly digitized and transferred high resolution image files with the content identifiers for the automatic routing of and adding information to form image media files based on identified content within the high resolution image files.
The flow chart of FIG. 8 shows another method for sharing of the media collection wherein the user has provided information regarding the content of the files to be shared using software operable on user computer 10. The information has been stored as metadata associated with the image file within the high resolution image media collection on the user computer 10 or storage drive 14. In step 148, a connection is automatically established between service provider 80 and the user computer 10. Optional step 149 reflects system 200 permitting the user to turn “on” or “off” the feature of automatically routing an image media file to a third party. If the autoroute feature is turned off, the rest of this flow chart doesn't apply, ending the process in step 162.
Continuing at step 150, service provider 80 determines if a new media file has been added to the high resolution image media collection on the user computer 10. Upon finding new high resolution image media files, service provider 80 examines the metadata associated with the new high resolution image media file for specific sharing metadata at step 152. For example, a high resolution image media file that is a still image of “John” has been annotated by the user as “John”. In the user's supplied account information with service provider 80, “John” has been correlated to an electronic mail address as john.doe@service.com. Sharing this image media file (step 158) causes an electronic mail message to be generated and forwarded to john.doe@service.com. Alternatively, “John” also has an account and low resolution image media collection with service provider 80. Sharing (step 158) in this alternative example, is accomplished by a direct file transfer from the low resolution image media collection of the user to the low resolution image media collection of “John”. Intermediate steps 154 and 156, allow service provider 80 to aggregate multiple image media files to be shared with the same third party. After sharing the image media files in accordance with the examined metadata, the new image media files within the high resolution image media collection are updated (step 160) with the metadata of which third party they were shared with.
Turning now to FIG. 9, another method for the sharing of and adding non-image information to image media files is shown as a flow chart wherein system 200 analyzes the content of the image media files and automatically shares those image media files with authorized third parties in accordance with instructions stored at service provider 80 in association with the user. System 200 additionally stores information associated with recognized content as metadata with the image media files. Beginning with connecting to user computer 10 in step 166, system 200 checks the high resolution image media collection for new added files (step 168). If no new files have been added, the current process ends in step 184. Upon finding new files (step 168), the computer system 86 of service provider 80 loads user content identifiers (step 170) from relational databases 88 associated with the user. Continuing on with step 172, computer system 86 processes the newly added files against the user content identifiers in accordance with the aforementioned U.S. patent application of John R. Squilla and Dale Fredrick McIntyre, Ser. No. 09/640,938, previously discussed. The processed high resolution image files with recognized content have metadata appended to them as determined by the content identifiers. Steps 174, 176 and 178 iteratively examine the processed image files for recognized content, add the information associated with the recognized content as metadata and create a sharing image media file that can include a plurality of the processed image files to be shared with a single third party. The sharing file is sent to a third party identified by the associated content identifier in step 180 following which, the image files have “sent to” metadata stored in association with the specific image file (step 182) both in the low resolution image media collection stored at the service provider 80 and the high resolution image media collection stored in the user computer 10 or storage device 14.
FIG. 10 is a partial view of the display screen 204 of user computer 10 wherein a representative image 206 of the high resolution image media file is displayed. Dotted line “L” indicates selected image content identifier and results from an action taken by software running on the user computer 10 in response to a user acting with a selection device such as a computer mouse or in response to an algorithm for identifying content. The selected image content identifier forms the image icon 202 as shown by FIG. 10 b which is a form of content identifier.
Turning now to FIG. 11, there is illustrated a flow chart for operating another aspect of system 18 and modified system 200. Beginning in step 250, service provider 80 establishes a connection with third party computer 16 over communication network 50 for the purposes of transferring low resolution image media files sent to the third party by the user. After establishing a working connection, service provider 80 downloads the low resolution image media files to third party computer 16 (step 252) which detects the newly shared low resolution image media files, (step 254) and launches a low resolution image media file browser such as standard slide show software (step 256) thus eliminating the need to detach an image media file from an e-mail message and launch an image viewing application.
Turning now to FIG. 12, a flow chart illustrates the process of tracking an individual low resolution image media file associated with a user when it is used by an authorized third party for producing image based goods and/or services and awarding loyalty points to the user. Beginning with step 228, an authorized third party places an order for image based goods and/or services with service provider 80 based on a low resolution image media file shared by the user. The authorized third party also provides a form of electronic payment such as a credit card to service provider 80 in a manner well understood in the art for electronic commerce transactions. Service provider 80 needs the high resolution image media file to forward to fulfillment provider 70. In step 230, service provider 80 determines the user who shared the low resolution image media file that the third party is using to place an image based order. This can be accomplished by looking at the metadata associated with the low resolution image media file as discussed earlier.
Continuing with step 232, the service provider 80 determines if the user computer 10 associated with the low resolution image media file is connected to the communication network 50. If user computer 10 is not available, the service provider 80 places a request (step 242) for the associated high resolution image media file with the account manager 84 for retrieval at the next routine communication interval indicated by the dotted line “M”. Optionally, service provider 80 can send an e-mail message to the user to alert him/her that a high resolution image media file is required to fulfill an order. In yet another method of notification, service provider 80 can send an automated phone message to the user instructing him/her to make user computer 10 available. When the user computer 10 is operably connected to the communication network 50, the associated high resolution image media file is retrieved and forwarded to the fulfillment provider 70 in step 234. The user's account is then updated with loyalty points (step 236) assigned as a result of the transaction of the third party. The loyalty points can be assigned as a function of a dynamic look-up table managed by service provider 80. For example, a 4×6 hard copy print might earn 10 loyalty points, an album page 100 points and a Compact Disc (CD) 200 points and so on and so forth for other goods and/or services that can be offered by service provider 80 or fulfillment provider 70. The loyalty points can be dynamically adjusted by the service provider 80 in response to market conditions or levels of user orders. Similarly, new products might be offered with a temporary higher level of loyalty points to encourage their trial and use.
Fulfillment provider 70 completes the order placed by the third party and delivers the image based goods and/or services in step 238. If the third party has a similar arrangement for a low resolution image media file collection with service provider 80, account manager 84 assigns loyalty points (step 240) to the account of the third party based on this order. At the completion of the order, service provider 80 distributes revenues (step 244) collected from the third party to those providers associated with the developing, scanning, processing, printing etc. where such providers have contributed to the production of the ordered goods and/or services. An example of revenue distribution amongst various contributing providers is illustrated in the table of FIG. 13. If the service provider 80 also completes the fulfillment of the ordered goods, then the service provider 80 earns the designated percentage “D” that would normally have been distributed to fulfillment provider 70. A retail store, for example, could process, print and scan negatives earning the combined designated percentages of “B” and “C” of the revenue collected by service provider 80. It is of course to be understood that the amount of percentages can be any desired value.
Turning now to FIG. 14, there is illustrated a process for restoring data structure information for high resolution image files stored on storage device 14 in the event of a user device malfunction. Beginning in step 260, the user has received a disk read error while trying to view or otherwise use an image from the high resolution image media collection stored on storage device 14. Setting a disk drive service flag (step 262), the user is asked (step 264) by software running on the user computer 10, if they desire to back up the high resolution image collection onto removable storage media prior to servicing the malfunctioning disk drive. The user optionally can choose (step 266) to back up the high resolution image media collection at home onto a storage device operably connected to user computer 10 or via service provider 80 uploading all of the high resolution image files that weren't previously backed up. In step 272, the user has chosen to back up the high resolution image media files at home whereby software running on user computer 10 causes the appropriate high resolution image media files to be written to removable storage media supplied by the user. If backing up the high resolution image media files at home is not possible, then the user can request service provider 80 to perform this task in exchange for a service fee. At a convenient time, service provider 80 uploads (step 268) all the high resolution image media files not previously backed up. Continuing with step 270, service provider 80 writes the uploaded high resolution image media files to an appropriate removable media which was previously agreed to by the user. After completing the writing and verifying of high resolution image media files, service provider 80 causes the written removable media to be sent to the user and deletes (step 270) the uploaded high resolution image media files. Of course, the user can choose to pay an additional fee and keep all the high resolution image media files stored at service provider 80. Following the completion of backing up high resolution image media files, service provider 80 downloads (step 274) data storage parameters to the user computer 10 which are updated at each communication or on a periodic basis. Finally in step 276, software running on the user computer 10 uses the data storage parameters to restore the integrity of the storage device 14.
Turning now to FIG. 15, there is illustrated another modified system 300 made in accordance with the present invention. System 300 is similar to system 18 with like numerals indicating like parts and operation as previously discussed. In system 300, user computer 10 permits the storage of high resolution image media files provided from a number of image media file sources on storage device 14. High resolution image media files can be provided by photofinisher 90, as previously discussed, which provides high resolution image media files associated with the user to service provider 80 for eventual transferring to the user computer 10. There are many other ways in which image media files associated with the user can be provided to service provider 80 for transfer to the user computer 10. For example, high resolution image media files captured by a cellular wireless electronic (digital) camera 23 can be transferred to service provider 80 through a common telecommunications network 25, as described in commonly-assigned U.S. patent application Ser. No. 09/718,018, “SYSTEM AND CAMERA FOR TRANSFERRING DIGITAL IMAGES TO A SERVICE PROVIDER” filed by Endsley, et. al., the disclosure of which is herein incorporated by reference. Each transfer through the telecommunications network 25 can generate a transfer fee to be charged to the user through service provider 80. Furthermore, service provider 80 can process the high resolution image media file from the cellular wireless electronic camera 23 with respect to content identifiers associated with the user as previously discussed with respect to FIGS. 1, 10 a and 10 b. Upon matching image content of the transmitted high resolution media file with the users content identifiers, service provider 80 can send a return message to the cellular wireless camera 23 prompting the user to verify the content identified by service provider 80. The verification prompt message can be displayed on the color LCD image display 332 and the user operating push buttons 372-376 shown in FIG. 19 can respond to validate or invalidate the identified content. Such validation is advantageous while the user has just captured the image and his memory of the image content is still fresh.
Another example in which image media files associated with the user can be provided to service provider 80 for transfer to the user computer 10 is a kiosk 15 such as the Kodak Picture Maker™ kiosk that includes a scanner for producing a high resolution image media file of a hardcopy print. Connected to the communications network 50, the kiosk 15 can, for a fee, provide high resolution image media files to service provider 80 that are eventually transferred to the user computer 10.
In FIG. 16, a process for operating the systems 18, 200 and 300 is shown which permits the user to request an extended service in association with a particular high resolution image media file. Beginning in step 280, the user electronically tags (identifies) a high resolution image media file with an extended service indicia. The extended service indicia causes software running on the user computer 10 to retrieve an electronic form (See FIG. 17) that is associated with the requested extended service. The electronic form can be stored on the user computer 10 as part of a service agreement with service provider 80 or it can be actively retrieved from the service provider 80. In either case, the electronic form is retrieved and filled out (step 282) by the user. Upon establishing communication (step 284) either immediately or at the routine communication interval, service provider 80 determines (step 286) if any extended services have been requested. If not, service provider 80 completes the typical processing done at the routine communication interval (step 288) as has been previously discussed ending the process in step 294. If extended services have been requested, service provider 80 uploads (step 290) the completed electronic form associated with the high resolution image media file. Following this step, service provider 80 executes (step 292) the extended service request as indicated by the instructions on the electronic form shown in FIG. 17, with the process ending in step 294.
Turning now to FIG. 17, a screen shot 310 of user computer 10 is shown that includes a visual representation 316 of a high resolution image media file to which an extended service request form is attached. An instruction block 312, contains information for the service provider 80 to follow in the execution of the requested extended service. In this example, the user has indicated that the high resolution image media file is to be placed for sale which can be one type of extended service offered by service provider 80. The italicized word “BOAT” can be the result of the user selecting a word from a list or it can be the result of applying the user's content identifiers to this specific high resolution image media file. Information block 314 includes keywords that can be input by the user and useful in the execution of the requested extended service. Other extended services include posting the visual representation 316 of the high resolution image media file to a website that uses such visual representations 316 to aid in the selling of goods or to aid in the finding of a seller of such goods.
Another example of an extended service is the use of the high resolution image media file to represent an item insured by a third party such as an insurance business. In the event that an insurance business has been contracted with by the user to insure specific household belongings, high resolution image media files help the user get insurance rates that reflect the actual belongings depicted in the high resolution image media file. The user provides specific information about the specific household belonging depicted by the high resolution image media file such as manufacturer, purchase price, purchase date, serial number and any other information necessary to providing insurance on such a belonging. Additionally, the user provides authorization to service provider 80 for the third party insurance business to view specific high resolution image media files. Tagging a high resolution image media file for adding to an insured item list or deleting from an insured item list permits an automatic update of insurance coverage and can result in an added fee or credit applied to the user by the third party insurance business. Service provider 80 can charge a fee from a third party business for permitting the third party business such as an insurance business to view image media files depicting household objects belonging to the user. An additional third party, such as the retailer of the item sold, can be used for validation of ownership and sale of the particular item.
Another example of extended services includes a service performed by a non-professional third party user or peer (a free lance individual) operable in the systems 18, 200 and 300 by the processes shown in FIGS. 16 and 18. The process of FIG. 18 describes an example of a detailed process used by service provider 80 in step 292 of FIG. 16. In this case, the user has provided unlimited third party authorized access to a high resolution image media file or group of high resolution image media files on the extended service request form for the purposes of restoring a scanned high resolution image file created from an older, damaged hardcopy print. Information on the extended service request form can include an amount of money that requesting user is willing to pay in exchange for the service. In lieu of money, account manager 84 can provide account credits to the third party providing the service. These account credits can be used when the third party requests extended services from other users. Account manager 84 can also provide account credits in the form of loyalty points or reduced account fees.
Beginning with step 550, service provider 80 retrieves the high resolution image media file from the user computer 10 and stores the high resolution image media file in a memory of computer system 86. While this is the preferred embodiment, the retrieval of the high resolution image media file from user computer 10 need not happen until after third party user accepts the service request in step 558. Following in step 552, service provider 80 adds the extended service request form including a low resolution image file to a list of service requests on a web page whose access and display is managed by web server 82 and account manager 84. Third party users access (step 554) the list of extended service request and decide to accept or not accept an extended service request in step 556. Third party users can counter offer (step 566) to perform the extended service for terms differing from what was originally offered. For example, the third party user can raise the required amount of money from that originally offered to complete the service. The user requesting the service can choose to accept (step 568) the revised terms of service or end the negotiation in step 570. If terms agreed upon, the third party user retrieves (step 558) the high resolution image file to perform the service on from either service provider 80 or directly from the requesting user by accessing the high resolution image media file on user computer 10.
The third party user performs (step 560) the extended service requested, which in this example is an image restoration, by using commonly available tools such as Photoshop™ produced by Adobe Systems Inc. The third party modified high resolution image media file is converted to a low resolution image file for review by the user requesting the extended service. If the user requesting the extended service accepts (step 562) the work of the third party user, service provider 80 assigns (step 564) credits to the third party user less a fee for brokering the service and debits to the user requesting the extended service with the process ending in step 570. Cataloging images is another extended service that can be provided by third party users or peers in this manner.
Turning now to FIG. 19, a block diagram of an electronic (digital) camera 23 which captures high resolution image files that are stored on the removable memory card 350. FIG. 20 depicts a rear view of the electronic camera 23 of FIG. 19. The electronic camera 23 is powered by rechargeable batteries 344 that connect to power supply 346 which supplies power to the camera circuits depicted in FIG. 19. A charger input 348 is provided as an external connection (which can be included as part of interface connection 342) so that the rechargeable batteries 344 can be recharged by an external power source. The electronic camera 23 includes a zoom lens 352 having zoom and focus motor drives 360 and an adjustable aperture and shutter (not shown). The user composes the image using the optical viewfinder 341 and the zoom lens control 334 and then depresses the shutter button 331 to begin capture of a still image. The zoom lens 352 focuses light from a scene (not shown) on an image sensor 354, for example, a single-chip color CCD image sensor, using the well-known Bayer color filter pattern. The image sensor 354 is controlled by clock drivers 366. The zoom and focus motors 360 and the clock drivers 366 are controlled by control signals supplied by a control processor and timing generator circuit 364. The control processor and timing generator circuit 364 receives inputs from autofocus and auto-exposure detectors 368 and controls a flash 362. The analog output signal from the image sensor 354 is amplified and converted to digital data by the analog signal processing (ASP) and analog-to-digital (A/D) converter circuit 356. The digital data is stored in a Dynamic Random Access Memory (DRAM) buffer memory 358 and subsequently processed by a processor 320 controlled by the firmware stored in the firmware memory 328, which can be flash Erasable Programmable Read Only Memory (EPROM).
The processed high resolution image file is provided to a memory card interface 324 which stores the high resolution image file on the removable memory card 350. Removable memory cards 350 are one type of removable image digital storage medium and are available in several different physical formats. For example, the removable memory card 350 can include memory cards adapted to the Personal Computer Memory Card International Association (PCMCIA) card interface standard, as described in the PC Card Standard, Release 2.0, published by the Personal Computer Memory Card International Association, Sunnyvale, Calif., September 1991. The removable memory card 350 can also be adapted to the Compact Flash interface standard, such as described in the CompactFlash Specification Version 1.3, published by the CompactFlash Association, Palo Alto, Calif., Aug. 5, 1998, or to the well-known SmartMedia, MemoryStick or SD memory card formats. Other types of removable image digital storage media, such as magnetic hard drives, magnetic tape, or optical disks, can alternatively be used to store the digital images.
The processor 320 performs color interpolation followed by color and tone correction, in order to produce rendered sRGB image data. The rendered sRGB image data is then JPEG compressed and stored as a JPEG image file on the removable memory card 350. The JPEG file uses the so-called “Exif” image format defined in “Digital Still Camera Image File Format (Exif)” version 2.1, July 1998 by the Japan Electronics Industries Development Association (JEIDA), Tokyo, Japan. This format includes an Exif application segment that stores particular image metadata, for example the date and time the picture was captured, the lens f/number and other camera settings and image captions or comments that can be selected or entered by the camera user.
The electronic camera 23 also includes a modem 390 connected to an RF antenna 392. The modem 390 is preferably a cellular modem using, for example CDMA (Code Division Multiple Access) or TDMA (Time Division Multiple Access) technologies. The modem 390 communicates with communication network 50 via a wide area cellular network, such as the 1900 MHz CDMA network deployed by Sprint PCS in the U.S.A.
An interface connection 342 can be used to connect between an interface 322 in the electronic camera 23 and a corresponding camera interface in the user computer 10. The interface connection 342 may conform to, for example, the well-known universal serial bus (USB) interface specification, or to many other standard interfaces. The interface connection 342 can be used to transfer images from removable memory card 350 to the user computer 10. The interface connection 342 can also be used to transfer data from the user computer 10 to firmware memory 328 in electronic camera 23. In particular, it can optionally be used to transfer phone numbers, e-mail addresses, Internet URLs, etc. to firmware memory 328, as described in commonly-assigned U.S. Ser. No. 09/004,046 filed Jan. 7, 1998 entitled “NETWORK CONFIGURATION FILE FOR AUTOMATICALLY TRANSMITTING IMAGES FROM AN ELECTRONIC STILL CAMERA” to Ward et. al., the disclosure of which is herein incorporated by reference.
The graphical user interface displayed on the color LCD image display 332 is controlled by mode control 370 and push buttons 372-376 shown in FIG. 19. The user places the mode control 370 in the “capture” position prior to capturing images. The user places the mode control 370 in the “review” position in order to review the captured images, delete undesirable images and transfer images via modem 390, using push buttons 372-376. An optional microphone 394, connected control processor and timing generator circuit 364 via audio codec 396, can be used to receive voice commands, as described in described in commonly-assigned U.S. Pat. No. 5,737,491 entitled “ELECTRONIC IMAGING SYSTEM CAPABLE OF IMAGE CAPTURE, LOCAL WIRELESS TRANSMISSION AND VOICE RECOGNITION” to Allen, et. al., the disclosure of which is herein incorporated by reference.
FIG. 21 depicts a flow chart of a method of using the electronic camera 23 in order to transfer high resolution image files captured by the electronic camera 23 to a user's high resolution image collection, automatically email images to one or more people depicted in the captured images and order copies of high resolution image files from fulfillment provider 70. In step 400, the user registers their electronic camera 23 with the service provider 80 and provides information such as was described earlier in relation to step 30 of FIG. 2. In step 402, the service provider 80 provides a service ID and network configuration information which is stored in the firmware memory 328 of electronic camera 23. This can be done when the electronic camera 23 is purchased or rented from the service provider 80, as described in commonly-assigned U.S. patent application Ser. No. 11/549,733 entitled “SYSTEM AND METHOD FOR PROVIDING IMAGING PRODUCTS AND SERVICES” to Wolcott, et. al., the disclosure of which is herein incorporated by reference. This enables the electronic camera 23 to automatically connect to the communications network 50 via modem 390 in order to transfer high resolution image files and control information to the service provider 80.
In step 404, the user content identifiers described earlier in relation to FIGS. 9-10 are stored in the firmware memory 328 of electronic camera 23. This enables the electronic camera 23 to recognize user content present in any captured high resolution image files. In step 406, the user fulfillment preferences are stored in firmware memory 328 of electronic camera 23. These preferences may stored using a service account information file as described in commonly-assigned U.S. patent application Ser. No. 09/576,288 entitled “METHOD FOR PROVIDING CUSTOMIZED PHOTO PRODUCTS OVER A NETWORK” to Parulski, the disclosure of which is herein incorporated by reference. This service account information file can be created when the user purchases or rents the electronic camera 23, in response to user selections of preferred photo products, such as service prints, album pages and the like, that the user is likely to purchase from the fulfillment provider 70.
Following step 406, the electronic camera 23 is ready to capture high resolution images. In step 408, the user captures a group of high resolution images using the electronic camera 23. The high resolution images are processed as described earlier and temporarily stored on memory card 350. In step 410, the captured high resolution images are optionally examined to determine if one or more are recognized as including user content, using the user content identifiers provided in step 404. Each user content identifier includes at least one e-mail address. In step 412, for each image which has been recognized as having user content (e.g. each image including the face of the person corresponding to image icon 202 in FIG. 10) the images are marked for automatic transfer to the e-mail address(s) corresponding to the recognized image icon 202. This image marking can be implemented, for example, by creating a Digital Print Order Format (DPOF) version 1.1 “auto transfer” file which includes the e-mail address and the file names of the images which have been recognized as including the image icon 202. This auto transfer file is preferably an ASCII text file named AUTXFER.MRK, in accordance with the DPOF specification.
In step 414, the user optionally reviews the captured high resolution images and orders photo products, such as enlargements and album pages, using the captured high resolution image files. The switches 372-376 are used to select high resolution image files to be printed to produce these photo products and the number of copies to be made. In step 416, the electronic camera 23 creates an image utilization file, as described in commonly-assigned U.S. Ser. No. 09/004,046 filed Jan. 7, 1998 entitled “NETWORK CONFIGURATION FILE FOR AUTOMATICALLY TRANSMITTING IMAGES FROM AN ELECTRONIC STILL CAMERA” to Ward et. al., the disclosure of which is herein incorporated by reference. This image utilization file is preferably an ASCII text file named AUTOPRNT.MRK, in accordance with the Digital Print Order Format (DPOF) specification.
In step 418, the captured high resolution image files and the optional DPOF auto transfer and print order files are transmitted to the service provider 80 via modem 390 and are temporarily stored at the service provider 80. The transmission begins when the electronic camera 23 provides an ID that identifies the user account and the instructions provided by the user during the registration process. These instructions normally include the address of the user's high resolution collection. The instructions can also include default photo product requests, that can be used instead of, or in addition to, the DPOF print order file. For example, the instructions can specify that one 4×6 inch print (10.16 cm×15.24 cm) of each uploaded image should be produced and mailed to a user specified address. In this case, the DPOF print order file is used only when the user wishes to override this “default” instruction.
In step 420, low resolution copies of each uploaded high resolution image file are added to the low resolution image collection associated with the ID provided by the electronic camera 23. These low resolution copies are normally stored at the service provider 80 so that they can be accessed by authorized third parties as described earlier in relation to step 44 of FIG. 1.
In step 422, the high resolution image files are transferred from the service provider 80 to the user's high resolution image collection (normally located on the user computer 10) as described earlier in step 120 of FIG. 6. This transfer can occur during the next routine communication interval, or during a non-scheduled communication.
In step 424, the high resolution image files are e-mailed to the email addresses provided in the DPOF AUTXFER.MRK file described earlier in relation to step 412.
In step 426, the high resolution image files are transferred from the service provider 80 to the fulfillment provider 70, where they are used to produce the default photo products defined in the instructions provided by the user in step 400, or in the DPOF AUTPRINT.MRK file described earlier in relation to step 416.
After the high resolution image files have been transferred, they no longer need to be stored by the service provider 80. Alternatively, service provider 80 can store the high resolution image files for a fixed period of time such as 90 days to facilitate product reordering. After such a fixed period, the high resolution image files are converted to low resolution image files and added to the user's low resolution collection as previously discussed.
Turning now to FIG. 22, there is shown a flow chart which shows another method of operation of the system of FIG. 1. In this embodiment, the low resolution images are maintained on user computer 10, rather than being provided by the service provider 80. In step 500, the user establishes an account with the service provider 80 and establishes account data flow parameters, as described earlier in reference to step 30 of FIG. 2. In step 502, the user identifies an image collection, as described earlier in reference to step 32 of FIG. 2.
In step 504, a low resolution image database is created on the user computer 10, so that low resolution images can be provided to authorized third parties. In step 506, an on-line connection is established using CSP 20 and communication network 50, between the user's home computer 10 and the service provider 80, to indicate that the user is now on-line. In step 508, the service provider 80 determines which, if any, authorized third parties are currently on-line and wish to view the images in the low resolution image collection of the user. In step 510, the low resolution images are transferred from the user computer 10 to the computer 16 of the authorized third party using CSP 20, communication network 50 and CSP 22. In step 512, the third party views the low resolution images transferred from the user computer 10 on the third party computer 16. In step 514, the third party requests the high resolution version of one or more low resolution images transferred from the user computer 10. In step 516, the high resolution images are transferred from the user computer 10 to the third party computer 16.
Turning now to FIG. 23, there is shown a flow chart which shows another method of operation of the system 18 of FIG. 1 or the system 200 of FIG. 5. In step 520, an authorized third party views the low resolution images of a first user. These low resolution images may be provided by the service provider 80, as described in relation to FIG. 2 and FIG. 6, or may be provided from the first user computer 10, as described in relation to FIG. 21. In step 522, the authorized third party selects one or more low resolution images from the first user's collection, for inclusion in a photo product, such as a photo album or a photo montage, containing numerous pictures. Such pictures might, for example, be of the same event attended by the first user, a second user and an authorized third party.
In step 524, the authorized third party views the low resolution images of the second user. Again, these low resolution images may be provided by the service provider 80, as described in relation to FIG. 2 and FIG. 6, or may be provided from the second user's computer, as described in relation to FIG. 21. In step 526, the authorized third party selects one or more low resolution images from the second user's collection, for inclusion in the same photo product.
In step 527, the authorized third party places an order with the fulfillment provider 70, via service provider 80, for the photo product, which includes the selected images from the first user's collection and the second user's collection. In step 528, high resolution versions of the images selected by the authorized third party are transferred from the first user's high resolution collection to the fulfillment provider 70. This may occur immediately if the first user is currently on-line, or at a later time at the next routine communication interval. In step 530, high resolution versions of the images selected by the authorized third party are transferred from the second user's high resolution collection to the fulfillment provider 70. In step 532, the fulfillment provider 70 produces and ships the photo product selected by the authorized third party to the designated address provided by the authorized third party and bills the authorized third party for the photo product. In step 534, loyalty points are assigned to the first and second users, for providing the digital images which were used in the photo product.
The invention has been described in detail with particular reference to certain preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention.
PARTS LIST
  • 10 User computer
  • 12 Electronic camera
  • 14 Storage drive
  • 15 Kiosk
  • 16 Third party computer
  • 18 System
  • 20 Communication service provider (CSP)
  • 22 Communication service provider (CSP)
  • 23 Digital Camera
  • 25 Telecommunications network
  • 30 Step
  • 32 Step
  • 34 Step
  • 36 Step
  • 38 Step
  • 40 Step
  • 42 Step
  • 44 Step
  • 46 Step
  • 50 Communication network
  • 52 Step
  • 54 Step
  • 56 Step
  • 58 Step
  • 68 Transportation vehicle
  • 70 Fulfillment Provider
  • 72 Web server
  • 74 Commerce manager
  • 75 Fulfillment manager
  • 76 Computer system
  • 78 Digital printer
  • 80 Service provider
  • 82 Server
  • 84 Account manager
  • 86 Computer system
  • 88 Regional database(s)
  • 90 Photofinisher
  • 92 Photographic film
  • 93 Film cartridge
  • 94 Film processor
  • 96 Film scanner
  • 98 Memory device
  • 100 Computer
  • 102 Server
  • 104 Printer
  • 106 Step
  • 108 Step
  • 110 Unique identification (ID)
  • 112 Step
  • 114 Step
  • 116 Step
  • 118 Step
  • 120 Step
  • 122 Step
  • 124 Step
  • 126 Step
  • 128 Step
  • 130 Step
  • 132 Step
  • 134 Step
  • 136 Step
  • 138 Step
  • 140 Step
  • 142 Step
  • 144 Step
  • 148 Step
  • 149 Step
  • 150 Step
  • 152 Step
  • 154 Step
  • 156 Step
  • 158 Step
  • 160 Step
  • 162 Step
  • 166 Step
  • 170 Step
  • 172 Step
  • 174 Step
  • 176 Step
  • 178 Step
  • 180 Step
  • 182 Step
  • 184 Step
  • 200 System
  • 202 Image icon
  • 204 Display screen
  • 206 Image
  • 228 Step
  • 230 Step
  • 232 Step
  • 234 Step
  • 236 Step
  • 238 Step
  • 240 Step
  • 242 Step
  • 244 Step
  • 250 Step
  • 252 Step
  • 254 Step
  • 256 Step
  • 260 Step
  • 262 Step
  • 264 Step
  • 266 Step
  • 268 Step
  • 270 Step
  • 272 Step
  • 274 Step
  • 276 Step
  • 280 Step
  • 282 Step
  • 284 Step
  • 286 Step
  • 288 Step
  • 290 Step
  • 292 Step
  • 294 Step
  • 300 System
  • 310 Screen shot
  • 312 Instruction block
  • 314 Information block
  • 316 Visual representation
  • 320 Processor
  • 322 Interface
  • 324 Memory card interface
  • 328 Firmware memory
  • 331 Shutter button
  • 332 LCD image display
  • 334 Zoom lens control
  • 341 Optical viewfinder
  • 342 Interface connection
  • 344 Rechargeable batteries
  • 346 Power supply
  • 348 Charger unit
  • 350 Removable memory card
  • 352 Zoom lens
  • 354 Image sensor
  • 356 Circuit
  • 358 Buffer memory
  • 360 Focus motors
  • 362 Flash
  • 364 Timing generator circuit
  • 366 Clock drivers
  • 368 Auto-exposure detectors
  • 370 Mode control
  • 372 Push buttons/switches
  • 373 Push buttons/switches
  • 374 Push buttons/switches
  • 375 Push buttons/switches
  • 376 Push buttons/switches
  • 390 Modem
  • 392 RF antenna
  • 394 Microphone
  • 396 Audio codec
  • 400 Step
  • 402 Step
  • 404 Step
  • 406 Step
  • 408 Step
  • 410 Step
  • 412 Step
  • 414 Step
  • 416 Step
  • 418 Step
  • 420 Step
  • 422 Step
  • 424 Step
  • 426 Step
  • 428 Step
  • 500 Step
  • 502 Step
  • 504 Step
  • 506 Step
  • 508 Step
  • 510 Step
  • 512 Step
  • 514 Step
  • 516 Step
  • 520 Step
  • 522 Step
  • 524 Step
  • 526 Step
  • 527 Step
  • 528 Step
  • 530 Step
  • 532 Step
  • 534 Step
  • 550 Step
  • 552 Step
  • 554 Step
  • 556 Step
  • 558 Step
  • 560 Step
  • 562 Step
  • 564 Step
  • 566 Step
  • 568 Step
  • 570 Step

Claims (12)

1. A system for managing digital images, comprising:
a first computing device for creating an image media file, the image media file including an electronic icon, information unique to a particular user, and information, including identification of a unique third party, allowing a unique third party to access a particular digital media file stored on said first computing device having said electronic icon associated therewith, said access implemented over a communication network by the unique third party's computing device; and
a second computing device for receiving said image media file from said first computing device, utilizing information from said image media file and providing said access to the particular digital media file by said unique third party after the image media file is provided to the third party's computing device;
said second computing device accessing and locating digital media files stored in said first computing device and associated with said electronic icon over said communication network for access by said unique third party;
wherein said electronic icon includes an instruction for the second computing device to automatically forward said image media file to said unique third party's computing device.
2. The system according to claim 1 wherein said first computing device comprises a user computer and said image media file is stored in a memory device in said user computer.
3. The system according to claim 1 wherein said first computing device comprises an electronic camera and automatically associates said electronic icon with digital media files captured by said electronic camera.
4. The system according to claim 2 further comprising a communication device for transferring said image media file from said user computer over said communication network.
5. The system according to claim 3 wherein said electronic camera has a communication device for transferring said image media file to a service provider wherein said electronic icon includes instructions for use by the service provider for further processing of said image media file.
6. The system according to claim 5 wherein said service provider provides confirmation of receipt of said image media file to said electronic camera.
7. The system according to claim 6 wherein said confirmation further includes confirmation of said instructions.
8. The system according to claim 2 wherein the second computing device includes means for accessing said image media file to obtain said electronic icon and allow access in accordance with information from said image media file.
9. The system according to claim 5 wherein said communication device comprises a wireless phone.
10. A method for managing digital images by a service provider computer on a computer of a user over a communication network, comprising:
creating, at said computer of the user, an image media file including an electronic icon, information unique to said user, and information, including identification of a designated unique third party allowed to access the particular digital media file, allowing controlled access by the designated unique third party to a particular digital media file stored on said computer of the user over the communication network; and
transferring said image media file from the computer of the user to the service provider computer;
said service provider computer utilizing information from said image media file and accessing said computer of the user over said communication network and locating digital media files stored in said computer of the user having said electronic icon associated therewith and allowing controlled access to said digital media files by said designated unique third party over the communication network;
wherein said information for allowing controlled access comprises instructions with respect to processing said image media file and an instruction to automatically forward said image media file to said designated unique third party.
11. The method according to claim 10 wherein said instructions further comprise forwarding an electronic address of said image media file to said designated unique third party such that said designated unique third party may directly access said image media file.
12. The method according to claim 11 wherein said image media file is a low resolution copy of a higher resolution media file.
US09/891,474 2001-06-26 2001-06-26 System and method for managing images over a communication network Expired - Fee Related US7840634B2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US09/891,474 US7840634B2 (en) 2001-06-26 2001-06-26 System and method for managing images over a communication network
JP2002184380A JP4554876B2 (en) 2001-06-26 2002-06-25 System and method for managing images over a communication network
US12/903,611 US8621047B2 (en) 2001-06-26 2010-10-13 System and method for managing images over a communication network
US14/104,018 US9979683B2 (en) 2001-06-26 2013-12-12 System and method for managing images over a communication network

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US09/891,474 US7840634B2 (en) 2001-06-26 2001-06-26 System and method for managing images over a communication network

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12/903,611 Continuation US8621047B2 (en) 2001-06-26 2010-10-13 System and method for managing images over a communication network

Publications (2)

Publication Number Publication Date
US20020198936A1 US20020198936A1 (en) 2002-12-26
US7840634B2 true US7840634B2 (en) 2010-11-23

Family

ID=25398254

Family Applications (3)

Application Number Title Priority Date Filing Date
US09/891,474 Expired - Fee Related US7840634B2 (en) 2001-06-26 2001-06-26 System and method for managing images over a communication network
US12/903,611 Expired - Fee Related US8621047B2 (en) 2001-06-26 2010-10-13 System and method for managing images over a communication network
US14/104,018 Expired - Fee Related US9979683B2 (en) 2001-06-26 2013-12-12 System and method for managing images over a communication network

Family Applications After (2)

Application Number Title Priority Date Filing Date
US12/903,611 Expired - Fee Related US8621047B2 (en) 2001-06-26 2010-10-13 System and method for managing images over a communication network
US14/104,018 Expired - Fee Related US9979683B2 (en) 2001-06-26 2013-12-12 System and method for managing images over a communication network

Country Status (2)

Country Link
US (3) US7840634B2 (en)
JP (1) JP4554876B2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100131573A1 (en) * 2008-11-21 2010-05-27 Randall Reese Machine, Program Product, And Computer-Implemented Method For File Management, Storage, And Display
US20120012651A1 (en) * 2001-01-11 2012-01-19 Kenna Iii Frank Electronic media communication system with a displayed code
US20120265844A1 (en) * 2011-04-15 2012-10-18 Richplaytechnology Corp. Method for establishing a personal database
US10839321B2 (en) 1997-01-06 2020-11-17 Jeffrey Eder Automated data storage system

Families Citing this family (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003018523A (en) * 2001-07-03 2003-01-17 Canon Inc Information management system and method of managing information, imaging device and method of controlling the same, program, and storage medium
US7913175B2 (en) * 2001-08-01 2011-03-22 Sony Corporation Information processing apparatus and method
US7196810B2 (en) * 2001-08-28 2007-03-27 Casio Computer Co., Ltd Printing system
US7568033B2 (en) * 2001-10-12 2009-07-28 Fujifilm Corporation Image storage system and image accumulation apparatus
US7466992B1 (en) 2001-10-18 2008-12-16 Iwao Fujisaki Communication device
US7127271B1 (en) 2001-10-18 2006-10-24 Iwao Fujisaki Communication device
US7107081B1 (en) 2001-10-18 2006-09-12 Iwao Fujisaki Communication device
JP2004088726A (en) * 2002-06-26 2004-03-18 Casio Comput Co Ltd Network printing system
US8229512B1 (en) 2003-02-08 2012-07-24 Iwao Fujisaki Communication device
FR2852769B1 (en) * 2003-03-20 2005-09-16 Eastman Kodak Co METHOD FOR SHARING MULTIMEDIA DATA
US8241128B1 (en) 2003-04-03 2012-08-14 Iwao Fujisaki Communication device
US8090402B1 (en) 2003-09-26 2012-01-03 Iwao Fujisaki Communication device
US7917167B1 (en) 2003-11-22 2011-03-29 Iwao Fujisaki Communication device
US8041348B1 (en) 2004-03-23 2011-10-18 Iwao Fujisaki Communication device
JPWO2005114664A1 (en) * 2004-05-20 2008-03-27 コニカミノルタホールディングス株式会社 Image data management method and management program
US8208954B1 (en) 2005-04-08 2012-06-26 Iwao Fujisaki Communication device
US7797019B2 (en) * 2006-03-29 2010-09-14 Research In Motion Limited Shared image database with geographic navigation
US8559983B1 (en) 2007-05-03 2013-10-15 Iwao Fujisaki Communication device
US7890089B1 (en) 2007-05-03 2011-02-15 Iwao Fujisaki Communication device
US8161179B2 (en) * 2007-06-28 2012-04-17 Apple Inc. Generating low resolution user interfaces for transmission to mobile devices
US8144944B2 (en) 2007-08-14 2012-03-27 Olympus Corporation Image sharing system and method
US8676273B1 (en) 2007-08-24 2014-03-18 Iwao Fujisaki Communication device
US8639214B1 (en) 2007-10-26 2014-01-28 Iwao Fujisaki Communication device
US8472935B1 (en) 2007-10-29 2013-06-25 Iwao Fujisaki Communication device
US8744720B1 (en) 2007-12-27 2014-06-03 Iwao Fujisaki Inter-vehicle middle point maintaining implementer
US8543157B1 (en) 2008-05-09 2013-09-24 Iwao Fujisaki Communication device which notifies its pin-point location or geographic area in accordance with user selection
US8340726B1 (en) 2008-06-30 2012-12-25 Iwao Fujisaki Communication device
US8452307B1 (en) 2008-07-02 2013-05-28 Iwao Fujisaki Communication device
US20110029904A1 (en) * 2009-07-30 2011-02-03 Adam Miles Smith Behavior and Appearance of Touch-Optimized User Interface Elements for Controlling Computer Function
US20110061009A1 (en) * 2009-09-10 2011-03-10 John David Poisson Flexible user interface for image manipulation for an iamge product
US20110211737A1 (en) * 2010-03-01 2011-09-01 Microsoft Corporation Event Matching in Social Networks
US9465993B2 (en) 2010-03-01 2016-10-11 Microsoft Technology Licensing, Llc Ranking clusters based on facial image analysis
US10126803B1 (en) 2011-04-04 2018-11-13 Google Llc Conditional power management activities
TWI452527B (en) * 2011-07-06 2014-09-11 Univ Nat Chiao Tung Method and system for application program execution based on augmented reality and cloud computing
HUE050993T2 (en) 2012-05-08 2021-01-28 Nicox Ophthalmics Inc Polymorphic form of fluticasone propionate
US9601059B2 (en) * 2012-05-15 2017-03-21 Google Inc. Dynamic backlight control selector
US9319480B2 (en) * 2012-08-31 2016-04-19 Apple Inc. Managing digital media presented in online digital media store
US10430047B2 (en) * 2012-10-02 2019-10-01 Razer (Asia-Pacific) Pte. Ltd. Managing content on an electronic device
US20140108210A1 (en) * 2012-10-16 2014-04-17 American Express Travel Related Services Company, Inc. Systems and Methods for Expense Management
US9208528B2 (en) 2012-10-16 2015-12-08 American Express Travel Related Services Company, Inc. Systems and methods for expense management
US9112939B2 (en) * 2013-02-12 2015-08-18 Brightcove, Inc. Cloud-based video delivery
JP2015103138A (en) * 2013-11-27 2015-06-04 ソニー株式会社 Information processing device, information processing method and program
US10320727B1 (en) 2014-12-15 2019-06-11 Amazon Technologies, Inc. Managing document feedback on a sharing service using a messaging client
US10110522B1 (en) 2014-12-15 2018-10-23 Amazon Technologies, Inc. Setting sharing options for files using a messaging client
JP2017059888A (en) * 2015-09-14 2017-03-23 オリンパス株式会社 Information recording apparatus, information recording method, and information recording program
US20220188676A1 (en) * 2020-12-15 2022-06-16 International Business Machines Corporation Inference model optimization

Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5164831A (en) 1990-03-15 1992-11-17 Eastman Kodak Company Electronic still camera providing multi-format storage of full and reduced resolution images
US5566003A (en) * 1992-01-21 1996-10-15 Canon Kabushiki Kaisha Image processing system in which the transmitter and receiver have different data resolutions and data is transmitted at the receiver resolution
US5737491A (en) 1996-06-28 1998-04-07 Eastman Kodak Company Electronic imaging system capable of image capture, local wireless transmission and voice recognition
US6044205A (en) * 1996-02-29 2000-03-28 Intermind Corporation Communications system for transferring information between memories according to processes transferred with the information
US6057842A (en) * 1997-03-10 2000-05-02 Quickbuy, Inc. Display layout generator for graphical representations
US6209104B1 (en) * 1996-12-10 2001-03-27 Reza Jalili Secure data entry and visual authentication system and method
US6275829B1 (en) * 1997-11-25 2001-08-14 Microsoft Corporation Representing a graphic image on a web page with a thumbnail-sized image
US20010054063A1 (en) * 1997-03-13 2001-12-20 Satoru Motoyama User dependent control of the transmission of image and sound data in a client-server system
US6353848B1 (en) * 1998-07-31 2002-03-05 Flashpoint Technology, Inc. Method and system allowing a client computer to access a portable digital image capture unit over a network
US20020035630A1 (en) * 1998-03-20 2002-03-21 Peggy M. Stumer Generic transport option ("gto")
US6493748B1 (en) * 1998-03-05 2002-12-10 Fujitsu Limited Information management system, local computer, server computer, and recording medium
US6571271B1 (en) * 1999-05-03 2003-05-27 Ricoh Company, Ltd. Networked appliance for recording, storing and serving digital images
US6578072B2 (en) * 1998-01-14 2003-06-10 Fuji Photo Film, Co., Ltd. Network photograph service system
US6731341B1 (en) * 1998-03-16 2004-05-04 Nikon Corporation Electronic still camera with casing containing image-capturing
US6771290B1 (en) * 1998-07-17 2004-08-03 B.E. Technology, Llc Computer interface method and apparatus with portable network organization system and targeted advertising
US6784925B1 (en) * 1998-03-24 2004-08-31 Canon Kabushiki Kaisha System to manage digital camera images
US6871231B2 (en) * 2001-01-03 2005-03-22 Ipac Acquisition Subsidiary I, Llc Role-based access to image metadata
US6920610B1 (en) * 1999-03-02 2005-07-19 Microsoft Corporation Method and system for browsing a low-resolution image
US7287088B1 (en) * 2000-10-06 2007-10-23 Fotomedia Technologies, Llc Transmission bandwidth and memory requirements reduction in a portable image capture device by eliminating duplicate image transmissions
US7502795B1 (en) * 2001-10-01 2009-03-10 Fotomedia Technologies, Llc Network-based photosharing architecture

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5579471A (en) * 1992-11-09 1996-11-26 International Business Machines Corporation Image query system and method
JP3528214B2 (en) * 1993-10-21 2004-05-17 株式会社日立製作所 Image display method and apparatus
US5802361A (en) * 1994-09-30 1998-09-01 Apple Computer, Inc. Method and system for searching graphic images and videos
WO1997006635A2 (en) * 1995-08-04 1997-02-20 Philips Electronics N.V. Method of picture information transmission, as well as an information carrier, a picture information receiving and a picture information transmitting device
US5633678A (en) * 1995-12-20 1997-05-27 Eastman Kodak Company Electronic still camera for capturing and categorizing images
US5963670A (en) * 1996-02-12 1999-10-05 Massachusetts Institute Of Technology Method and apparatus for classifying and identifying images
US6784924B2 (en) * 1997-02-20 2004-08-31 Eastman Kodak Company Network configuration file for automatically transmitting images from an electronic still camera
JPH10301938A (en) * 1997-04-22 1998-11-13 Canon Inc Image processor, method therefor, image processing system and storage medium
US5924090A (en) * 1997-05-01 1999-07-13 Northern Light Technology Llc Method and apparatus for searching a database of records
JPH10307831A (en) * 1997-05-07 1998-11-17 Fuji Xerox Co Ltd Document processing system
US6097389A (en) * 1997-10-24 2000-08-01 Pictra, Inc. Methods and apparatuses for presenting a collection of digital media in a media container
JP3994422B2 (en) 1997-11-12 2007-10-17 富士フイルム株式会社 Digital still camera
JPH11239313A (en) * 1998-02-23 1999-08-31 Omron Corp Image output processing unit
US20010012062A1 (en) * 1998-07-23 2001-08-09 Eric C. Anderson System and method for automatic analysis and categorization of images in an electronic imaging device
US6538698B1 (en) * 1998-08-28 2003-03-25 Flashpoint Technology, Inc. Method and system for sorting images in an image capture unit to ease browsing access
US6606398B2 (en) * 1998-09-30 2003-08-12 Intel Corporation Automatic cataloging of people in digital photographs
GB2354104A (en) * 1999-09-08 2001-03-14 Sony Uk Ltd An editing method and system
US7019862B1 (en) * 1999-12-22 2006-03-28 Eastman Kodak Company Kit for organizing a plurality of images
US6862038B1 (en) * 2000-02-11 2005-03-01 Ipac Acquisition Subsidiary I, Llc Efficient image categorization
US7034880B1 (en) * 2000-05-11 2006-04-25 Eastman Kodak Company System and camera for transferring digital images to a service provider
US6564225B1 (en) * 2000-07-14 2003-05-13 Time Warner Entertainment Company, L.P. Method and apparatus for archiving in and retrieving images from a digital image library
US6810149B1 (en) * 2000-08-17 2004-10-26 Eastman Kodak Company Method and system for cataloging images
US20040201711A1 (en) * 2001-04-30 2004-10-14 Lopaz Patricia D. Method for setting image intent
US6643665B2 (en) * 2001-05-10 2003-11-04 Hewlett-Packard Development Company, Lp. System for setting image intent using markup language structures

Patent Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5164831A (en) 1990-03-15 1992-11-17 Eastman Kodak Company Electronic still camera providing multi-format storage of full and reduced resolution images
US5566003A (en) * 1992-01-21 1996-10-15 Canon Kabushiki Kaisha Image processing system in which the transmitter and receiver have different data resolutions and data is transmitted at the receiver resolution
US6044205A (en) * 1996-02-29 2000-03-28 Intermind Corporation Communications system for transferring information between memories according to processes transferred with the information
US5737491A (en) 1996-06-28 1998-04-07 Eastman Kodak Company Electronic imaging system capable of image capture, local wireless transmission and voice recognition
US6209104B1 (en) * 1996-12-10 2001-03-27 Reza Jalili Secure data entry and visual authentication system and method
US6057842A (en) * 1997-03-10 2000-05-02 Quickbuy, Inc. Display layout generator for graphical representations
US20010054063A1 (en) * 1997-03-13 2001-12-20 Satoru Motoyama User dependent control of the transmission of image and sound data in a client-server system
US6275829B1 (en) * 1997-11-25 2001-08-14 Microsoft Corporation Representing a graphic image on a web page with a thumbnail-sized image
US6578072B2 (en) * 1998-01-14 2003-06-10 Fuji Photo Film, Co., Ltd. Network photograph service system
US6493748B1 (en) * 1998-03-05 2002-12-10 Fujitsu Limited Information management system, local computer, server computer, and recording medium
US6731341B1 (en) * 1998-03-16 2004-05-04 Nikon Corporation Electronic still camera with casing containing image-capturing
US20020035630A1 (en) * 1998-03-20 2002-03-21 Peggy M. Stumer Generic transport option ("gto")
US6784925B1 (en) * 1998-03-24 2004-08-31 Canon Kabushiki Kaisha System to manage digital camera images
US6771290B1 (en) * 1998-07-17 2004-08-03 B.E. Technology, Llc Computer interface method and apparatus with portable network organization system and targeted advertising
US6353848B1 (en) * 1998-07-31 2002-03-05 Flashpoint Technology, Inc. Method and system allowing a client computer to access a portable digital image capture unit over a network
US6920610B1 (en) * 1999-03-02 2005-07-19 Microsoft Corporation Method and system for browsing a low-resolution image
US6571271B1 (en) * 1999-05-03 2003-05-27 Ricoh Company, Ltd. Networked appliance for recording, storing and serving digital images
US7287088B1 (en) * 2000-10-06 2007-10-23 Fotomedia Technologies, Llc Transmission bandwidth and memory requirements reduction in a portable image capture device by eliminating duplicate image transmissions
US6871231B2 (en) * 2001-01-03 2005-03-22 Ipac Acquisition Subsidiary I, Llc Role-based access to image metadata
US7502795B1 (en) * 2001-10-01 2009-03-10 Fotomedia Technologies, Llc Network-based photosharing architecture

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10839321B2 (en) 1997-01-06 2020-11-17 Jeffrey Eder Automated data storage system
US20120012651A1 (en) * 2001-01-11 2012-01-19 Kenna Iii Frank Electronic media communication system with a displayed code
US8516527B2 (en) * 2001-01-11 2013-08-20 The Marlin Company Electronic media communication system with a displayed code
US8156121B2 (en) * 2008-11-21 2012-04-10 Randall Reese Machine, program product, and computer-implemented method for file management, storage, and display
US20100131574A1 (en) * 2008-11-21 2010-05-27 Randall Reese Machine, Program Product, And Computer-Implemented Method For File Management, Storage, And Access Utilizing A User-Selected Trigger Event
US20100131851A1 (en) * 2008-11-21 2010-05-27 Randall Reese Machine, Program Product, And Computer-Implemented Method For Randomized Slide Show Of Files
US20100131573A1 (en) * 2008-11-21 2010-05-27 Randall Reese Machine, Program Product, And Computer-Implemented Method For File Management, Storage, And Display
US20120191707A1 (en) * 2008-11-21 2012-07-26 Randall Reese Machine, Computer Readable Medium, and Computer-Implemented Method For File Management, Storage, and Display
US8510305B2 (en) * 2008-11-21 2013-08-13 Randall Reese Machine, computer readable medium, and computer-implemented method for file management, storage, and display
US20100132023A1 (en) * 2008-11-21 2010-05-27 Randall Reese Machine, Program Product, And Computer-Implemented Method For File Management, Storage, And Display In Albums Utilizing A Questionnaire
US8538966B2 (en) 2008-11-21 2013-09-17 Randall Reese Machine, program product, and computer-implemented method for file management, storage, and access utilizing a user-selected trigger event
US9699246B2 (en) 2008-11-21 2017-07-04 Randall Reese Machine, computer readable medium, and computer-implemented method for file management, storage, and display
US20100131882A1 (en) * 2008-11-21 2010-05-27 Randall Reese Machine, Program Product, And Computer-Implemented Method For File Management And Storage
US20120265844A1 (en) * 2011-04-15 2012-10-18 Richplaytechnology Corp. Method for establishing a personal database

Also Published As

Publication number Publication date
US9979683B2 (en) 2018-05-22
US8621047B2 (en) 2013-12-31
US20020198936A1 (en) 2002-12-26
US20110025713A1 (en) 2011-02-03
JP4554876B2 (en) 2010-09-29
US20140101569A1 (en) 2014-04-10
JP2003116087A (en) 2003-04-18

Similar Documents

Publication Publication Date Title
US9979683B2 (en) System and method for managing images over a communication network
US7398318B2 (en) Method and system for managing images over a communication network
US6999111B2 (en) Electronic camera and system for transmitting digital over a communication network
US6995789B2 (en) Method for managing images over a communication network
US7398319B2 (en) System and method for managing images over a communication network
US7467160B2 (en) Method and system for managing images over a communication network using user provided instructions
US6959122B2 (en) Method and system for assisting in the reconstruction of an image database over a communication network
CA2384487C (en) A method and system for managing images over a communication network

Legal Events

Date Code Title Description
AS Assignment

Owner name: EASTMAN KODAK COMPANY, NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MCINTYRE, DALE F.;PARULSKI, KENNETH A.;REEL/FRAME:011954/0653;SIGNING DATES FROM 20010622 TO 20010625

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

CC Certificate of correction
AS Assignment

Owner name: CITICORP NORTH AMERICA, INC., AS AGENT, NEW YORK

Free format text: SECURITY INTEREST;ASSIGNORS:EASTMAN KODAK COMPANY;PAKON, INC.;REEL/FRAME:028201/0420

Effective date: 20120215

AS Assignment

Owner name: EASTMAN KODAK COMPANY, NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK AMERICAS, LTD., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK PHILIPPINES, LTD., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: FAR EAST DEVELOPMENT LTD., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK PORTUGUESA LIMITED, NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: QUALEX INC., NORTH CAROLINA

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK AVIATION LEASING LLC, NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: PAKON, INC., INDIANA

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC.,

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK (NEAR EAST), INC., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK REALTY, INC., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: FPC INC., CALIFORNIA

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK IMAGING NETWORK, INC., CALIFORNIA

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: NPEC INC., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: CREO MANUFACTURING AMERICA LLC, WYOMING

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: LASER-PACIFIC MEDIA CORPORATION, NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

AS Assignment

Owner name: INTELLECTUAL VENTURES FUND 83 LLC, NEVADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:EASTMAN KODAK COMPANY;REEL/FRAME:030262/0750

Effective date: 20130201

FPAY Fee payment

Year of fee payment: 4

AS Assignment

Owner name: MONUMENT PEAK VENTURES, LLC, TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INTELLECTUAL VENTURES FUND 83 LLC;REEL/FRAME:041941/0079

Effective date: 20170215

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.)

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20181123

AS Assignment

Owner name: MONUMENT PEAK VENTURES, LLC, TEXAS

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:INTELLECTUAL VENTURES FUND 83 LLC;REEL/FRAME:064599/0304

Effective date: 20230728