CN104346387A - Cloud server and image storage and retrieval system - Google Patents

Cloud server and image storage and retrieval system Download PDF

Info

Publication number
CN104346387A
CN104346387A CN201310330693.6A CN201310330693A CN104346387A CN 104346387 A CN104346387 A CN 104346387A CN 201310330693 A CN201310330693 A CN 201310330693A CN 104346387 A CN104346387 A CN 104346387A
Authority
CN
China
Prior art keywords
retrieving information
input
information
type
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310330693.6A
Other languages
Chinese (zh)
Other versions
CN104346387B (en
Inventor
童莲芳
陈剑
沈旭
刘陈
毛吕井昭平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ricoh Co Ltd
Original Assignee
Ricoh Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ricoh Co Ltd filed Critical Ricoh Co Ltd
Priority to CN201310330693.6A priority Critical patent/CN104346387B/en
Publication of CN104346387A publication Critical patent/CN104346387A/en
Application granted granted Critical
Publication of CN104346387B publication Critical patent/CN104346387B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network

Abstract

The invention relates to a cloud server and an image storage and retrieval system for adding retrieval information, allowing convenient retrieval for users, to image files. In the image storage and retrieval system, an input display portion of a user terminal displays a voice inputting picture to allow a user to add voice information, as first-type retrieval information, to a currently displayed image file; a user side communication portion correspondingly transmits the first-type retrieval information and the currently displayed image file to the cloud server; an addition control portion of the cloud server adds the first-type retrieval information to the corresponding image file. In this way, during image file retrieval, the user can directly retrieve the image files according to pre-input first-type retrieval information just by inputting voice data; information inputting and retrieving efficiency can be improved; additionally, the user is allowed to add the voice information to the image files, the defect that the existing retrieval method has the single input mode is overcome, and the user can be more interested in using.

Description

Cloud server and Image Storage Retrieval system
Technical field
The present invention relates to a kind of cloud server and Image Storage Retrieval system, be particularly a kind ofly convenient to cloud server and the Image Storage Retrieval system of the retrieving information of user search for image file apposition.
Background technology
At present, can directly be retrieved image file by text messages such as input key words, its retrieving is as follows: user is when being saved to storer required image file, can needing for text messages such as this image file apposition keywords according to oneself, then text information and image file are stored in storer accordingly.Like this, as long as input the text message of oneself apposition after user, corresponding image file can just be found accordingly.
In above-mentioned image file search method, because text message is user is carry out apposition according to the language use custom of oneself, user is not easy to forget text information, so when user wants the image file searching oneself first pre-treatment at any time, can obtain result for retrieval very soon.Therefore, this image file search method retrieval accuracy is high, and purpose is strong, and can realize the personalization of retrieval.
But, in above-mentioned image file search method, the text message that user is image file apposition must input with hand, for typewriting or computer beginner that typing speed is slow and because for certain reason user that temporarily cannot typewrite, very inconvenient by hand input text information, thus reduce input efficiency.In addition, this kind of image file search method input mode is single, effectively can not improve the use interest of user.
Summary of the invention
The present invention carries out to solve the problem, and object is to provide a kind of user of enabling to image file apposition voice data thus the cloud server utilizing this voice data to retrieve image file and Image Storage Retrieval system.
The present invention to achieve these goals, have employed following structure:
The invention provides a kind of Image Storage Retrieval system, for the image file apposition retrieving information containing plural page, and retrieve based on retrieving information, it is characterized in that, comprising: cloud server, for memory image file, and at least one user terminal, communicated to connect with cloud server respectively by network, wherein, cloud server comprises: image storage part, retrieving information storage part, apposition control part and service side Department of Communication Force, user terminal comprises: picture storage part, user side Department of Communication Force and input display part, image storage part at least stores image file, service side Department of Communication Force is at least sent to user terminal image file, user side Department of Communication Force at least receives image file from cloud server, picture storage part at least storage figure picture informs picture and retrieving information apposition input picture, input display part at least shows image and informs that picture is to inform user's present image file, and display retrieving information apposition input picture allows the content-based input retrieving information of user, user side Department of Communication Force is sent to cloud server corresponding with present image file for retrieving information, service side Department of Communication Force receives retrieving information from user terminal, retrieving information apposition is controlled retrieving information storage part store corresponding with image file for retrieving information to image file by apposition control part, retrieving information apposition input picture at least contains Speech input picture, retrieving information at least comprise obtained by Speech input picture and as the acoustic information of first kind retrieving information.
The effect of invention and effect
According to cloud server of the present invention and Image Storage Retrieval system, because the input display part display Speech input picture of user terminal allows user add acoustic information as first kind retrieving information on the image file of current display, user side Department of Communication Force is sent to cloud server corresponding with the image file of current display for first kind retrieving information, the apposition control part of cloud server is on image file extremely corresponding for first kind retrieving information apposition, so when retrieving image file, as long as user's input audio data just directly can be retrieved image file based on the first kind retrieving information pre-entered, be conducive to the input of raising information and effectiveness of retrieval.
On the other hand, because user can add acoustic information for image file, so overcome the single defect of current search method input mode, the use interest improving user is conducive to.
Accompanying drawing explanation
Fig. 1 is the block diagram of the Image Storage Retrieval system of the embodiment of the present invention one.
Fig. 2 is the block diagram of the cloud server of the embodiment of the present invention one.
Fig. 3 is the block diagram of the user terminal of the embodiment of the present invention one.
Fig. 4 is the schematic diagram of the login screen of the embodiment of the present invention one.
Fig. 5 is the schematic diagram that the image file of the embodiment of the present invention one informs picture.
Fig. 6 is the schematic diagram of the apposition way selection picture of the embodiment of the present invention one.
Fig. 7 is the schematic diagram of the character input picture of the embodiment of the present invention one.
Fig. 8 is the schematic diagram of the Speech input picture of the embodiment of the present invention one.
Fig. 9 is the schematic diagram of the recognition result confirmation screen of the embodiment of the present invention one.
Figure 10 is the schematic diagram of the image input picture of the embodiment of the present invention one.
Figure 11 is the schematic diagram of the Q&A viewing area of the embodiment of the present invention one.
Figure 12 is the schematic diagram of the comment viewing area of the embodiment of the present invention one.
Figure 13 is the schematic diagram of the sound viewing area of the embodiment of the present invention one.
Figure 14 is the schematic diagram of the image display area of the embodiment of the present invention one.
Figure 15 is the schematic diagram of the information correspondence table of the embodiment of the present invention one.
Figure 16 is the 3rd type retrieving information apposition process flow diagram of the embodiment of the present invention one.
Figure 17 is the 4th type retrieving information apposition process flow diagram of the embodiment of the present invention one.
Figure 18 is the 5th type retrieving information apposition process flow diagram of the embodiment of the present invention one.
Figure 19 is the first kind retrieving information apposition process flow diagram of the embodiment of the present invention one.
Figure 20 is the Second Type retrieving information apposition process flow diagram of the embodiment of the present invention one.
Figure 21 is that the retrieval mode of the embodiment of the present invention one selects picture view.
Figure 22 is that the input mode of the embodiment of the present invention one selects picture view.
Figure 23 is the process flow diagram retrieved the 3rd type retrieving information of the embodiment of the present invention one.
Figure 24 is the process flow diagram retrieved first kind retrieving information of the embodiment of the present invention one.
Figure 25 is the process flow diagram retrieved Second Type retrieving information of the embodiment of the present invention one.
Figure 26 is the schematic diagram of the result for retrieval picture of the embodiment of the present invention one.
Figure 27 is the block diagram of the Image Storage Retrieval system of the embodiment of the present invention two.
Figure 28 is the block diagram of the cloud server of the embodiment of the present invention two.
Figure 29 is the block diagram of the user terminal of the embodiment of the present invention two.
Figure 30 is the schematic diagram that the page image of the embodiment of the present invention two informs picture.
Figure 31 is the schematic diagram of the Q&A viewing area of the embodiment of the present invention two.
Figure 32 is the schematic diagram of the comment viewing area of the embodiment of the present invention two.
Figure 33 is the schematic diagram of the sound viewing area of the embodiment of the present invention two.
Figure 34 is the schematic diagram of the image display area of the embodiment of the present invention two.
Figure 35 is the schematic diagram of the information correspondence table of the embodiment of the present invention two.
Figure 36 is the 3rd type retrieving information apposition process flow diagram of the embodiment of the present invention two.
Figure 37 is the retrieving information apposition prompting area schematic of the embodiment of the present invention two.
Figure 38 is the 4th type retrieving information apposition process flow diagram of the embodiment of the present invention two.
Figure 39 is the 5th type retrieving information apposition process flow diagram of the embodiment of the present invention two.
Figure 40 is the first kind retrieving information apposition process flow diagram of the embodiment of the present invention two.
Figure 41 is the Second Type retrieving information apposition process flow diagram of the embodiment of the present invention two.
Figure 42 is the process flow diagram retrieved the 3rd type retrieving information of the embodiment of the present invention two.
Figure 43 is the process flow diagram retrieved first kind retrieving information of the embodiment of the present invention two.
Figure 44 is the process flow diagram retrieved Second Type retrieving information of the embodiment of the present invention two.
Figure 45 is the schematic diagram of the Images Classification apposition picture of variation of the present invention.
Figure 46 is the schematic diagram of the Images Classification searching picture of variation of the present invention.
Figure 47 is the schematic diagram of the image viewing picture of variation of the present invention.
Embodiment
Be described in detail below in conjunction with the embodiment of accompanying drawing to the cloud server that the present invention relates to and Image Storage Retrieval system.
As a kind of example, the invention provides a kind of Image Storage Retrieval system, for the image file apposition retrieving information containing plural page, and retrieve based on retrieving information, it is characterized in that, comprising: cloud server, for memory image file, and at least one user terminal, communicated to connect with cloud server respectively by network, wherein, cloud server comprises: image storage part, retrieving information storage part, apposition control part and service side Department of Communication Force, user terminal comprises: picture storage part, user side Department of Communication Force and input display part, image storage part at least stores image file, service side Department of Communication Force is at least sent to user terminal image file, user side Department of Communication Force at least receives image file from cloud server, picture storage part at least storage figure picture informs picture and retrieving information apposition input picture, input display part at least shows image and informs that picture is to inform user's present image file, and display retrieving information apposition input picture allows the content-based input retrieving information of user, user side Department of Communication Force is sent to cloud server corresponding with present image file for retrieving information, service side Department of Communication Force receives retrieving information from user terminal, retrieving information apposition is controlled retrieving information storage part store corresponding with image file for retrieving information to image file by apposition control part, retrieving information apposition input picture at least contains Speech input picture, retrieving information at least comprise obtained by Speech input picture and as the acoustic information of first kind retrieving information.
In such example, such feature can be had: retrieving information apposition input picture also containing image input picture, retrieving information also comprise obtained by image input picture and as the image information of Second Type retrieving information.
Contain in the image file storage and retrieval system of acoustic information or image information above-mentioned, such feature can also be had: image storage part also stores the plural width page image corresponding with plural page of composition image file, service side Department of Communication Force is sent to user terminal page image, user side Department of Communication Force receives page image from cloud server, input display part display image informs that picture is to inform the content of user's current page image, and display retrieving information apposition input picture allows the content-based input retrieving information of user, user side Department of Communication Force is sent to cloud server corresponding with current page image for retrieving information, service side Department of Communication Force receives retrieving information from user terminal, retrieving information apposition is controlled retrieving information storage part store corresponding with page image for retrieving information to page image by apposition control part.
In superincumbent example, such feature can also be had: image storage part also stores the page attribute information of the attribute representing page image, user side Department of Communication Force also receives page attribute information while receiving page image from cloud server, and also send corresponding page attribute information while retrieving information is sent to cloud server, apposition control part controls retrieving information storage part and stores corresponding with retrieving information for page attribute information.
In superincumbent example, such feature can also be had: retrieving information also containing the keyword as the 3rd type retrieving information, the Q&A as the 4th type retrieving information, as one or more of the comment of the 5th type retrieving information, first kind retrieving information is voice data, Second Type retrieving information is view data, and the 3rd type retrieving information, the 4th type retrieving information and the 5th type retrieving information are character type data.
In superincumbent example, such feature can also be had: page image informs picture also containing retrieving information apposition selected zone, this retrieving information apposition selected zone comprises first kind retrieving information apposition key, Second Type retrieving information apposition key, 3rd type retrieving information apposition key, 4th type retrieving information apposition key and the 5th retrieving information type apposition key, picture storage part also stores the apposition way selection picture at least containing character input selection key, as the character input picture of retrieving information apposition with input picture, as the Speech input picture of retrieving information apposition with input picture, as the image input picture of retrieving information apposition with input picture, when first kind retrieving information apposition key is selected, input display part display Speech input picture allows user's input audio data as first kind retrieving information, when Second Type retrieving information apposition key is selected, input display part display image input picture allows user's input image data as Second Type retrieving information, when the 3rd type retrieving information apposition key is selected, input display part display apposition way selection picture allows user select apposition mode, when character input selection key is selected, input display part display character inputs picture by user inputs character type data as the 3rd type retrieving information, when the 4th type retrieving information apposition key is selected, input display part display apposition way selection picture allows user select apposition mode, when character input selection key is selected, input display part display character inputs picture by user inputs character type data as the 4th type retrieving information, when the 5th type retrieving information apposition key is selected, input display part display apposition way selection picture allows user select apposition mode, when character input selection key is selected, input display part display character inputs picture by user inputs character type data as the 5th type retrieving information.
In superincumbent example, such feature can also be had: image file storage and retrieval system also comprises voice recognition portion, wherein, apposition way selection picture is also containing Speech input options button, when the 3rd type retrieving information apposition key and Speech input options button is selected time, input display part display Speech input picture allows user's input audio data, this voice data is identified as character type data and as the 3rd type retrieving information by voice recognition portion, when the 4th type retrieving information apposition key and Speech input options button is selected time, input display part display Speech input picture allows user's input audio data, this voice data is identified as character type data and as type four retrieving information by voice recognition portion, when the 5th type retrieving information apposition key and Speech input options button is selected time, input display part display Speech input picture allows user's input audio data, this voice data is identified as character type data and as the 5th type retrieving information by voice recognition portion.
In superincumbent example, such feature can also be had: image file storage and retrieval system also comprises Image recognizing section, wherein, apposition way selection picture is also containing image input selection key, when the 3rd type retrieving information apposition key and image input selection key is selected time, input display part display image input picture allows user's input image data, this view data is identified as character type data and as the 3rd type retrieving information by Image recognizing section, when the 4th type retrieving information apposition key and image input selection key is selected time, input display part display image input picture allows user's input image data, this view data is identified as character type data and as the 4th type retrieving information by Image recognizing section, when the 5th type retrieving information apposition key and image input selection key is selected time, input display part display image input picture allows user's input image data, this view data is identified as character type data and as the 5th type retrieving information by Image recognizing section.
In superincumbent example, such feature can also be had: cloud server also comprises search part, wherein, picture storage part is memory scan information retrieval input picture also, input display part also shows retrieving information retrieval input picture allows user input retrieval information for retrieving, retrieval information is sent to cloud server by user side Department of Communication Force, service side Department of Communication Force receives retrieval information from user terminal, search part retrieval retrieving information storage part, obtain the retrieving information consistent with retrieval information and corresponding page attribute information, and obtain corresponding page image based on this page attribute information retrieval page image storage part.
In superincumbent example, such feature can also be had: retrieval information contains the sound as first kind retrieval information, as the image of Second Type retrieval information, as the keyword of the 3rd type retrieval information, as the Q&A of the 4th type retrieval information, as one or more in the comment of the 5th type retrieval information, first kind retrieval information is voice data, Second Type retrieval information is view data, 3rd type retrieval information, 4th type retrieval information and the 5th type retrieval information are character type data, picture storage part also stores and comprises first kind retrieval information enter key, information enter key is used in Second Type retrieval, information enter key is used in 3rd type retrieval, the 4th type retrieval retrieval mode of information enter key and the 5th type retrieval information enter key selects picture, input mode at least containing character entry key selects picture, as the character input picture of retrieving information retrieval with input picture, as the Speech input picture of retrieving information retrieval with input picture, as the image input picture of retrieving information retrieval with input picture, when first kind retrieval information enter key is selected, input display part display Speech input picture allows user's input audio data as first kind retrieval information, when Second Type retrieval information enter key is selected, input display part display image input picture allows user's input image data as Second Type retrieval information.When the 3rd type retrieval information enter key is selected, input display part display input mode selects picture to allow user select input mode, when character entry key is selected, input display part display character inputs picture by user inputs character type data as the 3rd type retrieval information, when the 4th type retrieval information enter key is selected, input display part display input mode selects picture to allow user select input mode, when character entry key is selected, input display part display character inputs picture by user inputs character type data as the 4th type retrieval information, when the 5th type retrieval information enter key is selected, input display part display input mode selects picture to allow user select input mode, when character input selection key is selected, input display part display character inputs picture by user inputs character type data as the 5th type retrieval information.
In superincumbent example, such feature can also be had: image file sends to cloud server by scanning uploading device, and user terminal comprises scanning uploading device.
In example of the present invention, the present invention also provides a kind of cloud server, to be communicated with user terminal by network and be connected, to the image file apposition retrieving information containing plural page, and retrieve based on this retrieving information, it is characterized in that, comprise: image storage part, retrieving information storage part, apposition control part and service side Department of Communication Force, wherein, image storage part at least stores image file, service side Department of Communication Force is at least sent to user terminal image file, and receive the retrieving information corresponding with present image file from user terminal, retrieving information apposition is controlled retrieving information storage part store corresponding with image file for retrieving information to image file by apposition control part, retrieving information at least comprises the one in acoustic information and image information.
In superincumbent example, such feature can also be had: cloud server also comprises search part, wherein, image storage part also stores the plural width page image corresponding with plural page of composition image file, and correspondingly store the page attribute information of the attribute representing page image, retrieving information storage part stores corresponding with retrieving information for page attribute information, when service side, Department of Communication Force receives retrieval information from user terminal, search part retrieval retrieving information storage part, obtain the retrieving information consistent with retrieval information and corresponding page attribute information, and obtain corresponding page image based on this page attribute information retrieval page image storage part.
Embodiment one
Fig. 1 is the block diagram of the Image Storage Retrieval system of the embodiment of the present invention one.
As shown in Figure 1, Image Storage Retrieval system 100 for being image file apposition retrieving information, and is retrieved based on this retrieving information, comprises cloud server 101 and at least one user terminal 102.
Fig. 2 is the block diagram of the cloud server of the embodiment of the present invention one.
As shown in Figure 2, cloud server 101, for storing a plurality of image file, comprises service side control part 105, image file storage part 106, retrieving information storage part 107, search part 108, service side Department of Communication Force 109, service side temporary storage part 110, apposition control part 150 etc.
Cloud server 101 is communicated to connect by the Internet 103 and each user terminal 102, thus transmits and exchange data information with these user terminals 102.Cloud server 101 also communicates with scanning uploading device 104 and is connected, and can receive the image file that also memory scanning uploading device 104 is uploaded.
Fig. 3 is the block diagram of the user terminal of the embodiment of the present invention one.
As shown in Figure 3, each user terminal 102 includes user side temporary storage part 116, picture storage part 113, input display part 114, user side Department of Communication Force 115 and user side control part 112 etc.User terminal 102 allows user input the retrieving information of apposition on image file and the retrieval information for retrieving image file, also allows user be uploaded in cloud server 101 by the image file of electronic form.
Image file storage part 106 is for storing image file, simultaneously also carry out corresponding stored to the image file attribute information of the attribute representing each image file, namely, image file storage part 106 pairs of image files image file attribute information that is each and this image file is corresponding stores.The image file attribute information of each image file and this image file one_to_one corresponding, comprise the size of this image file, take up room, resolution, file layout, check the information such as number of times, document source and the page number in respective image file.
Each image file is uploaded in cloud server 101 after can scanning via scanning uploading device 104, also directly can be uploaded in cloud server 101 via user terminal 102.No matter upload via any one mode above-mentioned, this image file is first all converted into SWF(shock wave flash) form being kept in image file storage part 106.
Data information exchange between each ingredient that service side Department of Communication Force 109 is responsible for cloud server 101 and between cloud server 101 and user terminal 102.When user terminal 102 needs View Image File, service side Department of Communication Force 109 is at least sent to user terminal image file.When user terminal 102 is for after certain image file with the addition of retrieving information, service side Department of Communication Force 109 receives retrieving information from user terminal.
Service side temporary storage part 110 for temporarily store cloud server 101 each ingredient between and the data message that exchanges between cloud server 101 and user terminal 102, the data such as the retrieving information that such as user terminal 5 sends and retrieval information.
Service side control part 105 responsible control service side Department of Communication Force 109 receives the data message that user terminal 102 sends, and controls the work of each ingredient of cloud server 101 based on this data message.
Data information exchange between each ingredient that user side communication section 115 is responsible for user terminal 102 and between user terminal 102 and cloud server 101.Such as, retrieval keyword and mode information are sent to cloud server 101 by user side communication section 115, receive result for retrieval from cloud server 101, and be sent to input display part 114 show.
Picture storage part 113 stores login screen, image file informs picture, retrieving information apposition input picture, retrieval mode select picture, retrieving information retrieval input picture, result for retrieval picture, character input picture, image input the picture such as picture, Speech input picture.
Input display part 114 for showing login screen, image file informs picture, retrieving information apposition input picture, retrieval mode select picture, recognition result confirmation screen, retrieving information retrieval input picture, result for retrieval picture, character inputs picture, image inputs the storage of the picture storage part 113 such as picture, Speech input picture various pictures, allow user input relevant information or to carry out various selection.
Fig. 4 is the schematic diagram of the login screen of the embodiment of the present invention one.
As shown in Figure 4, login screen 117 for allowing user input user identification code to log in this Image Storage Retrieval system 100.Login screen 117 has " please input your user identification code " points out printed words to input user identification code to point out user, and user identification code input frame 118 allows user input user identification code.
In addition, this login screen 117 also has " login " button, " exiting " button and " registration " button.After user inputs correct user identification code and selects " login " button, then login Image Storage Retrieval system 100.If the user identification code of user's input error, then input display part 114 and show " your user identification code input error please be re-entered your user identification code or register new user identification code " and point out printed words.If user selects " exiting " button, then exit Image Storage Retrieval system 100 and stop retrieving.If user does not have user identification code, then can click " registration " button, a new user identification code after the customer identification information such as input user identity, user's pet name, user name, author and password, can be obtained.Wherein, " author " information and user identification code are one-to-one relationship.
Certainly, this login screen 117 can also be provided with " forgetting identification code " button, if user have forgotten the user identification code of oneself, then can select " forgetting identification code " button, and the customer identification information according to inserting during registration can give user identification code for change.
Fig. 5 is the schematic diagram that the image file of the embodiment of the present invention one informs picture.
As shown in Figure 5, image file informs that picture 119 is for informing the content of the current selected image file of user, comprises the regions such as file name viewing area 120, page number viewing area 124, retrieving information apposition selected zone 121, retrieving information viewing area 122, image file viewing area 123, thumbnail viewing area 125.When user logins Image Storage Retrieval system 100 and after image file needed for selecting or after selecting the image file that retrieves, input display part 114 View Image File informs that picture 119 is to inform the content of the image file of its current selection of user.
Inform in picture 119 at image file, file name viewing area 120 is for showing the title of its current selected image file to user." reading .pdf " i.e. shown in Fig. 5 title of current selected image file.
Image file viewing area 123 not only shows the content of the image file selected by it to user, also show the various retrieving informations of apposition on this image file." bill storage ", " funds on account remaining sum " and " appointment & performance " in Fig. 5 is namely the keyword retrieval information that the image file of current display adds.No matter translate into how many pages at this image file, keyword retrieval information is all carry out showing according to the time order and function order of apposition.Image file viewing area 123 is also provided with scroll bar 142, comprises HScrollBar and vertical scroll bar.HScrollBar is for regulating the horizontal viewing area of image file, and vertical scroll bar is for regulating the vertical viewing area of image file.When the pixel of image file is higher, whole image file viewing area 123 can not show this image file completely, therefore, by the viewing area regulating the position of scroll bar 142 just can regulate current selected image file, and can be completely shown.
Thumbnail viewing area 125 is for the thumbnail that shows every image page by page of the image file of the current selection of user and the thumbnail of a few width page images be adjacent.In the present embodiment, thumbnail viewing area 125 shows the thumbnail of six width page images.Certainly, thumbnail viewing area 125 also can show more several or less width thumbnail.When any width thumbnail of this thumbnail viewing area 125 is selected, image file viewing area 123 just shows the content of the page image corresponding with selected thumbnail.By the thumbnail selected in thumbnail viewing area 125 with other non-selected thumbnail distinguish and show, such as shade, frame overstriking, add mark etc., know that to facilitate user which page current selected thumbnail is.Frame overstriking is adopted to show, to distinguish with the thumbnail of surrounding by the thumbnail selected in Fig. 5.Thumbnail can allow user understand the overview of the adjacent some width page images of selected page image current with it, is convenient to it and finds required page image fast.
Page number viewing area 124 is for showing its current selected page number of page image in image file to user.The page number number of display is consistent with the thumbnail number of display.
Retrieving information apposition selected zone 121 allows the retrieving information of user needed for current selected image file apposition.In the present embodiment, user the retrieving information of apposition can have five kinds, is respectively: as first kind retrieving information sound, as Second Type retrieving information image, the keyword as the 3rd type retrieving information, the Q&A as the 4th type retrieving information and as the 5th type retrieving information comment.First kind retrieving information is voice data, Second Type retrieving information is view data, 3rd type retrieving information, the 4th type retrieving information and the 5th type retrieving information are character type data, accordingly, retrieving information apposition selected zone 121 comprises first kind retrieving information apposition key, Second Type retrieving information apposition key, the 3rd type retrieving information apposition key, the 4th type retrieving information apposition key and these five kinds of information apposition keys of the 5th type retrieving information apposition key, for the above-mentioned retrieving information of the corresponding apposition of difference.As shown in Figure 5, " sound " button is first kind retrieving information apposition key, " image " button is Second Type retrieving information apposition key, " keyword " button is the 3rd type retrieving information apposition key, " Q&A " button is the 4th type retrieving information apposition key, " comment " button is the 5th type retrieving information apposition key.
Fig. 6 is the schematic diagram of the apposition way selection picture of the embodiment of the present invention one.
As shown in Figure 6, the apposition mode of apposition way selection picture 140 for allowing user select retrieving information, the prompting printed words containing " retrieving information apposition mode please be select ", character input selection key, Speech input options button and image input selection key.When any one in the 3rd type retrieving information apposition key, the 4th type retrieving information apposition key and the 5th type retrieving information apposition key is selected, input display part 114 shows apposition way selection picture 140 allows user select required apposition mode.Character input selection key and " with the character mode apposition " button shown in Fig. 6, Speech input options button and " with the image mode apposition " button shown in " audibly apposition " button, image input selection key and the Fig. 6 shown in Fig. 6.
Fig. 7 is the schematic diagram of the character input picture of the embodiment of the present invention one.
As shown in Figure 7, character input picture 130 contains prompting printed words and the character input boxes 131 of " asking input character ".When the character input selection key of apposition way selection picture 140 is selected, input display part 114 shows character input picture 130 allows user inputs character type data.
When user is after these character input boxes 131 input character type data, namely this character type data is attached to as retrieving information on the image file of current display.What input in the present embodiment is " bill time limit " character type data, be then somebody's turn to do " bill time limit " by the retrieving information of the image file as current display.
Fig. 8 is the schematic diagram of the Speech input picture of the embodiment of the present invention one.
As shown in Figure 8, Speech input picture 143 is for allowing user's input audio data.When the Speech input options button of apposition way selection picture 140 is selected, namely user selects using Speech input as apposition mode, and input display part 114 shows Speech input picture 143.The prompting printed words of Speech input picture 143 containing " asking sound import ", sound navigation key 144 and record button 145.Sound navigation key and the Browse button shown in Fig. 8.Record button 145 is that is shown in Fig. 8 button.
When sound navigation key 144 is by selection, user can upload voice data from user terminal 102.When record button 145 is by selection, user can direct input audio data.When user inputs complete, click sound replay key can play the sound of oneself input.Shown in sound replay key and Fig. 8 button.
Voice recognition portion 132 is character type data for voice data translation user inputted.When any one input audio data by above-mentioned two kinds of modes of user, this voice data translation is character type data by voice recognition portion 132, and this character type data is attached to as retrieving information on the image file of current display subsequently.
Fig. 9 is the schematic diagram of the recognition result confirmation screen of the embodiment of the present invention one.
As shown in Figure 9, the prompting printed words of recognition result confirmation screen 133 containing " whether the following content of PLSCONFM is correct ", and recognition result confirms frame 134.After voice data translation is character type data by voice recognition portion 132, input display part 114 Identification display results verification picture 133 allow user confirm whether voice recognition result correct.If recognition result is correct, then user selects " confirmation " button, and this recognition result is attached on the image file of current display as retrieving information.If recognition result mistake, then at recognition result, user confirms that frame 134 is revised as correct character type data and selects ACK button, and this amended character type data is attached on the image file of current display as retrieving information.Voice recognition result in Fig. 9 is " bill time limit ", then " bill time limit " recognition result of being displayed on recognition result confirmation screen 133 confirms in frame 134.
Figure 10 is the schematic diagram of the image input picture of the embodiment of the present invention one.
As shown in Figure 10, image input picture 135, for allowing user's input image data, contains prompting printed words, the picture browsing key 146 of " asking input picture " and key 147 of taking pictures.When the image input selection key of apposition way selection picture 140 is selected, input display part 114 shows image input picture 135.When picture browsing key 146 and " determination " button are selected, user can from user terminal 102 upload images data.When key 147 of taking pictures is by selection, user is by direct input image data of taking pictures.
Image recognizing section 136 is converted into character type data for view data user inputted.When any one input image data by above-mentioned two kinds of modes of user, this view data is converted into character type data by Image recognizing section 136.After view data is converted into character type data by Image recognizing section 136, input display part 114 Identification display results verification picture 133 allow user confirm whether image recognition result correct.If recognition result is correct, then the ACK button of user's selection result confirmation screen 133, makes this recognition result be attached on the image file of current display as retrieving information.If recognition result mistake, then at the recognition result of results verification picture 133, user confirms that frame 134 is revised as correct character type data and selects ACK button, and this amended character type data is attached on the image file of current display as retrieving information.
The interpolation detailed process of five kinds of retrieving informations is as follows:
When first kind retrieving information apposition key is selected, input display part 114 shows Speech input picture 143 allows user's input audio data as first kind retrieving information.
When Second Type retrieving information apposition key is selected, input display part 114 shows image input picture 135 allows user's input image data as Second Type retrieving information.
When the 3rd type retrieving information apposition key is selected, input display part 114 shows apposition way selection picture 140 allows user select apposition mode.When character input selection key is selected, input display part 114 shows character input picture 130 allows user inputs character type data as the 3rd type retrieving information; When Speech input options button is selected, input display part 114 shows Speech input picture 143 allows user's input audio data, and then this voice data is identified as character type data and as the 3rd type retrieving information by voice recognition portion 132; When image input selection key is selected, input display part 114 shows image input picture 135 allows user's input image data, Image recognizing section 136 that this view data is identified as character type data and as the 3rd type retrieving information.
When the 4th type retrieving information apposition key is selected, input display part 114 shows apposition way selection picture 140 allows user select apposition mode.When character input selection key is selected, input display part 114 shows character input picture 130 allows user inputs character type data as the 4th type retrieving information; When Speech input options button is selected, input display part 114 shows Speech input picture 143 allows user's input audio data, voice recognition portion 132 that this voice data is identified as character type data and as the 4th type retrieving information; When image input selection key is selected, input display part 114 shows image input picture 130 allows user's input image data, Image recognizing section 136 that this view data is identified as character type data and as the 4th type retrieving information.
When the 5th type retrieving information apposition key is selected, input display part 114 shows apposition way selection picture 140 allows user select apposition mode.When character input selection key is selected, input display part 114 shows character input picture by user inputs character type data as the 5th type retrieving information; When Speech input options button is selected, input display part 114 shows Speech input picture 143 allows user's input audio data, voice recognition portion 132 that this voice data is identified as character type data and as the 5th type retrieving information; When image input selection key is selected, input display part 114 shows image input picture allows user's input image data, Image recognizing section 136 that this view data is identified as character type data and as the 5th type retrieving information.
After any one of five kinds of retrieving informations is added, these retrieving informations show in retrieving information viewing area 122, to allow user check.
Retrieving information viewing area 122, for having shown in this image file the retrieving information of apposition in advance, comprises keyword viewing area 126, Q&A viewing area 127, comment region 128, sound viewing area 148 and image display area 149.
As shown in Figure 5, keyword viewing area 126 for showing the 3rd type retrieving information added, comprise the author of keyword, the content of keyword, creation-time and keyword check the information such as number of times.Keyword viewing area 126 is also provided with " deletion " button and the Edit button, so that user modifies to keyword.But " deletion " button keyword corresponding with same user identification code with the Edit button is corresponding to be arranged, therefore only have the user creating this keyword just can modify to the keyword of oneself setting, and can not the keyword that other users set be modified.In Fig. 5, the user that author is " fox " is called in name the image file of " read .pdf " creates two keywords " bill storage " and " funds on account remaining sum ", and author is that the user of " nick " creates a keyword " appointment & performance " on this image file.When the user that author is " fox " logs in this Image Storage Retrieval system, can only " bill storage " and " funds on account remaining sum " be deleted or be edited, can not " appointment & performance " be deleted or be edited.Accordingly, the keyword that all users create on this image file all shows on image file viewing area 123.
Figure 11 is the schematic diagram of the Q&A viewing area of the embodiment of the present invention one.
As shown in figure 11, Q&A viewing area 127, for showing the 4th type retrieving information added, comprises the author of Q&A, the content of enquirement, content, the creation-time of answer and checks the information such as number of times.There is " answer " button Q&A viewing area 127.When user selects this " answer " button, just can answer enquirement.If an enquirement has multiple answer, then each answer shows, to avoid confusion by the time sequencing answered successively in dialog box respectively.
Figure 12 is the schematic diagram of the comment viewing area of the embodiment of the present invention one.
As shown in figure 12, comment region 128 for showing the 5th type retrieving information added, comprise the author of comment, comment content, creation-time and check the information such as number of times.If an image file has multiple comment, then each comment shows from top to bottom successively by the time sequencing of adding, to avoid confusion respectively in dialog box.
Figure 13 is the schematic diagram of the sound viewing area of the embodiment of the present invention one.
As shown in figure 13, sound viewing area 148, for showing the first kind retrieving information added, comprises the author of sound, sound-content identifier creation-time and check the information such as number of times.Corresponding, also containing sound-content identifier in the retrieving information display box 155 of image file viewing area 123 retrieving information in this retrieving information display box 155 of prompting user is first kind retrieving information.When containing multiple first kind retrieving information in an image file, the time order and function order that sound viewing area 148 is added in image file by first kind retrieving information shows these first kind retrieving informations successively.Figure 13 contains three first kind retrieving informations.When user's click sound content designator time, just can play this first kind retrieving information.
Figure 14 is the schematic diagram of the image display area of the embodiment of the present invention one.
As shown in figure 14, image display area 149, for showing the Second Type retrieving information added, comprises the author of image, picture material identifier creation-time and check the information such as number of times.Corresponding, also containing picture material identifier in the retrieving information display box of image file viewing area 123 retrieving information in this retrieving information display box of prompting user is Second Type retrieving information.When containing multiple Second Type retrieving information in piece image file, image display area 149 shows these Second Type retrieving informations by Second Type retrieving information successively at the position sequencing of image file viewing area 123." debt " in Figure 14 represents the content of the image file of frame choosing, the picture material identifier on " debt " side illustrate that the region apposition that this frame selects has Second Type retrieving information.When user clicks picture material identifier time, just can check this Second Type retrieving information.
Any one apposition of above-mentioned five type retrieving informations is controlled retrieving information storage part 107 store corresponding with image file for the retrieving information of apposition to image file by apposition control part 150, also controls retrieving information storage part 107 and stores corresponding with these retrieving informations for image file attribute information.
Figure 15 is the schematic diagram of the information correspondence table of the embodiment of the present invention one.
As shown in figure 15, the corresponding table 151 of information is formed and stored in retrieving information storage part 107 by apposition control part 150.Information corresponding table 151 memory image file attribute information, retrieving information and corresponding relation therebetween.The image file attribute information stored in the corresponding table 151 of information comprises the information such as file name.The title of each image file can not repeat, and therefore, in the corresponding table 151 of information, the retrieving information of five types is corresponding with the title of image file respectively.In Figure 15, file name is that the image file of " F1 " is respectively containing three the 3rd type retrieving informations " K11 ?1 ", " K11 ?2 " and " K11 ?3 ", containing two the 4th type retrieving informations " Q & A11 ?1 ", " Q & A11 ?1 ", containing a 5th type retrieving information " C11 ?1 ", containing a first kind retrieving information " V11 ?1 ", not containing Second Type retrieving information.As long as user inputs any one retrieving information above-mentioned, corresponding image file just can be retrieved.Like this, an image file corresponds to multiple retrieving information, substantially increases degree of accuracy and the recall precision of retrieval.In addition, file name be the image file of " F2 " not containing the 3rd type retrieving information, the 4th type retrieving information, the 5th type retrieving information and first kind retrieving information, only containing a Second Type retrieving information " I13 ?1 ".For the image file that file name is " F2 ", Second Type retrieving information " I13 ?1 " can only be used to retrieve.
The attach procedure of retrieving information on image file is elaborated below in conjunction with process flow diagram.
Figure 16 is the 3rd type retrieving information apposition process flow diagram of the embodiment of the present invention one.
As shown in figure 16, the 3rd type retrieving information apposition flow process is as follows:
Step S1 ?1:
When user need for current selected and display image file apposition the 3rd type retrieving information time, input display part 114 View Image File informs that picture 119 allows user select the 3rd type retrieving information apposition key at retrieving information apposition selected zone 121, then enter step S1 ?2.
Step S1 ?2:
Input display part 114 shows apposition way selection picture 140 allows user select required apposition mode.When character input selection key is selected, enter step S1-3; When Speech input options button is selected, enter step S1-4; When image input selection key is selected, enter step S1-5.
Step S1 ?3:
Input display part 114 show character input picture 130 allows user inputs character type data as the 3rd type retrieving information, then enter step S1 ?6.
Step S1 ?4:
Input display part 114 shows Speech input picture 143 allows user's input audio data, voice recognition portion 132 that this voice data is identified as character type data and as the 3rd type retrieving information, then enter step S1 ?6.
Step S1 ?5:
Input display part 114 shows image input picture 135 allows user's input image data, Image recognizing section 136 that this view data is identified as character type data and as the 3rd type retrieving information, then enter step S1 ?6.
Step S1 ?6:
User side Department of Communication Force 115 is sent to cloud server 101 corresponding with present image file for the 3rd type retrieving information, then enter step S1 ?8.
Step S1 ?7:
Service side Department of Communication Force 109 receives the 3rd type retrieving information from user terminal 111, then enter step S1 ?8.
Step S1 ?8:
3rd type retrieving information apposition is controlled retrieving information storage part 107 store corresponding with image file for the 3rd type retrieving information to corresponding image file by apposition control part 150.
So far the 3rd type retrieving information adds complete.
Figure 17 is the 4th type retrieving information apposition process flow diagram of the embodiment of the present invention one.
As shown in figure 17, the 4th type retrieving information apposition flow process is as follows:
Step S2 ?1:
When user need for current selected and display image file apposition the 4th type retrieving information time, input display part 114 View Image File informs that picture 119 allows user select the 4th type retrieving information apposition key at retrieving information apposition selected zone 121, then enter step S2 ?2.
Step S2 ?2:
Input display part 114 shows apposition way selection picture 140 allows user select required apposition mode.When character input selection key is selected, enter step S2-3; When Speech input options button is selected, enter step S2-4; When image input selection key is selected, enter step S2-5.
Step S2 ?3:
Input display part 114 show character input picture 130 allows user inputs character type data as the 4th type retrieving information, then enter step S2 ?6.
Step S2 ?4:
Input display part 114 shows Speech input picture 143 allows user's input audio data, voice recognition portion 132 that this voice data is identified as character type data and as the 4th type retrieving information, then enter step S2 ?6.
Step S2 ?5:
Input display part 114 shows image input picture 135 allows user's input image data, Image recognizing section 136 that this view data is identified as character type data and as the 4th type retrieving information, then enter step S2 ?6.
Step S2 ?6:
User side Department of Communication Force 115 is sent to cloud server 101 corresponding with present image file for the 4th type retrieving information, then enter step S2 ?7.
Step S2 ?7:
Service side Department of Communication Force 109 receives the 4th type retrieving information from user terminal 111, then enter step S2 ?8.
Step S2 ?8:
4th type retrieving information apposition is controlled retrieving information storage part 107 store corresponding with image file for the 4th type retrieving information to corresponding image file by apposition control part 150.
So far the 4th type retrieving information adds complete.
Figure 18 is the 5th type retrieving information apposition process flow diagram of the embodiment of the present invention one.
As shown in figure 18, the 5th type retrieving information apposition flow process is as follows:
Step S3 ?1:
When user need for current selected and display image file apposition the 5th type retrieving information time, input display part 114 View Image File informs that picture 119 allows user select the 5th type retrieving information apposition key at retrieving information apposition selected zone 121, then enter step S3 ?2.
Step S3 ?2:
Input display part 114 shows apposition way selection picture 140 allows user select required apposition mode.When character input selection key is selected, enter step S3-3; When Speech input options button is selected, enter step S3-4; When image input selection key is selected, enter step S3-5.
Step S3 ?3:
Input display part 114 show character input picture 130 allows user inputs character type data as the 5th type retrieving information, then enter step S3 ?6.
Step S3 ?4:
Input display part 114 shows Speech input picture 143 allows user's input audio data, voice recognition portion 132 that this voice data is identified as character type data and as the 5th type retrieving information, then enter step S3 ?6.
Step S3 ?5:
Input display part 114 shows image input picture 135 allows user's input image data, Image recognizing section 136 that this view data is identified as character type data and as the 5th type retrieving information, then enter step S3 ?6.
Step S3 ?6:
User side Department of Communication Force 115 is sent to cloud server 101 corresponding with present image file for the 5th type retrieving information, then enter step S3 ?7.
Step S3 ?7:
Service side Department of Communication Force 109 receives the 5th type retrieving information from user terminal 111, then enter step S3 ?8.
Step S3 ?8:
5th type retrieving information apposition is controlled retrieving information storage part 107 store corresponding with image file for the 5th type retrieving information to corresponding image file by apposition control part 150.
So far the 5th type retrieving information adds complete.
Figure 19 is the first kind retrieving information apposition process flow diagram of the embodiment of the present invention one.
As shown in figure 19, first kind retrieving information apposition flow process is as follows:
Step S4 ?1:
When user need for current selected and display the image file apposition first kind retrieving information time, input display part 114 View Image File informs that picture 119 allows user select first kind retrieving information apposition key at retrieving information apposition selected zone 121, then enter step S4 ?2.
Step S4 ?2:
Input display part 114 shows Speech input picture 143 allows user's input audio data as first kind retrieving information, then enter step S4 ?3.
Step S4 ?3:
User side Department of Communication Force 115 is sent to cloud server 101 corresponding with present image file for first kind retrieving information, then enter step S4 ?4.
Step S4 ?4:
Service side Department of Communication Force 109 receives first kind retrieving information from user terminal 111, then enter step S4 ?5.
Step S4 ?5:
First kind retrieving information apposition is controlled retrieving information storage part 107 store corresponding with image file for this first kind retrieving information to corresponding image file by apposition control part 150.
So far first kind retrieving information adds complete.
Figure 20 is the Second Type retrieving information apposition process flow diagram of the embodiment of the present invention one.
As shown in figure 20, Second Type retrieving information apposition flow process is as follows:
Step S5 ?1:
When user need for current selected and display image file apposition Second Type retrieving information time, input display part 114 View Image File informs that picture 119 allows user select Second Type retrieving information apposition key at retrieving information apposition selected zone 121, then enter step S5 ?2.
Step S5 ?2:
Input display part 114 shows image input picture 135 allows user's input image data as Second Type retrieving information, then enter step S5 ?3.
Step S5 ?3:
User side Department of Communication Force 115 is sent to cloud server 101 corresponding with present image file for Second Type retrieving information, then enter step S5 ?4.
Step S5 ?4:
Service side Department of Communication Force 109 receives Second Type retrieving information from user terminal 111, then enter step S5 ?5.
Step S5 ?5:
Second Type retrieving information apposition is controlled retrieving information storage part 107 store corresponding with image file for this Second Type retrieving information to corresponding image file by apposition control part 150.
So far Second Type retrieving information adds complete.
Elaborate the retrieving of image file below.
Search part 108 is retrieved image file for the retrieval information inputted according to user.In the present embodiment, the retrieval information that user can input has five kinds, is respectively: the sound as first kind retrieval information, the image as Second Type retrieval information, the keyword as the 3rd type retrieval information, the Q&A as the 4th type retrieval information, as one or more in the comment of the 5th type retrieval information.Wherein, the 3rd type retrieval information, the 4th type retrieval information and the 5th type retrieval information are character type data, and first kind retrieval information is voice data, and Second Type retrieval information is view data.
Figure 21 is that the retrieval mode of the embodiment of the present invention one selects picture view.
As shown in figure 21, retrieval mode selects picture 152 select retrieval mode for allowing user.When user logins Image Storage Retrieval system 100, input display part 114 shows retrieval mode and selects picture 152.In the present embodiment, the retrieval mode that user can select has five kinds, be respectively: for " retrieval sound " retrieval mode retrieved first kind retrieving information, for " retrieving images " retrieval mode retrieved Second Type retrieving information, for " search key " retrieval mode retrieved the 3rd type retrieving information, for " retrieval Q&A " retrieval mode retrieved the 4th type retrieving information, for " retrieval comment " retrieval mode retrieved the 5th type retrieving information.Corresponding, retrieval mode selects picture 152 to use information enter key containing five kinds of retrievals, be respectively: as " search key " button of the 3rd type retrieval information enter key, as the 4th type retrieval " retrieval Q&A " button with information enter key, as the 5th type retrieval " retrieval comment " button with information enter key, as first kind retrieval " retrieval sound " button of information enter key and " retrieving images " button as Second Type retrieval information enter key.As shown in figure 21, when user needs to retrieve the 5th type retrieving information, as long as select the choice box before " retrieval comment " button.
Figure 22 is that the input mode of the embodiment of the present invention one selects picture view.
As shown in figure 22, input mode selects the input mode of picture 153 for allowing user select retrieval information.When any one in the 3rd type retrieval information enter key, the 4th type retrieval information enter key and the 5th type retrieval information enter key is selected, input display part 114 shows input mode and selects picture 153 to allow user select the input mode of required retrieval information.Input mode selects picture 153 to comprise character entry key, Speech input key and image enter key.Character entry key and " with the image mode input " button shown in " audibly inputting " button, image enter key and the Figure 22 shown in " with character mode input " button, Speech input key and Figure 22 shown in Figure 22.When input mode selects the character entry key of picture 153 to be selected, input display part 114 shows character input picture 130 allows user inputs character type data.When input mode selects the Speech input key of picture 153 to be selected, input display part 114 shows Speech input picture 143 allows user's input audio data.When input mode selects the image enter key of picture 153 to be selected, input display part 114 shows image input picture 135 allows user's input image data.
The input detailed process of five kinds of retrieval information is as follows:
When the 3rd type retrieval information enter key is selected, input display part 114 shows input mode and selects picture 153 to allow user select input mode.When character entry key is selected, input display part 114 shows character input picture 130 allows user inputs character type data as the 3rd type retrieval information; When Speech input key is selected, input display part 114 shows Speech input picture 143 allows user's input audio data, and then this voice data is identified as character type data and as the 3rd type retrieval information by voice recognition portion 132; When image enter key is selected, input display part 114 shows image input picture 135 allows user's input image data, Image recognizing section 136 that this view data is identified as character type data and as the 3rd type retrieving information.
When the 4th type retrieval information enter key is selected, input display part 114 shows retrieval mode and selects picture 152 to allow user select input mode.When character entry key is selected, input display part 114 shows character input picture 130 allows user inputs character type data as the 4th type retrieval information; When Speech input key is selected, input display part 114 shows Speech input picture 143 allows user's input audio data, and then this voice data is identified as character type data and as the 4th type retrieval information by voice recognition portion 132; When image enter key is selected, input display part 114 shows image input picture 135 allows user's input image data, Image recognizing section 136 that this view data is identified as character type data and as the 4th type retrieving information.
When the 5th type retrieval information enter key is selected, input display part 114 shows retrieval mode and selects picture 152 to allow user select input mode.When character input selection key is selected, input display part 114 shows character input picture 130 allows user inputs character type data as the 5th type retrieval information; When Speech input key is selected, input display part 114 shows Speech input picture 143 allows user's input audio data, and then this voice data is identified as character type data and as the 5th type retrieval information by voice recognition portion 132; When image enter key is selected, input display part 114 shows image input picture 135 allows user's input image data, Image recognizing section 136 that this view data is identified as character type data and as the 5th type retrieving information.
When first kind retrieval information enter key is selected, input display part 114 shows Speech input picture 143 allows user's input audio data as first kind retrieval information.
When Second Type retrieval information enter key is selected, input display part 114 shows image input picture 135 allows user's input image data as Second Type retrieval information.
Retrieving is elaborated below in conjunction with process flow diagram.
Figure 23 is the process flow diagram retrieved the 3rd type retrieving information of the embodiment of the present invention one.
As shown in figure 23, the flow process retrieved the 3rd type retrieving information is as follows:
Step S6 ?1:
When user needs employing the 3rd type retrieving information to retrieve, user selects retrieval mode to select the 3rd type retrieval information enter key of picture 152, then enter step S6 ?2.
Step S6 ?2:
Input display part 114 shows input mode and selects picture 153 to allow user select input mode.When character entry key is selected, enter step S6-3; When Speech input key is selected, enter step S6-4; When image enter key is selected, enter step S6-5.
Step S6 ?3:
Input display part 114 show character input picture 130 allows user inputs character type data as the 3rd type retrieval information, then enter step S6 ?6.
Step S6 ?4:
Input display part 114 shows Speech input picture 143 allows user's input audio data, voice recognition portion 132 that this voice data is identified as character type data and as the 3rd type retrieval information, then enter step S6 ?6.
Step S6 ?5:
Input display part 114 shows image input picture 135 allows user's input image data, Image recognizing section 136 that this view data is identified as character type data and as the 3rd type retrieval information, then enter step S6 ?6.
Step S6 ?6:
User side Department of Communication Force 115 is sent to cloud server 101 the 3rd type retrieval information, then enter step S6 ?7.
Step S6 ?7:
Service side Department of Communication Force 109 receives the 3rd type retrieval information from user terminal 111, then enter step S6 ?8.
Step S6 ?8:
Search part 108 retrieves retrieving information storage part 107, obtain the three type retrieving information consistent with the 3rd type retrieval information and corresponding image file attribute information, and obtain corresponding image file based on this image file attribute information retrieving images file storage part 106.
So far, carry out complete to the retrieving that the 3rd type retrieving information is retrieved.
The flow process retrieved the 4th type retrieving information is consistent with the flow process retrieved the 3rd type retrieving information with the flow process retrieved the 5th type retrieving information.
Figure 24 is the process flow diagram retrieved first kind retrieving information of the embodiment of the present invention one.
As shown in figure 24, the flow process retrieved first kind retrieving information is as follows:
Step S7 ?1:
When user needs to adopt first kind retrieving information to retrieve, user selects retrieval mode to select the first kind retrieval information enter key of picture 152, then enter step S7 ?2.
Step S7 ?2:
Input display part 114 shows Speech input picture 143 allows user's input audio data as first kind retrieval information, then enter step S7 ?3.
Step S7 ?3:
User side Department of Communication Force 115 is sent to cloud server 101 first kind retrieval information, then enter step S7 ?4.
Step S7 ?4:
Service side Department of Communication Force 109 receives first kind retrieval information from user terminal 111, then enter step S7 ?5.
Step S7 ?5:
Search part 108 retrieves retrieving information storage part 107, obtain the first kind retrieving information consistent with first kind retrieval information and corresponding image file attribute information, and obtain corresponding image file based on this image file attribute information retrieving images file storage part 106.
So far, carry out complete to the retrieving that first kind retrieving information is retrieved.
Figure 25 is the process flow diagram retrieved Second Type retrieving information of the embodiment of the present invention one.
As shown in figure 25, the flow process retrieved Second Type retrieving information is as follows:
Step S8 ?1:
When user needs to adopt Second Type retrieving information to retrieve, user selects retrieval mode to select the Second Type retrieval information enter key of picture 152, then enter step S8 ?2.
Step S8 ?2:
Input display part 114 shows image input picture 135 allows user's input image data as Second Type retrieval information, then enter step S8 ?3.
Step S8 ?3:
User side Department of Communication Force 115 is sent to cloud server 101 Second Type retrieval information, then enter step S8 ?4.
Step S8 ?4:
Service side Department of Communication Force 109 receives Second Type retrieval information from user terminal 111, then enter step S8 ?5.
Step S8 ?5:
Search part 108 retrieves retrieving information storage part 107, obtain the Second Type retrieving information consistent with Second Type retrieval information and corresponding image file attribute information, and obtain corresponding image file based on this image file attribute information retrieving images file storage part 106.
So far, carry out complete to the retrieving that Second Type retrieving information is retrieved.
Figure 26 is the schematic diagram of the result for retrieval picture of the embodiment of the present invention one.
As shown in figure 26, result for retrieval picture 154 has result for retrieval list.When search part 108 retrieve there is consistent with retrieval information retrieving information time, input display part 114 and show result for retrieval picture 154 and show result for retrieval list to user.As shown in figure 26, the title, author etc. of image file result for retrieval list retrieved containing with good grounds input retrieval information.Result for retrieval list is other retrieving information of apposition on View Image File also.When search part 108 retrieve there is not the retrieving information consistent with retrieval information time, input display part 114 shows the prompting printed words of " not finding matching result ".When any result for retrieval in result for retrieval list is selected, input display part 114 View Image File informs that picture 119 is to inform the content of the image file of user selected by it.Now, inform in picture 119 at image file, distinguished by the thumbnail of page image selected and the thumbnail of non-selected page image and show.As shown in Figure 5, display is distinguished by the thumbnail of page image selected and the thumbnail of non-selected page image by frame overstriking.
In the present embodiment, user terminal 102 and scanning uploading device 104 are separated, but user terminal also can comprise scanning uploading device, thus possess all functions of this scanning uploading device, and this can realize the present invention equally.
The effect of embodiment one and effect:
According to cloud server and the Image Storage Retrieval system of the present embodiment one, because the input display part display Speech input picture of user terminal allows user add acoustic information as first kind retrieving information on the image file of current display, user side Department of Communication Force is sent to cloud server corresponding with the image file of current display for first kind retrieving information, the apposition control part of cloud server is on image file extremely corresponding for first kind retrieving information apposition, so when retrieving image file, as long as user's input audio data just directly can be retrieved image file based on the first kind retrieving information pre-entered, be conducive to the input of raising information and effectiveness of retrieval.
Embodiment two
Compared with embodiment one, embodiment two is given same symbol to the inscape wherein with embodiment one with same structure and omits corresponding accompanying drawing.
Figure 27 is the block diagram of the Image Storage Retrieval system of the embodiment of the present invention two.
As shown in figure 27, Image Storage Retrieval system 200 for the image file apposition retrieving information containing plural page, and is retrieved based on this retrieving information, comprises cloud server 201 and at least one user terminal 202.
Figure 28 is the block diagram of the cloud server of the embodiment of the present invention two.
As shown in figure 28, cloud server 201 contains the image file of the plural width page image corresponding with above-mentioned plural page for storing, comprise service side control part 205, page image storage part 206, retrieving information storage part 207, search part 208, service side Department of Communication Force 209, service side temporary storage part 210, apposition control part 250 etc.
Cloud server 201 is communicated to connect by Internet 2 03 and each user terminal 202, thus transmits and exchange data information with these user terminals 202.Cloud server 201 also communicates with scanning device 204 and is connected, the image file that the also memory scanning equipment 204 that can receive is uploaded.
Figure 29 is the block diagram of the user terminal of the embodiment of the present invention two.
As shown in figure 29, each user terminal 202 includes user side temporary storage part 216, picture storage part 213, input display part 214, user side Department of Communication Force 215, voice recognition portion 232, Image recognizing section 236 and user side control part 212 etc.User terminal 202 allows user input the retrieving information of apposition on page image and the retrieval information for retrieving page image, also allows user be uploaded in cloud server 201 by the image file of electronic form.
Page image storage part 206 is for storing by page image file, simultaneously also carry out corresponding stored to the page attribute information of the attribute representing every width page image, namely, page image storage part 206 is to every width page image of composition image file and the page attribute information of this width page image is corresponding stores.The page attribute information of every width page image and this width page image one_to_one corresponding, comprise the size of this width page image, take up room, resolution, file layout, check the information such as number of times, document source and the page number in respective image file.
Every width page image is uploaded in cloud server 201 after can scanning via scanning device 204, also directly can be uploaded in cloud server 201 via user terminal 202.No matter upload via any one mode above-mentioned, first this image file is split into a page image by the page number, and then every width page image is all converted into SWF(shock wave flash) form being kept in page image storage part 206.
Data information exchange between each ingredient that service side Department of Communication Force 209 is responsible for cloud server 201 and between cloud server 201 and user terminal 202.When user terminal 202 needs display page image, service side Department of Communication Force 209 is at least sent to user terminal page image.When user terminal 202 is after certain width page image with the addition of retrieving information, service side Department of Communication Force 209 receives retrieving information from user terminal.
Service side temporary storage part 210 for temporarily store cloud server 201 each ingredient between and the data message that exchanges between cloud server 201 and user terminal 202, the data such as the retrieving information that such as user terminal 5 sends and retrieval information.
Service side control part 205 responsible control service side Department of Communication Force 209 receives the data message that user terminal 202 sends, and controls the work of each ingredient of cloud server 201 based on this data message.
Data information exchange between each ingredient that user side communication section 215 is responsible for user terminal 202 and between user terminal 202 and cloud server 201.Such as, retrieval keyword and mode information are sent to cloud server 201 by user side communication section 215, receive result for retrieval from cloud server 201, and be sent to input display part 214 show.
Picture storage part 213 stores login screen, page image informs picture, retrieving information apposition input picture, retrieval mode select picture, retrieving information retrieval input picture, result for retrieval picture, character input picture, image input the picture such as picture, Speech input picture.
Input display part 214 for showing login screen, page image informs picture, retrieving information apposition input picture, retrieval mode select picture, recognition result confirmation screen, retrieving information retrieval input picture, result for retrieval picture, character inputs picture, image inputs the storage of the picture storage part 213 such as picture, Speech input picture various pictures, allow user input relevant information or to carry out various selection.
As shown in Fig. 4 of embodiment one, login screen 117 for allowing user input user identification code to log in this Image Storage Retrieval system 200.Login screen 117 has " please input your user identification code " points out printed words to input user identification code to point out user, and user identification code input frame 118 allows user input user identification code.
In addition, this login screen 117 also has " login " button, " exiting " button and " registration " button.After user inputs correct user identification code and selects " login " button, then login Image Storage Retrieval system 200.If the user identification code of user's input error, then input display part 214 and show " your user identification code input error please be re-entered your user identification code or register new user identification code " and point out printed words.If user selects " exiting " button, then exit Image Storage Retrieval system 200 and stop retrieving.If user does not have user identification code, then can click " registration " button, a new user identification code after the customer identification information such as input user identity, user's pet name, user name, author and password, can be obtained.Wherein, " author " information and user identification code are one-to-one relationship.
Certainly, this login screen 117 can also be provided with " forgetting identification code " button, if user have forgotten the user identification code of oneself, then can select " forgetting identification code " button, and the customer identification information according to inserting during registration can give user identification code for change.
Figure 30 is the schematic diagram that the page image of the embodiment of the present invention two informs picture.
As shown in figure 30, page image informs that picture 219 is for informing the content of user's current page image, comprises the regions such as image name viewing area 220, page number viewing area 224, retrieving information apposition selected zone 221, retrieving information viewing area 222, page image display area 223, thumbnail viewing area 225.When user logins Image Storage Retrieval system 200 and after page image needed for selecting or after selecting the page image that retrieves, input display part 214 shows page image and informs that picture 219 is to inform the content of the page image of its current selection of user.
Inform in picture 219 at page image, image name viewing area 220 is for showing the title of the image file at its current selected page image place to user." reading .pdf " i.e. shown in Figure 30 title of current selected image file.
Page image display area 223 not only shows the content of the page image selected by it to user, also show the various retrieving informations of apposition on this page of image." bill storage ", " funds on account remaining sum " and " appointment & performance " in Figure 30 is namely the keyword retrieval information that the page image of current display adds.Page image display area 223 is also provided with scroll bar 242, comprises HScrollBar and vertical scroll bar.HScrollBar is for regulating the horizontal viewing area of page image, and vertical scroll bar is for regulating the vertical viewing area of page image.When the pixel of page image is higher, whole page image display area 223 can not show this page of image completely, therefore, by the viewing area regulating the position of scroll bar 242 just can regulate current selected page image, and can be completely shown.
Thumbnail viewing area 225 is for the thumbnail that shows the page image of the current selection of user and the thumbnail of a few width page images be adjacent.In the present embodiment, thumbnail viewing area 225 shows six width thumbnails.Certainly, thumbnail viewing area 225 also can show more several or less width thumbnail.When any width thumbnail of this thumbnail viewing area 225 is selected, page image display area 223 just shows the content of the page image corresponding with selected thumbnail.By the thumbnail selected in thumbnail viewing area 225 with other non-selected thumbnail distinguish and show, such as shade, frame overstriking, add mark etc., know current selected thumbnail to facilitate user.Frame overstriking is adopted to show, to distinguish with the thumbnail of surrounding by the thumbnail selected in Fig. 5.Thumbnail can allow user understand the overview of the adjacent some width page images of selected page image current with it, is convenient to it and finds required page image fast.
Page number viewing area 224 is for showing its current selected page number of page image in image file to user.The page number number of display is consistent with the thumbnail number of display.
Retrieving information apposition selected zone 221 allows the retrieving information of user needed for current selected page image apposition.In the present embodiment, user the retrieving information of apposition can have five kinds, is respectively: the keyword as the 3rd type retrieving information, the Q&A as the 4th type retrieving information, the comment as the 5th type retrieving information, the sound as first kind retrieving information and as Second Type retrieving information image.3rd type retrieving information, the 4th type retrieving information and the 5th type retrieving information are character type data, and first kind retrieving information is voice data, and Second Type retrieving information is view data.Accordingly, retrieving information apposition selected zone 221 comprises the 3rd type retrieving information apposition key, the 4th type retrieving information apposition key, the 5th type retrieving information apposition key, first kind retrieving information apposition key and these five kinds of information apposition keys of Second Type retrieving information apposition key, for the above-mentioned retrieving information of the corresponding apposition of difference.As shown in Figure 5, " keyword " button is the 3rd type retrieving information apposition key, " Q&A " button is the 4th type retrieving information apposition key, " comment " button is the 5th type retrieving information apposition key, " sound " button is first kind retrieving information apposition key, and " image " button is Second Type retrieving information apposition key.
As shown in Fig. 6 of embodiment one, the apposition mode of apposition way selection picture 140 for allowing user select retrieving information, the prompting printed words containing " retrieving information apposition mode please be select ", character input selection key, Speech input options button and image input selection key.When any one in the 3rd type retrieving information apposition key, the 4th type retrieving information apposition key and the 5th type retrieving information apposition key is selected, input display part 214 shows apposition way selection picture 140 allows user select required apposition mode.Character input selection key and " with the character mode apposition " button shown in Fig. 6, Speech input options button and " with the image mode apposition " button shown in " audibly apposition " button, image input selection key and the Fig. 6 shown in Fig. 6.
As shown in Fig. 7 of embodiment one, character input picture 130 contains prompting printed words and the character input boxes 131 of " asking input character ".When the character input selection key of apposition way selection picture 140 is selected, input display part 214 shows character input picture 130 allows user inputs character type data.
When user is after these character input boxes 131 input character type data, namely this character type data is attached on the page image of current display as retrieving information.What input in the present embodiment is " bill time limit " character type data, be then somebody's turn to do " bill time limit " by the retrieving information of the page image as current display.
As shown in Fig. 8 of embodiment one, Speech input picture 143 is for allowing user's input audio data.When the Speech input options button of apposition way selection picture 140 is selected, namely user selects using Speech input as apposition mode, and input display part 214 shows Speech input picture 143.The prompting printed words of Speech input picture 143 containing " asking sound import ", sound navigation key 144 and record button 145.Sound navigation key and the Browse button shown in Fig. 8.Record button 145 is that is shown in Fig. 8 button.
When sound navigation key 144 is by selection, user can upload voice data from user terminal 202.When record button 145 is by selection, user can direct input audio data.When user inputs complete, click sound replay key can play the sound of oneself input.Shown in sound replay key and Fig. 8 button.
Voice recognition portion 232 is character type data for voice data translation user inputted.When any one input audio data by above-mentioned two kinds of modes of user, this voice data translation is character type data by voice recognition portion 232, and this character type data is attached on the page image of current display as retrieving information subsequently.
As shown in Fig. 9 of embodiment one, the prompting printed words of recognition result confirmation screen 133 containing " whether the following content of PLSCONFM is correct ", and recognition result confirms frame 134.After voice data translation is character type data by voice recognition portion 232, input display part 214 Identification display results verification picture 133 allow user confirm whether voice recognition result correct.If recognition result is correct, then user selects " confirmation " button, and this recognition result is attached on the page image of current display as retrieving information.If recognition result mistake, then at recognition result, user confirms that frame 134 is revised as correct character type data and selects ACK button, and this amended character type data is attached on the page image of current display as retrieving information.Voice recognition result in Fig. 9 is " bill time limit ", then " bill time limit " recognition result of being displayed on recognition result confirmation screen 133 confirms in frame 134.
As shown in Figure 10 of embodiment one, image input picture 135, for allowing user's input image data, contains prompting printed words, the picture browsing key 146 of " asking input picture " and key 147 of taking pictures.When the image input selection key of apposition way selection picture 140 is selected, input display part 214 shows image input picture 135.When picture browsing key 146 and " determination " button are selected, user can from user terminal 202 upload images data.When key 147 of taking pictures is by selection, user is by direct input image data of taking pictures.
Image recognizing section 236 is converted into character type data for view data user inputted.When any one input image data by above-mentioned two kinds of modes of user, this view data is converted into character type data by Image recognizing section 236.After view data is converted into character type data by Image recognizing section 236, input display part 214 Identification display results verification picture 133 allow user confirm whether image recognition result correct.If recognition result is correct, then the ACK button of user's selective recognition results verification picture 133, makes this recognition result be attached on the page image of current display as retrieving information.If recognition result mistake, then at the recognition result of recognition result confirmation screen 133, user confirms that frame 134 is revised as correct character type data and selects ACK button, and this amended character type data is attached on the page image of current display as retrieving information.
The interpolation detailed process of five kinds of retrieving informations is as follows:
When the 3rd type retrieving information apposition key is selected, input display part 214 shows apposition way selection picture 140 allows user select apposition mode.When character input selection key is selected, input display part 214 shows character input picture 130 allows user inputs character type data as the 3rd type retrieving information; When Speech input options button is selected, input display part 214 shows Speech input picture 143 allows user's input audio data, and then this voice data is identified as character type data and as the 3rd type retrieving information by voice recognition portion 232; When image input selection key is selected, input display part 214 shows image input picture 135 allows user's input image data, Image recognizing section 236 that this view data is identified as character type data and as the 3rd type retrieving information.
When the 4th type retrieving information apposition key is selected, input display part 214 shows apposition way selection picture 140 allows user select apposition mode.When character input selection key is selected, input display part 214 shows character input picture 130 allows user inputs character type data as the 4th type retrieving information; When Speech input options button is selected, input display part 214 shows Speech input picture 143 allows user's input audio data, voice recognition portion 232 that this voice data is identified as character type data and as the 4th type retrieving information; When image input selection key is selected, input display part 214 shows image input picture 230 allows user's input image data, Image recognizing section 236 that this view data is identified as character type data and as the 4th type retrieving information.
When the 5th type retrieving information apposition key is selected, input display part 214 shows apposition way selection picture 140 allows user select apposition mode.When character input selection key is selected, input display part 214 shows character input picture by user inputs character type data as the 5th type retrieving information; When Speech input options button is selected, input display part 214 shows Speech input picture 143 allows user's input audio data, voice recognition portion 232 that this voice data is identified as character type data and as the 5th type retrieving information; When image input selection key is selected, input display part 214 shows image input picture allows user's input image data, Image recognizing section 236 that this view data is identified as character type data and as the 5th type retrieving information.
When first kind retrieving information apposition key is selected, input display part 214 shows Speech input picture 143 allows user's input audio data as first kind retrieving information.
When Second Type retrieving information apposition key is selected, input display part 214 shows image input picture allows user's input image data as Second Type retrieving information.After any one of five kinds of retrieving informations is added, these retrieving informations show in retrieving information viewing area 222, to allow user check.
Retrieving information viewing area 222, for having shown in this page of image the retrieving information of apposition in advance, comprises keyword viewing area 226, Q&A viewing area 227, comment region 228, sound viewing area 248 and image display area 249.
As shown in figure 30, keyword viewing area 226 for showing the 3rd type retrieving information added, comprise the author of keyword, the content of keyword, creation-time and keyword check the information such as number of times.Keyword viewing area 226 is also provided with " deletion " button and the Edit button, so that user modifies to keyword.But " deletion " button keyword corresponding with same user identification code with the Edit button is corresponding to be arranged, therefore only have the user creating this keyword just can modify to the keyword of oneself setting, and can not the keyword that other users set be modified.In Figure 30, the user that author is " fox " is called in name the 52nd page of page image of " read .pdf " creates two keywords " bill storage " and " funds on account remaining sum ", and author is that the user of " nick " creates a keyword " appointment & performance " on this page of page image.When the user that author is " fox " logs in this Image Storage Retrieval system, can only " bill storage " and " funds on account remaining sum " be deleted or be edited, can not " appointment & performance " be deleted or be edited.Accordingly, the keyword that all users create on the 52nd page of page image all shows in page image display area 223.
Figure 31 is the schematic diagram of the Q&A viewing area of the embodiment of the present invention two.
As shown in figure 31, Q&A viewing area 227, for showing the 4th type retrieving information added, comprises the author of Q&A, the content of enquirement, content, the creation-time of answer and checks the information such as number of times.Q&A is corresponding with page image to be added, when adding without selected zone.There is " answer " button Q&A viewing area 227.When user selects this " answer " button, just can answer enquirement.If an enquirement has multiple answer, then each answer shows, to avoid confusion by the time sequencing answered successively in dialog box respectively.
Figure 32 is the schematic diagram of the comment viewing area of the embodiment of the present invention two.
As shown in figure 32, comment region 228 for showing the 5th type retrieving information added, comprise the author of comment, comment content, creation-time and check the information such as number of times.Comment on also corresponding with page image interpolation, when adding without selected zone.If a page image has multiple comment, then each comment shows from top to bottom successively by the time sequencing of adding, to avoid confusion respectively in dialog box.
Figure 33 is the schematic diagram of the sound viewing area of the embodiment of the present invention two.
As shown in figure 33, sound viewing area 248, for showing the first kind retrieving information added, comprises the author of sound, sound-content identifier creation-time and check the information such as number of times.Corresponding, also containing sound-content identifier in the retrieving information display box 255 of page image display area 223 retrieving information in this retrieving information display box 255 of prompting user is first kind retrieving information.When containing multiple first kind retrieving information in a width page image, sound viewing area 248 shows these first kind retrieving informations by first kind retrieving information successively at the position sequencing of page image display area 223.Sound is add corresponding with certain region of page image.Figure 33 contains three first kind retrieving informations.In Figure 33, the acoustic information of apposition on " amount of money calculating " region is presented at the top of sound viewing area 248.In Figure 33, the acoustic information of apposition on " cut-off date " is presented at the bottom of sound viewing area 248.In Figure 33, the acoustic information of apposition on " setup time " is presented at the centre of sound viewing area 248.When user's click sound content designator time, just can play this first kind retrieving information.
Figure 34 is the schematic diagram of the image display area of the embodiment of the present invention two.
As shown in figure 34, image display area 249, for showing the Second Type retrieving information added, comprises the author of image, picture material identifier creation-time and check the information such as number of times.Corresponding, also containing picture material identifier in the retrieving information display box of page image display area 223 retrieving information in this retrieving information display box of prompting user is Second Type retrieving information.When containing multiple Second Type retrieving information in a width page image, image display area 249 shows these Second Type retrieving informations by Second Type retrieving information successively at the position sequencing of page image display area 223." debt " in Figure 27 4 represents the content of the page image of frame choosing, the picture material identifier on " debt " side illustrate that the region apposition that this frame selects has Second Type retrieving information.When user clicks picture material identifier time, just can check this Second Type retrieving information.
Any one apposition of above-mentioned five type retrieving informations is controlled retrieving information storage part 207 store corresponding with page image for the retrieving information of apposition to page image by apposition control part 250, also controls retrieving information storage part 207 and stores corresponding with these retrieving informations for page attribute information.
Figure 35 is the schematic diagram of the information correspondence table of the embodiment of the present invention two.
As shown in figure 35, information correspondence table is formed and stored in retrieving information storage part 207 by apposition control part 250.Information correspondence table memory page attribute information, retrieving information and corresponding relation therebetween.The page attribute information stored in information correspondence table comprises the information such as file name and the page number.In information correspondence table, the retrieving information of five types is corresponding with page image respectively, also corresponding with the page number of page image in image file respectively.In Figure 35, file name is " F1 " and page number is that the page image of " P1 " is respectively containing three the 3rd type retrieving informations " K11 ?1 ", " K11 ?2 " and " K11 ?3 ", containing two the 4th type retrieving informations " Q & A11 ?1 ", " Q & A11 ?1 ", containing a 5th type retrieving information " C11 ?1 ", containing a first kind retrieving information " V11 ?1 ", not containing Second Type retrieving information.File name to be the page number of " F1 " the be page image of " P3 " not containing the 3rd type retrieving information, the 4th type retrieving information, the 5th type retrieving information and first kind retrieving information, only containing a Second Type retrieving information " I13 ?1 ".
The attach procedure of retrieving information on page image is elaborated below in conjunction with process flow diagram.
Figure 36 is the 3rd type retrieving information apposition process flow diagram of the embodiment of the present invention two.
As shown in figure 36, the 3rd type retrieving information apposition flow process is as follows:
Step S9 ?1:
When user need for current selected and display page image apposition the 3rd type retrieving information time, input display part 214 shows page image and informs that picture 219 allows user select the 3rd type retrieving information apposition key at retrieving information apposition selected zone 221, then enter step S9 ?2.
Step S9 ?2:
Figure 37 is the retrieving information apposition prompting area schematic of the embodiment of the present invention two.
As shown in figure 37, input display part 214 informs the prompting printed words of display " please at image display area selected zone " on the retrieving information apposition prompting region of picture 219 at page image, using the apposition region of pointing out user to select the required keyword as the 3rd type retrieving information in page image display area 223, then enter step S9 ?3.
Step S9 ?3:
After user selects the apposition region of keyword, input display part 214 shows apposition way selection picture 140 allows user select required apposition mode.When character input selection key is selected, enter step S9-4; When Speech input options button is selected, enter step S9-5; When image input selection key is selected, enter step S9-6.
Step S9 ?4:
Input display part 214 show character input picture 130 allows user inputs character type data as the 3rd type retrieving information, then enter step S9 ?7.
Step S9 ?5:
Input display part 214 shows Speech input picture 143 allows user's input audio data, voice recognition portion 232 that this voice data is identified as character type data and as the 3rd type retrieving information, then enter step S9 ?7.
Step S9 ?6:
Input display part 214 shows image input picture 135 allows user's input image data, Image recognizing section 236 that this view data is identified as character type data and as the 3rd type retrieving information, then enter step S9 ?7.
Step S9 ?7:
User side Department of Communication Force 215 is sent to cloud server 201 corresponding with current page image for the 3rd type retrieving information, then enter step S9 ?8.
Step S9 ?8:
Service side Department of Communication Force 209 receives the 3rd type retrieving information from user terminal 211, then enter step S9 ?9.
Step S9 ?9:
3rd type retrieving information apposition is controlled retrieving information storage part 207 store corresponding with page image for the 3rd type retrieving information to corresponding page image by apposition control part 250.
So far the 3rd type retrieving information adds complete.
Figure 38 is the 4th type retrieving information apposition process flow diagram of the embodiment of the present invention two.
As shown in figure 38, the 4th type retrieving information apposition flow process is as follows:
Step S10 ?1:
When user need for current selected and display page image apposition the 4th type retrieving information time, input display part 214 shows page image and informs that picture 219 allows user select the 4th type retrieving information apposition key at retrieving information apposition selected zone 221, then enter step S10 ?2.
Step S10 ?2:
Input display part 214 shows apposition way selection picture 140 allows user select required apposition mode.When character input selection key is selected, enter step S10-3; When Speech input options button is selected, enter step S10-4; When image input selection key is selected, enter step S10-5.
Step S10 ?3:
Input display part 214 show character input picture 130 allows user inputs character type data as the 4th type retrieving information, then enter step S10 ?6.
Step S10 ?4:
Input display part 214 shows Speech input picture 143 allows user's input audio data, voice recognition portion 232 that this voice data is identified as character type data and as the 4th type retrieving information, then enter step S10 ?6.
Step S10 ?5:
Input display part 214 shows image input picture 135 allows user's input image data, Image recognizing section 236 that this view data is identified as character type data and as the 4th type retrieving information, then enter step S10 ?6.
Step S10 ?6:
User side Department of Communication Force 215 is sent to cloud server 201 corresponding with current page image for the 4th type retrieving information, then enter step S10 ?7.
Step S10 ?7:
Service side Department of Communication Force 209 receives the 4th type retrieving information from user terminal 211, then enter step S10 ?8.
Step S10 ?8:
4th type retrieving information apposition is controlled retrieving information storage part 207 store corresponding with page image for the 4th type retrieving information to corresponding page image by apposition control part 250.
So far the 4th type retrieving information adds complete.
Figure 39 is the 5th type retrieving information apposition process flow diagram of the embodiment of the present invention two.
As shown in figure 39, the 5th type retrieving information apposition flow process is as follows:
Step S11 ?1:
When user need for current selected and display page image apposition the 5th type retrieving information time, input display part 214 shows page image and informs that picture 219 allows user select the 5th type retrieving information apposition key at retrieving information apposition selected zone 221, then enter step S11 ?2.
Step S11 ?2:
Input display part 214 shows apposition way selection picture 140 allows user select required apposition mode.When character input selection key is selected, enter step S11-3; When Speech input options button is selected, enter step S11-4; When image input selection key is selected, enter step S11-5.
Step S11 ?3:
Input display part 214 show character input picture 130 allows user inputs character type data as the 5th type retrieving information, then enter step S11 ?6.
Step S11 ?4:
Input display part 214 shows Speech input picture 143 allows user's input audio data, voice recognition portion 232 that this voice data is identified as character type data and as the 5th type retrieving information, then enter step S11 ?6.
Step S11 ?5:
Input display part 214 shows image input picture 135 allows user's input image data, Image recognizing section 236 that this view data is identified as character type data and as the 5th type retrieving information, then enter step S11 ?6.
Step S11 ?6:
User side Department of Communication Force 215 is sent to cloud server 201 corresponding with current page image for the 5th type retrieving information, then enter step S11 ?7.
Step S11 ?7:
Service side Department of Communication Force 209 receives the 5th type retrieving information from user terminal 211, then enter step S11 ?8.
Step S11 ?8:
5th type retrieving information apposition is controlled retrieving information storage part 207 store corresponding with page image for the 5th type retrieving information to corresponding page image by apposition control part 250.
So far the 5th type retrieving information adds complete.
Figure 40 is the first kind retrieving information apposition process flow diagram of the embodiment of the present invention two.
As shown in figure 40, first kind retrieving information apposition flow process is as follows:
Step S12 ?1:
When user need for current selected and display the page image apposition first kind retrieving information time, input display part 214 shows page image and informs that picture 219 allows user select first kind retrieving information apposition key at retrieving information apposition selected zone 221, then enter step S12 ?2.
Step S12 ?2:
The apposition region of the sound as first kind retrieving information needed for user selects in page image display area 223, input display part 214 shows Speech input picture 143 allows user's input audio data as first kind retrieving information, then enter step S12 ?3.
Step S12 ?3:
User side Department of Communication Force 215 is sent to cloud server 201 corresponding with current page image for first kind retrieving information, then enter step S12 ?4.
Step S12 ?4:
Service side Department of Communication Force 209 receives first kind retrieving information from user terminal 211, then enter step S12 ?5.
Step S12 ?5:
First kind retrieving information apposition is controlled retrieving information storage part 207 store corresponding with page image for this first kind retrieving information to corresponding page image by apposition control part 250.
So far first kind retrieving information adds complete.
Figure 41 is the Second Type retrieving information apposition process flow diagram of the embodiment of the present invention two.
As shown in figure 41, Second Type retrieving information apposition flow process is as follows:
Step S13 ?1:
When user need for current selected and display page image apposition Second Type retrieving information time, input display part 214 shows page image and informs that picture 219 allows user select Second Type retrieving information apposition key at retrieving information apposition selected zone 221, then enter step S13 ?2.
Step S13 ?2:
The apposition region of the image as Second Type retrieving information needed for user selects in page image display area 223, input display part 214 shows image input picture 135 allows user's input image data as Second Type retrieving information, then enter step S13 ?3.
Step S13 ?3:
User side Department of Communication Force 215 is sent to cloud server 201 corresponding with current page image for Second Type retrieving information, then enter step S13 ?4.
Step S13 ?4:
Service side Department of Communication Force 209 receives Second Type retrieving information from user terminal 211, then enter step S13 ?5.
Step S13 ?5:
Second Type retrieving information apposition is controlled retrieving information storage part 207 store corresponding with page image for this Second Type retrieving information to corresponding page image by apposition control part 250.
So far Second Type retrieving information adds complete.
Elaborate the retrieving of page image below.
Search part 208 is retrieved page image for the retrieval information inputted according to user.In the present embodiment, the retrieval information that user can input has five kinds, is respectively: one or more in the keyword as the 3rd type retrieval information, the Q&A as the 4th type retrieval information, comment as the 5th type retrieval information, the sound as first kind retrieval information, the image as Second Type retrieval information.Wherein, the 3rd type retrieval information, the 4th type retrieval information and the 5th type retrieval information are character type data, and first kind retrieval information is voice data, and Second Type retrieval information is view data.
As shown in Figure 22 of embodiment one, retrieval mode selects picture 152 select retrieval mode for allowing user.When user logins Image Storage Retrieval system 200, input display part 214 shows retrieval mode and selects picture 152.In the present embodiment, the retrieval mode that user can select has five kinds, be respectively: for " search key " retrieval mode retrieved the 3rd type retrieving information, for " retrieval Q&A " retrieval mode retrieved the 4th type retrieving information, for " retrieval comment " retrieval mode retrieved the 5th type retrieving information, for " retrieval sound " retrieval mode retrieved first kind retrieving information, for " retrieving images " retrieval mode retrieved Second Type retrieving information.Corresponding, retrieval mode selects picture 152 to use information enter key containing five kinds of retrievals, be respectively: as " search key " button of the 3rd type retrieval information enter key, as the 4th type retrieval " retrieval Q&A " button with information enter key, as the 5th type retrieval " retrieval comment " button with information enter key, as first kind retrieval " retrieval sound " button of information enter key and " retrieving images " button as Second Type retrieval information enter key.As shown in figure 22, when user needs to retrieve the 5th type retrieving information, as long as select the choice box before " retrieval comment " button.
As shown in Figure 23 of embodiment one, input mode selects the input mode of picture 153 for allowing user select retrieval information.When any one in the 3rd type retrieval information enter key, the 4th type retrieval information enter key and the 5th type retrieval information enter key is selected, input display part 214 shows input mode and selects picture 153 to allow user select the input mode of required retrieval information.Input mode selects picture 153 to comprise character entry key, Speech input key and image enter key.Character entry key and " with the image mode input " button shown in " audibly inputting " button, image enter key and the Figure 23 shown in " with character mode input " button, Speech input key and Figure 23 shown in Figure 23.When input mode selects the character entry key of picture 153 to be selected, input display part 214 shows character input picture 130 allows user inputs character type data.When input mode selects the Speech input key of picture 153 to be selected, input display part 214 shows Speech input picture 143 allows user's input audio data.When input mode selects the image enter key of picture 153 to be selected, input display part 214 shows image input picture 135 allows user's input image data.
The input detailed process of five kinds of retrieval information is as follows:
When the 3rd type retrieval information enter key is selected, input display part 214 shows input mode and selects picture 153 to allow user select input mode.When character entry key is selected, input display part 214 shows character input picture 130 allows user inputs character type data as the 3rd type retrieval information; When Speech input key is selected, input display part 214 shows Speech input picture 143 allows user's input audio data, and then this voice data is identified as character type data and as the 3rd type retrieval information by voice recognition portion 232; When image enter key is selected, input display part 214 shows image input picture 135 allows user's input image data, Image recognizing section 236 that this view data is identified as character type data and as the 3rd type retrieving information.
When the 4th type retrieval information enter key is selected, input display part 214 shows retrieval mode and selects picture 152 to allow user select input mode.When character entry key is selected, input display part 214 shows character input picture 130 allows user inputs character type data as the 4th type retrieval information; When Speech input key is selected, input display part 214 shows Speech input picture 143 allows user's input audio data, and then this voice data is identified as character type data and as the 4th type retrieval information by voice recognition portion 232; When image enter key is selected, input display part 214 shows image input picture 135 allows user's input image data, Image recognizing section 236 that this view data is identified as character type data and as the 4th type retrieving information.
When the 5th type retrieval information enter key is selected, input display part 214 shows retrieval mode and selects picture 152 to allow user select input mode.When character input selection key is selected, input display part 214 shows character input picture 130 allows user inputs character type data as the 5th type retrieval information; When Speech input key is selected, input display part 214 shows Speech input picture 143 allows user's input audio data, and then this voice data is identified as character type data and as the 5th type retrieval information by voice recognition portion 232; When image enter key is selected, input display part 214 shows image input picture 135 allows user's input image data, Image recognizing section 236 that this view data is identified as character type data and as the 5th type retrieving information.
When first kind retrieval information enter key is selected, input display part 214 shows Speech input picture 143 allows user's input audio data as first kind retrieval information.
When Second Type retrieval information enter key is selected, input display part 214 shows image input picture 135 allows user's input image data as Second Type retrieval information.
Retrieving is elaborated below in conjunction with process flow diagram.
Figure 42 is the process flow diagram retrieved the 3rd type retrieving information of the embodiment of the present invention two.
As shown in figure 42, the flow process retrieved the 3rd type retrieving information is as follows:
Step S14 ?1:
When user needs employing the 3rd type retrieving information to retrieve, user selects retrieval mode to select the 3rd type retrieval information enter key of picture 152, then enter step S14 ?2.
Step S14 ?2:
Input display part 214 shows input mode and selects picture 153 to allow user select input mode.When character entry key is selected, enter step S14-3; When Speech input key is selected, enter step S14-4; When image enter key is selected, enter step S14-5.
Step S14 ?3:
Input display part 214 show character input picture 130 allows user inputs character type data as the 3rd type retrieval information, then enter step S14 ?6.
Step S14 ?4:
Input display part 214 shows Speech input picture 143 allows user's input audio data, voice recognition portion 232 that this voice data is identified as character type data and as the 3rd type retrieval information, then enter step S14 ?6.
Step S14 ?5:
Input display part 214 shows image input picture 135 allows user's input image data, Image recognizing section 236 that this view data is identified as character type data and as the 3rd type retrieval information, then enter step S14 ?6.
Step S14 ?6:
User side Department of Communication Force 215 is sent to cloud server 201 the 3rd type retrieval information, then enter step S14 ?7.
Step S14 ?7:
Service side Department of Communication Force 209 receives the 3rd type retrieval information from user terminal 211, then enter step S14 ?8.
Step S14 ?8:
Search part 208 retrieves retrieving information storage part 207, obtains the three type retrieving information consistent with the 3rd type retrieval information and corresponding page attribute information, and obtains corresponding page image based on this page attribute information retrieval page image storage part 206.
So far, carry out complete to the retrieving that the 3rd type retrieving information is retrieved.
The flow process retrieved the 4th type retrieving information is the same with the flow process retrieved the 3rd type retrieving information with the flow process retrieved the 5th type retrieving information.
Figure 43 is the process flow diagram retrieved first kind retrieving information of the embodiment of the present invention two.
As shown in figure 43, the flow process retrieved first kind retrieving information is as follows:
Step S15 ?1:
When user needs to adopt first kind retrieving information to retrieve, user selects retrieval mode to select the first kind retrieval information enter key of picture 152, then enter step S15 ?2.
Step S15 ?2:
Input display part 214 shows Speech input picture 143 allows user's input audio data as first kind retrieval information, then enter step S15 ?3.
Step S15 ?3:
User side Department of Communication Force 215 is sent to cloud server 201 first kind retrieval information, then enter step S15 ?4.
Step S15 ?4:
Service side Department of Communication Force 209 receives first kind retrieval information from user terminal 211, then enter step S15 ?5.
Step S15 ?5:
Search part 208 retrieves retrieving information storage part 207, obtains the first kind retrieving information consistent with first kind retrieval information and corresponding page attribute information, and obtains corresponding page image based on this page attribute information retrieval page image storage part 206.
So far, carry out complete to the retrieving that first kind retrieving information is retrieved.
Figure 44 is the process flow diagram retrieved Second Type retrieving information of the embodiment of the present invention two.
As shown in figure 44, the flow process retrieved Second Type retrieving information is as follows:
Step S16 ?1:
When user needs to adopt Second Type retrieving information to retrieve, user selects retrieval mode to select the Second Type retrieval information enter key of picture 152, then enter step S16 ?2.
Step S16 ?2:
Input display part 214 shows image input picture 135 allows user's input image data as Second Type retrieval information, then enter step S16 ?3.
Step S16 ?3:
User side Department of Communication Force 215 is sent to cloud server 201 Second Type retrieval information, then enter step S16 ?4.
Step S16 ?4:
Service side Department of Communication Force 209 receives Second Type retrieval information from user terminal 211, then enter step S16 ?5.
Step S16 ?5:
Search part 208 retrieves retrieving information storage part 207, obtains the Second Type retrieving information consistent with Second Type retrieval information and corresponding page attribute information, and obtains corresponding page image based on this page attribute information retrieval page image storage part 206.
So far, carry out complete to the retrieving that Second Type retrieving information is retrieved.
As shown in Figure 27 of embodiment one, result for retrieval picture 154 has result for retrieval list.When search part 208 retrieve there is consistent with retrieval information retrieving information time, input display part 214 and show result for retrieval picture 154 and show result for retrieval list to user.As shown in figure 27, the page number etc. containing the title of image file, author, page image containing the retrieving information consistent with the retrieval information of input in result for retrieval list.Result for retrieval list also shows other retrieving information of apposition on page image.When search part 208 retrieve there is not the retrieving information consistent with retrieval information time, input display part 214 shows the prompting printed words of " not finding matching result ".When any result for retrieval in result for retrieval list is selected, input display part 214 shows page image and informs that picture 219 is to inform the content of the page image of user selected by it.Now, inform in picture 219 at page image, distinguished by the thumbnail of page image selected and the thumbnail of non-selected page image and show.As shown in Figure 5, display is distinguished by the thumbnail of page image selected and the thumbnail of non-selected page image by frame overstriking.
The effect of embodiment two and effect:
According to cloud server and the Image Storage Retrieval system of the present embodiment, because the input display part display page image of user terminal informs that picture allows user add retrieving information on the page image of current display, user side Department of Communication Force is sent to cloud server corresponding with the page image of current display for retrieving information, the apposition control part of cloud server is on page image extremely corresponding for this retrieving information apposition, so user directly can realize retrieval to the page image of composition image file according to the retrieving information pre-entered, be conducive to improving effectiveness of retrieval.
Variation:
In embodiment two, Second Type retrieving information is retrieved by input image data, but, also can be retrieved by Images Classification Second Type retrieving information.
When user is in image input picture 135 after input image data, input that display part 235 can also show " this image is added Images Classification table? " prompting printed words, when user agrees to this image to add Images Classification table, input display part 235 shows Images Classification apposition picture.
Figure 45 is the schematic diagram of the Images Classification apposition picture of variation of the present invention.
As shown in figure 45, Images Classification apposition picture 260 is stored in picture storage part 213, comprises multiple Images Classification option, and the image of input can add in any one Images Classification by user as required.As shown in figure 45, if the view data of input is added to " finance " classification by user, then only need to select " finance " classification, then, Second Type retrieving information apposition to " finance " are classified and are controlled retrieving information storage part 207 and this Second Type retrieving information and " finance " to be classified corresponding storage by apposition control part 250.
During retrieval, user selects retrieval mode to select the Second Type retrieval information enter key of picture 152, and input display part 214 shows Images Classification searching picture 261.
Figure 46 is the schematic diagram of the Images Classification searching picture of variation of the present invention.
As shown in figure 46, Images Classification searching picture 261 is stored in picture storage part 213, containing multiple Images Classification, as " landscape ", " personage " etc.The view data of user's apposition is included in these Images Classifications.The arrowhead-shaped symbol of this Images Classification searching picture 261 the right and left is for selecting prevpage or the next page.As shown in figure 29, if when user wants to check " finance " classification lower view data, only need to select " finance " to classify, now, input display part 214 and show image viewing picture.
Figure 47 is the schematic diagram of the image viewing picture of variation of the present invention.
As shown in figure 47, image viewing picture 262 is stored in picture storage part 213, comprises the multiple image under a certain Images Classification.When user selects a certain image, the page image that input display part 214 just shows the page image corresponding with this width image informs that picture 219 allows user check the content of this page of image.
The effect of variation and effect:
Because this variation adopts Images Classification, the view data to input carries out apposition and retrieval, and user directly can view the content of view data, so this kind of retrieval is relatively more directly perceived and simple, is convenient to the use of computer beginner.

Claims (13)

1. an Image Storage Retrieval system, for the image file apposition retrieving information containing plural page, and retrieve based on described retrieving information, it is characterized in that, comprising:
Cloud server, for storing described image file; And
At least one user terminal, is communicated to connect with described cloud server respectively by network,
Wherein, described cloud server comprises: image storage part, retrieving information storage part, apposition control part and service side Department of Communication Force,
Described user terminal comprises: picture storage part, user side Department of Communication Force and input display part,
Described image storage part at least stores described image file,
Described service side Department of Communication Force is at least sent to described user terminal described image file,
Described user side Department of Communication Force at least receives described image file from described cloud server,
Described picture storage part at least storage figure picture informs picture and retrieving information apposition input picture,
Described input display part at least shows described image and informs that picture is to inform the current described image file of user, and display retrieving information apposition input picture allows user input described retrieving information based on described content,
Described user side Department of Communication Force is sent to described cloud server corresponding with current described image file for described retrieving information,
Described service side Department of Communication Force receives described retrieving information from described user terminal,
Described retrieving information apposition is controlled described retrieving information storage part and stores corresponding with described image file for described retrieving information to described image file by described apposition control part,
Described retrieving information apposition input picture at least contains Speech input picture,
Described retrieving information at least comprise obtained by described Speech input picture and as the acoustic information of first kind retrieving information.
2. image file storage and retrieval system according to claim 1, is characterized in that:
Wherein, described retrieving information apposition input picture also inputs picture containing image,
Described retrieving information also comprise obtained by described image input picture and as the image information of Second Type retrieving information.
3. image file storage and retrieval system according to claim 1 and 2, is characterized in that:
Wherein, described image storage part also stores the plural width page image corresponding with described plural page of the described image file of composition,
Described service side Department of Communication Force is sent to described user terminal described page image,
Described user side Department of Communication Force receives described page image from described cloud server,
Described input display part shows described image and informs that picture is to inform the content of the current described page image of user, and display retrieving information apposition input picture allows user input described retrieving information based on described content,
Described user side Department of Communication Force is sent to described cloud server corresponding with current described page image for described retrieving information,
Described service side Department of Communication Force receives described retrieving information from described user terminal,
Described retrieving information apposition is controlled described retrieving information storage part and stores corresponding with described page image for retrieving information to described page image by described apposition control part.
4. image file storage and retrieval system according to claim 3, is characterized in that:
Wherein, described image storage part also stores the page attribute information of the attribute representing described page image,
Described user side Department of Communication Force also receives described page attribute information while receiving described page image from described cloud server, and while described retrieving information is sent to described cloud server, also send corresponding described page attribute information,
Described apposition control part controls described retrieving information storage part and stores corresponding with described retrieving information for described page attribute information.
5. image file storage and retrieval system according to claim 4, is characterized in that:
Wherein, described retrieving information also containing the keyword as the 3rd type retrieving information, the Q&A as the 4th type retrieving information, as one or more of the comment of the 5th type retrieving information,
Described first kind retrieving information is voice data, and described Second Type retrieving information is view data, and described 3rd type retrieving information, described 4th type retrieving information and the 5th type retrieving information are character type data.
6. image file storage and retrieval system according to claim 5, is characterized in that:
Wherein, described page image informs picture also containing retrieving information apposition selected zone, this retrieving information apposition selected zone comprises first kind retrieving information apposition key, Second Type retrieving information apposition key, the 3rd type retrieving information apposition key, the 4th type retrieving information apposition key and the 5th retrieving information type apposition key
Described picture storage part also stores the apposition way selection picture at least containing character input selection key, the character input picture inputting picture as retrieving information apposition, the Speech input picture as retrieving information apposition input picture, the image input picture as retrieving information apposition input picture
When first kind retrieving information apposition key is selected, described input display part shows described Speech input picture allows user's input audio data as described first kind retrieving information,
When Second Type retrieving information apposition key is selected, described input display part shows described image input picture allows user's input image data as described Second Type retrieving information,
When the 3rd type retrieving information apposition key is selected, described input display part shows described apposition way selection picture allows user select apposition mode, when described character input selection key is selected, described input display part shows described character input picture by user inputs character type data as the 3rd type retrieving information
When the 4th type retrieving information apposition key is selected, described input display part shows described apposition way selection picture allows user select apposition mode, when described character input selection key is selected, described input display part shows described character input picture by user inputs character type data as the 4th type retrieving information
When the 5th type retrieving information apposition key is selected, described input display part shows described apposition way selection picture allows user select apposition mode, when described character input selection key is selected, described input display part shows described character input picture by user inputs character type data as the 5th type retrieving information.
7. image file storage and retrieval system according to claim 6, is characterized in that, also comprise:
Voice recognition portion,
Wherein, described apposition way selection picture also contains Speech input options button,
When described 3rd type retrieving information apposition key and described Speech input options button is selected time, described input display part shows described Speech input picture allows user's input audio data, this voice data is identified as character type data and as the 3rd type retrieving information by described voice recognition portion
When described 4th type retrieving information apposition key and described Speech input options button is selected time, described input display part shows described Speech input picture allows user's input audio data, this voice data is identified as character type data and as type four retrieving information by described voice recognition portion
When described 5th type retrieving information apposition key and described Speech input options button is selected time, described input display part shows described Speech input picture allows user's input audio data, described voice recognition portion that this voice data is identified as character type data and as the 5th type retrieving information.
8. image file storage and retrieval system according to claim 6, is characterized in that, also comprise:
Image recognizing section,
Wherein, described apposition way selection picture also contains image input selection key,
When described 3rd type retrieving information apposition key and described image input selection key is selected time, described input display part shows described image input picture allows user's input image data, this view data is identified as character type data and as the 3rd type retrieving information by described Image recognizing section
When described 4th type retrieving information apposition key and described image input selection key is selected time, described input display part shows described image input picture allows user's input image data, this view data is identified as character type data and as the 4th type retrieving information by described Image recognizing section
When described 5th type retrieving information apposition key and described image input selection key is selected time, described input display part shows described image input picture allows user's input image data, described Image recognizing section that this view data is identified as character type data and as the 5th type retrieving information.
9. image file storage and retrieval system according to claim 3, is characterized in that:
Described cloud server also comprises search part,
Wherein, described picture storage part is memory scan information retrieval input picture also,
Described input display part also shows described retrieving information retrieval input picture allows user input retrieval information for retrieving,
Described retrieval information is sent to described cloud server by described user side Department of Communication Force,
Described service side Department of Communication Force receives described retrieval information from described user terminal,
Described search part retrieves described retrieving information storage part, obtains the described retrieving information consistent with described retrieval information and corresponding described page attribute information, and obtains corresponding described page image based on page image storage part described in this page attribute information retrieval.
10. image file storage and retrieval system according to claim 9, is characterized in that:
Wherein, described retrieval information contain the sound as first kind retrieval information, the image as Second Type retrieval information, the keyword as the 3rd type retrieval information, the Q&A as the 4th type retrieval information, as one or more in the comment of the 5th type retrieval information
First kind retrieval information is voice data, and Second Type retrieval information is view data, and the 3rd type retrieval information, the 4th type retrieval information and the 5th type retrieval information are character type data,
The image input picture that described picture storage part also stores the retrieval mode selection picture comprising first kind retrieval information enter key, Second Type retrieval information enter key, the 3rd type retrieval information enter key, the 4th type retrieval information enter key and the 5th type retrieval information enter key, the input mode at least containing character entry key selects picture, input picture as the character of retrieving information retrieval input picture, input the Speech input picture of picture, input picture as retrieving information retrieval as retrieving information retrieval
When first kind retrieval information enter key is selected, described input display part shows described Speech input picture allows user's input audio data as described first kind retrieval information,
When Second Type retrieval information enter key is selected, described input display part shows described image input picture allows user's input image data as described Second Type retrieval information.
When the 3rd type retrieval information enter key is selected, described input display part shows described input mode and selects picture to allow user select input mode, when described character entry key is selected, described input display part shows described character input picture by user inputs character type data as described 3rd type retrieval information
When the 4th type retrieval information enter key is selected, described input display part shows described input mode and selects picture to allow user select input mode, when described character entry key is selected, described input display part shows described character input picture by user inputs character type data as described 4th type retrieval information
When the 5th type retrieval information enter key is selected, described input display part shows described input mode and selects picture to allow user select input mode, when described character input selection key is selected, described input display part shows described character input picture by user inputs character type data as described 5th type retrieval information.
11. image file storage and retrieval systems according to claim 1, is characterized in that:
Wherein, described image file sends to described cloud server by scanning uploading device,
Described user terminal comprises described scanning uploading device.
12. 1 kinds of cloud servers, to be communicated with user terminal by network and are connected, to the image file apposition retrieving information containing plural page, and retrieve based on this retrieving information, it is characterized in that, comprising:
Image storage part, retrieving information storage part, apposition control part and service side Department of Communication Force,
Wherein, described image storage part at least stores described image file,
Described service side Department of Communication Force is at least sent to described user terminal described image file, and receives the retrieving information corresponding with current described image file from described user terminal,
Described retrieving information apposition is controlled described retrieving information storage part and stores corresponding with described image file for described retrieving information to described image file by described apposition control part,
Described retrieving information at least comprises the one in acoustic information and image information.
13. cloud servers according to claim 12, is characterized in that, also comprise:
Search part,
Wherein, described image storage part also stores the plural width page image corresponding with described plural page of the described image file of composition, and correspondingly stores the page attribute information of the attribute representing described page image,
Described retrieving information storage part stores corresponding with described retrieving information for described page attribute information,
When described service side, Department of Communication Force receives retrieval information from described user terminal, described search part retrieves described retrieving information storage part, obtain the described retrieving information consistent with described retrieval information and corresponding described page attribute information, and obtain corresponding described page image based on page image storage part described in this page attribute information retrieval.
CN201310330693.6A 2013-07-31 2013-07-31 Cloud server and Image Storage Retrieval system Expired - Fee Related CN104346387B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310330693.6A CN104346387B (en) 2013-07-31 2013-07-31 Cloud server and Image Storage Retrieval system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310330693.6A CN104346387B (en) 2013-07-31 2013-07-31 Cloud server and Image Storage Retrieval system

Publications (2)

Publication Number Publication Date
CN104346387A true CN104346387A (en) 2015-02-11
CN104346387B CN104346387B (en) 2018-06-05

Family

ID=52502002

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310330693.6A Expired - Fee Related CN104346387B (en) 2013-07-31 2013-07-31 Cloud server and Image Storage Retrieval system

Country Status (1)

Country Link
CN (1) CN104346387B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105893431A (en) * 2015-12-09 2016-08-24 乐视网信息技术（北京）股份有限公司 Media retrieval method and equipment
CN105956186A (en) * 2016-06-03 2016-09-21 捷开通讯科技(上海)有限公司 Picture search system and method

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1704926A (en) * 2004-06-01 2005-12-07 佳能株式会社 Information processing device and method
US20060053365A1 (en) * 2004-09-08 2006-03-09 Josef Hollander Method for creating custom annotated books
CN1822662A (en) * 2005-02-17 2006-08-23 佳能株式会社 Image processing apparatus and control method thereof
CN1842790A (en) * 2003-06-04 2006-10-04 松下电器产业株式会社 Information presentation system, management device, and terminal device
CN101022618A (en) * 2006-02-14 2007-08-22 三星电子株式会社 Multimedia content production method for portable device
US20100131614A1 (en) * 2008-11-24 2010-05-27 The Boeing Company System and method for scalable architecture for web-based collaborative annotation of page-based documents
US20120036153A1 (en) * 2010-08-04 2012-02-09 Nhn Corporation Mobile system, search system and search result providing method for mobile search

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1842790A (en) * 2003-06-04 2006-10-04 松下电器产业株式会社 Information presentation system, management device, and terminal device
CN1704926A (en) * 2004-06-01 2005-12-07 佳能株式会社 Information processing device and method
US20060053365A1 (en) * 2004-09-08 2006-03-09 Josef Hollander Method for creating custom annotated books
CN1822662A (en) * 2005-02-17 2006-08-23 佳能株式会社 Image processing apparatus and control method thereof
CN101022618A (en) * 2006-02-14 2007-08-22 三星电子株式会社 Multimedia content production method for portable device
US20100131614A1 (en) * 2008-11-24 2010-05-27 The Boeing Company System and method for scalable architecture for web-based collaborative annotation of page-based documents
US20120036153A1 (en) * 2010-08-04 2012-02-09 Nhn Corporation Mobile system, search system and search result providing method for mobile search

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105893431A (en) * 2015-12-09 2016-08-24 乐视网信息技术（北京）股份有限公司 Media retrieval method and equipment
CN105956186A (en) * 2016-06-03 2016-09-21 捷开通讯科技(上海)有限公司 Picture search system and method

Also Published As

Publication number Publication date
CN104346387B (en) 2018-06-05

Similar Documents

Publication Publication Date Title
US11023666B2 (en) Narrative-based media organizing system for transforming and merging graphical representations of digital media within a work area
US10599743B2 (en) Providing localized individually customized updates from a social network site to a desktop application
US20170220858A1 (en) Optical recognition of tables
US20130031208A1 (en) Management and Provision of Interactive Content
DE202010018551U1 (en) Automatically deliver content associated with captured information, such as information collected in real-time
CN101546588B (en) Image processing apparatus and method
CN102317955A (en) Data managing method and system based on image
US20160117301A1 (en) Annotation sharing system and method
CN101421697A (en) Method and apparatus for requesting the print of panorama image at mobile device
JP6287373B2 (en) Image storage and retrieval system
US20110151426A1 (en) Learning tool
CN107203498A (en) A kind of method, system and its user terminal and server for creating e-book
CN104346388A (en) Cloud server and image storage and retrieval system
KR20180046784A (en) Platform management system of experience learning activity using location based services
CN104346387A (en) Cloud server and image storage and retrieval system
CN109697242B (en) Photographing question searching method and device, storage medium and computing equipment
KR20090000745A (en) Sound book production system and the method which use the internet
US20220129518A1 (en) System and method for providing book-based personalized social media service
CN102129430A (en) Device and method for browsing images
US20150324370A1 (en) Multimedia portfolio management system and method
Fay et al. Semantic Web Technologies and Social Searching for Librarians:(THE TECH SET®# 20)
JP5223328B2 (en) Information management apparatus, information management method, and program thereof
KR20080034863A (en) Education system
Liu et al. Design and implementation of a cloud-based resume creation applet
KR20150087861A (en) System and method for e-book service

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180605