WO2007046016A1 - Mobile listing system - Google Patents

Mobile listing system Download PDF

Info

Publication number
WO2007046016A1
WO2007046016A1 PCT/IB2006/053505 IB2006053505W WO2007046016A1 WO 2007046016 A1 WO2007046016 A1 WO 2007046016A1 IB 2006053505 W IB2006053505 W IB 2006053505W WO 2007046016 A1 WO2007046016 A1 WO 2007046016A1
Authority
WO
WIPO (PCT)
Prior art keywords
folder
file
user
voice stream
hand
Prior art date
Application number
PCT/IB2006/053505
Other languages
French (fr)
Inventor
Kent Layher
Original Assignee
Kent Layher
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kent Layher filed Critical Kent Layher
Publication of WO2007046016A1 publication Critical patent/WO2007046016A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems

Definitions

  • PDA personal assistant
  • Palm Pilot for example, a Palm Pilot or a Blackberry.
  • the user of such a device could then consult the shopping list whilst in the store, to ensure that an item was not forgotten.
  • a method for use on a hand-held mobile self-powered wireless device including a listing
  • the listing programs extracts commands from a user's voice streams and initiates subroutines in response to those commands. For example, the method of the present
  • invention allows a user to navigate through a hierarchy of files and folders, create new files and
  • the method of the present invention safely allows a user to save voice streams in a
  • Fig. 1 is a functional block diagram of the hardware of the hand-held mobile self-powered wireless device.
  • Figs. 2-7 are instruction sheets detailing instructions for a user to operate the hand-held mobile
  • a method for use and a hand-held mobile self-powered wireless device including a listing
  • present invention solve the problems of the prior art by safely allowing a user to navigate through and to manage a hierarchy of folders and files without the visual attention of the user and without the physical manipulation of the keys or the stylus of the device. Further, a user, with the same
  • reminder lists such as shopping lists, wish lists, or to-do lists with voice commands.
  • the device comprises: a listing program; a
  • memory having a file storage directory comprising a hierarchy of folders, files stored within the
  • Figure 1 shows the hardware of a hand-held mobile self-powered wireless device 101 in
  • the hardware includes a microprocessor 103, RAM 105, permanent memory 107 which may be field-programmed PROM
  • ROM 109 e.g. flash memory
  • factory-masked ROM 111 factory-masked ROM 111, or both as depicted in this particular
  • the hardware also includes a microphone 113, a keyboard 115, a screen 117, a
  • a listing program comprising a
  • microprocessor 103 executing the appropriate software.
  • commands from voice streams said by the user being the microprocessor 103 executing the appropriate software.
  • An example of other means being the microprocessor 103 executing the
  • the hand-held mobile self-powered device is not particularly limited and can be, for example, a cell phone or a personal data assistant (PDA) such as a Blackberry or Palm Pilot.
  • PDA personal data assistant
  • program may come resident on the device from a retailer or it may be purchased separately from
  • program is loaded on the device it may be initiated by the user. In one embodiment it is
  • the listing program is initiated by pressing a button on the device.
  • the user may then say a voice stream comprising
  • the human input device which is coupled to the listing program through the
  • microprocessor of the hand-held mobile self-powered wireless device then obtains the voice
  • the human input device is not particularly limited so long as it is able to
  • the human input device is a microphone.
  • the audio output device which is coupled to the listing program is not particularly limited either, so long as it is able to convert an electronic signal into an audio
  • the audio output device is a speaker.
  • the listing program comprises a speech recognition engine, a text-to-speech engine, and a
  • present invention are those offered by Fonix, Inc.
  • the listing program extracts commands from the voice streams said by user.
  • the commands are those offered by Fonix, Inc.
  • extracted from the voice streams are commands that are indicative of a user's desires to: (1)
  • the hand-held mobile self-powered wireless device creates a folder to be located in a currently open folder in the file storage directory of the hand-held mobile self-powered wireless device; (6)
  • main folder located in the file storage directory of the hand-held mobile self-powered wireless
  • This subroutine comprises
  • parent folder of the currently open folder or file located in the file storage directory of the handheld mobile self-powered wireless device by the listing program, initiating an "open parent folder” subroutine comprising the steps of:
  • This subroutine comprises the steps of: (i) by the listing program, sending an audible request comprising instructions for the user
  • the user may be required to say the folder name using the individual characters of the folder name spelled out.
  • the listing program initiates an "open file” subroutine.
  • This subroutine comprises the steps of: (i) by the listing program, sending an audible request comprising instructions for the user
  • the user may be required to say the file name using the individual characters of the file name spelled out.
  • the listing program initiates a "create folder” subroutine. This
  • subroutine comprises the steps of:
  • the user desires to be created in the currently open folder of the file storage directory.
  • the speech recognition engine selected (i.e. the depth of vocabulary that the engine recognizes) and the corresponding name of the folder that the user
  • the user may be required to say the folder name using the individual characters of the folder name spelled out.
  • the listing program initiates a "create file” subroutine. This
  • subroutine comprises the steps of:
  • a file with the text-converted voice stream comprising the name of the file the user desires to be created in the currently open folder of the file storage directory.
  • the user may be required to say the file name using the individual characters of the file name spelled out.
  • the listing program initiates a "delete folder” subroutine. This
  • subroutine comprises the steps of: (i) by the listing program, sending an audible request comprising instructions for the user
  • the user may be required to say the folder name using the individual characters of the folder name spelled out.
  • the listing program initiates a "delete file” subroutine. This subroutine
  • the listing program initiates a "review folder"
  • This subroutine comprises the steps of:
  • obtaining the voice stream comprising the command indicative of the user's desire to delete the file or folder that had been announced immediately prior
  • obtaining the voice stream comprising the command indicative of the user's desire to open the file or folder that had been announced immediately prior
  • the listing program initiates a "review voice
  • This subroutine comprises the steps of:
  • obtaining the voice stream comprising the command indicative of the user's desire to delete the voice stream that had been announced immediately prior
  • subroutine comprises the steps of:
  • the listing program recognize when a user's voice streams have stopped and to save the voice
  • the listing program initiates a "delete all voice streams"
  • This subroutine comprises the steps of:
  • commands extracted from the user's voice streams may be commands that are indicative of
  • This subroutine comprises the steps of:
  • This subroutine comprises
  • This subroutine comprises the steps of:
  • the hand-held mobile self-powered wireless device is communicatively coupled to a wide-area wireless communications network enabled with file sharing, hi this
  • the listing program comprises a "self shutdown" subroutine initiated
  • the "self shutdown" subroutine comprises the steps of:
  • the hand-held mobile self-powered wireless device may be any type of wireless device.
  • a user is able to create a file, a folder, or both a file and a file folder on a personal computer and subsequently load it into
  • Figs. 2-7 comprise a series of instruction sheets for a user detailing the operation of a hand-held
  • Fig. 2 details instructions instruction steps 1 - 5
  • Step 1 Details instructions for a user to load the listing program onto a PDA or cell phone in the event that the device does not contain the listing software of the present invention.
  • Step 2 Details instructions for the user to assign a button on the PDA or cell phone to be used
  • Step 3 The user is directed to initiate the listing program by using the quick start button assigned in step two.
  • Step 4 Details instructions for ensuring that the program is running.
  • Step 5 Details an exemplary hierarchy of folders and files (lists) that can be created and managed.
  • Fig. 3 details instructions instruction steps 6 - 8
  • Step 6 Details the use of a priority folder.
  • Step 7 Details the 'use last list' and 'use last folder' program options.
  • Step 8 Details the mobile listing commands that the listing program may extract from a user's
  • Fig. 4 details instructions instruction steps 9 - 11
  • Steps 9 and 10 Detail the listing program's actions that it will take in response to inaction by the user.
  • Step 11 Details instruction for the user to stop the listing program
  • Fig. 5 details instructions instruction steps 12 - 18
  • Step 12 Details instructions for a user to create a file/list.
  • Step 13 Details instructions for a user to open a file/list.
  • Step 14 Details instructions for a user to delete a file/list.
  • Step 15 Details instructions for a user to review voice files/items stored in a file/list.
  • Step 16 Details instructions for a user to add a voice file/item to a file/list.
  • Step 17 Details instructions for a user to delete voice files/items stored in a file/list.
  • Step 18 Details instructions for a user to delete all voice files/items stored in a file/list.
  • Fig. 6 details instructions instruction steps 19 - 22
  • Step 19 Details instructions for a user to create a folder.
  • Step 20 Details instructions for a user to open a folder.
  • Step 21 Details instructions for a user to review a folder.
  • Step 22 Details instructions for a user to delete a folder.
  • Fig. 7 details instructions instruction steps 23 - 25
  • Steps 23 - 25 Detail instructions for a user to navigate through the hierarchy of folders.

Abstract

A method for use on a hand-held mobile self-powered wireless device including a listing program is provided. The listing programs extracts commands from a user's voice streams and initiates subroutines in response to those commands. For example, the method of the present invention allows a user to navigate through a hierarchy of files and folders, create new files and folders, and manage the contents thereof without the inconvenience of physically manipulating keys or a stylus and without paying visual attention to the device. Further, the method of the present invention allows a user to save voice streams in a desired file and to easily locate and play back the voice streams at a convenient time and place.

Description

TITLE:
Mobile Listing Device
CROSS REFERENCE TO RELATED APPLICATIONS:
This application claims the benefit of US provisional application 60/727356 filed on October 17,
2005, which is herein incorporated by reference.
BACKGROUND:
A shopper often enters a store with the intention of buying numerous items. Unfortunately, after
leaving the store the shopper is all-to-often confronted with the problem of having forgotten to
purchase a specific item, for example, forgetting to purchase milk or eggs, hi the past this
regrettable situation was averted by writing down, on paper, a list of items to purchase from the
store, for example, generating a grocery list. However, lists written on paper were easily lost or
destroyed.
With the advent of modern computing, a shopper was able to generate shopping lists on a less
easily lost or destroyed device such as on a personal computer (PC) or on a personal data
assistant (PDA), for example, a Palm Pilot or a Blackberry. The user of such a device could then consult the shopping list whilst in the store, to ensure that an item was not forgotten. However,
when generating a shopping list on a PC or a PDA, a shopper was required to use a human input
device such as a mouse, a keyboard, or a stylus. The use of such a human input device was also required to review the list. The use of a PDA or PC to generate a list also required the visual attention of the user as well as
the physical manipulation of the human input device. Physically impaired users, such as the
blind, were not able to use the PDA or the PC for generating shopping lists. Further, the
operation of the PDA or PC required the user's undivided attention thereby making it difficult
and dangerous to generate a shopping list and perform another task, such as driving, at the same
time. It would be extremely beneficial to provide a device that solves the problems of the prior
art.
SUMMARY OF INVENTION:
A method for use on a hand-held mobile self-powered wireless device including a listing
program is provided. The listing programs extracts commands from a user's voice streams and initiates subroutines in response to those commands. For example, the method of the present
invention allows a user to navigate through a hierarchy of files and folders, create new files and
folders, and manage the contents thereof by voice command and without the inconvenience of physically manipulating keys or a stylus and without paying visual attention to the device.
Further, the method of the present invention safely allows a user to save voice streams in a
desired location and to easily locate and play back the saved voice streams at a convenient time
and place.
DESCRIPTION OF DRAWING:
Fig. 1 is a functional block diagram of the hardware of the hand-held mobile self-powered wireless device. Figs. 2-7 are instruction sheets detailing instructions for a user to operate the hand-held mobile
self-powered wireless device in accordance with an exemplary embodiment of the present
invention.
DETAILED DESCRIPTION:
A method for use and a hand-held mobile self-powered wireless device including a listing
program is provided. The method and hand-held mobile self-powered wireless device of the
present invention solve the problems of the prior art by safely allowing a user to navigate through and to manage a hierarchy of folders and files without the visual attention of the user and without the physical manipulation of the keys or the stylus of the device. Further, a user, with the same
conveniences, may now save voice streams in a desired location on the device and play back
saved voice streams at a preferred time and place. Thus, physically impaired users such as the
blind, are now able to create and manage files on an electronic device while others can safely
perform other tasks, such as driving, while using the device. Further, a user can now generate,
play back and manage reminder lists, such as shopping lists, wish lists, or to-do lists with voice commands.
In accordance with an embodiment of the present invention, a method is provided for use on a
hand-held mobile self-powered wireless device. The device comprises: a listing program; a
memory having a file storage directory comprising a hierarchy of folders, files stored within the
hierarchy of folders, and voice streams stored within files stored within the hierarchy of folders; a
human input device; an audio output device; and a microprocessor, wherein each of the listing program, the memory, the human input device, and the audio output device are coupled through
the microprocessor.
Figure 1 shows the hardware of a hand-held mobile self-powered wireless device 101 in
accordance with an embodiment of the present invention. The hardware includes a microprocessor 103, RAM 105, permanent memory 107 which may be field-programmed PROM
109 (e.g. flash memory) or factory-masked ROM 111, or both as depicted in this particular
embodiment. The hardware also includes a microphone 113, a keyboard 115, a screen 117, a
speaker 119, and a RF transmitter/receiver 121. Each of the microprocessor 103, RAM 105,
permanent memory 107, microphone 113, keyboard 115, screen 117, speaker 119, and RF transmitter/receiver 121 coupled by electronic wiring 123. A listing program, comprising a
speech recognition engine, a text-to-speech engine, and a plurality of subroutines that are
initiated in response to commands extracted by the listing program from a user's voice streams,
is stored within the permanent memory 107. An example of the means for initiating the listing
program stored in the permanent memory 107, being a key on keyboard 115. An example of the means for obtaining a voice stream said by user comprising a command, being the
microprocessor 103 executing the appropriate software. An example of the means for extracting
commands from voice streams said by the user, being the microprocessor 103 executing the appropriate software. An example of other means, being the microprocessor 103 executing the
appropriate software.
The hand-held mobile self-powered device is not particularly limited and can be, for example, a cell phone or a personal data assistant (PDA) such as a Blackberry or Palm Pilot. The listing
program may come resident on the device from a retailer or it may be purchased separately from
the device and subsequently loaded into the permanent memory by a user. Once the listing
program is loaded on the device it may be initiated by the user. In one embodiment it is
envisioned that the listing program is initiated by pressing a button on the device.
Once the listing program is initiated by the user, the user may then say a voice stream comprising
a command. The human input device, which is coupled to the listing program through the
microprocessor of the hand-held mobile self-powered wireless device, then obtains the voice
stream said by the user. The human input device is not particularly limited so long as it is able to
receive a voice stream and convert it to an electronic signal. It is herein preferred that the human input device is a microphone. The audio output device, which is coupled to the listing program is not particularly limited either, so long as it is able to convert an electronic signal into an audio
output. It is herein preferred that the audio output device is a speaker.
The listing program comprises a speech recognition engine, a text-to-speech engine, and a
plurality of subroutines that are initiated in response to commands extracted by the listing
program from a user's voice streams. The speech recognition engine and text-to-speech engines
are not particularly limited as such applications are well known in the art. Examples of a speech
recognition engines and a text-to-speech engines suitable for use with the listing program of the
present invention are those offered by Fonix, Inc. The listing program extracts commands from the voice streams said by user. The commands
extracted from the voice streams are commands that are indicative of a user's desires to: (1)
open a main folder located in the file storage directory of the hand-held mobile self-powered
wireless device; (2) open a parent folder of a currently open folder or file located in the file
storage directory of the hand-held mobile self-powered wireless device; (3) open a folder located
in a currently open folder in the file storage directory of the hand-held mobile self-powered
wireless device; (4) open a file located in a currently open folder in the file storage directory of
the hand-held mobile self-powered wireless device; (5) create a folder to be located in a currently open folder in the file storage directory of the hand-held mobile self-powered wireless device; (6)
create a file to be located in a currently open folder in the file storage directory of the hand-held
mobile self-powered wireless device; (7) delete a folder located in a currently open folder in the
file storage directory of the hand-held mobile self-powered wireless device; (8) delete a file
located in a currently open folder in the file storage directory of the hand-held mobile self-
powered wireless device; (9) review and manage folders and files located in a currently open folder in the file storage directory of the hand-held mobile self-powered wireless device; (10)
review and manage voice streams saved in a currently open file located in the file storage
directory of the hand-held mobile self-powered wireless device; (11) save a voice stream in a
currently open file located in the file storage directory of the hand-held mobile self-powered
wireless device; and (12) delete all voice streams located in a currently open file located in the
file storage directory of the hand-held mobile self-powered wireless device. In response to the command extracted from the user's voice stream, the listing program then initiates a subroutine. (1) Open main folder
When a command extracted from a voice stream is indicative of a user's desire to: (1) open the
main folder located in the file storage directory of the hand-held mobile self-powered wireless
device, the listing program initiates an "open main folder" subroutine. This subroutine comprises
the steps of:
(i) by the listing program, opening the main folder located in the file storage directory.
(2) Open parent folder
When a command extracted from a voice stream is indicative of a user's desire to: (2) open the
parent folder of the currently open folder or file located in the file storage directory of the handheld mobile self-powered wireless device, by the listing program, initiating an "open parent folder" subroutine comprising the steps of:
(i) by the listing program, opening the parent folder of the currently open folder or file
located in the file storage directory.
(S) Open folder
When a command extracted from a voice stream is indicative of a user's desire to: (3) open a
folder located in a currently open folder in the file storage directory of the hand-held mobile self-
powered wireless device, the listing program, initiates an "open folder" subroutine. This subroutine comprises the steps of: (i) by the listing program, sending an audible request comprising instructions for the user
to say a voice stream comprising the name of the folder the user desires to be opened, to
the user through the audio output device of the hand-held mobile self-powered wireless
device,
(ii) by the user of the hand-held mobile self-powered wireless device, saying the voice
stream comprising the name of the folder the user desires to be opened,
(iii) by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the name of the folder the user desires to be
opened,
(iv) by the listing program, performing a speech-to-text conversion on the voice stream
comprising the name of the folder the user desires to be opened,
(v) by the listing program, comparing the text-converted voice stream comprising the name of the folder the user desires to be opened to the names of folders located in a
currently open folder in the file storage directory,
(vi) in the event that the listing program matches the text-converted voice stream comprising the name of the folder the user desires to be opened and a name of a folder
located in the currently open folder in the file storage directory, by the listing program, opening the matching folder located in a currently open folder in the file storage
directory, and
(vii) in the event that the listing program does not match the text-converted voice stream
comprising the name of the folder the user desires to be opened and a name of a folder
located in the currently open folder in the file storage directory, by the listing program,
(A) sending an audible request comprising instructions for the user that the folder
does not exist in the currently open folder in the file storage directory, to the user through the audio output device of the hand-held mobile self-powered wireless device, and
(B) looping back to step (i) of this subroutine.
The user may be required to say the folder name using the individual characters of the folder name spelled out.
(4) Open file
When a command extracted from a voice stream is indicative of a user's desire to: (4) open a file
located in a currently open folder in the file storage directory of the hand-held mobile self-
powered wireless device, the listing program initiates an "open file" subroutine. This subroutine comprises the steps of: (i) by the listing program, sending an audible request comprising instructions for the user
to say a voice stream comprising the name of the file the user desires to be opened, to the
user through the audio output device of the hand-held mobile self-powered wireless
device,
(ii) by the user of the hand-held mobile self-powered wireless device, saying the voice
stream comprising the name of the file the user desires to be opened,
(iii) by the human input device of the hand-held mobile self-powered wireless device, obtaining the voice stream comprising the name of the file the user desires to be opened,
(iv) by the listing program, performing a speech-to-text conversion on the voice stream
comprising the name of the file the user desires to be opened,
(v) by the listing program, comparing the text-converted voice stream comprising the name of the file the user desires to be opened to names of files located in the currently
open folder in the file storage directory,
(vi) in the event that the listing program matches the text-converted voice stream
comprising the name of the file the user desires to be opened and a name of a file located
in the currently open folder in the file storage directory, by the listing program, opening
the matching file located in the currently open folder in the file storage directory, and (vii) in the event that the listing program does not match the text-converted voice stream
comprising the name of the file the user desires to be opened and a name of a file located
in the currently open folder in the file storage directory, by the listing program,
(A) sending an audible request comprising instructions that the file does not exist
in the currently open folder in the file storage directory, to the user through the
audio output device of the hand-held mobile self-powered wireless device, and
(B) looping back to step (i) of this subroutine.
The user may be required to say the file name using the individual characters of the file name spelled out.
(5) Create folder
When a command extracted from a voice stream is indicative of a user's desire to: (5) create a folder to be located in a currently open folder in the file storage directory of the hand-held mobile
self-powered wireless device, the listing program initiates a "create folder" subroutine. This
subroutine comprises the steps of:
(i) by the listing program, sending an audible request comprising instructions for the user
to say a voice stream comprising the name of the folder the user desires to be created, to the user through the audio output device of the hand-held mobile self-powered wireless device,
(ii) by the user of the hand-held mobile self-powered wireless device, saying the voice
stream comprising the name of the folder the user desires to be created,
(iii) by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the name of the folder the user desires to be created,
(iv) by the listing program, performing a speech-to-text conversion on the voice stream comprising the name of the folder the user desires to be created,
(v) by the listing program, comparing the text-converted voice stream comprising the
name of the folder the user desires to be created to names of folders located in the currently open folder in the file storage directory,
(vi) in the event that the listing program matches the text-converted voice stream
comprising the name of the folder the user desires to be created and a name of a folder located in the currently open folder of the file storage directory, by the listing program,
(A) sending an audible comprising instructions that the folder name already exists
in the currently open folder located in file storage directory, to the user through the audio output device of the hand-held mobile self-powered wireless device, and
(B) looping back to step (i) of this subroutine, and
(vii) in the event that the listing program does not match the text-converted voice stream
comprising the name of the folder the user desires to be created and a name of a folder
located in the currently open folder in the file storage directory, by the listing program, creating a folder with the text-converted voice stream comprising the name of the folder
the user desires to be created in the currently open folder of the file storage directory.
Depending on the performance of the speech recognition engine selected (i.e. the depth of vocabulary that the engine recognizes) and the corresponding name of the folder that the user
desires to be created, the user may be required to say the folder name using the individual characters of the folder name spelled out.
(6) Create file
When a command extracted from a voice stream is indicative of a user's desire to: (6) create a
file to be located in a currently open folder in the file storage directory of the hand-held mobile
self-powered wireless device, the listing program initiates a "create file" subroutine. This
subroutine comprises the steps of:
(i) by the listing program, sending an audible request comprising instructions for the user to say a voice stream comprising the name of the file the user desires to be created, to the
user through the audio output device of the hand-held mobile self-powered wireless
device,
(ii) by the user of the hand-held mobile self-powered wireless device, saying the voice
stream comprising the name of the file the user desires to be created,
(iii) by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the name of the file the user desires to be created,
(iv) by the listing program, performing a speech-to-text conversion on the voice stream comprising the name of the file the user desires to be created,
(v) by the listing program, comparing the text-converted voice stream comprising the
name of the file the user desires to be created to names of files located in the currently open folder in the folder in the file storage directory,
(vi) in the event that the listing program matches the text-converted voice stream
comprising the name of the file the user desires to be created and a name of a file located
in the currently open folder in the file storage directory, by the listing program,
(A) sending an audible request comprising instructions that the file name already exists in the currently open folder located in file storage directory, to the user
through the audio output device of the hand-held mobile self-powered wireless
device, and
(B) looping back to step (i) of this subroutine, and
(vii) in the event that the listing program does not match the text-converted voice stream
comprising the name of the file the user desires to be created and a name of a file in the
currently open folder located in the file storage directory, by the listing program, creating
a file with the text-converted voice stream comprising the name of the file the user desires to be created in the currently open folder of the file storage directory.
Depending on the performance of the speech recognition engine selected (i.e. the depth of
vocabulary that the engine recognizes) and the corresponding name of the file that the user
desires to be created, the user may be required to say the file name using the individual characters of the file name spelled out.
(7) Delete folder
When a command extracted from a voice stream is indicative of a user's desire to: (7) delete a
folder located in a currently open folder in the file storage directory of the hand-held mobile self-
powered wireless device, the listing program initiates a "delete folder" subroutine. This
subroutine comprises the steps of: (i) by the listing program, sending an audible request comprising instructions for the user
to say a voice stream comprising the name of the folder the user desires to be deleted, to
the user through the audio output device of the hand-held mobile self-powered wireless
device,
(ii) by the user of the hand-held mobile selfφowered wireless device, saying the voice stream comprising the name of the folder the user desires to be deleted,
(iii) by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the name of the folder the user desires to be
deleted,
(iv) by the listing program, performing a speech-to-text conversion on the voice stream
comprising the name of the folder the user desires to be deleted,
(v) by the listing program, comparing the text-converted voice stream comprising the
name of the folder the user desires to be deleted to names of folders located in the currently open folder in the file storage directory,
(vi) in the event that the listing program matches the text-converted voice stream
comprising the name of the folder the user desires to be deleted and a name of a folder
located in the currently open folder in the folder storage directory, by the listing program, deleting the matching folder in the currently open folder in the file storage directory, and
(vii) in the event that the listing program does not match the text-converted voice stream
comprising the name of the folder the user desires to be deleted and a name of a folder in
the currently open folder located in the file storage directory, by the listing program,
(A) sending an audible request comprising instructions that the folder name does
not exist in the currently open folder located in file storage directory, to the user through the audio output device of the hand-held mobile self-powered wireless device, and
(B) looping back to step (i) of this subroutine.
The user may be required to say the folder name using the individual characters of the folder name spelled out.
(8) Delete file
When a command extracted from a voice stream is indicative of a user's desire to: (8) delete a
file located in a currently open folder in the file storage directory of the hand-held mobile self-
powered wireless device, the listing program initiates a "delete file" subroutine. This subroutine
comprises the steps of: (i) by the listing program, sending an audible request comprising instructions for the user
to say a voice stream comprising the name of the file the user desires to be deleted, to the
user through the audio output device of the hand-held mobile self-powered wireless
device,
(ii) by the user of the hand-held mobile self-powered wireless device, saying the voice
stream comprising the name of the file the user desires to be deleted,
(iii) by the human input device of the hand-held mobile self-powered wireless device, obtaining the voice stream comprising the name of the file the user desires to be deleted,
(iv) by the listing program, performing a speech-to-text conversion on the voice stream comprising the name of the file the user desires to be deleted,
(v) by the listing program, comparing the text-converted voice stream comprising the
name of the file the user desires to be deleted to names of files located in the currently
open folder in the file storage directory,
(vi) in the event that the listing program matches the text-converted voice stream
comprising the name of the file the user desires to be deleted and a name of a file located in the currently open folder in the file storage directory, by the listing program, deleting
the matching file in the currently open folder in the file storage directory, and (vii) in the event that the listing program does not match the text-converted voice stream
comprising the name of the file the user desires to be deleted and a name of a file in the currently open folder located in the file storage directory, by the listing program,
(A) sending an audible request comprising instructions that the file name does not
exist in the currently open folder located in file storage directory, to the user
through the audio output device of the hand-held mobile self-powered wireless
device, and
(B) looping back to step (i) of this subroutine.
The user may be required to say the file name using the individual characters of the file name
spelled out.
(9) Review folder
When a command extracted from a voice stream is indicative of a user's desire to: (9) review
and manage folders and files located in a currently open folder in the file storage directory of the
hand-held mobile self-powered wireless device, the listing program initiates a "review folder"
subroutine. This subroutine comprises the steps of:
(i) by the listing program, performing a text-to-voice conversion on the names of the names of the folders and files located in the currently open folder in the file storage directory,
(ii) by the listing program, sequentially announcing, to a user, the voice conversions of
the names of the folders and files located in the currently open folder in the file storage
directory through the audio output device of the hand-held mobile self-powered wireless device,
(iii) in the event that the user of the hand-held mobile self-powered wireless device desires to delete a file or folder announced during step (ii) of this subroutine,
by the user, saying a voice stream comprising a command indicative of the user's desire to delete the file or folder that had been announced immediately prior,
by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the command indicative of the user's desire to delete the file or folder that had been announced immediately prior, and
by the listing program of the hand-held mobile self-powered wireless device,
(A) extracting the command from the voice stream indicative of the user's desire to delete the file or folder that had been announced immediately prior, and (B) deleting the file or folder in the file storage directory in response to the
command extracted from the user's voice stream, and
(iv) in the event that the user of the hand-held mobile self-powered wireless device
desires to open a file or folder announced during step (ii) of this subroutine,
by the user, saying a voice stream comprising a command indicative of the user's
desire to open the file or folder that had been announced immediately prior,
by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the command indicative of the user's desire to open the file or folder that had been announced immediately prior, and
by the listing program of the hand-held mobile self-powered wireless device,
(A) extracting the command from the voice stream indicative of the user's
desire to open the file or folder that had been announced immediately prior, and
(B) opening the file or folder in the file storage directory in response to the
command extracted from the user's voice stream. (10) Review voice streams
When a command extracted from a voice stream is indicative of a user's desire to: (10) review
and manage voice streams saved in a currently open file located in the file storage directory of
the hand-held mobile self-powered wireless device, the listing program initiates a "review voice
streams" subroutine. This subroutine comprises the steps of:
(i) by the listing program, sequentially announcing, to the user, the voice stream files
located in the currently open file in the file storage directory through the audio output
device of the hand-held mobile self-powered wireless device, and
(ii) in the event that the user of the hand-held mobile self-powered wireless device desires to delete a voice stream announced during step (i) of this subroutine,
by the user, saying a voice stream comprising a command indicative of the user's
desire to delete the voice stream that had been announced immediately prior,
by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the command indicative of the user's desire to delete the voice stream that had been announced immediately prior, and
by the listing program of the hand-held mobile self-powered wireless device, (A) extracting the command from the voice stream indicative of the user's
desire to delete the voice stream that had been announced immediately
prior, and
(B) deleting the voice stream from the file located in the file storage
directory in response to the command extracted from the user's voice
stream.
(11) Save voice stream
When a command extracted from a voice stream is indicative of a user's desire to: (11) save a voice stream in a currently open file located in the file storage directory of the hand-held mobile self-powered wireless device, the listing program initiates a "save voice stream" subroutine. This
subroutine comprises the steps of:
(i) by the listing program, sending an audible request comprising instructions for the user
to say a desired voice stream to be recorded in the currently open file in the file storage
directory, to the user through the audio output device of the hand-held mobile self-
powered wireless device,
(ii) by the user of the hand-held mobile self-powered wireless device, saying the desired
voice stream to be recorded in the currently open file in the file storage directory, (iii) by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the desired voice stream to be recorded in the
currently open file in the file storage directory, and
(iv) by the listing program, saving the voice stream as a sound file in the currently open
file in the file storage directory.
To accommodate voice streams of varying length and to save such efficiently, it is preferred that the listing program recognize when a user's voice streams have stopped and to save the voice
streams up to their stopping point.
(12) Delete all voice streams
When a command extracted from a voice stream is indicative of a user's desire to: (12) delete all voice streams located in a currently open file located in the file storage directory of the hand-held
mobile self-powered wireless device, the listing program initiates a "delete all voice streams"
subroutine. This subroutine comprises the steps of:
(i) deleting all voice streams located in the currently open file in the file storage directory.
With reference to the concepts of saving voice streams in a file, reviewing voice streams located
in a file, and deleting voice streams in a file, it is herein understood that the voice streams are
stored in the file itself or in a location associated with the file. Other commands extracted from the user's voice streams may be commands that are indicative of
a user's desires to: (13) stop the listing program; (14) cancel the current subroutine; and (15) list
the commands that the listing program recognizes.
(13) Stop program
When a command extracted from a voice stream is indicative of a user's desire to: (13) stop the
listing program, the listing program initiates a "stop program" subroutine. This subroutine comprises the steps of:
(i) by the listing program, stopping the program.
(14) Cancel
When a command extracted from a voice stream is indicative of a user's desire to: (14) cancel the
current subroutine, the listing program initiates a "cancel" subroutine. This subroutine comprises
the steps of:
(i) by the listing program, canceling the currently running subroutine, and
(ii) sending an audible request comprising instructions for the user that the currently
running subroutine has been canceled and for the user to say a voice stream comprising a command. (15) List commands
When a command extracted from a voice stream is indicative of a user's desire to: (15) list the
commands that the listing program recognizes, the listing program initiates a "list commands"
subroutine. This subroutine comprises the steps of:
(i) by the listing program, listing the commands that the listing program recognizes.
hi another embodiment, the hand-held mobile self-powered wireless device is communicatively coupled to a wide-area wireless communications network enabled with file sharing, hi this
embodiment the device is able to send a file or files located in the file directory over the wide-
area wireless communications network to a second hand-held mobile self-powered wireless device that is coupled to the wide-area wireless communications network.
In a further embodiment, the listing program comprises a "self shutdown" subroutine initiated
when a user fails to say a voice stream comprising a command for a period of time greater than 10 seconds, more preferably greater than 20 seconds, and still more preferably greater than 30
seconds. The "self shutdown" subroutine comprises the steps of:
(i) by the listing program, stopping the program.
hi another embodiment, the hand-held mobile self-powered wireless device may be
communicatively coupled to a personal computer. In this embodiment a user is able to create a file, a folder, or both a file and a file folder on a personal computer and subsequently load it into
the file storage directory of the hand-held mobile self-powered wireless device for access thereon
by a user.
Figs. 2-7 comprise a series of instruction sheets for a user detailing the operation of a hand-held
mobile self-powered wireless device in accordance with an exemplary embodiment of the present invention.
Fig. 2 details instructions instruction steps 1 - 5
(Step 1) Details instructions for a user to load the listing program onto a PDA or cell phone in the event that the device does not contain the listing software of the present invention.
(Step 2) Details instructions for the user to assign a button on the PDA or cell phone to be used
for the quick initiation of the listing program.
(Step 3) The user is directed to initiate the listing program by using the quick start button assigned in step two.
(Step 4) Details instructions for ensuring that the program is running.
(Step 5) Details an exemplary hierarchy of folders and files (lists) that can be created and managed. Fig. 3 details instructions instruction steps 6 - 8
(Step 6) Details the use of a priority folder.
(Step 7) Details the 'use last list' and 'use last folder' program options.
(Step 8) Details the mobile listing commands that the listing program may extract from a user's
voice streams.
Fig. 4 details instructions instruction steps 9 - 11
(Steps 9 and 10) Detail the listing program's actions that it will take in response to inaction by the user.
(Step 11) Details instruction for the user to stop the listing program
Fig. 5 details instructions instruction steps 12 - 18
(Step 12) Details instructions for a user to create a file/list.
(Step 13) Details instructions for a user to open a file/list.
(Step 14) Details instructions for a user to delete a file/list.
(Step 15) Details instructions for a user to review voice files/items stored in a file/list. (Step 16) Details instructions for a user to add a voice file/item to a file/list.
(Step 17) Details instructions for a user to delete voice files/items stored in a file/list.
(Step 18) Details instructions for a user to delete all voice files/items stored in a file/list.
Fig. 6 details instructions instruction steps 19 - 22
(Step 19) Details instructions for a user to create a folder.
(Step 20) Details instructions for a user to open a folder.
(Step 21) Details instructions for a user to review a folder.
(Step 22) Details instructions for a user to delete a folder.
Fig. 7 details instructions instruction steps 23 - 25
(Steps 23 - 25) Detail instructions for a user to navigate through the hierarchy of folders.

Claims

CLAIMS:
1. A method for use on a hand-held mobile self-powered wireless device comprising: a listing
program comprising a speech recognition engine, a text-to-speech engine, and a plurality of
subroutines that are initiated in response to commands extracted by the listing program from a
user's voice streams; a memory having a file storage directory comprising a hierarchy of folders,
files stored within the hierarchy of folders, and voice streams stored within files stored within the
hierarchy of folders; a human input device; an audio output device; and a microprocessor,
wherein each of the listing program, the memory, the human input device, and the audio output
device are coupled through the microprocessor, the method comprising the steps of:
by the user of the hand-held mobile self-powered wireless device, initiating the listing program of the hand-held mobile self-powered wireless device,
by the user, saying a voice stream comprising a command,
by the human input device coupled to the listing program through the microprocessor of the
hand-held mobile self-powered wireless device, obtaining a voice stream said by user comprising
a command,
by the listing program of the hand-held mobile self-powered wireless device, extracting
commands from voice streams said by the user, wherein the commands extracted from the voice
streams comprise commands that are indicative of a user's desires to: (1) open a main folder located in the file storage directory of the hand-held mobile self-powered wireless device; (2)
open a parent folder of a currently open folder or file located in the file storage directory of the
hand-held mobile self-powered wireless device; (3) open a folder located in a currently open
folder in the file storage directory of the hand-held mobile self-powered wireless device; (4) open
a file located in a currently open folder in the file storage directory of the hand-held mobile self-
powered wireless device; (5) create a folder to be located in a currently open folder in the file storage directory of the hand-held mobile self-powered wireless device; (6) create a file to be
located in a currently open folder in the file storage directory of the hand-held mobile self-
powered wireless device; (7) delete a folder located in a currently open folder in the file storage
directory of the hand-held mobile self-powered wireless device; (8) delete a file located in a currently open folder in the file storage directory of the hand-held mobile self-powered wireless device; (9) review and manage folders and files located in a currently open folder in the file
storage directory of the hand-held mobile self-powered wireless device; (10) review and manage
voice streams saved in a currently open file located in the file storage directory of the hand-held
mobile self-powered wireless device; (11) save a voice stream in a currently open file located in
the file storage directory of the hand-held mobile self-powered wireless device; and (12) delete
all voice streams located in a currently open file located in the file storage directory of the handheld mobile self-powered wireless device;
when a command extracted from a voice stream is indicative of a user's desire to: (1) open the
main folder located in the file storage directory of the hand-held mobile self-powered wireless device, by the listing program, initiating an "open main folder" subroutine comprising the steps of:
(i) by the listing program, opening the main folder located in the file storage directory,
when a command extracted from a voice stream is indicative of a user's desire to: (2) open the
parent folder of the currently open folder or file located in the file storage directory of the hand¬
held mobile self-powered wireless device, by the listing program, initiating an "open parent
folder" subroutine comprising the steps of:
(i) by the listing program, opening the parent folder of the currently open folder or file
located in the file storage directory,
when a command extracted from a voice stream is indicative of a user's desire to: (3) open a
folder located in a currently open folder in the file storage directory of the hand-held mobile self- powered wireless device, by the listing program, initiating an "open folder" subroutine
comprising the steps of:
(i) by the listing program, sending an audible request comprising instructions for the user to say a voice stream comprising the name of the folder the user desires to be opened, to
the user through the audio output device of the hand-held mobile self-powered wireless
device, (ii) by the user of the hand-held mobile self-powered wireless device, saying the voice
stream comprising the name of the folder the user desires to be opened,
(iii) by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the name of the folder the user desires to be
opened,
(iv) by the listing program, performing a speech-to-text conversion on the voice stream
comprising the name of the folder the user desires to be opened,
(v) by the listing program, comparing the text-converted voice stream comprising the name of the folder the user desires to be opened to the names of folders located in a
currently open folder in the file storage directory,
(vi) in the event that the listing program matches the text-converted voice stream comprising the name of the folder the user desires to be opened and a name of a folder
located in the currently open folder in the file storage directory, by the listing program,
opening the matching folder located in a currently open folder in the file storage
directory, and
(vii) in the event that the listing program does not match the text-converted voice stream
comprising the name of the folder the user desires to be opened and a name of a folder located in the currently open folder in the file storage directory, by the listing program,
(A) sending an audible request comprising instructions for the user that the folder
does not exist in the currently open folder in the file storage directory, to the user
through the audio output device of the hand-held mobile self-powered wireless
device, and
(B) looping back to step (i) of this subroutine,
when a command extracted from a voice stream is indicative of a user's desire to: (4) open a file
located in a currently open folder in the file storage directory of the hand-held mobile self- powered wireless device, by the listing program, initiating an "open file" subroutine comprising
the steps of:
(i) by the listing program, sending an audible request comprising instructions for the user
to say a voice stream comprising the name of the file the user desires to be opened, to the
user through the audio output device of the hand-held mobile self-powered wireless
device,
(ii) by the user of the hand-held mobile self-powered wireless device, saying the voice
stream comprising the name of the file the user desires to be opened, (iii) by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the name of the file the user desires to be opened,
(iv) by the listing program, performing a speech-to-text conversion on the voice stream
comprising the name of the file the user desires to be opened,
(v) by the listing program, comparing the text-converted voice stream comprising the
name of the file the user desires to be opened to names of files located in the currently
open folder in the file storage directory,
(vi) in the event that the listing program matches the text-converted voice stream
comprising the name of the file the user desires to be opened and a name of a file located in the currently open folder in the file storage directory, by the listing program, opening
the matching file located in the currently open folder in the file storage directory, and
(vii) in the event that the listing program does not match the text-converted voice stream
comprising the name of the file the user desires to be opened and a name of a file located
in the currently open folder in the file storage directory, by the listing program,
(A) sending an audible request comprising instructions that the file does not exist
in the currently open folder in the file storage directory, to the user through the
audio output device of the hand-held mobile self-powered wireless device, and (B) looping back to step (i) of this subroutine,
when a command extracted from a voice stream is indicative of a user's desire to: (5) create a
folder to be located in a currently open folder in the file storage directory of the hand-held mobile
self-powered wireless device, by the listing program, initiating a "create folder" subroutine
comprising the steps of:
(i) by the listing program, sending an audible request comprising instructions for the user
to say a voice stream comprising the name of the folder the user desires to be created, to
the user through the audio output device of the hand-held mobile self-powered wireless
device,
(ii) by the user of the hand-held mobile self-powered wireless device, saying the voice
stream comprising the name of the folder the user desires to be created,
(iii) by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the name of the folder the user desires to be
created,
(iv) by the listing program, performing a speech-to-text conversion on the voice stream
comprising the name of the folder the user desires to be created, (v) by the listing program, comparing the text-converted voice stream comprising the
name of the folder the user desires to be created to names of folders located in the
currently open folder in the file storage directory,
(vi) in the event that the listing program matches the text-converted voice stream
comprising the name of the folder the user desires to be created and a name of a folder
located in the currently open folder of the file storage directory, by the listing program,
(A) sending an audible comprising instructions that the folder name already exists in the currently open folder located in file storage directory, to the user through
the audio output device of the hand-held mobile self-powered wireless device, and
(B) looping back to step (i) of this subroutine, and
(vii) in the event that the listing program does not match the text-converted voice stream comprising the name of the folder the user desires to be created and a name of a folder
located in the currently open folder in the file storage directory, by the listing program,
creating a folder with the text-converted voice stream comprising the name of the folder
the user desires to be created in the currently open folder of the file storage directory,
when a command extracted from a voice stream is indicative of a user's desire to: (6) create a file to be located in a currently open folder in the file storage directory of the hand-held mobile self-powered wireless device, by the listing program, initiating a "create file" subroutine
comprising the steps of:
(i) by the listing program, sending an audible request comprising instructions for the user
to say a voice stream comprising the name of the file the user desires to be created, to the
user through the audio output device of the hand-held mobile self-powered wireless
device,
(ii) by the user of the hand-held mobile self-powered wireless device, saying the voice
stream comprising the name of the file the user desires to be created,
(iii) by the human input device of the hand-held mobile self-powered wireless device, obtaining the voice stream comprising the name of the file the user desires to be created,
(iv) by the listing program, performing a speech-to-text conversion on the voice stream comprising the name of the file the user desires to be created,
(v) by the listing program, comparing the text-converted voice stream comprising the
name of the file the user desires to be created to names of files located in the currently
open folder in the folder in the file storage directory,
(vi) in the event that the listing program matches the text-converted voice stream comprising the name of the file the user desires to be created and a name of a file located
in the currently open folder in the file storage directory, by the listing program,
(A) sending an audible request comprising instructions that the file name already
exists in the currently open folder located in file storage directory, to the user
through the audio output device of the hand-held mobile self-powered wireless
device, and
(B) looping back to step (i) of this subroutine, and
(vii) in the event that the listing program does not match the text-converted voice stream comprising the name of the file the user desires to be created and a name of a file in the currently open folder located in the file storage directory, by the listing program, creating
a file with the text-converted voice stream comprising the name of the file the user
desires to be created in the currently open folder of the file storage directory,
when a command extracted from a voice stream is indicative of a user's desire to: (7) delete a
folder located in a currently open folder in the file storage directory of the hand-held mobile self-
powered wireless device, by the listing program, initiating a "delete folder" subroutine
comprising the steps of:
(i) by the listing program, sending an audible request comprising instructions for the user to say a voice stream comprising the name of the folder the user desires to be deleted, to
the user through the audio output device of the hand-held mobile self-powered wireless
device,
(ii) by the user of the hand-held mobile self-powered wireless device, saying the voice
stream comprising the name of the folder the user desires to be deleted,
(iii) by the human input device of the hand-held mobile self-powered wireless device, obtaining the voice stream comprising the name of the folder the user desires to be
deleted,
(iv) by the listing program, performing a speech-to-text conversion on the voice stream comprising the name of the folder the user desires to be deleted,
(v) by the listing program, comparing the text-converted voice stream comprising the
name of the folder the user desires to be deleted to names of folders located in the
currently open folder in the file storage directory,
(vi) in the event that the listing program matches the text-converted voice stream
comprising the name of the folder the user desires to be deleted and a name of a folder
located in the currently open folder in the folder storage directory, by the listing program,
deleting the matching folder in the currently open folder in the file storage directory, and (vii) in the event that the listing program does not match the text-converted voice stream
comprising the name of the folder the user desires to be deleted and a name of a folder in
the currently open folder located in the file storage directory, by the listing program,
(A) sending an audible request comprising instructions that the folder name does
not exist in the currently open folder located in file storage directory, to the user
through the audio output device of the hand-held mobile self-powered wireless
device, and
(B) looping back to step (i) of this subroutine,
when a command extracted from a voice stream is indicative of a user's desire to: (8) delete a
file located in a currently open folder in the file storage directory of the hand-held mobile self-
powered wireless device, by the listing program, initiating a "delete file" subroutine comprising
the steps of:
(i) by the listing program, sending an audible request comprising instructions for the user
to say a voice stream comprising the name of the file the user desires to be deleted, to the
user through the audio output device of the hand-held mobile self-powered wireless
device,
(ii) by the user of the hand-held mobile self-powered wireless device, saying the voice stream comprising the name of the file the user desires to be deleted,
(iii) by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the name of the file the user desires to be deleted,
(iv) by the listing program, performing a speech-to-text conversion on the voice stream
comprising the name of the file the user desires to be deleted,
(v) by the listing program, comparing the text-converted voice stream comprising the
name of the file the user desires to be deleted to names of files located in the currently
open folder in the file storage directory,
(vi) in the event that the listing program matches the text-converted voice stream
comprising the name of the file the user desires to be deleted and a name of a file located in the currently open folder in the file storage directory, by the listing program, deleting
the matching file in the currently open folder in the file storage directory, and
(vii) in the event that the listing program does not match the text-converted voice stream
comprising the name of the file the user desires to be deleted and a name of a file in the
currently open folder located in the file storage directory, by the listing program,
(A) sending an audible request comprising instructions that the file name does not exist in the currently open folder located in file storage directory, to the user
through the audio output device of the hand-held mobile self-powered wireless device, and
(B) looping back to step (i) of this subroutine,
when a command extracted from a voice stream is indicative of a user's desire to: (9) review and
manage folders and files located in a currently open folder in the file storage directory of the hand-held mobile self-powered wireless device, by the listing program, initiating a "review folder" subroutine comprising the steps of:
(i) by the listing program, performing a text-to-voice conversion on the names of the
names of the folders and files located in the currently open folder in the file storage directory,
(ii) by the listing program, sequentially announcing, to a user, the voice conversions of
the names of the folders and files located in the currently open folder in the file storage
directory through the audio output device of the hand-held mobile self-powered wireless device,
(iii) in the event that the user of the hand-held mobile self-powered wireless device desires to delete a file or folder announced during step (ii) of this subroutine, by the user, saying a voice stream comprising a command indicative of the user's
desire to delete the file or folder that had been announced immediately prior,
by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the command indicative of the user's desire
to delete the file or folder that had been announced immediately prior, and
by the listing program of the hand-held mobile self-powered wireless device,
(A) extracting the command from the voice stream indicative of the user's desire to delete the file or folder that had been announced immediately prior, and
(B) deleting the file or folder in the file storage directory in response to the
command extracted from the user's voice stream, and
(iv) in the event that the user of the hand-held mobile self-powered wireless device
desires to open a file or folder announced during step (ii) of this subroutine,
by the user, saying a voice stream comprising a command indicative of the user's
desire to open the file or folder that had been announced immediately prior, by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the command indicative of the user's desire to open the file or folder that had been announced immediately prior, and
by the listing program of the hand-held mobile self-powered wireless device,
(A) extracting the command from the voice stream indicative of the user's
desire to open the file or folder that had been announced immediately prior, and
(B) opening the file or folder in the file storage directory in response to the command extracted from the user's voice stream,
when a command extracted from a voice stream is indicative of a user's desire to: (10) review
and manage voice streams saved in a currently open file located in the file storage directory of the hand-held mobile self-powered wireless device, by the listing program, initiating a "review
voice streams" subroutine comprising the steps of:
(i) by the listing program, sequentially announcing, to the user, the voice stream files
located in the currently open file in the file storage directory through the audio output
device of the hand-held mobile self-powered wireless device, and (ii) in the event that the user of the hand-held mobile self-powered wireless device desires
to delete a voice stream announced during step (i) of this subroutine,
by the user, saying a voice stream comprising a command indicative of the user's
desire to delete the voice stream that had been announced immediately prior,
by the human input device of the hand-held mobile self-powered wireless device, obtaining the voice stream comprising the command indicative of the user's desire
to delete the voice stream that had been announced immediately prior, and
by the listing program of the hand-held mobile self-powered wireless device,
(A) extracting the command from the voice stream indicative of the user's
desire to delete the voice stream that had been announced immediately prior, and
(B) deleting the voice stream from the file located in the file storage
directory in response to the command extracted from the user's voice stream,
when a command extracted from a voice stream is indicative of a user's desire to: (11) save a
voice stream in a currently open file located in the file storage directory of the hand-held mobile self-powered wireless device, by the listing program, initiating a "save voice stream" subroutine
comprising the steps of:
(i) by the listing program, sending an audible request comprising instructions for the user
to say a desired voice stream to be recorded in the currently open file in the file storage
directory, to the user through the audio output device of the hand-held mobile self-
powered wireless device,
(ii) by the user of the hand-held mobile self-powered wireless device, saying the desired
voice stream to be recorded in the currently open file in the file storage directory,
(iii) by the human input device of the hand-held mobile self-powered wireless device,
obtaining the voice stream comprising the desired voice stream to be recorded in the
currently open file in the file storage directory, and
(iv) by the listing program, saving the voice stream as a sound file in the currently open
file in the file storage directory, and
when a command extracted from a voice stream is indicative of a user's desire to: (12) delete all voice streams located in a currently open file located in the file storage directory of the hand-held
mobile self-powered wireless device, by the listing program, initiating a "delete all voice
streams" subroutine comprising the steps of: (i) deleting all voice streams located in the currently open file in the file storage directory.
2. The method of claim 1, wherein the human input device is a microphone.
3. The method of claim 1, wherein the audio output device is a speaker.
4. The method of claim 1, wherein the hand-held mobile self-powered wireless device is a PDA
or a cell phone.
5. The method of claim 1, wherein a file located in the file storage directory of the hand-held
mobile self-powered wireless device is a reminder list comprising a voice stream detailing an
item on the list.
6. The method of claim 5, wherein the reminder list is selected from the group consisting of: a
shopping list, a wish list, and a to-do list.
7. The method of claim 1, wherein the method further comprises the steps:
by the listing program of the hand-held mobile self-powered wireless device, extracting
commands from voice streams said by the user, wherein the commands extracted from the voice
streams comprise commands that are indicative of a user's desires to: (13) stop the listing
program; (14) cancel the current subroutine; and (15) list the commands that the listing program recognizes.
when a command extracted from a voice stream is indicative of a user's desire to: (13) stop the
listing program, by the listing program, initiating a "stop program" subroutine comprising the
steps of:
(i) by the listing program, stopping the program,
when a command extracted from a voice stream is indicative of a user's desire to: (14) cancel the current subroutine, by the listing program, initiating a "cancel" subroutine comprising the steps
of:
(i) by the listing program, canceling the currently running subroutine, and
(ii) sending an audible request comprising instructions for the user that the currently running subroutine has been canceled and for the user to say a voice stream comprising a
command,
when a command extracted from a voice stream is indicative of a user's desire to: (15) list the commands that the listing program recognizes, by the listing program, initiating a "list
commands" subroutine comprising the steps of: (i) by the listing program, listing the commands that the listing program recognizes.
8. The method of claim 1, wherein the hand-held mobile self-powered wireless device is
communicatively coupled to a wide-area wireless communications network enabled with file
sharing, wherein the method further comprises:
sending a file located in the file directory over the wide-area wireless communications network,
to a second hand-held mobile self-powered wireless device that is coupled to the wide-area
wireless communications network.
9. The method of claim 1, wherein the listing program further comprises a "self shutdown" subroutine initiated when a user fails to say a voice stream comprising a command for a period of
time greater than 10 seconds, wherein the "self shutdown" subroutine comprises the steps of:
(i) by the listing program, stopping the program.
10. The method of claim 1, wherein the hand-held mobile self-powered wireless device is communicatively coupled to a personal computer, wherein the method further comprises the
steps of:
by the user, creating a file, a folder, or both a file and a folder on the personal computer, by the user, transferring the file, the folder, or both the file and the folder to the file storage
directory of the hand-held mobile self-powered wireless device.
11. The method of claim 1, wherein step (ii) of each of the "open folder", "open file", "create folder", "create file", "delete folder", and "delete file" subroutines, is accomplished by the user
saying the name of the file or folder by spelling the name of the file or folder.
12. A hand-held mobile self-powered wireless device comprising: a listing program comprising
a speech recognition engine, a text-to-speech engine, and a plurality of subroutines that are initiated in response to commands extracted by the listing program from a user's voice streams; a
memory having a file storage directory comprising a hierarchy of folders, files stored within the
hierarchy of folders, and voice streams stored within files stored within the hierarchy of folders; a
human input device; an audio output device; and a microprocessor, wherein each of the listing
program, the memory, the human input device, and the audio output device are coupled through the microprocessor, the hand-held mobile self-powered wireless device further comprising:
means for initiating the listing program of the hand-held mobile self-powered wireless device,
means for obtaining a voice stream said by user comprising a command,
means for extracting commands from voice streams said by the user, wherein the commands
extracted from the voice streams comprise commands that are indicative of a user's desires to: (1) open a main folder located in the file storage directory of the hand-held mobile self-powered
wireless device; (2) open a parent folder of a currently open folder or file located in the file storage directory of the hand-held mobile self-powered wireless device; (3) open a folder located
in a currently open folder in the file storage directory of the hand-held mobile self-powered
wireless device; (4) open a file located in a currently open folder in the file storage directory of
the hand-held mobile self-powered wireless device; (5) create a folder to be located in a currently
open folder in the file storage directory of the hand-held mobile self-powered wireless device; (6)
create a file to be located in a currently open folder in the file storage directory of the hand-held
mobile self-powered wireless device; (7) delete a folder located in a currently open folder in the
file storage directory of the hand-held mobile self-powered wireless device; (8) delete a file located in a currently open folder in the file storage directory of the hand-held mobile self- powered wireless device; (9) review and manage folders and files located in a currently open
folder in the file storage directory of the hand-held mobile self-powered wireless device; (10)
review and manage voice streams saved in a currently open file located in the file storage directory of the hand-held mobile self-powered wireless device; (11) save a voice stream in a
currently open file located in the file storage directory of the hand-held mobile self-powered
wireless device; and (12) delete all voice streams located in a currently open file located in the
file storage directory of the hand-held mobile self-powered wireless device;
when a command extracted from a voice stream is indicative of a user's desire to: (1) open the
main folder located in the file storage directory of the hand-held mobile self-powered wireless device, means for initiating an "open main folder" subroutine comprising means for: (i) opening the main folder located in the file storage directory,
when a command extracted from a voice stream is indicative of a user's desire to: (2) open the
parent folder of the currently open folder or file located in the file storage directory of the hand¬
held mobile self-powered wireless device, means for initiating an "open parent folder" subroutine
comprising means for:
(i) opening the parent folder of the currently open folder or file located in the file storage directory,
when a command extracted from a voice stream is indicative of a user's desire to: (3) open a folder located in a currently open folder in the file storage directory of the hand-held mobile self-
powered wireless device, means for initiating an "open folder" subroutine comprising means for:
(i) sending an audible request comprising instructions for the user to say a voice stream
comprising the name of the folder the user desires to be opened, to the user through the
audio output device of the hand-held mobile self-powered wireless device,
(ii) obtaining the voice stream comprising the name of the folder the user desires to be
opened,
(iii) performing a speech-to-text conversion on the voice stream comprising the name of the folder the user desires to be opened,
(iv) comparing the text-converted voice stream comprising the name of the folder the user
desires to be opened to the names of folders located in a currently open folder in the file
storage directory,
(v) in the event that the listing program matches the text-converted voice stream
comprising the name of the folder the user desires to be opened and a name of a folder
located in the currently open folder in the file storage directory, means for opening the
matching folder located in a currently open folder in the file storage directory, and
(vi) in the event that the listing program does not match the text-converted voice stream comprising the name of the folder the user desires to be opened and a name of a folder
located in the currently open folder in the file storage directory, means for
(A) sending an audible request comprising instructions for the user that the folder
does not exist in the currently open folder in the file storage directory, to the user through the audio output device of the hand-held mobile self-powered wireless
device, and
(B) looping back to step (i) of this subroutine, when a command extracted from a voice stream is indicative of a user's desire to: (4) open a file
located in a currently open folder in the file storage directory of the hand-held mobile self-
powered wireless device, means for initiating an "open file" subroutine comprising means for:
(i) sending an audible request comprising instructions for the user to say a voice stream
comprising the name of the file the user desires to be opened, to the user through the audio output device of the hand-held mobile self-powered wireless device,
(ii) obtaining the voice stream comprising the name of the file the user desires to be
opened,
(iii) performing a speech-to-text conversion on the voice stream comprising the name of
the file the user desires to be opened,
(iv) comparing the text-converted voice stream comprising the name of the file the user
desires to be opened to names of files located in the currently open folder in the file
storage directory,
(v) in the event that the listing program matches the text-converted voice stream
comprising the name of the file the user desires to be opened and a name of a file located in the currently open folder in the file storage directory, means for opening the matching
file located in the currently open folder in the file storage directory, and (vi) in the event that the listing program does not match the text-converted voice stream
comprising the name of the file the user desires to be opened and a name of a file located
in the currently open folder in the file storage directory, means for
(A) sending an audible request comprising instructions that the file does not exist
in the currently open folder in the file storage directory, to the user through the
audio output device of the hand-held mobile self-powered wireless device, and
(B) looping back to step (i) of this subroutine,
when a command extracted from a voice stream is indicative of a user's desire to: (5) create a
folder to be located in a currently open folder in the file storage directory of the hand-held mobile
self-powered wireless device, means for initiating a "create folder" subroutine comprising means for:
(i) means for sending an audible request comprising instructions for the user to say a
voice stream comprising the name of the folder the user desires to be created, to the user through the audio output device of the hand-held mobile self-powered wireless device,
(ii) means for obtaining the voice stream comprising the name of the folder the user desires to be created, (iii) means for performing a speech-to-text conversion on the voice stream comprising the
name of the folder the user desires to be created,
(iv) means for comparing the text-converted voice stream comprising the name of the
folder the user desires to be created to names of folders located in the currently open
folder in the file storage directory,
(v) in the event that the listing program matches the text-converted voice stream comprising the name of the folder the user desires to be created and a name of a folder
located in the currently open folder of the file storage directory, means for
(A) sending an audible comprising instructions that the folder name already exists
in the currently open folder located in file storage directory, to the user through
the audio output device of the hand-held mobile self-powered wireless device, and
(B) looping back to step (i) of this subroutine, and
(vii) in the event that the listing program does not match the text-converted voice stream comprising the name of the folder the user desires to be created and a name of a folder
located in the currently open folder in the file storage directory, means for creating a
folder with the text-converted voice stream comprising the name of the folder the user
desires to be created in the currently open folder of the file storage directory, when a command extracted from a voice stream is indicative of a user's desire to: (6) create a
file to be located in a currently open folder in the file storage directory of the hand-held mobile
self-powered wireless device, means for initiating a "create file" subroutine comprising means
for:
(i) sending an audible request comprising instructions for the user to say a voice stream
comprising the name of the file the user desires to be created, to the user through the
audio output device of the hand-held mobile self-powered wireless device,
(ii) obtaining the voice stream comprising the name of the file the user desires to be
created,
(iii) performing a speech-to-text conversion on the voice stream comprising the name of
the file the user desires to be created,
(iv) comparing the text-converted voice stream comprising the name of the file the user
desires to be created to names of files located in the currently open folder in the folder in
the file storage directory,
(v) in the event that the listing program matches the text-converted voice stream
comprising the name of the file the user desires to be created and a name of a file located
in the currently open folder in the file storage directory, means for (A) sending an audible request comprising instructions that the file name already exists in the currently open folder located in file storage directory, to the user
through the audio output device of the hand-held mobile self-powered wireless
device, and
(B) looping back to step (i) of this subroutine, and
(vii) in the event that the listing program does not match the text-converted voice stream comprising the name of the file the user desires to be created and a name of a file in the currently open folder located in the file storage directory, means for creating a file with
the text-converted voice stream comprising the name of the file the user desires to be created in the currently open folder of the file storage directory,
when a command extracted from a voice stream is indicative of a user's desire to: (7) delete a folder located in a currently open folder in the file storage directory of the hand-held mobile self- powered wireless device, means for initiating a "delete folder" subroutine comprising means for:
(i) sending an audible request comprising instructions for the user to say a voice stream
comprising the name of the folder the user desires to be deleted, to the user through the
audio output device of the hand-held mobile self-powered wireless device,
(ii) obtaining the voice stream comprising the name of the folder the user desires to be deleted,
(iii) performing a speech-to-text conversion on the voice stream comprising the name of
the folder the user desires to be deleted,
(iv) comparing the text-converted voice stream comprising the name of the folder the user desires to be deleted to names of folders located in the currently open folder in the file storage directory,
(vi) in the event that the listing program matches the text-converted voice stream comprising the name of the folder the user desires to be deleted and a name of a folder
located in the currently open folder in the folder storage directory, means for deleting the
matching folder in the currently open folder in the file storage directory, and
(vii) in the event that the listing program does not match the text-converted voice stream
comprising the name of the folder the user desires to be deleted and a name of a folder in
the currently open folder located in the file storage directory, means for
(A) sending an audible request comprising instructions that the folder name does
not exist in the currently open folder located in file storage directory, to the user through the audio output device of the hand-held mobile self-powered wireless device, and (B) looping back to step (i) of this subroutine,
when a command extracted from a voice stream is indicative of a user's desire to: (8) delete a
file located in a currently open folder in the file storage directory of the hand-held mobile self-
powered wireless device, means for initiating a "delete file" subroutine comprising means for:
(i) sending an audible request comprising instructions for the user to say a voice stream comprising the name of the file the user desires to be deleted, to the user through the audio output device of the hand-held mobile self-powered wireless device,
(ii) obtaining the voice stream comprising the name of the file the user desires to be deleted,
(iii) performing a speech-to-text conversion on the voice stream comprising the name of
the file the user desires to be deleted,
(iv) comparing the text-converted voice stream comprising the name of the file the user desires to be deleted to names of files located in the currently open folder in the file
storage directory,
(v) in the event that the listing program matches the text-converted voice stream
comprising the name of the file the user desires to be deleted and a name of a file located in the currently open folder in the file storage directory, means for deleting the matching
file in the currently open folder in the file storage directory, and
(vi) in the event that the listing program does not match the text-converted voice stream
comprising the name of the file the user desires to be deleted and a name of a file in the
currently open folder located in the file storage directory, means for
(A) sending an audible request comprising instructions that the file name does not exist in the currently open folder located in file storage directory, to the user through the audio output device of the hand-held mobile self-powered wireless
device, and
(B) looping back to step (i) of this subroutine,
when a command extracted from a voice stream is indicative of a user's desire to: (9) review and
manage folders and files located in a currently open folder in the file storage directory of the
hand-held mobile self-powered wireless device, means for initiating a "review folder" subroutine
comprising means for:
(i) performing a text-to-voice conversion on the names of the names of the folders and
files located in the currently open folder in the file storage directory, (ii) sequentially announcing, to a user, the voice conversions of the names of the folders
and files located in the currently open folder in the file storage directory through the audio
output device of the hand-held mobile self-powered wireless device,
(iii) in the event that the user of the hand-held mobile self-powered wireless device
desires to delete a file or folder announced during step (ii) of this subroutine,
means for obtaining a voice stream comprising a command indicative of the user's
desire to delete the file or folder that had been announced immediately prior, and means for
(A) extracting the command from the voice stream indicative of the user's
desire to delete the file or folder that had been announced immediately
prior, and
(B) deleting the file or folder in the file storage directory in response to the
command extracted from the user's voice stream, and
(iv) in the event that the user of the hand-held mobile self-powered wireless device
desires to open a file or folder announced during step (ii) of this subroutine,
means for obtaining a voice stream comprising a command indicative of the user's desire to open the file or folder that had been announced immediately prior, and means for
(A) extracting the command from the voice stream indicative of the user's
desire to open the file or folder that had been announced immediately prior, and
(B) opening the file or folder in the file storage directory in response to the command extracted from the user's voice stream,
when a command extracted from a voice stream is indicative of a user's desire to: (10) review and manage voice streams saved in a currently open file located in the file storage directory of
the hand-held mobile self-powered wireless device, means for initiating a "review voice streams" subroutine comprising means for:
(i) sequentially announcing, to the user, the voice stream files located in the currently
open file in the file storage directory through the audio output device of the hand-held
mobile self-powered wireless device, and
(ii) in the event that the user of the hand-held mobile selfrpowered wireless device desires to delete a voice stream announced during step (i) of this subroutine, means for obtaining a voice stream comprising a command indicative of the user's desire to delete the voice stream that had been announced immediately prior, and
means for
(A) extracting the command from the voice stream indicative of the user's
desire to delete the voice stream that had been announced immediately
prior, and
(B) deleting the voice stream from the file located in the file storage directory in response to the command extracted from the user's voice
stream,
when a command extracted from a voice stream is indicative of a user's desire to: (11) save a
voice stream in a currently open file located in the file storage directory of the hand-held mobile
self-powered wireless device, means for initiating a "save voice stream" subroutine comprising means for:
(i) sending an audible request comprising instructions for the user to say a desired voice
stream to be recorded in the currently open file in the file storage directory, to the user
through the audio output device of the hand-held mobile self-powered wireless device,
(iii) obtaining a voice stream comprising a desired voice stream to be recorded in the currently open file in the file storage directory, and
(iv) saving the voice stream as a sound file in the currently open file in the file storage directory, and
when a command extracted from a voice stream is indicative of a user's desire to: (12) delete all
voice streams located in a currently open file located in the file storage directory of the hand-held mobile self-powered wireless device, means for initiating a "delete all voice streams" subroutine comprising means for:
(i) deleting all voice streams located in the currently open file in the file storage directory.
13. The hand-held mobile self-powered wireless device of claim 12, wherein the means for
obtaining a voice stream is a human input device.
14. The hand-held mobile self-powered wireless device of claim 13, wherein the human input
device is a microphone.
15. The hand-held mobile self-powered wireless device of claim 12, wherein the audio output device is a speaker.
16. The hand-held mobile self-powered wireless device of claim 12, wherein the hand-held mobile self-powered wireless device is a PDA or a cell phone.
17. The hand-held mobile self-powered wireless device of claim 12, wherein a file located in the
file storage directory of the hand-held mobile self-powered wireless device is a reminder list
comprising a voice stream detailing an item on the list.
18. The hand-held mobile self-powered wireless device of claim 17, wherein the reminder list is
selected from the group consisting of: a shopping list, a wish list, and a to-do list.
19. The hand-held mobile self-powered wireless device of claim 12, wherein the hand-held
mobile self-powered wireless device of claim further comprises means for:
extracting commands from voice streams said by the user, wherein the commands extracted from
the voice streams comprise commands that are indicative of a user's desires to: (13) stop the
listing program; (14) cancel the current subroutine; and (15) list the commands that the listing
program recognizes.
when a command extracted from a voice stream is indicative of a user's desire to: (13) stop the
listing program, means for initiating a "stop program" subroutine comprising means for:
(i) stopping the program, when a command extracted from a voice stream is indicative of a user's desire to: (14) cancel the
current subroutine, means for initiating a "cancel" subroutine comprising means for:
(i) canceling the currently running subroutine, and
(ii) sending an audible request comprising instructions for the user that the currently
running subroutine has been canceled and for the user to say a voice stream comprising a
command,
when a command extracted from a voice stream is indicative of a user's desire to: (15) list the
commands that the listing program recognizes, means for initiating a "list commands" subroutine comprising means for:
(i) listing the commands that the listing program recognizes.
20. The hand-held mobile self-powered wireless device of claim 12, wherein the hand-held
mobile self-powered wireless device is communicatively coupled to a wide-area wireless
communications network enabled with file sharing, wherein the hand-held mobile self-powered
wireless device further comprises means for:
sending a file located in the file storage directory over the wide-area wireless communications
network, to a second hand-held mobile self-powered wireless device that is coupled to the wide- area wireless communications network further comprising means for sending a file or files located in the file directory over the wide-area wireless communications network to a second
hand-held mobile self-powered wireless device.
21. The hand-held mobile self-powered wireless device of claim 12, wherein the listing program
further comprises a "self shutdown" subroutine initiated when a user fails to say a voice stream
comprising a command for a period of time greater than 10 seconds, wherein the "self shutdown"
subroutine comprises means for:
(i) stopping the program.
PCT/IB2006/053505 2005-10-17 2006-09-27 Mobile listing system WO2007046016A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US72735605P 2005-10-17 2005-10-17
US60/727,356 2005-10-17
US11/284,560 2005-11-22
US11/284,560 US7567904B2 (en) 2005-10-17 2005-11-22 Mobile listing system

Publications (1)

Publication Number Publication Date
WO2007046016A1 true WO2007046016A1 (en) 2007-04-26

Family

ID=37709502

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2006/053505 WO2007046016A1 (en) 2005-10-17 2006-09-27 Mobile listing system

Country Status (2)

Country Link
US (1) US7567904B2 (en)
WO (1) WO2007046016A1 (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100856407B1 (en) * 2006-07-06 2008-09-04 삼성전자주식회사 Data recording and reproducing apparatus for generating metadata and method therefor
US8719027B2 (en) * 2007-02-28 2014-05-06 Microsoft Corporation Name synthesis
KR100851306B1 (en) * 2007-02-28 2008-08-08 삼성전자주식회사 Mobile terminal and method for creating file list
US20090089057A1 (en) * 2007-10-02 2009-04-02 International Business Machines Corporation Spoken language grammar improvement tool and method of use
US9754224B2 (en) 2009-06-26 2017-09-05 International Business Machines Corporation Action based to-do list
US9372885B2 (en) 2010-06-11 2016-06-21 Doat Media Ltd. System and methods thereof for dynamically updating the contents of a folder on a device
US9235693B2 (en) 2012-12-06 2016-01-12 Doat Media Ltd. System and methods thereof for tracking and preventing execution of restricted applications
KR102245098B1 (en) 2014-05-23 2021-04-28 삼성전자주식회사 Mobile terminal and control method thereof
US10839593B2 (en) 2016-04-08 2020-11-17 Maxx Media Group, LLC System, method and software for adding three-dimensional images to an intelligent virtual assistant that appear to project forward of or vertically above an electronic display
RU2642802C1 (en) * 2016-07-25 2018-01-26 Алексей Васильевич Глушков Method of making lists in programs by registration of voice messages by special device with following character recognition
WO2018187694A1 (en) * 2017-04-06 2018-10-11 Maxx Media Group, LLC System and method for adding three dimensional images to an interlligent virtual assistant that appear to project forward of or vertically above an electronic display
JP2019046267A (en) * 2017-09-04 2019-03-22 トヨタ自動車株式会社 Information providing method, information providing system, and information providing device

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19622603A1 (en) * 1996-06-05 1997-12-11 Quaas Hans Rainer Dipl Ing Mobile telephone with voice controlled menu
US20020040297A1 (en) * 2000-09-29 2002-04-04 Professorq, Inc. Natural-language voice-activated personal assistant

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6370238B1 (en) * 1997-09-19 2002-04-09 Siemens Information And Communication Networks Inc. System and method for improved user interface in prompting systems
US6069940A (en) * 1997-09-19 2000-05-30 Siemens Information And Communication Networks, Inc. Apparatus and method for adding a subject line to voice mail messages
US6038199A (en) * 1997-11-21 2000-03-14 Dictaphone Corporation Portable digital audio recorder with adaptive control configurations
US20030023435A1 (en) * 2000-07-13 2003-01-30 Josephson Daryl Craig Interfacing apparatus and methods
US6996212B1 (en) * 2002-06-26 2006-02-07 Bellsouth Intellectual Property Corporation Voicemail system with subscriber specific storage folders
US6907397B2 (en) * 2002-09-16 2005-06-14 Matsushita Electric Industrial Co., Ltd. System and method of media file access and retrieval using speech recognition
KR100608677B1 (en) * 2003-12-17 2006-08-02 삼성전자주식회사 Method of supporting TTS navigation and multimedia device thereof
US7574453B2 (en) 2005-01-03 2009-08-11 Orb Networks, Inc. System and method for enabling search and retrieval operations to be performed for data items and records using data obtained from associated voice files

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19622603A1 (en) * 1996-06-05 1997-12-11 Quaas Hans Rainer Dipl Ing Mobile telephone with voice controlled menu
US20020040297A1 (en) * 2000-09-29 2002-04-04 Professorq, Inc. Natural-language voice-activated personal assistant

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
"TALK TO THE MACHINE", IEEE SPECTRUM, IEEE INC. NEW YORK, US, vol. 39, no. 9, September 2002 (2002-09-01), pages 60 - 64,85, XP001117047, ISSN: 0018-9235 *
ANONYMOUS: "Tréo 650", 2004, pages 1 - 2, XP002425155, Retrieved from the Internet <URL:http://www.palm.com/us/products/smartphones/treo650/pdf/datasheet_Treo650.zip> [retrieved on 20070316] *
MICHAEL MILLER: "Ten Minute Guide to Pocket PC 2002", 5 September 2002, QUE, XP002425158 *
SHELLEY O'HARA: "Absolute Beginner's Guide to Microsoft Windows XP, Second Edition", 13 June 2005, QUE, ISBN: 0-7897-3432-X, XP002425159 *

Also Published As

Publication number Publication date
US20070088555A1 (en) 2007-04-19
US7567904B2 (en) 2009-07-28

Similar Documents

Publication Publication Date Title
US7567904B2 (en) Mobile listing system
JP7037602B2 (en) Long-distance expansion of digital assistant services
JP5048174B2 (en) Method and apparatus for recognizing user utterance
JP5799621B2 (en) Information processing apparatus, information processing method, and program
JP2006208696A (en) Device, method, program, and recording medium for remotely controlling application for presentation
WO1999063425A1 (en) Method and apparatus for information processing, and medium for provision of information
EP1650744A1 (en) Invalid command detection in speech recognition
US20110161075A1 (en) Real-time voice recognition on a handheld device
JP2009538444A5 (en)
CN110459222A (en) Sound control method, phonetic controller and terminal device
WO2020001165A1 (en) Voice control method and apparatus, and storage medium and electronic device
EP2682931B1 (en) Method and apparatus for recording and playing user voice in mobile terminal
WO1995025326A1 (en) Voice/pointer operated system
CN104184890A (en) Information processing method and electronic device
US7349844B2 (en) Minimizing resource consumption for speech recognition processing with dual access buffering
US8060370B2 (en) Integrated system and method for mobile audio playback and dictation
JP2003255982A (en) Speech recognition system and speech file recording system
JP6522009B2 (en) Speech recognition system
JP6375592B2 (en) Information processing apparatus, information processing method, and program
JP2019001428A (en) On-vehicle device, voice operation system, and voice operation method
JPH1165799A (en) Designating device for information object
FR3011101A1 (en) USER MOBILE TERMINAL AND METHOD FOR CONTROLLING SUCH TERMINAL
KR20210029177A (en) Method for performing document editing based on speech recognition and apparatus using the same
WO2019142447A1 (en) Information processing device and information processing method
US6381574B1 (en) Device for reproducing information or executing functions

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06809414

Country of ref document: EP

Kind code of ref document: A1