US20170147563A1 - System and method for collaborative language translation - Google Patents

System and method for collaborative language translation Download PDF

Info

Publication number
US20170147563A1
US20170147563A1 US15/423,142 US201715423142A US2017147563A1 US 20170147563 A1 US20170147563 A1 US 20170147563A1 US 201715423142 A US201715423142 A US 201715423142A US 2017147563 A1 US2017147563 A1 US 2017147563A1
Authority
US
United States
Prior art keywords
translation
list
alternative
possibilities
machine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/423,142
Inventor
Srinivas Bangalore
Kateryna Kuksenok
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nuance Communications Inc
Original Assignee
Nuance Communications Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nuance Communications Inc filed Critical Nuance Communications Inc
Priority to US15/423,142 priority Critical patent/US20170147563A1/en
Publication of US20170147563A1 publication Critical patent/US20170147563A1/en
Assigned to AT&T INTELLECTUAL PROPERTY I, L. P. reassignment AT&T INTELLECTUAL PROPERTY I, L. P. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BANGALORE, SRINIVAS, KUKSENOK, KATERYNA
Assigned to NUANCE COMMUNICATIONS, INC. reassignment NUANCE COMMUNICATIONS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AT&T INTELLECTUAL PROPERTY I, L. P.
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G06F17/2854
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/40Processing or translation of natural language
    • G06F40/51Translation evaluation
    • G06F17/2836
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/40Processing or translation of natural language
    • G06F40/42Data-driven translation
    • G06F40/47Machine-assisted translation, e.g. using translation memory
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/40Processing or translation of natural language
    • G06F40/58Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation

Definitions

  • the present disclosure relates to machine translations and more specifically to presenting a machine translation and alternative translations to a user, where a selection by the user of an alternative re-ranks other alternatives.
  • Translators are valuable tools in optimizing time and ability to function.
  • Professional human language translators both historically and today, present value in their services by overcoming an impasse of communication.
  • the service of a translator allows people to engage in commerce and communicate in situations where they otherwise could not.
  • computers With the advent of modern computing, computers have the ability to generate machine translations of text, which reduces the time necessary for translation but also presents possible incorrect translations.
  • Unfortunately the only way in the current state of the art to truly account for these possibly incorrect translations is to hire a human translator. This translator's task is to check the machine translation for errors, nuance, and only in rare situations actually translate from the original text.
  • the system presents these re-ranked alternatives to the user, who can continue proofing the machine translation using the re-ranked alternatives or by providing an improved or alternate translation. This process continues until the user indicates that the current portion of the translation is complete, at which point the system moves to the next portion.
  • the determination that a portion is complete can be decided by direct or indirect input from the user, upon reaching a certain level of confidence, or receiving confirmation from the user that each portion is translated correctly.
  • a system configured to practice the method of this disclosure generates a machine translation of a source text as well as a list of alternative translation possibilities.
  • the system then ranks the list of alternative translation possibilities and presents the machine translation and the alternative translation possibilities to a user, who selects the machine translation or one of the alternatives as the preferred translation, or enters a their own translation.
  • the user can be a participant in a collaborative translation of the source text with at least one other human and/or computer-based entity. If the user selects one of the alternative translations listed, the system re-orders or recreates the alternative translations list in a new order based on the user selection.
  • FIG. 1 illustrates an example system embodiment
  • FIG. 2 illustrates an example method of machine translation
  • FIG. 3 illustrates a decision tree of an example method embodiment
  • FIGS. 4A, 4B, and 4C illustrate node interconnectivity
  • FIGS. 5A, 5B, and 5C illustrate presentation of alternative translations, re-ordering those translations, and presentation of re-ordered alternative translations, respectively;
  • FIG. 6 illustrates an example method embodiment.
  • the present disclosure addresses the need in the art for improved machine translation proofing by a human.
  • a system, method and non-transitory computer-readable media are disclosed which present a machine translation along with alternative translation possibilities, where the alternative translation possibilities are re-ordered depending upon selection by a user of one of the alternative translation presented.
  • a brief introductory description of a basic general purpose system or computing device in FIG. 1 which can be employed to practice the concepts is disclosed herein.
  • a more detailed description of dynamically presenting alternative translation options will then follow, accompanied by descriptions of various embodiments.
  • the disclosure now turns to FIG. 1 .
  • an exemplary system 100 includes a general-purpose computing device 100 , including a processing unit (CPU or processor) 120 and a system bus 110 that couples various system components including the system memory 130 such as read only memory (ROM) 140 and random access memory (RAM) 150 to the processor 120 .
  • the system 100 can include a cache 122 of high speed memory connected directly with, in close proximity to, or integrated as part of the processor 120 .
  • the system 100 copies data from the memory 130 and/or the storage device 160 to the cache 122 for quick access by the processor 120 . In this way, the cache provides a performance boost that avoids processor 120 delays while waiting for data.
  • These and other modules can control or be configured to control the processor 120 to perform various actions.
  • Other system memory 130 may be available for use as well.
  • the memory 130 can include multiple different types of memory with different performance characteristics. It can be appreciated that the disclosure may operate on a computing device 100 with more than one processor 120 or on a group or cluster of computing devices networked together to provide greater processing capability.
  • the processor 120 can include any general purpose processor and a hardware module or software module, such as module 1 162 , module 2 164 , and module 3 166 stored in storage device 160 , configured to control the processor 120 as well as a special-purpose processor where software instructions are incorporated into the actual processor design.
  • the processor 120 may essentially be a completely self-contained computing system, containing multiple cores or processors, a bus, memory controller, cache, etc.
  • a multi-core processor may be symmetric or asymmetric.
  • the system bus 110 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures.
  • a basic input/output system (BIOS) stored in ROM 140 or the like, may provide the basic routine that helps to transfer information between elements within the computing device 100 , such as during start-up.
  • the computing device 100 further includes storage devices 160 such as a hard disk drive, a magnetic disk drive, an optical disk drive, tape drive or the like.
  • the storage device 160 can include software modules 162 , 164 , 166 for controlling the processor 120 . Other hardware or software modules are contemplated.
  • the storage device 160 is connected to the system bus 110 by a drive interface.
  • the drives and the associated computer readable storage media provide nonvolatile storage of computer readable instructions, data structures, program modules and other data for the computing device 100 .
  • a hardware module that performs a particular function includes the software component stored in a non-transitory computer-readable medium in connection with the necessary hardware components, such as the processor 120 , bus 110 , display 170 , and so forth, to carry out the function.
  • the basic components are known to those of skill in the art and appropriate variations are contemplated depending on the type of device, such as whether the device 100 is a small, handheld computing device, a desktop computer, or a computer server.
  • Non-transitory computer-readable storage media expressly exclude media such as energy, carrier signals, electromagnetic waves, and signals per se.
  • an input device 190 represents any number of input mechanisms, such as a microphone for speech, a touch-sensitive screen for gesture or graphical input, keyboard, mouse, motion input, speech and so forth.
  • An output device 170 can also be one or more of a number of output mechanisms known to those of skill in the art.
  • multimodal systems enable a user to provide multiple types of input to communicate with the computing device 100 .
  • the communications interface 180 generally governs and manages the user input and system output. There is no restriction on operating on any particular hardware arrangement and therefore the basic features here may easily be substituted for improved hardware or firmware arrangements as they are developed.
  • the illustrative system embodiment is presented as including individual functional blocks including functional blocks labeled as a “processor” or processor 120 .
  • the functions these blocks represent may be provided through the use of either shared or dedicated hardware, including, but not limited to, hardware capable of executing software and hardware, such as a processor 120 , that is purpose-built to operate as an equivalent to software executing on a general purpose processor.
  • the functions of one or more processors presented in FIG. 1 may be provided by a single shared processor or multiple processors.
  • Illustrative embodiments may include microprocessor and/or digital signal processor (DSP) hardware, read-only memory (ROM) 140 for storing software performing the operations discussed below, and random access memory (RAM) 150 for storing results.
  • DSP digital signal processor
  • ROM read-only memory
  • RAM random access memory
  • VLSI Very large scale integration
  • the logical operations of the various embodiments are implemented as: (1) a sequence of computer implemented steps, operations, or procedures running on a programmable circuit within a general use computer, (2) a sequence of computer implemented steps, operations, or procedures running on a specific-use programmable circuit; and/or (3) interconnected machine modules or program engines within the programmable circuits.
  • the system 100 shown in FIG. 1 can practice all or part of the recited methods, can be a part of the recited systems, and/or can operate according to instructions in the recited non-transitory computer-readable storage media.
  • Such logical operations can be implemented as modules configured to control the processor 120 to perform particular functions according to the programming of the module. For example, FIG.
  • Mod 1 162 , Mod 2 164 and Mod 3 166 which are modules configured to control the processor 120 . These modules may be stored on the storage device 160 and loaded into RAM 150 or memory 130 at runtime or may be stored as would be known in the art in other computer-readable memory locations.
  • FIG. 2 illustrates an example method of machine translation 200 .
  • a computer or computing device translates a source text 202 into a machine translation 204 .
  • a human translator uses the machine translation as a basis for human editing 206 , where the translator can correct for any vocabulary, nuance, or other translation errors made by the computer. Once the translator considers the translation complete, distribution of the translation to various users occurs 208 .
  • This translation method 200 transfers the bulk of the translation work to the machine, shifting the role of a human translator to one of confirmation, editing, or proof reading the machine translation.
  • the human translator in this new role can be an expert or a non-expert, and can have a knowledge of the source language and the target language or just the target language.
  • This method 200 provides quality translations between spoken languages, such as from English to Spanish, French to German, etc.
  • the same translation process applies to computer compilers, where a compiler translates code written in a language understood by humans into intermediate code, optionally further optimizes that code, and translates the intermediate code into machine executable code.
  • human beings can optimize machine translations by tweaks or changes to the intermediate code or the final machine code. These modifications can improve the size, speed, security, or other aspects of the code.
  • the human user can see how one change in the intermediate code affects other portions of the code in real time.
  • FIG. 3 illustrates a decision tree of an example method embodiment 300 .
  • a system configured according to this disclosure first receives a source text 302 to translate. Upon translating the source text into a machine text 304 via a computer or computing device, the system creates a ranked list of alternative translations 306 . The system then presents the machine translation of a single portion or multiple portions, up to and including the entire document, and the ranked list of alternative translations of that portion to a human translator 308 . The human translator can then review the machine translation and determine if the translation is complete or if the translation needs modification 312 , indicated by the system receiving explicit or implicit input from the user 310 .
  • the system proceeds to the next portion 318 . If the translator instead provides input, such as entering their own translation of the source text or selecting from one of the alternative translations presented, this ‘Not Complete’ 314 explicit response initiates a return to ranking translation alternatives 306 . Alternatively, if the system relies upon a threshold to determine if the portion is complete, the system can return an implicit completeness upon determining that the machine translation and the alternatives selected meet or exceed the threshold. The system then ranks translation alternatives using the newly entered input from the user in addition to the original machine translation, creating a new list of ranked alternative translations.
  • the ranked list of translation alternatives presented to the user with the machine translation 308 can be all alternative translations possible, only the top ranked translation alternatives, or only those alternative translation possibilities whose probability of being a likely alternative exceeds a threshold.
  • the user can be a participant in a multi-party collaborative translation effort to translate the source text.
  • the user can be one participant in a group of human and/or computer-based translators who are each translating at least a part of the source text.
  • the various participants can be aware of each other's participation and work close together, or can work completely independently. The participants may not even know of each other's existence, and still collaborate by virtue of working to translate a common source text.
  • the threshold can vary dynamically depending upon the number of potential alternatives and settings established by the user or the system.
  • the system can determine that five alternatives should be presented based on the translated portion and the number of alternatives having a certain probability. The user can then adjust this to present seven alternatives because the user prefers more choices, or adjust it to only two alternatives because the translator trusts the machine translation or dislikes the alternatives presented. For example, rather than showing the top five alternative translations, which may or may not be helpful translations, the system will only present translation alternatives having a minimum 60% probability of correctness. Ranking the probable translation alternatives can be done based on the likelihood that the translation alternative is to be used, the usage of the alternative in previous translations, the usage of the alternative within this translation, or the usage of the alternative by this translator in previous translations. The ranking can also be determined using crowdsourcing/historical models from a wide range of translators, or translations concerning a specific topic or subject area.
  • the alternative translations in the case of translation from one language to another, such as from English to Spanish, can be words, sentences, paragraphs, or other phonetically meaningful portions.
  • the portions can be a single command, a cluster of commands, or a reference to an alternative.
  • the system can present a description of the changes present in the alternative and the advantages for making the change.
  • FIGS. 4A, 4B, and 4C illustrate node interconnectivity.
  • the nodes 402 are connected by lines 404 , and represent node interconnectivity with no selection made 400 A.
  • Each node 402 represents an alternative translation portion, and each line 404 represents a relationship between nodes.
  • each line 404 illustrates a binary relationship between nodes. That is, if the line 404 is present between two nodes then they are likely to co-exist within the translation, and if the line 404 is not present than the existence of either one of the nodes in the translation will eliminate the other from occurrence.
  • these lines can be weighted, such that nodes connect to all other nodes, but those connections are weighted to change the probability of use based on the node selected. If illustrated, every node 402 would connect 404 to every other node 402 , creating a network of relative probability. However, even within this probability network no connectivity 404 exists between alternatives of a specific portion. As illustrated, each node 402 represents a possible alternative translation of a source text, with each column of nodes 402 representing the alternative translations for that specific portion.
  • FIG. 4B illustrates the node interconnectivity of FIG. 4A , with a selection 406 made 400 B.
  • the selected node 406 continues to have binary lines 412 connecting the selected node 406 to neighboring nodes 408 . From some of those neighboring nodes 408 that connect to the selected node 406 , there are other possible nodes 410 connected by an additional binary line 414 . Those nodes without a direct connection 412 or a secondary connection 414 to the selected node become eliminated nodes 416 . The remaining nodes 408 , 410 are presented with the selected node 406 as an updated list of alternative translations.
  • FIG. 4C similarly shows the node interconnectivity of FIG. 4A , with a different node selected 406 than in FIG. 4B .
  • the node selected 406 is on the edge, and connects directly 412 to both of the adjacent nodes 408 in the neighboring column, every node 408 , 410 outside of the selected node 406 column is still selectable by the user.
  • the only nodes eliminated are the nodes 416 in the same column as the selected node 406 .
  • FIGS. 5A, 5B, and 5C illustrate presentation of alternative translations, re-ordering those translations, and presentation of re-ordered alternative translations, respectively.
  • FIG. 5A illustrates the presentation of a machine translation 502 of a sentence to a human translator, accompanied by translation alternatives 504 and a display of the final version as currently selected 506 by the translator.
  • the system has divided the machine translation 502 into specific portions 508 , with corresponding columns of alternative translations 512 , as well as corresponding sections in the final version as currently selected 510 .
  • the alternative translations 512 in this example, are arranged such that the top alternative translation is the most likely alternative, and the bottom alternative translation is the least likely alternative.
  • the options arrangement can be determined based on the translator preference, results from crowd sourcing, historical trends, geographic preferences, intended audience, and/or phonetic flow.
  • the system can utilize crowdsourcing by recording data from multiple translators concerning when and how often translators choose specific alternatives as replacements for machine translations. Based on this data, the system can determine that certain alternative translations have higher or lower probabilities of being selected under specific circumstances, and based on those higher or lower probabilities rank the alternatives accordingly.
  • Historical trends can be formed from a single user, a specific locality, region, demographic, or other group of relevant translation data.
  • the human translator As the human translator is viewing these options 504 in relation to the original text and the machine translation 502 , they can make a selection. In this case, the translator is considering two alternatives to the portion “to a house”, namely “a home” 514 and “home” 516 . The translator selects “home” 516 to replace “to a house”. Upon selecting an alternative translation, the system modifies the options presented 504 . This modification is shown in FIG. 5B .
  • FIG. 5B illustrates an example of how the system modifies the ranked list of translation alternatives upon the selection of the alternative translation “home” 518 by the translator.
  • the alternatives for the same portion as the selection 518 can remain as additional translation alternatives after making a selection. This can be useful if the translator is considering more than one alternative, or wants to test one alternative before ultimately selecting a different alternative.
  • re-ordering 522 of the remaining alternatives causes a shift in the positioning of the alternative translations, such that several of the most likely translation alternatives are now the least likely alternatives presented, and the remaining alternatives have shifted one place closer to the most likely alternative presented.
  • FIG. 5C illustrates the presentation to the translator of the translation and translation alternatives after re-ordering the translation alternatives following the selection of “home” 528 by the translator.
  • the machine translation 502 remains identical to the machine translation of FIG. 5A , because the source text was not re-translated.
  • the machine translation 502 remains constant as a base from which the translator can compare the current revision 526 to the original machine translation 502 .
  • the current revision, or Final Version 526 is the original machine translation with portions replaced by any selections 528 or corrections made by the translator.
  • the only change between the machine translation 502 and the current revision is that “to a house” has been replaced with “home” in the final portion of the sentence, based on the selection of “home” 528 in the options presented 528 .
  • FIG. 6 For the sake of clarity, the method is discussed in terms of an exemplary system 100 as shown in FIG. 1 configured to practice the method.
  • the steps outlined herein are exemplary and can be implemented in any combination thereof, including combinations that exclude, add, or modify certain steps.
  • the system 100 receives a source text ( 602 ) and generates a machine translation of the source text accompanied by a list of alternative translation possibilities ( 604 ). The system 100 then ranks the list of alternative translation possibilities, yielding a ranked list of translation alternatives in a first order ( 606 ). The machine translation and the ranked list of translation alternatives in the first order are presented to a user ( 608 ), wherein the user is participating in a collaborative translation of the source text with at least one other entity, at which point the system receives an input from the user associated with the ranked list of translation alternatives ( 610 ). This input can be one of the alternatives, or can be an alternative translation entered by user not previously presented by the system 100 .
  • the user can select one of the alternatives, or write in their own alternative translation.
  • the system 100 then re-ranks the list of alternative translation possibilities based at least in part on the input, to yield a re-ranked list of translation alternatives in a second order ( 612 ).
  • the system 100 can then present this re-ranked list of translation alternatives in a second order, the input, and the machine translation to the user.
  • the system can not only re-order the translation alternatives for one user, but for other users in the collaborative translation effort.
  • the system can propagate those changes to other users' lists as well, or can propagate other changes or rank adjustment parameters to other users' lists based at least in part on the input from the first user. In this manner, the efficiency of the collaborative translation can be enhanced, even if participants in the collaborative translation effort are in different locations, or are working at different, non-overlapping times.
  • the system 100 ranks the list of alternative translation possibilities based on the likelihood of the user selecting each translation alternative. This likelihood of selection can be determined from historical trends, crowdsourcing, or previous usage associated with the source text. For example, if a user/translator proofing a machine translation of a specific source text has selected a specific alternative translation multiple times while editing the specific source text, the system 100 can increase the likelihood of subsequent selections in the future and increase the probability for selection of those alternative translations.
  • the alternative translation possibilities correspond to specific portions of the machine translation.
  • the system 100 can dynamically adjust the size of the specific portions, or the system 100 can have a fixed portions corresponding to words, phrases, sentences, prosaically meaningful phrases, or paragraphs. If the source text being translated is a higher level computing language, and the machine translation is an intermediate, machine code language, the portions can be individual machine code lines or clusters of lines.
  • Embodiments within the scope of the present disclosure may also include tangible and/or non-transitory computer-readable storage media for carrying or having computer-executable instructions or data structures stored thereon.
  • Such non-transitory computer-readable storage media can be any available media that can be accessed by a general purpose or special purpose computer, including the functional design of any special purpose processor as discussed above.
  • non-transitory computer-readable media can include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store desired program code means in the form of computer-executable instructions, data structures, or processor chip design.
  • Computer-executable instructions include, for example, instructions and data which cause a general purpose computer, special purpose computer, or special purpose processing device to perform a certain function or group of functions.
  • Computer-executable instructions also include program modules that are executed by computers in stand-alone or network environments.
  • program modules include routines, programs, components, data structures, objects, and the functions inherent in the design of special-purpose processors, etc. that perform particular tasks or implement particular abstract data types.
  • Computer-executable instructions, associated data structures, and program modules represent examples of the program code means for executing steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represents examples of corresponding acts for implementing the functions described in such steps.
  • Embodiments of the disclosure may be practiced in network computing environments with many types of computer system configurations, including personal computers, hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, and the like. Embodiments may also be practiced in distributed computing environments where tasks are performed by local and remote processing devices that are linked (either by hardwired links, wireless links, or by a combination thereof) through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

Abstract

Disclosed herein are systems, methods, and non-transitory computer-readable storage media for presenting a machine translation and alternative translations to a user, where a selection of any particular alternative translation results in the re-ranking of the remaining alternatives. The system then presents these re-ranked alternatives to the user, who can continue proofing the machine translation using the re-ranked alternatives or by typing an improved translation. This process continues until the user indicates that the current portion of the translation is complete, at which point the system moves to the next portion.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation of U.S. patent application Ser. No. 15/075,265, filed Mar. 21, 2016, which is a continuation of and claims priority to U.S. patent application Ser. No. 13/311,836, filed Dec. 6, 2011, now U.S. Pat. No. 9,323,746, issued Apr. 26, 2016. The contents of which are incorporated herein by reference in their entirety.
  • FIELD OF THE DISCLOSURE
  • The present disclosure relates to machine translations and more specifically to presenting a machine translation and alternative translations to a user, where a selection by the user of an alternative re-ranks other alternatives.
  • Introduction
  • Translators are valuable tools in optimizing time and ability to function. Professional human language translators, both historically and today, present value in their services by overcoming an impasse of communication. The service of a translator allows people to engage in commerce and communicate in situations where they otherwise could not. With the advent of modern computing, computers have the ability to generate machine translations of text, which reduces the time necessary for translation but also presents possible incorrect translations. Unfortunately, the only way in the current state of the art to truly account for these possibly incorrect translations is to hire a human translator. This translator's task is to check the machine translation for errors, nuance, and only in rare situations actually translate from the original text.
  • Employing a human translator to correct for any possible errors in the machine translation appears, at present, to be unavoidable. While machine translations can and will continue to improve, achieving greater translation efficiency at present relies on increasing the speed and accuracy of the human translator checking the machine translation. One way of increasing human speed and accuracy is presenting alternative translation options to the translator, from which the translator can select replacement words, phrases, sentences, or other text sections in the machine translation.
  • BACKGROUND OF THE DISCLOSURE
  • Additional features and advantages of the disclosure will be set forth in the description which follows, and in part will be understood from the description, or can be learned by practice of the herein disclosed principles. The features and advantages of the disclosure can be realized and obtained by means of the instruments and combinations particularly pointed out in the appended claims. These and other features of the disclosure will become more fully apparent from the following description and appended claims, or can be learned by the practice of the principles set forth herein.
  • Disclosed are systems, methods, and non-transitory computer-readable storage media for presenting a machine translation and alternative translations to a user, where a selection of any particular alternative translation results in the re-ranking of the remaining alternatives. The system then presents these re-ranked alternatives to the user, who can continue proofing the machine translation using the re-ranked alternatives or by providing an improved or alternate translation. This process continues until the user indicates that the current portion of the translation is complete, at which point the system moves to the next portion. The determination that a portion is complete can be decided by direct or indirect input from the user, upon reaching a certain level of confidence, or receiving confirmation from the user that each portion is translated correctly.
  • As an example, a system configured to practice the method of this disclosure generates a machine translation of a source text as well as a list of alternative translation possibilities. The system then ranks the list of alternative translation possibilities and presents the machine translation and the alternative translation possibilities to a user, who selects the machine translation or one of the alternatives as the preferred translation, or enters a their own translation. The user can be a participant in a collaborative translation of the source text with at least one other human and/or computer-based entity. If the user selects one of the alternative translations listed, the system re-orders or recreates the alternative translations list in a new order based on the user selection.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • In order to describe the manner in which the above-recited and other advantages and features of the disclosure can be obtained, a more particular description of the principles briefly described above will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings. Understanding that these drawings depict only exemplary embodiments of the disclosure and are not therefore to be considered to be limiting of its scope, the principles herein are described and explained with additional specificity and detail through the use of the accompanying drawings in which:
  • FIG. 1 illustrates an example system embodiment;
  • FIG. 2 illustrates an example method of machine translation;
  • FIG. 3 illustrates a decision tree of an example method embodiment;
  • FIGS. 4A, 4B, and 4C illustrate node interconnectivity;
  • FIGS. 5A, 5B, and 5C illustrate presentation of alternative translations, re-ordering those translations, and presentation of re-ordered alternative translations, respectively; and
  • FIG. 6 illustrates an example method embodiment.
  • DETAILED DESCRIPTION OF THE DRAWINGS
  • Various embodiments of the disclosure are discussed in detail below. While specific implementations are discussed, it should be understood that this is done for illustration purposes only. A person skilled in the relevant art will recognize that other components and configurations may be used without parting from the spirit and scope of the disclosure.
  • The present disclosure addresses the need in the art for improved machine translation proofing by a human. A system, method and non-transitory computer-readable media are disclosed which present a machine translation along with alternative translation possibilities, where the alternative translation possibilities are re-ordered depending upon selection by a user of one of the alternative translation presented. A brief introductory description of a basic general purpose system or computing device in FIG. 1 which can be employed to practice the concepts is disclosed herein. A more detailed description of dynamically presenting alternative translation options will then follow, accompanied by descriptions of various embodiments. The disclosure now turns to FIG. 1.
  • With reference to FIG. 1, an exemplary system 100 includes a general-purpose computing device 100, including a processing unit (CPU or processor) 120 and a system bus 110 that couples various system components including the system memory 130 such as read only memory (ROM) 140 and random access memory (RAM) 150 to the processor 120. The system 100 can include a cache 122 of high speed memory connected directly with, in close proximity to, or integrated as part of the processor 120. The system 100 copies data from the memory 130 and/or the storage device 160 to the cache 122 for quick access by the processor 120. In this way, the cache provides a performance boost that avoids processor 120 delays while waiting for data. These and other modules can control or be configured to control the processor 120 to perform various actions. Other system memory 130 may be available for use as well. The memory 130 can include multiple different types of memory with different performance characteristics. It can be appreciated that the disclosure may operate on a computing device 100 with more than one processor 120 or on a group or cluster of computing devices networked together to provide greater processing capability. The processor 120 can include any general purpose processor and a hardware module or software module, such as module 1 162, module 2 164, and module 3 166 stored in storage device 160, configured to control the processor 120 as well as a special-purpose processor where software instructions are incorporated into the actual processor design. The processor 120 may essentially be a completely self-contained computing system, containing multiple cores or processors, a bus, memory controller, cache, etc. A multi-core processor may be symmetric or asymmetric.
  • The system bus 110 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. A basic input/output system (BIOS) stored in ROM 140 or the like, may provide the basic routine that helps to transfer information between elements within the computing device 100, such as during start-up. The computing device 100 further includes storage devices 160 such as a hard disk drive, a magnetic disk drive, an optical disk drive, tape drive or the like. The storage device 160 can include software modules 162, 164, 166 for controlling the processor 120. Other hardware or software modules are contemplated. The storage device 160 is connected to the system bus 110 by a drive interface. The drives and the associated computer readable storage media provide nonvolatile storage of computer readable instructions, data structures, program modules and other data for the computing device 100. In one aspect, a hardware module that performs a particular function includes the software component stored in a non-transitory computer-readable medium in connection with the necessary hardware components, such as the processor 120, bus 110, display 170, and so forth, to carry out the function. The basic components are known to those of skill in the art and appropriate variations are contemplated depending on the type of device, such as whether the device 100 is a small, handheld computing device, a desktop computer, or a computer server.
  • Although the exemplary embodiment described herein employs the hard disk 160, it should be appreciated by those skilled in the art that other types of computer readable media which can store data that are accessible by a computer, such as magnetic cassettes, flash memory cards, digital versatile disks, cartridges, random access memories (RAMs) 150, read only memory (ROM) 140, a cable or wireless signal containing a bit stream and the like, may also be used in the exemplary operating environment. Non-transitory computer-readable storage media expressly exclude media such as energy, carrier signals, electromagnetic waves, and signals per se.
  • To enable user interaction with the computing device 100, an input device 190 represents any number of input mechanisms, such as a microphone for speech, a touch-sensitive screen for gesture or graphical input, keyboard, mouse, motion input, speech and so forth. An output device 170 can also be one or more of a number of output mechanisms known to those of skill in the art. In some instances, multimodal systems enable a user to provide multiple types of input to communicate with the computing device 100. The communications interface 180 generally governs and manages the user input and system output. There is no restriction on operating on any particular hardware arrangement and therefore the basic features here may easily be substituted for improved hardware or firmware arrangements as they are developed.
  • For clarity of explanation, the illustrative system embodiment is presented as including individual functional blocks including functional blocks labeled as a “processor” or processor 120. The functions these blocks represent may be provided through the use of either shared or dedicated hardware, including, but not limited to, hardware capable of executing software and hardware, such as a processor 120, that is purpose-built to operate as an equivalent to software executing on a general purpose processor. For example the functions of one or more processors presented in FIG. 1 may be provided by a single shared processor or multiple processors. (Use of the term “processor” should not be construed to refer exclusively to hardware capable of executing software.) Illustrative embodiments may include microprocessor and/or digital signal processor (DSP) hardware, read-only memory (ROM) 140 for storing software performing the operations discussed below, and random access memory (RAM) 150 for storing results. Very large scale integration (VLSI) hardware embodiments, as well as custom VLSI circuitry in combination with a general purpose DSP circuit, may also be provided.
  • The logical operations of the various embodiments are implemented as: (1) a sequence of computer implemented steps, operations, or procedures running on a programmable circuit within a general use computer, (2) a sequence of computer implemented steps, operations, or procedures running on a specific-use programmable circuit; and/or (3) interconnected machine modules or program engines within the programmable circuits. The system 100 shown in FIG. 1 can practice all or part of the recited methods, can be a part of the recited systems, and/or can operate according to instructions in the recited non-transitory computer-readable storage media. Such logical operations can be implemented as modules configured to control the processor 120 to perform particular functions according to the programming of the module. For example, FIG. 1 illustrates three modules Mod 1 162, Mod 2 164 and Mod 3 166 which are modules configured to control the processor 120. These modules may be stored on the storage device 160 and loaded into RAM 150 or memory 130 at runtime or may be stored as would be known in the art in other computer-readable memory locations.
  • Having disclosed some components of a computing system, the disclosure now turns to FIG. 2, which illustrates an example method of machine translation 200. According to this method, a computer or computing device translates a source text 202 into a machine translation 204. Because machine translations are not perfect, a human translator uses the machine translation as a basis for human editing 206, where the translator can correct for any vocabulary, nuance, or other translation errors made by the computer. Once the translator considers the translation complete, distribution of the translation to various users occurs 208.
  • This translation method 200 transfers the bulk of the translation work to the machine, shifting the role of a human translator to one of confirmation, editing, or proof reading the machine translation. The human translator in this new role can be an expert or a non-expert, and can have a knowledge of the source language and the target language or just the target language. This method 200 provides quality translations between spoken languages, such as from English to Spanish, French to German, etc. The same translation process applies to computer compilers, where a compiler translates code written in a language understood by humans into intermediate code, optionally further optimizes that code, and translates the intermediate code into machine executable code. In the process of these computer code translations, human beings can optimize machine translations by tweaks or changes to the intermediate code or the final machine code. These modifications can improve the size, speed, security, or other aspects of the code. In this example, the human user can see how one change in the intermediate code affects other portions of the code in real time.
  • FIG. 3 illustrates a decision tree of an example method embodiment 300. As in the translation method 200 of FIG. 2, here a system configured according to this disclosure first receives a source text 302 to translate. Upon translating the source text into a machine text 304 via a computer or computing device, the system creates a ranked list of alternative translations 306. The system then presents the machine translation of a single portion or multiple portions, up to and including the entire document, and the ranked list of alternative translations of that portion to a human translator 308. The human translator can then review the machine translation and determine if the translation is complete or if the translation needs modification 312, indicated by the system receiving explicit or implicit input from the user 310. If the input from the user explicitly indicates that the translation is complete 316, the system proceeds to the next portion 318. If the translator instead provides input, such as entering their own translation of the source text or selecting from one of the alternative translations presented, this ‘Not Complete’ 314 explicit response initiates a return to ranking translation alternatives 306. Alternatively, if the system relies upon a threshold to determine if the portion is complete, the system can return an implicit completeness upon determining that the machine translation and the alternatives selected meet or exceed the threshold. The system then ranks translation alternatives using the newly entered input from the user in addition to the original machine translation, creating a new list of ranked alternative translations.
  • The ranked list of translation alternatives presented to the user with the machine translation 308 can be all alternative translations possible, only the top ranked translation alternatives, or only those alternative translation possibilities whose probability of being a likely alternative exceeds a threshold. The user can be a participant in a multi-party collaborative translation effort to translate the source text. For example, the user can be one participant in a group of human and/or computer-based translators who are each translating at least a part of the source text. The various participants can be aware of each other's participation and work close together, or can work completely independently. The participants may not even know of each other's existence, and still collaborate by virtue of working to translate a common source text. The threshold can vary dynamically depending upon the number of potential alternatives and settings established by the user or the system. For example, the system can determine that five alternatives should be presented based on the translated portion and the number of alternatives having a certain probability. The user can then adjust this to present seven alternatives because the user prefers more choices, or adjust it to only two alternatives because the translator trusts the machine translation or dislikes the alternatives presented. For example, rather than showing the top five alternative translations, which may or may not be helpful translations, the system will only present translation alternatives having a minimum 60% probability of correctness. Ranking the probable translation alternatives can be done based on the likelihood that the translation alternative is to be used, the usage of the alternative in previous translations, the usage of the alternative within this translation, or the usage of the alternative by this translator in previous translations. The ranking can also be determined using crowdsourcing/historical models from a wide range of translators, or translations concerning a specific topic or subject area.
  • The alternative translations in the case of translation from one language to another, such as from English to Spanish, can be words, sentences, paragraphs, or other phonetically meaningful portions. In the case of translation from a higher level language, such as C++, to an intermediary assembly language, the portions can be a single command, a cluster of commands, or a reference to an alternative. For instance, if the alternative translation is too large to easily view, the system can present a description of the changes present in the alternative and the advantages for making the change.
  • From a user perspective, upon selecting an alternative translation option the other translation alternatives update using the previous translation and the most recent input. To the user, this update seems nearly instantaneous. Without the user's knowledge, the system determines a new list of alternative translations based on the previous machine translation, the alternative translation selected, and any other relevant factors. The system then presents this new list of alternative translations to the user and allows the user to continue to adjust the translation as desired.
  • FIGS. 4A, 4B, and 4C illustrate node interconnectivity. In FIG. 4A, the nodes 402 are connected by lines 404, and represent node interconnectivity with no selection made 400A. Each node 402 represents an alternative translation portion, and each line 404 represents a relationship between nodes. For this illustration, each line 404 illustrates a binary relationship between nodes. That is, if the line 404 is present between two nodes then they are likely to co-exist within the translation, and if the line 404 is not present than the existence of either one of the nodes in the translation will eliminate the other from occurrence. In other embodiments, these lines can be weighted, such that nodes connect to all other nodes, but those connections are weighted to change the probability of use based on the node selected. If illustrated, every node 402 would connect 404 to every other node 402, creating a network of relative probability. However, even within this probability network no connectivity 404 exists between alternatives of a specific portion. As illustrated, each node 402 represents a possible alternative translation of a source text, with each column of nodes 402 representing the alternative translations for that specific portion.
  • FIG. 4B illustrates the node interconnectivity of FIG. 4A, with a selection 406 made 400B. The selected node 406 continues to have binary lines 412 connecting the selected node 406 to neighboring nodes 408. From some of those neighboring nodes 408 that connect to the selected node 406, there are other possible nodes 410 connected by an additional binary line 414. Those nodes without a direct connection 412 or a secondary connection 414 to the selected node become eliminated nodes 416. The remaining nodes 408, 410 are presented with the selected node 406 as an updated list of alternative translations.
  • FIG. 4C similarly shows the node interconnectivity of FIG. 4A, with a different node selected 406 than in FIG. 4B. In FIG. 4C, because the node selected 406 is on the edge, and connects directly 412 to both of the adjacent nodes 408 in the neighboring column, every node 408, 410 outside of the selected node 406 column is still selectable by the user. The only nodes eliminated are the nodes 416 in the same column as the selected node 406.
  • FIGS. 5A, 5B, and 5C illustrate presentation of alternative translations, re-ordering those translations, and presentation of re-ordered alternative translations, respectively. FIG. 5A illustrates the presentation of a machine translation 502 of a sentence to a human translator, accompanied by translation alternatives 504 and a display of the final version as currently selected 506 by the translator. The system has divided the machine translation 502 into specific portions 508, with corresponding columns of alternative translations 512, as well as corresponding sections in the final version as currently selected 510. The alternative translations 512, in this example, are arranged such that the top alternative translation is the most likely alternative, and the bottom alternative translation is the least likely alternative. In other configurations the options arrangement can be determined based on the translator preference, results from crowd sourcing, historical trends, geographic preferences, intended audience, and/or phonetic flow. For example, the system can utilize crowdsourcing by recording data from multiple translators concerning when and how often translators choose specific alternatives as replacements for machine translations. Based on this data, the system can determine that certain alternative translations have higher or lower probabilities of being selected under specific circumstances, and based on those higher or lower probabilities rank the alternatives accordingly. Historical trends can be formed from a single user, a specific locality, region, demographic, or other group of relevant translation data.
  • As the human translator is viewing these options 504 in relation to the original text and the machine translation 502, they can make a selection. In this case, the translator is considering two alternatives to the portion “to a house”, namely “a home” 514 and “home” 516. The translator selects “home” 516 to replace “to a house”. Upon selecting an alternative translation, the system modifies the options presented 504. This modification is shown in FIG. 5B.
  • FIG. 5B illustrates an example of how the system modifies the ranked list of translation alternatives upon the selection of the alternative translation “home” 518 by the translator. In the case of the other alternative “a home” 520 in the same column as the selection 518, it is removed from consideration. In other configurations, the alternatives for the same portion as the selection 518 can remain as additional translation alternatives after making a selection. This can be useful if the translator is considering more than one alternative, or wants to test one alternative before ultimately selecting a different alternative. In the illustrated configuration, re-ordering 522 of the remaining alternatives causes a shift in the positioning of the alternative translations, such that several of the most likely translation alternatives are now the least likely alternatives presented, and the remaining alternatives have shifted one place closer to the most likely alternative presented.
  • FIG. 5C illustrates the presentation to the translator of the translation and translation alternatives after re-ordering the translation alternatives following the selection of “home” 528 by the translator. The machine translation 502 remains identical to the machine translation of FIG. 5A, because the source text was not re-translated. The machine translation 502 remains constant as a base from which the translator can compare the current revision 526 to the original machine translation 502. The current revision, or Final Version 526, is the original machine translation with portions replaced by any selections 528 or corrections made by the translator. In this example, the only change between the machine translation 502 and the current revision is that “to a house” has been replaced with “home” in the final portion of the sentence, based on the selection of “home” 528 in the options presented 528. Many of the remaining alternative translations shown in the Options Presented 524 are in a different order than originally presented 504 in FIG. 5A, based on the changes made and illustrated in FIG. 5B. This process of presenting a machine translation and translation alternatives to a human translator, receiving input using the translation alternatives presented or input directly from the human translator, and updating the translation alternatives can continue until receiving input from the translator that the translation is sufficiently accurate. At that point, the system can present the next translation segment and its associated translation alternatives to the translator.
  • Having disclosed some basic system components and concepts, the disclosure now turns to the exemplary method embodiment shown in FIG. 6. For the sake of clarity, the method is discussed in terms of an exemplary system 100 as shown in FIG. 1 configured to practice the method. The steps outlined herein are exemplary and can be implemented in any combination thereof, including combinations that exclude, add, or modify certain steps.
  • The system 100 receives a source text (602) and generates a machine translation of the source text accompanied by a list of alternative translation possibilities (604). The system 100 then ranks the list of alternative translation possibilities, yielding a ranked list of translation alternatives in a first order (606). The machine translation and the ranked list of translation alternatives in the first order are presented to a user (608), wherein the user is participating in a collaborative translation of the source text with at least one other entity, at which point the system receives an input from the user associated with the ranked list of translation alternatives (610). This input can be one of the alternatives, or can be an alternative translation entered by user not previously presented by the system 100. For example, the user can select one of the alternatives, or write in their own alternative translation. The system 100 then re-ranks the list of alternative translation possibilities based at least in part on the input, to yield a re-ranked list of translation alternatives in a second order (612). The system 100 can then present this re-ranked list of translation alternatives in a second order, the input, and the machine translation to the user. In one variation, the system can not only re-order the translation alternatives for one user, but for other users in the collaborative translation effort. For example, if a first user enters input which affects the order or rank of the list of alternatives, the system can propagate those changes to other users' lists as well, or can propagate other changes or rank adjustment parameters to other users' lists based at least in part on the input from the first user. In this manner, the efficiency of the collaborative translation can be enhanced, even if participants in the collaborative translation effort are in different locations, or are working at different, non-overlapping times.
  • In one configuration, the system 100 ranks the list of alternative translation possibilities based on the likelihood of the user selecting each translation alternative. This likelihood of selection can be determined from historical trends, crowdsourcing, or previous usage associated with the source text. For example, if a user/translator proofing a machine translation of a specific source text has selected a specific alternative translation multiple times while editing the specific source text, the system 100 can increase the likelihood of subsequent selections in the future and increase the probability for selection of those alternative translations.
  • The alternative translation possibilities correspond to specific portions of the machine translation. Depending upon the configuration, the system 100 can dynamically adjust the size of the specific portions, or the system 100 can have a fixed portions corresponding to words, phrases, sentences, prosaically meaningful phrases, or paragraphs. If the source text being translated is a higher level computing language, and the machine translation is an intermediate, machine code language, the portions can be individual machine code lines or clusters of lines.
  • Embodiments within the scope of the present disclosure may also include tangible and/or non-transitory computer-readable storage media for carrying or having computer-executable instructions or data structures stored thereon. Such non-transitory computer-readable storage media can be any available media that can be accessed by a general purpose or special purpose computer, including the functional design of any special purpose processor as discussed above. By way of example, and not limitation, such non-transitory computer-readable media can include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store desired program code means in the form of computer-executable instructions, data structures, or processor chip design. When information is transferred or provided over a network or another communications connection (either hardwired, wireless, or combination thereof) to a computer, the computer properly views the connection as a computer-readable medium. Thus, any such connection is properly termed a computer-readable medium. Combinations of the above should also be included within the scope of the computer-readable media.
  • Computer-executable instructions include, for example, instructions and data which cause a general purpose computer, special purpose computer, or special purpose processing device to perform a certain function or group of functions. Computer-executable instructions also include program modules that are executed by computers in stand-alone or network environments. Generally, program modules include routines, programs, components, data structures, objects, and the functions inherent in the design of special-purpose processors, etc. that perform particular tasks or implement particular abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of the program code means for executing steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represents examples of corresponding acts for implementing the functions described in such steps.
  • Those of skill in the art will appreciate that other embodiments of the disclosure may be practiced in network computing environments with many types of computer system configurations, including personal computers, hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, and the like. Embodiments may also be practiced in distributed computing environments where tasks are performed by local and remote processing devices that are linked (either by hardwired links, wireless links, or by a combination thereof) through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
  • The various embodiments described above are provided by way of illustration only and should not be construed to limit the scope of the disclosure. For example, the principles herein apply equally to spoken language translations and computer language translations. Those skilled in the art will readily recognize various modifications and changes that may be made to the principles described herein without following the example embodiments and applications illustrated and described herein, and without departing from the spirit and scope of the disclosure.

Claims (20)

What is claimed is:
1. A method comprising:
detecting an input from a first device, the input identifying a translation possibility from a list of alternative translation possibilities;
ranking a list of translation possibilities in a first order based on the input, to yield a ranked list of translation possibilities in a second order;
providing the ranked list of translation possibilities to the first device; and
facilitating a transfer of the ranked list of translation possibilities to a second device for display, wherein the ranked list of translation possibilities is presented contemporaneously to both the first device and the second device.
2. The method of claim 1, wherein the list of translation possibilities was previously ranked such that the ranking comprises a re-ranking of the list of translation possibilities.
3. The method of claim 1, wherein the list of translation possibilities in the first order comprises machine translations of a source text in an original language distinct from machine translations.
4. The method of claim 1, wherein the list of translation possibilities and the list of alternative translation possibilities are contemporaneously presented to a single device allowing a first user and a second user to participate in a collaborative translation of a source text.
5. The method of claim 1, further comprising providing to the first device a machine translation, the input, and the ranked list of translation possibilities in the second order.
6. The method of claim 1, wherein a ranking of the list of alternative translation possibilities is based on a likelihood of each translation alternative of the ranked list of translation possibilities being selected by a first user using the first device.
7. The method of claim 6, wherein the likelihood of each translation alternative being selected via the first device is determined from one of historical trends, crowdsourcing, previous usage associated with a source text, or a combination thereof.
8. The method of claim 7, wherein the list of alternative translation possibilities comprises alternative portions associated with machine translation portions.
9. The method of claim 8, wherein the machine translation portions comprise one of a line of machine code and a cluster of machine code lines.
10. The method of claim 1, wherein the input from the first device comprises one of a selection from the ranked list of translation possibilities and a non-predetermined translation alternative from the first device.
11. A system comprising:
a processor; and
a memory that stores executable instructions that, when executed by the processor, cause the processor to perform operations comprising:
detecting an input from a first device, the input identifying a translation possibility from a list of alternative translation possibilities;
ranking a list of translation possibilities in a first order based on the input, to yield a ranked list of translation possibilities in a second order;
providing the ranked list of translation possibilities to the first device; and
facilitating a transfer of the ranked list of translation possibilities to a second device for display, wherein the ranked list of translation possibilities is presented contemporaneously to both the first device and the second device.
12. The system of claim 11, wherein the list of translation possibilities was previously ranked such that the ranking comprises a re-ranking of the list of translation possibilities.
13. The system of claim 11, wherein the list of translation possibilities in the first order comprises machine translations of a source text in an original language distinct from machine translations.
14. The system of claim 11, wherein the list of translation possibilities and the list of alternative translation possibilities are contemporaneously presented to a single device allowing a first user and a second user to participate in a collaborative translation of a source text.
15. The system of claim 11, wherein the memory stores additional instructions which, when executed by the processor, cause the processor to perform further operations comprising:
providing to the first device a machine translation, the input, and the ranked list of translation possibilities in the second order.
16. The system of claim 11, wherein a ranking of the list of alternative translation possibilities is based on a likelihood of each translation alternative of the ranked list of translation possibilities being selected by a first user using the first device.
17. The system of claim 16, wherein the likelihood of each translation alternative being selected via the first device is determined from one of historical trends, crowdsourcing, previous usage associated with a source text, or a combination thereof.
18. The system of claim 17, wherein the list of alternative translation possibilities comprises alternative portions associated with machine translation portions.
19. The system of claim 18, wherein the machine translation portions comprise one of a line of machine code and a cluster of machine code lines.
20. The system of claim 11, wherein the input from the first device comprises one of a selection from the ranked list of translation possibilities and a non-predetermined translation alternative from the first device.
US15/423,142 2011-12-06 2017-02-02 System and method for collaborative language translation Abandoned US20170147563A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/423,142 US20170147563A1 (en) 2011-12-06 2017-02-02 System and method for collaborative language translation

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/311,836 US9323746B2 (en) 2011-12-06 2011-12-06 System and method for collaborative language translation
US15/075,265 US9563625B2 (en) 2011-12-06 2016-03-21 System and method for collaborative language translation
US15/423,142 US20170147563A1 (en) 2011-12-06 2017-02-02 System and method for collaborative language translation

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US15/075,265 Continuation US9563625B2 (en) 2011-12-06 2016-03-21 System and method for collaborative language translation

Publications (1)

Publication Number Publication Date
US20170147563A1 true US20170147563A1 (en) 2017-05-25

Family

ID=48524621

Family Applications (3)

Application Number Title Priority Date Filing Date
US13/311,836 Active 2032-11-05 US9323746B2 (en) 2011-12-06 2011-12-06 System and method for collaborative language translation
US15/075,265 Active US9563625B2 (en) 2011-12-06 2016-03-21 System and method for collaborative language translation
US15/423,142 Abandoned US20170147563A1 (en) 2011-12-06 2017-02-02 System and method for collaborative language translation

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US13/311,836 Active 2032-11-05 US9323746B2 (en) 2011-12-06 2011-12-06 System and method for collaborative language translation
US15/075,265 Active US9563625B2 (en) 2011-12-06 2016-03-21 System and method for collaborative language translation

Country Status (1)

Country Link
US (3) US9323746B2 (en)

Families Citing this family (188)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US10319252B2 (en) 2005-11-09 2019-06-11 Sdl Inc. Language capability assessment and training apparatus and techniques
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US9235573B2 (en) 2006-10-10 2016-01-12 Abbyy Infopoisk Llc Universal difference measure
US8145473B2 (en) 2006-10-10 2012-03-27 Abbyy Software Ltd. Deep model statistics method for machine translation
US8195447B2 (en) 2006-10-10 2012-06-05 Abbyy Software Ltd. Translating sentences between languages using language-independent semantic structures and ratings of syntactic constructions
US9495358B2 (en) 2006-10-10 2016-11-15 Abbyy Infopoisk Llc Cross-language text clustering
US9633005B2 (en) 2006-10-10 2017-04-25 Abbyy Infopoisk Llc Exhaustive automatic processing of textual information
US8959011B2 (en) * 2007-03-22 2015-02-17 Abbyy Infopoisk Llc Indicating and correcting errors in machine translation systems
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US10002189B2 (en) 2007-12-20 2018-06-19 Apple Inc. Method and apparatus for searching using an active ontology
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US9798720B2 (en) 2008-10-24 2017-10-24 Ebay Inc. Hybrid machine translation
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US20120311585A1 (en) 2011-06-03 2012-12-06 Apple Inc. Organizing task items that represent tasks to perform
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
US10417646B2 (en) 2010-03-09 2019-09-17 Sdl Inc. Predicting the cost associated with translating textual content
US9063931B2 (en) * 2011-02-16 2015-06-23 Ming-Yuan Wu Multiple language translation system
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US11003838B2 (en) 2011-04-18 2021-05-11 Sdl Inc. Systems and methods for monitoring post translation editing
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
WO2013102052A1 (en) * 2011-12-28 2013-07-04 Bloomberg Finance L.P. System and method for interactive automatic translation
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US10417037B2 (en) 2012-05-15 2019-09-17 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US10261994B2 (en) 2012-05-25 2019-04-16 Sdl Inc. Method and system for automatic management of reputation of translators
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
US10331793B2 (en) * 2012-10-17 2019-06-25 Proz.Com Method and apparatus to facilitate high-quality translation of texts by multiple translators
US9152622B2 (en) * 2012-11-26 2015-10-06 Language Weaver, Inc. Personalized machine translation via online adaptation
US9817821B2 (en) * 2012-12-19 2017-11-14 Abbyy Development Llc Translation and dictionary selection by context
KR102516577B1 (en) 2013-02-07 2023-04-03 애플 인크. Voice trigger for a digital assistant
US10652394B2 (en) 2013-03-14 2020-05-12 Apple Inc. System and method for processing voicemail
US10748529B1 (en) 2013-03-15 2020-08-18 Apple Inc. Voice activated device for use with a voice-based digital assistant
US9183198B2 (en) * 2013-03-19 2015-11-10 International Business Machines Corporation Customizable and low-latency interactive computer-aided translation
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
EP3008641A1 (en) 2013-06-09 2016-04-20 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US20150081893A1 (en) * 2013-09-17 2015-03-19 Netapp. Inc. Fabric attached storage
US9213694B2 (en) 2013-10-10 2015-12-15 Language Weaver, Inc. Efficient online domain adaptation
US10296160B2 (en) 2013-12-06 2019-05-21 Apple Inc. Method for extracting salient dialog usage from live data
RU2592395C2 (en) 2013-12-19 2016-07-20 Общество с ограниченной ответственностью "Аби ИнфоПоиск" Resolution semantic ambiguity by statistical analysis
RU2586577C2 (en) 2014-01-15 2016-06-10 Общество с ограниченной ответственностью "Аби ИнфоПоиск" Filtering arcs parser graph
US9881006B2 (en) 2014-02-28 2018-01-30 Paypal, Inc. Methods for automatic generation of parallel corpora
US9569526B2 (en) * 2014-02-28 2017-02-14 Ebay Inc. Automatic machine translation using user feedback
US9940658B2 (en) 2014-02-28 2018-04-10 Paypal, Inc. Cross border transaction machine translation
US9530161B2 (en) 2014-02-28 2016-12-27 Ebay Inc. Automatic extraction of multilingual dictionary items from non-parallel, multilingual, semi-structured data
US9842101B2 (en) * 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
EP3149728B1 (en) 2014-05-30 2019-01-16 Apple Inc. Multi-command single utterance input method
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9760559B2 (en) * 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US20160140244A1 (en) * 2014-08-20 2016-05-19 Boomalang Company Systems and methods for connecting native language speakers and second language learners across a network
US20160055148A1 (en) * 2014-08-22 2016-02-25 Mr. Ravi Kumar Govindan TranslateMe - Software Application to Translate Message(s)/Picture(s) through Human Collaboration
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US9805028B1 (en) 2014-09-17 2017-10-31 Google Inc. Translating terms using numeric representations
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US9626358B2 (en) 2014-11-26 2017-04-18 Abbyy Infopoisk Llc Creating ontologies by analyzing natural language texts
WO2016137470A1 (en) * 2015-02-26 2016-09-01 Hewlett Packard Enterprise Development Lp Obtaining translations utilizing test step and subject application displays
US10152299B2 (en) 2015-03-06 2018-12-11 Apple Inc. Reducing response latency of intelligent automated assistants
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
CN104731776B (en) * 2015-03-27 2017-12-26 百度在线网络技术(北京)有限公司 The offer method and system of translation information
US10460227B2 (en) 2015-05-15 2019-10-29 Apple Inc. Virtual assistant in a communication session
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10200824B2 (en) 2015-05-27 2019-02-05 Apple Inc. Systems and methods for proactively identifying and surfacing relevant content on a touch-sensitive device
US20160350289A1 (en) 2015-06-01 2016-12-01 Linkedln Corporation Mining parallel data from user profiles
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US20160378747A1 (en) 2015-06-29 2016-12-29 Apple Inc. Virtual assistant for media playback
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10331312B2 (en) 2015-09-08 2019-06-25 Apple Inc. Intelligent automated assistant in a media environment
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10740384B2 (en) 2015-09-08 2020-08-11 Apple Inc. Intelligent automated assistant for media search and playback
US11010550B2 (en) * 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10956666B2 (en) 2015-11-09 2021-03-23 Apple Inc. Unconventional virtual assistant interactions
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US9747281B2 (en) * 2015-12-07 2017-08-29 Linkedin Corporation Generating multi-language social network user profiles by translation
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
KR20170079173A (en) 2015-12-30 2017-07-10 삼성전자주식회사 Method for collecting translation content and translation server
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US10430522B2 (en) * 2016-03-15 2019-10-01 Qordoba, Inc. Dynamic suggestions for content translation
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US11227589B2 (en) 2016-06-06 2022-01-18 Apple Inc. Intelligent list reading
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179309B1 (en) 2016-06-09 2018-04-23 Apple Inc Intelligent automated assistant in a home environment
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
US9922029B1 (en) * 2016-06-30 2018-03-20 Facebook, Inc. User feedback for low-confidence translations
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
CN107818086B (en) * 2016-09-13 2021-08-10 株式会社东芝 Machine translation method and device
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10229113B1 (en) 2016-09-28 2019-03-12 Amazon Technologies, Inc. Leveraging content dimensions during the translation of human-readable languages
US10261995B1 (en) * 2016-09-28 2019-04-16 Amazon Technologies, Inc. Semantic and natural language processing for content categorization and routing
US10235362B1 (en) 2016-09-28 2019-03-19 Amazon Technologies, Inc. Continuous translation refinement with automated delivery of re-translated content
US10275459B1 (en) 2016-09-28 2019-04-30 Amazon Technologies, Inc. Source language content scoring for localizability
US10223356B1 (en) 2016-09-28 2019-03-05 Amazon Technologies, Inc. Abstraction of syntax in localization through pre-rendering
US20180143975A1 (en) * 2016-11-18 2018-05-24 Lionbridge Technologies, Inc. Collection strategies that facilitate arranging portions of documents into content collections
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
US10235363B2 (en) 2017-04-28 2019-03-19 Sap Se Instant translation of user interfaces of a web application
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
DK201770383A1 (en) 2017-05-09 2018-12-14 Apple Inc. User interface for correcting recognition errors
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
DK201770439A1 (en) 2017-05-11 2018-12-13 Apple Inc. Offline personal assistant
DK180048B1 (en) 2017-05-11 2020-02-04 Apple Inc. MAINTAINING THE DATA PROTECTION OF PERSONAL INFORMATION
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK201770429A1 (en) 2017-05-12 2018-12-14 Apple Inc. Low-latency intelligent automated assistant
US11301477B2 (en) 2017-05-12 2022-04-12 Apple Inc. Feedback analysis of a digital assistant
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
DK201770432A1 (en) 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
DK201770431A1 (en) 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
DK179560B1 (en) 2017-05-16 2019-02-18 Apple Inc. Far-field extension for digital assistant services
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
US20180336892A1 (en) 2017-05-16 2018-11-22 Apple Inc. Detecting a trigger of a digital assistant
US20180336275A1 (en) 2017-05-16 2018-11-22 Apple Inc. Intelligent automated assistant for media exploration
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US10657328B2 (en) 2017-06-02 2020-05-19 Apple Inc. Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10755051B2 (en) 2017-09-29 2020-08-25 Apple Inc. Rule-based natural language processing
US10636424B2 (en) 2017-11-30 2020-04-28 Apple Inc. Multi-turn canned dialog
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US10789959B2 (en) 2018-03-02 2020-09-29 Apple Inc. Training speaker recognition models for digital assistants
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10909331B2 (en) 2018-03-30 2021-02-02 Apple Inc. Implicit identification of translation payload with neural machine translation
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US10984780B2 (en) 2018-05-21 2021-04-20 Apple Inc. Global semantic word embeddings using bi-directional recurrent neural networks
DK201870355A1 (en) 2018-06-01 2019-12-16 Apple Inc. Virtual assistant operation in multi-device environments
DK179822B1 (en) 2018-06-01 2019-07-12 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US11386266B2 (en) 2018-06-01 2022-07-12 Apple Inc. Text correction
DK180639B1 (en) 2018-06-01 2021-11-04 Apple Inc DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
US10496705B1 (en) 2018-06-03 2019-12-03 Apple Inc. Accelerated task performance
US11010561B2 (en) 2018-09-27 2021-05-18 Apple Inc. Sentiment prediction from textual data
US11170166B2 (en) 2018-09-28 2021-11-09 Apple Inc. Neural typographical error modeling via generative adversarial networks
US10839159B2 (en) 2018-09-28 2020-11-17 Apple Inc. Named entity normalization in a spoken dialog system
US11462215B2 (en) 2018-09-28 2022-10-04 Apple Inc. Multi-modal inputs for voice commands
US11475898B2 (en) 2018-10-26 2022-10-18 Apple Inc. Low-latency multi-speaker speech recognition
US11638059B2 (en) 2019-01-04 2023-04-25 Apple Inc. Content playback on multiple devices
US11348573B2 (en) 2019-03-18 2022-05-31 Apple Inc. Multimodality in digital assistant systems
US11307752B2 (en) 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
US11475884B2 (en) 2019-05-06 2022-10-18 Apple Inc. Reducing digital assistant latency when a language is incorrectly determined
US11423908B2 (en) 2019-05-06 2022-08-23 Apple Inc. Interpreting spoken requests
DK201970509A1 (en) 2019-05-06 2021-01-15 Apple Inc Spoken notifications
US11140099B2 (en) 2019-05-21 2021-10-05 Apple Inc. Providing message response suggestions
DK201970510A1 (en) 2019-05-31 2021-02-11 Apple Inc Voice identification in digital assistant systems
US11289073B2 (en) 2019-05-31 2022-03-29 Apple Inc. Device text to speech
DK180129B1 (en) 2019-05-31 2020-06-02 Apple Inc. User activity shortcut suggestions
US11496600B2 (en) 2019-05-31 2022-11-08 Apple Inc. Remote execution of machine-learned models
US11468890B2 (en) 2019-06-01 2022-10-11 Apple Inc. Methods and user interfaces for voice-based control of electronic devices
US11360641B2 (en) 2019-06-01 2022-06-14 Apple Inc. Increasing the relevance of new available information
US11488406B2 (en) 2019-09-25 2022-11-01 Apple Inc. Text detection using global geometry estimators
WO2021139871A1 (en) * 2020-01-08 2021-07-15 Across Systems Gmbh A method for adjusting or amending translated draft text, an electronic device for amending translated draft text, and smart phone app implementing said method
US11061543B1 (en) 2020-05-11 2021-07-13 Apple Inc. Providing relevant data items based on context
US11183193B1 (en) 2020-05-11 2021-11-23 Apple Inc. Digital assistant hardware abstraction
US11755276B2 (en) 2020-05-12 2023-09-12 Apple Inc. Reducing description length based on confidence
US11490204B2 (en) 2020-07-20 2022-11-01 Apple Inc. Multi-device audio adjustment coordination
US11438683B2 (en) 2020-07-21 2022-09-06 Apple Inc. User identification using headphones

Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060123220A1 (en) * 2004-12-02 2006-06-08 International Business Machines Corporation Speech recognition in BIOS
US20060190561A1 (en) * 2002-06-19 2006-08-24 Watchfire Corporation Method and system for obtaining script related information for website crawling
US20060192775A1 (en) * 2005-02-25 2006-08-31 Microsoft Corporation Using detected visual cues to change computer system operating states
US20060259462A1 (en) * 2005-05-12 2006-11-16 Sybase, Inc. System and Methodology for Real-time Content Aggregation and Syndication
US20110066634A1 (en) * 2007-03-07 2011-03-17 Phillips Michael S Sending a communications header with voice recording to send metadata for use in speech recognition, formatting, and search in mobile search application
US8099289B2 (en) * 2008-02-13 2012-01-17 Sensory, Inc. Voice interface and search for electronic devices including bluetooth headsets and remote systems
US20120253785A1 (en) * 2011-04-03 2012-10-04 Microsoft Corporation Translation of multilingual embedded phrases
US20120311476A1 (en) * 2011-06-02 2012-12-06 Alan Stirling Campbell System and method for providing an adaptive touch screen keyboard
US20130033523A1 (en) * 2011-08-04 2013-02-07 Research In Motion Limited Orientation-dependent processing of input files by an electronic device
US20130124185A1 (en) * 2011-11-14 2013-05-16 Amadou Sarr Collaborative Language Translation System
US20130246179A1 (en) * 2010-03-30 2013-09-19 Diy Media, Inc. Method for content management and distribution
US8543397B1 (en) * 2012-10-11 2013-09-24 Google Inc. Mobile device voice activation
US20130279744A1 (en) * 2012-04-23 2013-10-24 Apple Inc. Systems and methods for controlling output of content based on human recognition data detection
US20140122057A1 (en) * 2012-10-26 2014-05-01 Google Inc. Techniques for input method editor language models using spatial input models
US8838455B1 (en) * 2008-06-13 2014-09-16 West Corporation VoiceXML browser and supporting components for mobile devices
US8862475B2 (en) * 2007-04-12 2014-10-14 Nuance Communications, Inc. Speech-enabled content navigation and control of a distributed multimodal browser
US20140365865A1 (en) * 2013-06-06 2014-12-11 International Business Machines Corporation Optimizing loading of web page based on aggregated user preferences for web page elements of web page
US20150116341A1 (en) * 2012-06-18 2015-04-30 Nec Display Solutions, Ltd. Display Device, and Method for Adjusting Display Device

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS61184685A (en) 1985-02-12 1986-08-18 Hitachi Ltd Translation information adding system
JP2892548B2 (en) * 1992-05-25 1999-05-17 シャープ株式会社 Automatic translation device
JP3356536B2 (en) 1994-04-13 2002-12-16 松下電器産業株式会社 Machine translation equipment
CA2286935C (en) 1997-05-28 2001-02-27 Shinar Linguistic Technologies Inc. Translation system
US7162528B1 (en) * 1998-11-23 2007-01-09 The United States Of America As Represented By The Secretary Of The Navy Collaborative environment implemented on a distributed computer network and software therefor
US20060116865A1 (en) 1999-09-17 2006-06-01 Www.Uniscape.Com E-services translation utilizing machine translation and translation memory
US20040205671A1 (en) * 2000-09-13 2004-10-14 Tatsuya Sukehiro Natural-language processing system
US7860706B2 (en) * 2001-03-16 2010-12-28 Eli Abir Knowledge system method and appparatus
JP3933449B2 (en) * 2001-11-22 2007-06-20 株式会社東芝 Communication support device
JP4050950B2 (en) * 2002-07-26 2008-02-20 富士通株式会社 Parallel translation candidate display device and parallel translation candidate display program
US7346487B2 (en) * 2003-07-23 2008-03-18 Microsoft Corporation Method and apparatus for identifying translations
US7539619B1 (en) 2003-09-05 2009-05-26 Spoken Translation Ind. Speech-enabled language translation system and method enabling interactive user supervision of translation and speech recognition accuracy
US8374846B2 (en) * 2005-05-18 2013-02-12 Neuer Wall Treuhand Gmbh Text input device and method
WO2007070558A2 (en) * 2005-12-12 2007-06-21 Meadan, Inc. Language translation using a hybrid network of human and machine translators
GB2433403B (en) * 2005-12-16 2009-06-24 Emil Ltd A text editing apparatus and method
JP5011751B2 (en) * 2006-02-27 2012-08-29 富士通株式会社 Translation information output processing program, processing method, and processing apparatus
US8046233B2 (en) * 2006-11-21 2011-10-25 Lionbridge Technologies, Inc. Methods and systems for local, computer-aided translation using remotely-generated translation predictions
CA2675208A1 (en) 2007-01-10 2008-07-17 National Research Council Of Canada Means and method for automatic post-editing of translations
US7809719B2 (en) * 2007-02-08 2010-10-05 Microsoft Corporation Predicting textual candidates
US7983897B2 (en) * 2007-02-14 2011-07-19 Google Inc. Machine translation feedback
US8326598B1 (en) * 2007-03-26 2012-12-04 Google Inc. Consensus translations from multiple machine translation systems
US7877251B2 (en) 2007-05-07 2011-01-25 Microsoft Corporation Document translation system
WO2009004723A1 (en) * 2007-07-04 2009-01-08 Fujitsu Limited Translation support program, translation support apparatus and method of translation support
US20090037401A1 (en) 2007-07-31 2009-02-05 Microsoft Corporation Information Retrieval and Ranking
JP5572624B2 (en) * 2008-07-03 2014-08-13 グーグル・インコーポレーテッド Parameter optimization for machine translation
US8352244B2 (en) 2009-07-21 2013-01-08 International Business Machines Corporation Active learning systems and methods for rapid porting of machine translation systems to new language pairs or new domains
US20110087961A1 (en) * 2009-10-11 2011-04-14 A.I Type Ltd. Method and System for Assisting in Typing
KR101612788B1 (en) * 2009-11-05 2016-04-18 엘지전자 주식회사 Mobile terminal and method for controlling the same
BR112012012133B1 (en) * 2009-11-20 2021-01-12 Google Llc computer-implemented method, system and computer storage medium for multi-language search options
US8782556B2 (en) * 2010-02-12 2014-07-15 Microsoft Corporation User-centric soft keyboard predictive technologies
US8386235B2 (en) * 2010-05-20 2013-02-26 Acosys Limited Collaborative translation system and method
WO2011163477A2 (en) * 2010-06-24 2011-12-29 Whitesmoke, Inc. Systems and methods for machine translation
US20120206367A1 (en) * 2011-02-14 2012-08-16 Research In Motion Limited Handheld electronic devices with alternative methods for text input
US8996351B2 (en) * 2011-08-24 2015-03-31 Ricoh Company, Ltd. Cloud-based translation service for multi-function peripheral
US8713433B1 (en) * 2012-10-16 2014-04-29 Google Inc. Feature-based autocorrection

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060190561A1 (en) * 2002-06-19 2006-08-24 Watchfire Corporation Method and system for obtaining script related information for website crawling
US20060123220A1 (en) * 2004-12-02 2006-06-08 International Business Machines Corporation Speech recognition in BIOS
US20060192775A1 (en) * 2005-02-25 2006-08-31 Microsoft Corporation Using detected visual cues to change computer system operating states
US20060259462A1 (en) * 2005-05-12 2006-11-16 Sybase, Inc. System and Methodology for Real-time Content Aggregation and Syndication
US20110066634A1 (en) * 2007-03-07 2011-03-17 Phillips Michael S Sending a communications header with voice recording to send metadata for use in speech recognition, formatting, and search in mobile search application
US8862475B2 (en) * 2007-04-12 2014-10-14 Nuance Communications, Inc. Speech-enabled content navigation and control of a distributed multimodal browser
US8099289B2 (en) * 2008-02-13 2012-01-17 Sensory, Inc. Voice interface and search for electronic devices including bluetooth headsets and remote systems
US8838455B1 (en) * 2008-06-13 2014-09-16 West Corporation VoiceXML browser and supporting components for mobile devices
US20130246179A1 (en) * 2010-03-30 2013-09-19 Diy Media, Inc. Method for content management and distribution
US20120253785A1 (en) * 2011-04-03 2012-10-04 Microsoft Corporation Translation of multilingual embedded phrases
US20120311476A1 (en) * 2011-06-02 2012-12-06 Alan Stirling Campbell System and method for providing an adaptive touch screen keyboard
US20130033523A1 (en) * 2011-08-04 2013-02-07 Research In Motion Limited Orientation-dependent processing of input files by an electronic device
US20130124185A1 (en) * 2011-11-14 2013-05-16 Amadou Sarr Collaborative Language Translation System
US20130279744A1 (en) * 2012-04-23 2013-10-24 Apple Inc. Systems and methods for controlling output of content based on human recognition data detection
US20150116341A1 (en) * 2012-06-18 2015-04-30 Nec Display Solutions, Ltd. Display Device, and Method for Adjusting Display Device
US8543397B1 (en) * 2012-10-11 2013-09-24 Google Inc. Mobile device voice activation
US20140122057A1 (en) * 2012-10-26 2014-05-01 Google Inc. Techniques for input method editor language models using spatial input models
US20140365865A1 (en) * 2013-06-06 2014-12-11 International Business Machines Corporation Optimizing loading of web page based on aggregated user preferences for web page elements of web page

Also Published As

Publication number Publication date
US20160203128A1 (en) 2016-07-14
US9323746B2 (en) 2016-04-26
US9563625B2 (en) 2017-02-07
US20130144594A1 (en) 2013-06-06

Similar Documents

Publication Publication Date Title
US9563625B2 (en) System and method for collaborative language translation
US10061769B2 (en) Machine translation method for performing translation between languages
US10726833B2 (en) System and method for rapid customization of speech recognition models
Goo et al. Abstractive dialogue summarization with sentence-gated modeling optimized by dialogue acts
US10628474B2 (en) Probabalistic generation of diverse summaries
Kim et al. Predictor-estimator: neural quality estimation based on target word prediction for machine translation
US8849665B2 (en) System and method of providing machine translation from a source language to a target language
US20170337189A1 (en) Method and system for providing translated result
US11093719B2 (en) Machine translation method and apparatus
US20190026263A1 (en) System and method for unsupervised text normalization using distributed representation of words
JP7111682B2 (en) Speech command matching during testing of a speech-assisted application prototype for languages using non-phonetic writing systems
US9235565B2 (en) Blending customized user dictionaries
US11126794B2 (en) Targeted rewrites
CN112905735A (en) Method and apparatus for natural language processing
US10713288B2 (en) Natural language content generator
JP2004259271A (en) Method and system for language translation
CN110415679B (en) Voice error correction method, device, equipment and storage medium
WO2018057427A1 (en) Syntactic re-ranking of potential transcriptions during automatic speech recognition
CN110457719A (en) A kind of method and device of translation model result reordering
KR102188564B1 (en) Method and system for machine translation capable of style transfer
US11056103B2 (en) Real-time utterance verification system and method thereof
US20230096070A1 (en) Natural-language processing across multiple languages
Cai et al. Query enhanced knowledge-intensive conversation via unsupervised joint modeling
US20230119161A1 (en) Efficient Index Lookup Using Language-Agnostic Vectors and Context Vectors
Xu et al. Complementing GPT-3 with Few-Shot Sequence-to-Sequence Semantic Parsing over Wikidata

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: NUANCE COMMUNICATIONS, INC., MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AT&T INTELLECTUAL PROPERTY I, L. P.;REEL/FRAME:059725/0810

Effective date: 20161214

Owner name: AT&T INTELLECTUAL PROPERTY I, L. P., GEORGIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BANGALORE, SRINIVAS;KUKSENOK, KATERYNA;SIGNING DATES FROM 20111202 TO 20111205;REEL/FRAME:059726/0458