US20100174524A1 - Empirical Methods for Splitting Compound Words with Application to Machine Translation - Google Patents
Empirical Methods for Splitting Compound Words with Application to Machine Translation Download PDFInfo
- Publication number
- US20100174524A1 US20100174524A1 US12/722,470 US72247010A US2010174524A1 US 20100174524 A1 US20100174524 A1 US 20100174524A1 US 72247010 A US72247010 A US 72247010A US 2010174524 A1 US2010174524 A1 US 2010174524A1
- Authority
- US
- United States
- Prior art keywords
- translation
- split
- word
- compounded
- compounded word
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/268—Morphological analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/40—Processing or translation of natural language
- G06F40/42—Data-driven translation
- G06F40/44—Statistical methods, e.g. probability models
Definitions
- Machine translation is the automatic translation from a first language (a “source” language) into another language (a “target” language). Systems that perform an MT process are said to “decode” the source language into the target language.
- a statistical MT system that translates foreign language sentences, e.g., French, into English may include the following components: a language model that assigns a probability P(e) to any English string; a translation model that assigns a probability P(f
- the decoder may take a previously unseen sentence f and try to find the e that maximizes P(elf), or equivalently maximizes P(e)*P(f
- Compounded words may present a challenge for MT systems.
- Compounding of words is common in a number of languages (e.g., German, Dutch, Finnish, and Greek).
- An example of a compounded word is the German word “Aktionsplan”, which was created by joining the words “Akom” and “Plan”. Words may be joined freely in such languages, which may greatly increase the vocabulary size of such languages.
- a statistical machine translation (MT) system may include a compound splitting module to split compounded words (“compounds”) for more accurate translation.
- the compound splitting module select a best split for translation by the MT system.
- the compound splitting module may identify split option(s) for a compound, rank the compounds, and then pick a best translation from the compound and split option(s).
- the compound splitting module may rank using different metrics, e.g., frequency of a split's parts in a corpus or translations of the compound in a translation lexicon.
- the compound splitting module may exclude split options based on parts-of-speech they contain, e.g., prepositions and determiners.
- FIG. 1 is a block diagram of a statistical machine translation (MT) system including a compound splitting module according to an embodiment.
- MT statistical machine translation
- FIG. 2 is a block diagram of a compound splitting module.
- FIG. 3 is a flowchart describing a compound splitting operation.
- FIG. 4 shows splitting options for the compounded German word “Aktionsplan”.
- FIG. 5 shows correspondences between the splitting options for “Aktionsplan” and the English translation.
- FIG. 1 illustrates a statistical machine translation (MT) system 100 according to an embodiment.
- the MT system 100 may be used to translate from a source language (e.g., French) to a target language (e.g., English).
- the MT system 100 may include a language model 105 , a translation model 110 , and a decoder 115 .
- the MT system 100 may be based on a source-channel model.
- the language model 105 (or “source”) may assign a probability P(e) to any given English sentence e.
- the language model 105 may be an n-gram model trained by a large monolingual corpus to determine the probability of a word sequence.
- the translation model 110 may be used to determine the probability of correctness for a translation, e.g., the probability P(f
- e) may be learned from a parallel corpus including bilingual sentence pairs.
- the translation model 110 may be, for example, an IBM translation model 4, described in U.S. Pat. No. 5,477,451.
- the decoder may be used to identify the best translation by maximizing the product of P(e)*P(f
- Compounding of words is common in a number of languages (e.g., German, Dutch, Finnish, and Greek).
- the compounded words may greatly increase the vocabulary size of such languages, which may present a challenge for MT systems.
- the MT system 100 may include a compound splitting module 120 to determine if and how a compounded word should be split in a translation operation.
- FIG. 2 shows various components of the compound splitting module 120 . These components may include a split generator 205 , a frequency module 210 , a primary translation lexicon 215 , a secondary translation lexicon 220 , a part-of-speech (POS) module 225 , and a split selector 230 .
- POS part-of-speech
- FIG. 3 is a flowchart describing operations that may be performed by the compound splitting module in an MT system for translating German sentences into English.
- the split generator 205 may split a German word into possible split options (or “splits”) (block 305 ), e.g., into parts that have individual translations into English words.
- the frequency module 210 may select split(s) based on the frequencies of the splits' parts in the corpus (block 310 ).
- the primary translation 215 lexicon may check if the splits have corresponding translations in the English translation of the sentence (block 315 ), and the secondary translation lexicon 320 may be used to account for special cases (block 320 ).
- the POS module 325 may qualify the splits based on statistics of parts-of-speech in the translation lexicon (block 325 ).
- the split selector 230 may then select the best split (block 330 ).
- the split generator 205 may use known words, e.g., words existing in a training corpus 150 ( FIG. 1 ) to identify possible splittings of a compound.
- the training corpus used was Europarl, which is derived from the European legislation proceedings and consists of 20 million words of German (available at http://www.isi.edu/publications/europarl/).
- the known words may be stored in a hash table based on the first three letters.
- the known words in the hash table may be limited to words having at least three letters.
- the split generator 205 may account for filler letters between words in the compound.
- the letter “s” is a filler letter in “Aktionsplan”, which is a compound of the words “Akom” and “Plan”.
- the filler letters “s” and “es” may be allowed when splitting German words, which covers most cases.
- the splits may be generated using an exhaustive recursive search. As shown in FIG. 4 , the split generator may generate the following splits for “Aktionsplan”: “fracsplan”; “sure-plan”; “sures-plan”; and “akt-ion-plan”. Each part of the splits (i.e., “relysplan”, “sures”, “tim”, “akt”, “ion”, and “plan”) exist as whole words in the training corpus.
- the frequency module 210 may identify the split having a highest probability based on word frequency. Given the count of words in the corpus, the frequency module may select the split S with the highest geometric mean of word frequencies of its parts p i (n being the number of parts):
- the frequency module 210 utilizes a metric based on word frequency.
- the metric is based on the assumption that the more frequent a word occurs in a training corpus, the larger the statistical basis to estimate translation probabilities, and the more likely the correct translation probability distribution will be learned. However, since this metric is defined purely in terms of German word frequencies, there is not necessarily a relationship between the selected option and correspondence to English words. If a compound occurs more frequently in the text than its parts, this metric would leave the compound unbroken, even if it is translated in parts into English. In fact, this is the case for the example “Aktionsplan”. As shown in Table 1, the mean score for the unbroken compound (852) is higher than the preferred choice (825.6).
- the translation lexicons may be used to improve one-to-one correspondence with English.
- the primary translation lexicon 215 can check for each split whether that split's parts have translations in the English translation of the foreign language sentence(s) in the parallel corpus containing the compound.
- the words “action” and “plan” would be expected on the English side, as shown in FIG. 5 .
- “Freitag” the words “free” and “day” would not be expected. This information may be used by the compound splitting module 120 to break up “Aktionsplan”, but not “Freitag”.
- the primary translation lexicon 215 may be learned from the parallel corpus 150 . This can be done with the toolkit Giza, which establishes word-alignments for the sentences in the two languages.
- the toolkit Giza is described in Al-Onaizan et al., “Statistical machine translation,” Technical report, John Hopkins University Summer Workshop (1999).
- the primary translation lexicon 215 may require that the translation probability of the English word given the German word be at least 0.01. Also, each English word may be considered only once. If a word is taken as evidence for correspondence to the first part of the compound, that word is excluded as evidence for the other parts. If multiple options match the English, the one(s) with the most splits may be selected and word frequencies may be used as a tie-breaker.
- the second translation lexicon 220 may be used to account for such special cases. German words in the parallel corpus 150 may be broken up with the frequency method. Then, the translation lexicon may be trained using Giza from the parallel corpus with split German and unchanged English. Since in this corpus “Grund” is often broken off from a compound, the compound splitting module learns the translation table entry “Grund” q “basic”. By joining the two translation lexicons, the same method may be applied, but this time with the correct split of “Grundrechte”.
- a vast amount of splitting knowledge (for this data, 75,055 different words) is acquired by splitting all the words on the German side of the parallel corpus. This knowledge contains for instance that “Grundrechte” was split up 213 times and kept together 17 times.
- the compound splitting module 120 may use the most frequent option based on the splitting knowledge. If the word has not been seen before, the compound splitting module may use the frequency method as a back-off.
- the POS module 225 may be used to prevent errors involving the splitting off of prefixes and suffixes. For instance, the word “ur” (English: “following”) may be broken off into “ stages” (English: “consequences”) and den (English: “the”). This occurs because the word “the” is commonly found in English sentences, and therefore taken as evidence for the existence of a translation for “den”. Another example for this is the word “Vorausry” (English: “condition”), which is split into “vor” and “ausry”. The word “vor” translates to many different prepositions, which frequently occur in English.
- the POS module 225 may only break compounds into content words, e.g., nouns, adverbs, adjectives, and verbs, and not prepositions or determiners.
- the German corpus may be tagged with POS tags using a tagger, e.g., the TnT tagger, which is described in Brants, T., “TnT—a statistical part-of-speech tagger,” Proceedings of the Sixth Applied Natural Language Processing Conference ANLP (2000).
- the POS module 225 may obtain statistics on the POS of words in the corpus and use this information to exclude words based on their POS as possible parts of compounds.
- the performance of the compound splitting module 120 was evaluated on a blind test set of 1000 NP/PPs, which contained 3498 words. To test one-to-one correspondence of split or not-split German words into parts that have a one-to-one translation correspondence to English words, the test set was manually annotated with correct splits. The splitting techniques were then evaluated against this gold standard. The results of this evaluation are given in Table 3.
- correct-split refers to words that should be split and were split correctly. “Correct-not” refers to words that should not be split and were not split. “Wrong-not” refers to words that should be split but Were not split. “Wrong-faulty” refers to words that should be split, were split, but incorrectly (either too much or too little). “Wrong-split” refers towards that should not be split, but were split. “Precision” is the ratio of (correct split)/(correct split+wrong faulty split+wrong superfluous split). “Recall” is the ratio or (correct split)/(correct split+wrong faulty split+wrong not split). “Accuracy” is the ratio of (correct)/(correct+wrong).
- “raw” refers to the results with unprocessed data with no splits.
- “Eager” refers to the biggest split, i.e., the compound split into as many parts as possible. If multiple biggest splits are possible, the one with the highest frequency score is taken.
- the “frequency based” method the word is split into most frequent words.
- the split is guided by splitting knowledge from a parallel corpus.
- the split is guided by splitting knowledge from a parallel corpus with an additional restriction on the POS of split parts.
- the frequency based method produced better translation quality than the more accurate methods that take advantage of knowledge obtained from the parallel corpus.
- One reason for this may be that the system recovers more easily from words that are split too much than from words that are not split up sufficiently.
- this has limitations as shown by the poor results of the eager method.
- the translation quality was also tested using a phrase-based MT system. This system was trained with the different flavors of the training data, and the performance was evaluated as before.
- the eager-splitting method that performed poorly with the word-based statistical MT system gave the best results.
- the task of deciding the granularity of good splits may be deferred to the phrase-based statistical MT system, which uses a statistical method to group phrases and rejoin split words. This turns out to be even slightly better than the frequency based method.
- the words resulting from compound splitting could also be marked as such, and not just treated as regular words.
Abstract
A statistical machine translation (MT) system may include a compound splitting module to split compounded words for more accurate translation. The compound splitting module select a best split for translation by the MT system.
Description
- This application claims priority to U.S. Provisional Application Ser. No. 60/484,812, filed on Jul. 2, 2003, the disclosure of which is incorporated here by reference in its entirety.
- The research and development described in this application were supported by DARPA under grant number N66001-00-1-8914. The U.S. Government may have certain rights in the claimed inventions.
- Machine translation (MT) is the automatic translation from a first language (a “source” language) into another language (a “target” language). Systems that perform an MT process are said to “decode” the source language into the target language.
- A statistical MT system that translates foreign language sentences, e.g., French, into English may include the following components: a language model that assigns a probability P(e) to any English string; a translation model that assigns a probability P(f|e) to any pair of English and French strings; and a decoder. The decoder may take a previously unseen sentence f and try to find the e that maximizes P(elf), or equivalently maximizes P(e)*P(f|e).
- Compounded words may present a challenge for MT systems. Compounding of words is common in a number of languages (e.g., German, Dutch, Finnish, and Greek). An example of a compounded word is the German word “Aktionsplan”, which was created by joining the words “Aktion” and “Plan”. Words may be joined freely in such languages, which may greatly increase the vocabulary size of such languages.
- A statistical machine translation (MT) system may include a compound splitting module to split compounded words (“compounds”) for more accurate translation. The compound splitting module select a best split for translation by the MT system.
- The compound splitting module may identify split option(s) for a compound, rank the compounds, and then pick a best translation from the compound and split option(s). The compound splitting module may rank using different metrics, e.g., frequency of a split's parts in a corpus or translations of the compound in a translation lexicon. The compound splitting module may exclude split options based on parts-of-speech they contain, e.g., prepositions and determiners.
-
FIG. 1 is a block diagram of a statistical machine translation (MT) system including a compound splitting module according to an embodiment. -
FIG. 2 is a block diagram of a compound splitting module. -
FIG. 3 is a flowchart describing a compound splitting operation. -
FIG. 4 shows splitting options for the compounded German word “Aktionsplan”. -
FIG. 5 shows correspondences between the splitting options for “Aktionsplan” and the English translation. -
FIG. 1 illustrates a statistical machine translation (MT)system 100 according to an embodiment. TheMT system 100 may be used to translate from a source language (e.g., French) to a target language (e.g., English). TheMT system 100 may include a language model 105, atranslation model 110, and adecoder 115. - The
MT system 100 may be based on a source-channel model. The language model 105 (or “source”) may assign a probability P(e) to any given English sentence e. The language model 105 may be an n-gram model trained by a large monolingual corpus to determine the probability of a word sequence. Thetranslation model 110 may be used to determine the probability of correctness for a translation, e.g., the probability P(f|e) of a French string f given an English string e. The parameter values for computing P(f|e) may be learned from a parallel corpus including bilingual sentence pairs. Thetranslation model 110 may be, for example, an IBM translation model 4, described in U.S. Pat. No. 5,477,451. The decoder may be used to identify the best translation by maximizing the product of P(e)*P(f|e). - Compounding of words is common in a number of languages (e.g., German, Dutch, Finnish, and Greek). The compounded words (or “compounds”) may greatly increase the vocabulary size of such languages, which may present a challenge for MT systems.
- In an embodiment, the
MT system 100 may include acompound splitting module 120 to determine if and how a compounded word should be split in a translation operation.FIG. 2 shows various components of thecompound splitting module 120. These components may include asplit generator 205, afrequency module 210, aprimary translation lexicon 215, asecondary translation lexicon 220, a part-of-speech (POS)module 225, and asplit selector 230. -
FIG. 3 is a flowchart describing operations that may be performed by the compound splitting module in an MT system for translating German sentences into English. Thesplit generator 205 may split a German word into possible split options (or “splits”) (block 305), e.g., into parts that have individual translations into English words. Thefrequency module 210 may select split(s) based on the frequencies of the splits' parts in the corpus (block 310). Theprimary translation 215 lexicon may check if the splits have corresponding translations in the English translation of the sentence (block 315), and thesecondary translation lexicon 320 may be used to account for special cases (block 320). ThePOS module 325 may qualify the splits based on statistics of parts-of-speech in the translation lexicon (block 325). Thesplit selector 230 may then select the best split (block 330). - The
split generator 205 may use known words, e.g., words existing in a training corpus 150 (FIG. 1 ) to identify possible splittings of a compound. In an experiment, the training corpus used was Europarl, which is derived from the European parliament proceedings and consists of 20 million words of German (available at http://www.isi.edu/publications/europarl/). To speed up word matching, the known words may be stored in a hash table based on the first three letters. The known words in the hash table may be limited to words having at least three letters. - The
split generator 205 may account for filler letters between words in the compound. For example, the letter “s” is a filler letter in “Aktionsplan”, which is a compound of the words “Aktion” and “Plan”. The filler letters “s” and “es” may be allowed when splitting German words, which covers most cases. The splits may be generated using an exhaustive recursive search. As shown inFIG. 4 , the split generator may generate the following splits for “Aktionsplan”: “aktionsplan”; “aktion-plan”; “aktions-plan”; and “akt-ion-plan”. Each part of the splits (i.e., “aktionsplan”, “aktions”, “aktion”, “akt”, “ion”, and “plan”) exist as whole words in the training corpus. - The
frequency module 210 may identify the split having a highest probability based on word frequency. Given the count of words in the corpus, the frequency module may select the split S with the highest geometric mean of word frequencies of its parts pi (n being the number of parts): -
- The
frequency module 210 utilizes a metric based on word frequency. The metric is based on the assumption that the more frequent a word occurs in a training corpus, the larger the statistical basis to estimate translation probabilities, and the more likely the correct translation probability distribution will be learned. However, since this metric is defined purely in terms of German word frequencies, there is not necessarily a relationship between the selected option and correspondence to English words. If a compound occurs more frequently in the text than its parts, this metric would leave the compound unbroken, even if it is translated in parts into English. In fact, this is the case for the example “Aktionsplan”. As shown in Table 1, the mean score for the unbroken compound (852) is higher than the preferred choice (825.6). -
TABLE 1 Frequency of parts Mean score aktionsplan (852) 852 aktion (960), plan (710) 825.6 aktions (5), plan (710) 59.6 akt (224), ion (1), plan (710) 54.2 - On the other hand, a word that has a simple one-to-one correspondence to English may be broken into parts that bear little relation to its meaning. For example, the German word “Freitag” (English: “Friday”) may be broken into “frei” (English: “free”) and “Tag” (English: “day”), as shown in Table 2.
-
TABLE 2 Frequency of parts Mean score frei (885), tag (1864) 1284.4 freitag (556) 556 - The translation lexicons may be used to improve one-to-one correspondence with English. The
primary translation lexicon 215 can check for each split whether that split's parts have translations in the English translation of the foreign language sentence(s) in the parallel corpus containing the compound. In the case of “Aktionsplan”, the words “action” and “plan” would be expected on the English side, as shown inFIG. 5 . In case of “Freitag” the words “free” and “day” would not be expected. This information may be used by thecompound splitting module 120 to break up “Aktionsplan”, but not “Freitag”. - The
primary translation lexicon 215 may be learned from theparallel corpus 150. This can be done with the toolkit Giza, which establishes word-alignments for the sentences in the two languages. The toolkit Giza is described in Al-Onaizan et al., “Statistical machine translation,” Technical report, John Hopkins University Summer Workshop (1999). - To deal with noise in the translation table, the
primary translation lexicon 215 may require that the translation probability of the English word given the German word be at least 0.01. Also, each English word may be considered only once. If a word is taken as evidence for correspondence to the first part of the compound, that word is excluded as evidence for the other parts. If multiple options match the English, the one(s) with the most splits may be selected and word frequencies may be used as a tie-breaker. - While this method has been found to work well for the examples “Aktionsplan” and “Freitag”, it failed in an experiment for words such as “Grundrechte” (English: “basic rights”). This word should be broken into the two parts “Grund” and “Rechte”. However, “Grund” translates usually as “reason” or “foundation”. But here, the more correct translation is the adjective “basic” or “fundamental”. Such a translation only occurs when “Grund” is used as the first part of a compound.
- The
second translation lexicon 220 may be used to account for such special cases. German words in theparallel corpus 150 may be broken up with the frequency method. Then, the translation lexicon may be trained using Giza from the parallel corpus with split German and unchanged English. Since in this corpus “Grund” is often broken off from a compound, the compound splitting module learns the translation table entry “Grund” q “basic”. By joining the two translation lexicons, the same method may be applied, but this time with the correct split of “Grundrechte”. - A vast amount of splitting knowledge (for this data, 75,055 different words) is acquired by splitting all the words on the German side of the parallel corpus. This knowledge contains for instance that “Grundrechte” was split up 213 times and kept together 17 times. When making splitting decisions for new texts, the
compound splitting module 120 may use the most frequent option based on the splitting knowledge. If the word has not been seen before, the compound splitting module may use the frequency method as a back-off. - The
POS module 225 may be used to prevent errors involving the splitting off of prefixes and suffixes. For instance, the word “folgenden” (English: “following”) may be broken off into “folgen” (English: “consequences”) and den (English: “the”). This occurs because the word “the” is commonly found in English sentences, and therefore taken as evidence for the existence of a translation for “den”. Another example for this is the word “Voraussetzung” (English: “condition”), which is split into “vor” and “aussetzung”. The word “vor” translates to many different prepositions, which frequently occur in English. - To exclude these mistakes, the
POS module 225 may only break compounds into content words, e.g., nouns, adverbs, adjectives, and verbs, and not prepositions or determiners. The German corpus may be tagged with POS tags using a tagger, e.g., the TnT tagger, which is described in Brants, T., “TnT—a statistical part-of-speech tagger,” Proceedings of the Sixth Applied Natural Language Processing Conference ANLP (2000). - The
POS module 225 may obtain statistics on the POS of words in the corpus and use this information to exclude words based on their POS as possible parts of compounds. - Experiments were performed using a corpus of 650,000 NP/PPs. The corpus included an English translation for each German NP/PP. The corpus was extracted from the Europarl corpus with the help of a German and English statistical parser. This limitation was made for computational reasons, since most compounds were expected to be nouns. An evaluation of full sentences is expected to show similar results.
- The performance of the
compound splitting module 120 was evaluated on a blind test set of 1000 NP/PPs, which contained 3498 words. To test one-to-one correspondence of split or not-split German words into parts that have a one-to-one translation correspondence to English words, the test set was manually annotated with correct splits. The splitting techniques were then evaluated against this gold standard. The results of this evaluation are given in Table 3. -
TABLE 3 correct wrong metrics Method split not not faulty split prec. recall acc. Raw 0 3296 202 0 0 — 0.0% 94.2% Eager 148 2901 3 51 397 24.8% 73.3% 87.1% Fre- 175 3176 19 8 122 57.4% 96.6% 95.7% quency based Parallel 180 3270 13 9 27 83.3% 89.1% 98.6% Parallel 182 3287 18 2 10 93.8% 90.1% 99.1% and POS - In the columns, “correct-split” refers to words that should be split and were split correctly. “Correct-not” refers to words that should not be split and were not split. “Wrong-not” refers to words that should be split but Were not split. “Wrong-faulty” refers to words that should be split, were split, but incorrectly (either too much or too little). “Wrong-split” refers towards that should not be split, but were split. “Precision” is the ratio of (correct split)/(correct split+wrong faulty split+wrong superfluous split). “Recall” is the ratio or (correct split)/(correct split+wrong faulty split+wrong not split). “Accuracy” is the ratio of (correct)/(correct+wrong).
- In the rows, “raw” refers to the results with unprocessed data with no splits. “Eager” refers to the biggest split, i.e., the compound split into as many parts as possible. If multiple biggest splits are possible, the one with the highest frequency score is taken. In the “frequency based” method, the word is split into most frequent words. In the “parallel” method, the split is guided by splitting knowledge from a parallel corpus. In the combined “parallel and POS” method the split is guided by splitting knowledge from a parallel corpus with an additional restriction on the POS of split parts.
- For one-to-one correspondence, the most sophisticated method that employs splitting knowledge from a parallel corpus and information about POS tags provides the best results, with 99.1% accuracy. The main remaining source of error is the lack of training data. For instance, the method failed on more obscure words such as “Passagier-aufkommen” (English: “passenger volume”), where even some of the parts have not been seen in the training corpus.
- An experiment was performed to test translation quality with a word-based MT system. The translation model used was the IBM Model 4. The system was trained on the 650,000 NP/PPs with the Giza toolkit, and the translation quality was evaluated on the same 1000 NP/PP test set as in experiment described above for one-to-one correspondence. Training and testing data was split consistently in the same way. The translation accuracy is measured against reference translations using the BLEU score, described in Papineni et al., “BLEU: a method for automatic evaluation of machine translation,” Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL) (2002). The results are shown in Table 4.
-
TABLE 4 Method BLEU Raw 0.291 Eager 0.222 Frequency based 0.317 Parallel 0.294 Parallel and POS 0.306 - In this experiment, the frequency based method produced better translation quality than the more accurate methods that take advantage of knowledge obtained from the parallel corpus. One reason for this may be that the system recovers more easily from words that are split too much than from words that are not split up sufficiently. However, this has limitations as shown by the poor results of the eager method.
- Compound words violate the bias for one-to-one word correspondences of word based statistical MT systems. This is one of the motivations for phrase based systems that translate groups of words, such as that described in co-pending application Ser. No. 10/402,350, filed Mar. 27, 2003, which is incorporated herein in its entirety. The results are shown in Table 5.
- The translation quality was also tested using a phrase-based MT system. This system was trained with the different flavors of the training data, and the performance was evaluated as before.
-
TABLE 5 Method BLEU Raw 0.305 Eager 0.344 Frequency based 0.342 Parallel 0.330 Parallel and POS 0.326 - Here, the eager-splitting method that performed poorly with the word-based statistical MT system gave the best results. The task of deciding the granularity of good splits may be deferred to the phrase-based statistical MT system, which uses a statistical method to group phrases and rejoin split words. This turns out to be even slightly better than the frequency based method.
- In an embodiment, the words resulting from compound splitting could also be marked as such, and not just treated as regular words.
- A number of embodiments have been described. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of the invention. For example, blocks in the flowchart may be skipped or performed out of order. Accordingly, other embodiments are within the scope of the following claims.
Claims (20)
1. A method comprising:
identifying one or more split options for a compounded word in a source language, each split option having a translation in a target language;
ranking the compounded word and the one or more split options; and
selecting a translation option from the compounded word and the one or more split options.
2. The method of claim 1 , further comprising:
providing the translation option to a machine translation system for translation into the target language.
3. The method of claim 1 , wherein said ranking comprises:
ranking the compounded word and the one or more split options based on the number of split options.
4. The method of claim 1 , wherein said ranking comprises:
ranking the compounded word and the one or more split options based on the frequency of occurrence of the compounded word and the one or more split options in a source language corpus.
5. The method of claim 1 , wherein said ranking comprises:
identifying a translation pair including the compounded word in a parallel corpus, said translation pair including a translation of the compounded word in the target language; and
comparing the compounded word and the one or more split options to the translation of the compounded word in the target language.
6. The method of claim 1 , wherein said identifying comprises:
excluding a potential split option based on a part-of-speech of said potential split option.
7. The method of claim 6 , wherein the part-of-speech comprises one of a preposition and a determiner.
8. An apparatus comprising:
a split generator to identify one or more split options for a compounded word in a source language, each split option having a translation in a target language;
a module to generate ranking information for the compounded word and the one or more split options; and
a split selector to rank the compounded word and the one or more split options based on the ranking information and select a translation option from the compounded word and the one or more split options.
9. The apparatus of claim 8 , wherein the module comprises:
a frequency module to identify the frequency of occurrence of the compounded word and the one or more split options in a source language corpus.
10. The apparatus of claim 8 , wherein the module comprises:
a translation lexicon to
identify a translation pair including the compounded word in a parallel corpus, said translation pair including a translation of the compounded word in the target language, and
compare the compounded word and the one or more split options to the translation of the compounded word in the target language.
11. The apparatus of claim 8 , wherein the module comprises a translation table generated by splitting compounded words in a parallel corpus and aligning the split compounded words with corresponding target words in the parallel corpus.
12. The apparatus of claim 8 , wherein the module comprises:
a module to exclude a potential split option based on a part-of-speech of said potential split option.
13. The apparatus of claim 12 , wherein the part-of-speech comprises one of a preposition and a determiner.
14. An article comprising a machine-readable medium including machine-executable instructions, the instructions operative to cause a machine to:
identify one or more split options for a compounded word in a source language, each split option having a translation in a target language;
rank the compounded word and the one or more split options; and
select a translation option from the compounded word and the one or more split options.
15. The article of claim 14 , further comprising instructions to cause the machine to:
provide the translation option to a machine translation system for translation into the target language.
16. The article of claim 14 , wherein the instructions for ranking comprise instructions to cause the machine to:
rank the compounded word and the one or more split options based on the number of split options.
17. The article of claim 14 , wherein the instructions for ranking comprise instructions to cause the machine to:
rank the compounded word and the one or more split options based on the frequency of occurrence of the compounded word and the one or more split options in a source language corpus.
18. The article of claim 14 , wherein the instructions for ranking comprise instructions to cause the machine to:
identify a translation pair including the compounded word in a parallel corpus, said translation pair including a translation of the compounded word in the target language; and
compare the compounded word and the one or more split options to the translation of the compounded word in the target language.
19. The article of claim 14 , wherein the instructions for identifying comprise instructions to cause the machine to:
exclude a potential split option based on a part-of-speech of said potential split option.
20. The article of claim 19 , wherein the part-of-speech comprises one of a preposition and a determiner.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/722,470 US20100174524A1 (en) | 2004-07-02 | 2010-03-11 | Empirical Methods for Splitting Compound Words with Application to Machine Translation |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/884,174 US7711545B2 (en) | 2003-07-02 | 2004-07-02 | Empirical methods for splitting compound words with application to machine translation |
US12/722,470 US20100174524A1 (en) | 2004-07-02 | 2010-03-11 | Empirical Methods for Splitting Compound Words with Application to Machine Translation |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/884,174 Continuation US7711545B2 (en) | 2003-07-02 | 2004-07-02 | Empirical methods for splitting compound words with application to machine translation |
Publications (1)
Publication Number | Publication Date |
---|---|
US20100174524A1 true US20100174524A1 (en) | 2010-07-08 |
Family
ID=42312262
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/884,174 Active 2029-02-27 US7711545B2 (en) | 2003-07-02 | 2004-07-02 | Empirical methods for splitting compound words with application to machine translation |
US12/722,470 Abandoned US20100174524A1 (en) | 2004-07-02 | 2010-03-11 | Empirical Methods for Splitting Compound Words with Application to Machine Translation |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/884,174 Active 2029-02-27 US7711545B2 (en) | 2003-07-02 | 2004-07-02 | Empirical methods for splitting compound words with application to machine translation |
Country Status (1)
Country | Link |
---|---|
US (2) | US7711545B2 (en) |
Cited By (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8214196B2 (en) | 2001-07-03 | 2012-07-03 | University Of Southern California | Syntax-based statistical translation model |
US8234106B2 (en) | 2002-03-26 | 2012-07-31 | University Of Southern California | Building a translation lexicon from comparable, non-parallel corpora |
US8296127B2 (en) | 2004-03-23 | 2012-10-23 | University Of Southern California | Discovery of parallel text portions in comparable collections of corpora and training using comparable texts |
US8380486B2 (en) | 2009-10-01 | 2013-02-19 | Language Weaver, Inc. | Providing machine-generated translations and corresponding trust levels |
US8433556B2 (en) | 2006-11-02 | 2013-04-30 | University Of Southern California | Semi-supervised training for statistical word alignment |
US8468149B1 (en) | 2007-01-26 | 2013-06-18 | Language Weaver, Inc. | Multi-lingual online community |
US8548794B2 (en) | 2003-07-02 | 2013-10-01 | University Of Southern California | Statistical noun phrase translation |
US8600728B2 (en) | 2004-10-12 | 2013-12-03 | University Of Southern California | Training for a text-to-text application which uses string to tree conversion for training and decoding |
US8615389B1 (en) | 2007-03-16 | 2013-12-24 | Language Weaver, Inc. | Generation and exploitation of an approximate language model |
US8666725B2 (en) | 2004-04-16 | 2014-03-04 | University Of Southern California | Selection and use of nonstatistical translation components in a statistical machine translation framework |
US8676563B2 (en) | 2009-10-01 | 2014-03-18 | Language Weaver, Inc. | Providing human-generated and machine-generated trusted translations |
US8694303B2 (en) | 2011-06-15 | 2014-04-08 | Language Weaver, Inc. | Systems and methods for tuning parameters in statistical machine translation |
US8825466B1 (en) | 2007-06-08 | 2014-09-02 | Language Weaver, Inc. | Modification of annotated bilingual segment pairs in syntax-based machine translation |
US8831928B2 (en) | 2007-04-04 | 2014-09-09 | Language Weaver, Inc. | Customizable machine translation service |
US8886518B1 (en) | 2006-08-07 | 2014-11-11 | Language Weaver, Inc. | System and method for capitalizing machine translated text |
US8886517B2 (en) | 2005-06-17 | 2014-11-11 | Language Weaver, Inc. | Trust scoring for language translation systems |
US8886515B2 (en) | 2011-10-19 | 2014-11-11 | Language Weaver, Inc. | Systems and methods for enhancing machine translation post edit review processes |
US8943080B2 (en) | 2006-04-07 | 2015-01-27 | University Of Southern California | Systems and methods for identifying parallel documents and sentence fragments in multilingual document collections |
US8942973B2 (en) | 2012-03-09 | 2015-01-27 | Language Weaver, Inc. | Content page URL translation |
US8990064B2 (en) | 2009-07-28 | 2015-03-24 | Language Weaver, Inc. | Translating documents based on content |
US20150186361A1 (en) * | 2013-12-25 | 2015-07-02 | Kabushiki Kaisha Toshiba | Method and apparatus for improving a bilingual corpus, machine translation method and apparatus |
US9122674B1 (en) | 2006-12-15 | 2015-09-01 | Language Weaver, Inc. | Use of annotations in statistical machine translation |
US9152622B2 (en) | 2012-11-26 | 2015-10-06 | Language Weaver, Inc. | Personalized machine translation via online adaptation |
US9213694B2 (en) | 2013-10-10 | 2015-12-15 | Language Weaver, Inc. | Efficient online domain adaptation |
US20170083513A1 (en) * | 2015-09-23 | 2017-03-23 | Alibaba Group Holding Limited | Method and system of performing a translation |
KR101764994B1 (en) | 2013-05-31 | 2017-08-03 | 엠파이어 테크놀로지 디벨롭먼트 엘엘씨 | Incremental reasoning based on scalable and dynamical semantic data |
KR101764941B1 (en) | 2010-01-07 | 2017-08-03 | 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 | Efficient immutable syntax representation with incremental change |
US10261994B2 (en) | 2012-05-25 | 2019-04-16 | Sdl Inc. | Method and system for automatic management of reputation of translators |
US10319252B2 (en) | 2005-11-09 | 2019-06-11 | Sdl Inc. | Language capability assessment and training apparatus and techniques |
CN110097886A (en) * | 2019-04-29 | 2019-08-06 | 贵州小爱机器人科技有限公司 | Intension recognizing method and device, storage medium, terminal |
US10417646B2 (en) | 2010-03-09 | 2019-09-17 | Sdl Inc. | Predicting the cost associated with translating textual content |
US10572976B2 (en) | 2017-10-18 | 2020-02-25 | International Business Machines Corporation | Enhancing observation resolution using continuous learning |
US11003838B2 (en) | 2011-04-18 | 2021-05-11 | Sdl Inc. | Systems and methods for monitoring post translation editing |
Families Citing this family (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7711545B2 (en) * | 2003-07-02 | 2010-05-04 | Language Weaver, Inc. | Empirical methods for splitting compound words with application to machine translation |
US7747428B1 (en) | 2003-09-24 | 2010-06-29 | Yahoo! Inc. | Visibly distinguishing portions of compound words |
US7464020B1 (en) * | 2003-09-24 | 2008-12-09 | Yahoo! Inc. | Visibly distinguishing portions of compound words |
JP4236057B2 (en) * | 2006-03-24 | 2009-03-11 | インターナショナル・ビジネス・マシーンズ・コーポレーション | A system to extract new compound words |
US7860707B2 (en) * | 2006-12-13 | 2010-12-28 | Microsoft Corporation | Compound word splitting for directory assistance services |
US20080221866A1 (en) * | 2007-03-06 | 2008-09-11 | Lalitesh Katragadda | Machine Learning For Transliteration |
US8332207B2 (en) * | 2007-03-26 | 2012-12-11 | Google Inc. | Large language models in machine translation |
US8046355B2 (en) | 2007-09-04 | 2011-10-25 | Google Inc. | Word decompounder |
US8548796B2 (en) * | 2010-01-20 | 2013-10-01 | Xerox Corporation | Statistical machine translation system and method for translation of text into languages which produce closed compound words |
CN102859515B (en) * | 2010-02-12 | 2016-01-13 | 谷歌公司 | Compound word splits |
WO2013091075A1 (en) * | 2011-12-20 | 2013-06-27 | Soschen Alona | Natural language processor |
CN103870472B (en) * | 2012-12-11 | 2018-07-10 | 百度国际科技(深圳)有限公司 | A kind of compound word method for digging and device |
US9460088B1 (en) * | 2013-05-31 | 2016-10-04 | Google Inc. | Written-domain language modeling with decomposition |
CN106462579B (en) * | 2014-10-15 | 2019-09-27 | 微软技术许可有限责任公司 | Dictionary is constructed for selected context |
US10347240B2 (en) | 2015-02-26 | 2019-07-09 | Nantmobile, Llc | Kernel-based verbal phrase splitting devices and methods |
EP3398311B1 (en) * | 2016-03-31 | 2021-05-26 | NEC Laboratories Europe GmbH | Method and system for preserving privacy in an http communication between a client and a server |
US10467114B2 (en) | 2016-07-14 | 2019-11-05 | International Business Machines Corporation | Hierarchical data processor tester |
CN107273364A (en) * | 2017-05-15 | 2017-10-20 | 百度在线网络技术(北京)有限公司 | A kind of voice translation method and device |
CN107590138B (en) * | 2017-08-18 | 2020-01-31 | 浙江大学 | neural machine translation method based on part-of-speech attention mechanism |
Citations (96)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4502128A (en) * | 1981-06-05 | 1985-02-26 | Hitachi, Ltd. | Translation between natural languages |
US4661924A (en) * | 1984-07-31 | 1987-04-28 | Hitachi, Ltd. | Multiple-parts-of-speech disambiguating method and apparatus for machine translation system |
US4800522A (en) * | 1985-05-14 | 1989-01-24 | Sharp Kabushiki Kaisha | Bilingual translation system capable of memorizing learned words |
US4814987A (en) * | 1985-05-20 | 1989-03-21 | Sharp Kabushiki Kaisha | Translation system |
US5020112A (en) * | 1989-10-31 | 1991-05-28 | At&T Bell Laboratories | Image recognition method using two-dimensional stochastic grammars |
US5088038A (en) * | 1989-05-24 | 1992-02-11 | Kabushiki Kaisha Toshiba | Machine translation system and method of machine translation |
US5091876A (en) * | 1985-08-22 | 1992-02-25 | Kabushiki Kaisha Toshiba | Machine translation system |
US5181163A (en) * | 1988-08-03 | 1993-01-19 | Hitachi, Ltd. | Method and apparatus for generating and/or updating cooccurrence relation dictionary |
US5212730A (en) * | 1991-07-01 | 1993-05-18 | Texas Instruments Incorporated | Voice recognition of proper names using text-derived recognition models |
US5295068A (en) * | 1990-03-19 | 1994-03-15 | Fujitsu Limited | Apparatus for registering private-use words in machine-translation/electronic-mail system |
US5311429A (en) * | 1989-05-17 | 1994-05-10 | Hitachi, Ltd. | Maintenance support method and apparatus for natural language processing system |
US5387104A (en) * | 1992-04-01 | 1995-02-07 | Corder; Paul R. | Instructional system for improving communication skills |
US5495413A (en) * | 1992-09-25 | 1996-02-27 | Sharp Kabushiki Kaisha | Translation machine having a function of deriving two or more syntaxes from one original sentence and giving precedence to a selected one of the syntaxes |
US5497319A (en) * | 1990-12-31 | 1996-03-05 | Trans-Link International Corp. | Machine translation and telecommunications system |
US5510981A (en) * | 1993-10-28 | 1996-04-23 | International Business Machines Corporation | Language translation apparatus and method using context-based translation models |
US5724593A (en) * | 1995-06-07 | 1998-03-03 | International Language Engineering Corp. | Machine assisted translation tools |
US5752052A (en) * | 1994-06-24 | 1998-05-12 | Microsoft Corporation | Method and system for bootstrapping statistical processing into a rule-based natural language parser |
US5754972A (en) * | 1992-03-06 | 1998-05-19 | Dragon Systems, Inc. | Speech recognition system for languages with compound words |
US5864788A (en) * | 1992-09-25 | 1999-01-26 | Sharp Kabushiki Kaisha | Translation machine having a function of deriving two or more syntaxes from one original sentence and giving precedence to a selected one of the syntaxes |
US5867811A (en) * | 1993-06-18 | 1999-02-02 | Canon Research Centre Europe Ltd. | Method, an apparatus, a system, a storage device, and a computer readable medium using a bilingual database including aligned corpora |
US5870706A (en) * | 1996-04-10 | 1999-02-09 | Lucent Technologies, Inc. | Method and apparatus for an improved language recognition system |
US5893134A (en) * | 1992-10-30 | 1999-04-06 | Canon Europa N.V. | Aligning source texts of different natural languages to produce or add to an aligned corpus |
US5903858A (en) * | 1995-06-23 | 1999-05-11 | Saraki; Masashi | Translation machine for editing a original text by rewriting the same and translating the rewrote one |
US5907821A (en) * | 1995-11-06 | 1999-05-25 | Hitachi, Ltd. | Method of computer-based automatic extraction of translation pairs of words from a bilingual text |
US6018617A (en) * | 1997-07-31 | 2000-01-25 | Advantage Learning Systems, Inc. | Test generating and formatting system |
US6032111A (en) * | 1997-06-23 | 2000-02-29 | At&T Corp. | Method and apparatus for compiling context-dependent rewrite rules and input strings |
US6031984A (en) * | 1998-03-09 | 2000-02-29 | I2 Technologies, Inc. | Method and apparatus for optimizing constraint models |
US6064819A (en) * | 1993-12-08 | 2000-05-16 | Imec | Control flow and memory management optimization |
US6064951A (en) * | 1997-12-11 | 2000-05-16 | Electronic And Telecommunications Research Institute | Query transformation system and method enabling retrieval of multilingual web documents |
US6182027B1 (en) * | 1997-12-24 | 2001-01-30 | International Business Machines Corporation | Translation method and system |
US6182014B1 (en) * | 1998-11-20 | 2001-01-30 | Schlumberger Technology Corporation | Method and system for optimizing logistical operations in land seismic surveys |
US6205456B1 (en) * | 1997-01-17 | 2001-03-20 | Fujitsu Limited | Summarization apparatus and method |
US6223150B1 (en) * | 1999-01-29 | 2001-04-24 | Sony Corporation | Method and apparatus for parsing in a spoken language translation system |
US6233546B1 (en) * | 1998-11-19 | 2001-05-15 | William E. Datig | Method and system for machine translation using epistemic moments and stored dictionary entries |
US6233544B1 (en) * | 1996-06-14 | 2001-05-15 | At&T Corp | Method and apparatus for language translation |
US6233545B1 (en) * | 1997-05-01 | 2001-05-15 | William E. Datig | Universal machine translator of arbitrary languages utilizing epistemic moments |
US6236958B1 (en) * | 1997-06-27 | 2001-05-22 | International Business Machines Corporation | Method and system for extracting pairs of multilingual terminology from an aligned multilingual text |
US20020002451A1 (en) * | 2000-06-30 | 2002-01-03 | Tatsuya Sukehiro | Translating system and translating apparatus |
US20020013693A1 (en) * | 1997-12-15 | 2002-01-31 | Masaru Fuji | Apparatus and method for controlling the display of a translation or dictionary searching process |
US6356864B1 (en) * | 1997-07-25 | 2002-03-12 | University Technology Corporation | Methods for analysis and evaluation of the semantic content of a writing based on vector length |
US6360196B1 (en) * | 1998-05-20 | 2002-03-19 | Sharp Kabushiki Kaisha | Method of and apparatus for retrieving information and storage medium |
US20020040292A1 (en) * | 2000-05-11 | 2002-04-04 | Daniel Marcu | Machine translation techniques |
US20020046262A1 (en) * | 2000-08-18 | 2002-04-18 | Joerg Heilig | Data access system and method with proxy and remote processing |
US6389387B1 (en) * | 1998-06-02 | 2002-05-14 | Sharp Kabushiki Kaisha | Method and apparatus for multi-language indexing |
US20030009322A1 (en) * | 2001-05-17 | 2003-01-09 | Daniel Marcu | Statistical method for building a translation memory |
US20030023423A1 (en) * | 2001-07-03 | 2003-01-30 | Kenji Yamada | Syntax-based statistical translation model |
US6529865B1 (en) * | 1999-10-18 | 2003-03-04 | Sony Corporation | System and method to compile instructions to manipulate linguistic structures into separate functions |
US6535842B1 (en) * | 1998-12-10 | 2003-03-18 | Global Information Research And Technologies, Llc | Automatic bilingual translation memory system |
US20040015342A1 (en) * | 2002-02-15 | 2004-01-22 | Garst Peter F. | Linguistic support for a recognizer of mathematical expressions |
US20040024581A1 (en) * | 2002-03-28 | 2004-02-05 | Philipp Koehn | Statistical machine translation |
US6691279B2 (en) * | 1997-03-31 | 2004-02-10 | Sanyo Electric Co., Ltd | Document preparation method and machine translation device |
US20040030551A1 (en) * | 2002-03-27 | 2004-02-12 | Daniel Marcu | Phrase to phrase joint probability model for statistical machine translation |
US20040035055A1 (en) * | 2002-08-21 | 2004-02-26 | Tianli Zhu | Sulfur control for fuel processing system for fuel cell power plant |
US20040059708A1 (en) * | 2002-09-24 | 2004-03-25 | Google, Inc. | Methods and apparatus for serving relevant advertisements |
US20040068411A1 (en) * | 2001-02-22 | 2004-04-08 | Philip Scanlan | Translation information segment |
US20050021517A1 (en) * | 2000-03-22 | 2005-01-27 | Insightful Corporation | Extended functionality for an inverse inference engine based web search |
US20050026131A1 (en) * | 2003-07-31 | 2005-02-03 | Elzinga C. Bret | Systems and methods for providing a dynamic continual improvement educational environment |
US20050033565A1 (en) * | 2003-07-02 | 2005-02-10 | Philipp Koehn | Empirical methods for splitting compound words with application to machine translation |
US6857022B1 (en) * | 2000-02-02 | 2005-02-15 | Worldlingo.Com Pty Ltd | Translation ordering system |
US20050038643A1 (en) * | 2003-07-02 | 2005-02-17 | Philipp Koehn | Statistical noun phrase translation |
US20050060160A1 (en) * | 2003-09-15 | 2005-03-17 | Roh Yoon Hyung | Hybrid automatic translation apparatus and method employing combination of rule-based method and translation pattern method, and computer-readable medium thereof |
US20050075858A1 (en) * | 2003-10-06 | 2005-04-07 | Microsoft Corporation | System and method for translating from a source language to at least one target language utilizing a community of contributors |
US6885985B2 (en) * | 2000-12-18 | 2005-04-26 | Xerox Corporation | Terminology translation for unaligned comparable corpora using category based translation probabilities |
US6983239B1 (en) * | 2000-10-25 | 2006-01-03 | International Business Machines Corporation | Method and apparatus for embedding grammars in a natural language understanding (NLU) statistical parser |
US20060015320A1 (en) * | 2004-04-16 | 2006-01-19 | Och Franz J | Selection and use of nonstatistical translation components in a statistical machine translation framework |
US20060015323A1 (en) * | 2004-07-13 | 2006-01-19 | Udupa Raghavendra U | Method, apparatus, and computer program for statistical translation decoding |
US20060018541A1 (en) * | 2004-07-21 | 2006-01-26 | Microsoft Corporation | Adaptation of exponential models |
US20060020448A1 (en) * | 2004-07-21 | 2006-01-26 | Microsoft Corporation | Method and apparatus for capitalizing text using maximum entropy |
US6996520B2 (en) * | 2002-11-22 | 2006-02-07 | Transclick, Inc. | Language translation system and method using specialized dictionaries |
US6999925B2 (en) * | 2000-11-14 | 2006-02-14 | International Business Machines Corporation | Method and apparatus for phonetic context adaptation for improved speech recognition |
US7013262B2 (en) * | 2002-02-12 | 2006-03-14 | Sunflare Co., Ltd | System and method for accurate grammar analysis using a learners' model and part-of-speech tagged (POST) parser |
US7016827B1 (en) * | 1999-09-03 | 2006-03-21 | International Business Machines Corporation | Method and system for ensuring robustness in natural language understanding |
US7016977B1 (en) * | 1999-11-05 | 2006-03-21 | International Business Machines Corporation | Method and system for multilingual web server |
US7024351B2 (en) * | 2001-08-21 | 2006-04-04 | Microsoft Corporation | Method and apparatus for robust efficient parsing |
US7031911B2 (en) * | 2002-06-28 | 2006-04-18 | Microsoft Corporation | System and method for automatic detection of collocation mistakes in documents |
US20070016400A1 (en) * | 2005-06-21 | 2007-01-18 | Radu Soricutt | Weighted system of expressing language information using a compact notation |
US20070033001A1 (en) * | 2005-08-03 | 2007-02-08 | Ion Muslea | Identifying documents which form translated pairs, within a document collection |
US7177792B2 (en) * | 2001-05-31 | 2007-02-13 | University Of Southern California | Integer programming decoder for machine translation |
US7191115B2 (en) * | 2001-06-20 | 2007-03-13 | Microsoft Corporation | Statistical method and apparatus for learning translation relationships among words |
US7197451B1 (en) * | 1998-07-02 | 2007-03-27 | Novell, Inc. | Method and mechanism for the creation, maintenance, and comparison of semantic abstracts |
US7206736B2 (en) * | 2004-07-14 | 2007-04-17 | Microsoft Corporation | Method and apparatus for improving statistical word alignment models using smoothing |
US7209875B2 (en) * | 2002-12-04 | 2007-04-24 | Microsoft Corporation | System and method for machine learning a confidence metric for machine translation |
US20070094169A1 (en) * | 2005-09-09 | 2007-04-26 | Kenji Yamada | Adapter for allowing both online and offline training of a text to text system |
US7319949B2 (en) * | 2003-05-27 | 2008-01-15 | Microsoft Corporation | Unilingual translator |
US20080052061A1 (en) * | 2006-08-25 | 2008-02-28 | Kim Young Kil | Domain-adaptive portable machine translation device for translating closed captions using dynamic translation resources and method thereof |
US7340388B2 (en) * | 2002-03-26 | 2008-03-04 | University Of Southern California | Statistical translation using a large monolingual corpus |
US7346493B2 (en) * | 2003-03-25 | 2008-03-18 | Microsoft Corporation | Linguistically informed statistical models of constituent structure for ordering in sentence realization for a natural language generation system |
US7346487B2 (en) * | 2003-07-23 | 2008-03-18 | Microsoft Corporation | Method and apparatus for identifying translations |
US7349839B2 (en) * | 2002-08-27 | 2008-03-25 | Microsoft Corporation | Method and apparatus for aligning bilingual corpora |
US7356457B2 (en) * | 2003-02-28 | 2008-04-08 | Microsoft Corporation | Machine translation using learned word associations without referring to a multi-lingual human authored dictionary of content words |
US7496497B2 (en) * | 2003-12-18 | 2009-02-24 | Taiwan Semiconductor Manufacturing Co., Ltd. | Method and system for selecting web site home page by extracting site language cookie stored in an access device to identify directional information item |
US20090083023A1 (en) * | 2005-06-17 | 2009-03-26 | George Foster | Means and Method for Adapted Language Translation |
US20100017293A1 (en) * | 2008-07-17 | 2010-01-21 | Language Weaver, Inc. | System, method, and computer program for providing multilingual text advertisments |
US7680646B2 (en) * | 2004-12-21 | 2010-03-16 | Xerox Corporation | Retrieval method for translation memories containing highly structured documents |
US7698125B2 (en) * | 2004-03-15 | 2010-04-13 | Language Weaver, Inc. | Training tree transducers for probabilistic operations |
US20110029300A1 (en) * | 2009-07-28 | 2011-02-03 | Daniel Marcu | Translating Documents Based On Content |
Family Cites Families (38)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS58201175A (en) | 1982-05-20 | 1983-11-22 | Kokusai Denshin Denwa Co Ltd <Kdd> | Machine translation system |
JPS61217871A (en) | 1985-03-25 | 1986-09-27 | Toshiba Corp | Translation processor |
JPH083815B2 (en) | 1985-10-25 | 1996-01-17 | 株式会社日立製作所 | Natural language co-occurrence relation dictionary maintenance method |
US5146405A (en) | 1988-02-05 | 1992-09-08 | At&T Bell Laboratories | Methods for part-of-speech determination and usage |
US5369574A (en) | 1990-08-01 | 1994-11-29 | Canon Kabushiki Kaisha | Sentence generating system |
US5477451A (en) | 1991-07-25 | 1995-12-19 | International Business Machines Corp. | Method and system for natural language translation |
US5267156A (en) | 1991-12-05 | 1993-11-30 | International Business Machines Corporation | Method for constructing a knowledge base, knowledge base system, machine translation method and system therefor |
GB9209346D0 (en) | 1992-04-30 | 1992-06-17 | Sharp Kk | Machine translation system |
US6278967B1 (en) | 1992-08-31 | 2001-08-21 | Logovista Corporation | Automated system for generating natural language translations that are domain-specific, grammar rule-based, and/or based on part-of-speech analysis |
US5432948A (en) | 1993-04-26 | 1995-07-11 | Taligent, Inc. | Object-oriented rule-based text input transliteration system |
US6304841B1 (en) | 1993-10-28 | 2001-10-16 | International Business Machines Corporation | Automatic construction of conditional exponential models from elementary features |
JP3345763B2 (en) | 1994-03-04 | 2002-11-18 | 日本電信電話株式会社 | Natural language translator |
JP3377290B2 (en) | 1994-04-27 | 2003-02-17 | シャープ株式会社 | Machine translation device with idiom processing function |
JP2855409B2 (en) | 1994-11-17 | 1999-02-10 | 日本アイ・ビー・エム株式会社 | Natural language processing method and system |
GB2295470A (en) | 1994-11-28 | 1996-05-29 | Sharp Kk | Machine translation system |
CA2170669A1 (en) | 1995-03-24 | 1996-09-25 | Fernando Carlos Neves Pereira | Grapheme-to phoneme conversion with weighted finite-state transducers |
US5987404A (en) | 1996-01-29 | 1999-11-16 | International Business Machines Corporation | Statistical natural language understanding using hidden clumpings |
JPH09259127A (en) | 1996-03-21 | 1997-10-03 | Sharp Corp | Translation device |
US6161083A (en) | 1996-05-02 | 2000-12-12 | Sony Corporation | Example-based translation method and system which calculates word similarity degrees, a priori probability, and transformation probability to determine the best example for translation |
JPH1011447A (en) | 1996-06-21 | 1998-01-16 | Ibm Japan Ltd | Translation method and system based upon pattern |
US5991710A (en) | 1997-05-20 | 1999-11-23 | International Business Machines Corporation | Statistical translation system with features based on phrases or groups of words |
US6415250B1 (en) | 1997-06-18 | 2002-07-02 | Novell, Inc. | System and method for identifying language using morphologically-based techniques |
JPH11143877A (en) | 1997-10-22 | 1999-05-28 | Internatl Business Mach Corp <Ibm> | Compression method, method for compressing entry index data and machine translation system |
US6533822B2 (en) | 1998-01-30 | 2003-03-18 | Xerox Corporation | Creating summaries along with indicators, and automatically positioned tabs |
JP3430007B2 (en) | 1998-03-20 | 2003-07-28 | 富士通株式会社 | Machine translation device and recording medium |
US6092034A (en) | 1998-07-27 | 2000-07-18 | International Business Machines Corporation | Statistical translation system and method for fast sense disambiguation and translation of large corpora using fertility models and sense models |
US6285978B1 (en) | 1998-09-24 | 2001-09-04 | International Business Machines Corporation | System and method for estimating accuracy of an automatic natural language translation |
JP2000132550A (en) | 1998-10-26 | 2000-05-12 | Matsushita Electric Ind Co Ltd | Chinese generating device for machine translation |
US6460015B1 (en) | 1998-12-15 | 2002-10-01 | International Business Machines Corporation | Method, system and computer program product for automatic character transliteration in a text string object |
WO2000062193A1 (en) | 1999-04-08 | 2000-10-19 | Kent Ridge Digital Labs | System for chinese tokenization and named entity recognition |
US6393389B1 (en) | 1999-09-23 | 2002-05-21 | Xerox Corporation | Using ranked translation choices to obtain sequences indicating meaning of multi-token expressions |
US6904402B1 (en) | 1999-11-05 | 2005-06-07 | Microsoft Corporation | System and iterative method for lexicon, segmentation and language model joint optimization |
JP2001249922A (en) * | 1999-12-28 | 2001-09-14 | Matsushita Electric Ind Co Ltd | Word division system and device |
US6782356B1 (en) | 2000-10-03 | 2004-08-24 | Hewlett-Packard Development Company, L.P. | Hierarchical language chunking translation table |
US7113903B1 (en) | 2001-01-30 | 2006-09-26 | At&T Corp. | Method and apparatus for providing stochastic finite-state machine translation |
US7107215B2 (en) | 2001-04-16 | 2006-09-12 | Sakhr Software Company | Determining a compact model to transcribe the arabic language acoustically in a well defined basic phonetic study |
US6810374B2 (en) | 2001-07-23 | 2004-10-26 | Pilwon Kang | Korean romanization system |
US20030144832A1 (en) * | 2002-01-16 | 2003-07-31 | Harris Henry M. | Machine translation system |
-
2004
- 2004-07-02 US US10/884,174 patent/US7711545B2/en active Active
-
2010
- 2010-03-11 US US12/722,470 patent/US20100174524A1/en not_active Abandoned
Patent Citations (99)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4502128A (en) * | 1981-06-05 | 1985-02-26 | Hitachi, Ltd. | Translation between natural languages |
US4661924A (en) * | 1984-07-31 | 1987-04-28 | Hitachi, Ltd. | Multiple-parts-of-speech disambiguating method and apparatus for machine translation system |
US4800522A (en) * | 1985-05-14 | 1989-01-24 | Sharp Kabushiki Kaisha | Bilingual translation system capable of memorizing learned words |
US4814987A (en) * | 1985-05-20 | 1989-03-21 | Sharp Kabushiki Kaisha | Translation system |
US5091876A (en) * | 1985-08-22 | 1992-02-25 | Kabushiki Kaisha Toshiba | Machine translation system |
US5181163A (en) * | 1988-08-03 | 1993-01-19 | Hitachi, Ltd. | Method and apparatus for generating and/or updating cooccurrence relation dictionary |
US5311429A (en) * | 1989-05-17 | 1994-05-10 | Hitachi, Ltd. | Maintenance support method and apparatus for natural language processing system |
US5088038A (en) * | 1989-05-24 | 1992-02-11 | Kabushiki Kaisha Toshiba | Machine translation system and method of machine translation |
US5020112A (en) * | 1989-10-31 | 1991-05-28 | At&T Bell Laboratories | Image recognition method using two-dimensional stochastic grammars |
US5295068A (en) * | 1990-03-19 | 1994-03-15 | Fujitsu Limited | Apparatus for registering private-use words in machine-translation/electronic-mail system |
US5497319A (en) * | 1990-12-31 | 1996-03-05 | Trans-Link International Corp. | Machine translation and telecommunications system |
US5212730A (en) * | 1991-07-01 | 1993-05-18 | Texas Instruments Incorporated | Voice recognition of proper names using text-derived recognition models |
US5754972A (en) * | 1992-03-06 | 1998-05-19 | Dragon Systems, Inc. | Speech recognition system for languages with compound words |
US5387104A (en) * | 1992-04-01 | 1995-02-07 | Corder; Paul R. | Instructional system for improving communication skills |
US5495413A (en) * | 1992-09-25 | 1996-02-27 | Sharp Kabushiki Kaisha | Translation machine having a function of deriving two or more syntaxes from one original sentence and giving precedence to a selected one of the syntaxes |
US5864788A (en) * | 1992-09-25 | 1999-01-26 | Sharp Kabushiki Kaisha | Translation machine having a function of deriving two or more syntaxes from one original sentence and giving precedence to a selected one of the syntaxes |
US5893134A (en) * | 1992-10-30 | 1999-04-06 | Canon Europa N.V. | Aligning source texts of different natural languages to produce or add to an aligned corpus |
US5867811A (en) * | 1993-06-18 | 1999-02-02 | Canon Research Centre Europe Ltd. | Method, an apparatus, a system, a storage device, and a computer readable medium using a bilingual database including aligned corpora |
US5510981A (en) * | 1993-10-28 | 1996-04-23 | International Business Machines Corporation | Language translation apparatus and method using context-based translation models |
US6064819A (en) * | 1993-12-08 | 2000-05-16 | Imec | Control flow and memory management optimization |
US5752052A (en) * | 1994-06-24 | 1998-05-12 | Microsoft Corporation | Method and system for bootstrapping statistical processing into a rule-based natural language parser |
US5724593A (en) * | 1995-06-07 | 1998-03-03 | International Language Engineering Corp. | Machine assisted translation tools |
US5903858A (en) * | 1995-06-23 | 1999-05-11 | Saraki; Masashi | Translation machine for editing a original text by rewriting the same and translating the rewrote one |
US5907821A (en) * | 1995-11-06 | 1999-05-25 | Hitachi, Ltd. | Method of computer-based automatic extraction of translation pairs of words from a bilingual text |
US5870706A (en) * | 1996-04-10 | 1999-02-09 | Lucent Technologies, Inc. | Method and apparatus for an improved language recognition system |
US6233544B1 (en) * | 1996-06-14 | 2001-05-15 | At&T Corp | Method and apparatus for language translation |
US6205456B1 (en) * | 1997-01-17 | 2001-03-20 | Fujitsu Limited | Summarization apparatus and method |
US6691279B2 (en) * | 1997-03-31 | 2004-02-10 | Sanyo Electric Co., Ltd | Document preparation method and machine translation device |
US6233545B1 (en) * | 1997-05-01 | 2001-05-15 | William E. Datig | Universal machine translator of arbitrary languages utilizing epistemic moments |
US6032111A (en) * | 1997-06-23 | 2000-02-29 | At&T Corp. | Method and apparatus for compiling context-dependent rewrite rules and input strings |
US6236958B1 (en) * | 1997-06-27 | 2001-05-22 | International Business Machines Corporation | Method and system for extracting pairs of multilingual terminology from an aligned multilingual text |
US6356864B1 (en) * | 1997-07-25 | 2002-03-12 | University Technology Corporation | Methods for analysis and evaluation of the semantic content of a writing based on vector length |
US6018617A (en) * | 1997-07-31 | 2000-01-25 | Advantage Learning Systems, Inc. | Test generating and formatting system |
US6064951A (en) * | 1997-12-11 | 2000-05-16 | Electronic And Telecommunications Research Institute | Query transformation system and method enabling retrieval of multilingual web documents |
US20020013693A1 (en) * | 1997-12-15 | 2002-01-31 | Masaru Fuji | Apparatus and method for controlling the display of a translation or dictionary searching process |
US6182027B1 (en) * | 1997-12-24 | 2001-01-30 | International Business Machines Corporation | Translation method and system |
US6031984A (en) * | 1998-03-09 | 2000-02-29 | I2 Technologies, Inc. | Method and apparatus for optimizing constraint models |
US6360196B1 (en) * | 1998-05-20 | 2002-03-19 | Sharp Kabushiki Kaisha | Method of and apparatus for retrieving information and storage medium |
US6389387B1 (en) * | 1998-06-02 | 2002-05-14 | Sharp Kabushiki Kaisha | Method and apparatus for multi-language indexing |
US7197451B1 (en) * | 1998-07-02 | 2007-03-27 | Novell, Inc. | Method and mechanism for the creation, maintenance, and comparison of semantic abstracts |
US6233546B1 (en) * | 1998-11-19 | 2001-05-15 | William E. Datig | Method and system for machine translation using epistemic moments and stored dictionary entries |
US6182014B1 (en) * | 1998-11-20 | 2001-01-30 | Schlumberger Technology Corporation | Method and system for optimizing logistical operations in land seismic surveys |
US6535842B1 (en) * | 1998-12-10 | 2003-03-18 | Global Information Research And Technologies, Llc | Automatic bilingual translation memory system |
US6223150B1 (en) * | 1999-01-29 | 2001-04-24 | Sony Corporation | Method and apparatus for parsing in a spoken language translation system |
US7016827B1 (en) * | 1999-09-03 | 2006-03-21 | International Business Machines Corporation | Method and system for ensuring robustness in natural language understanding |
US6529865B1 (en) * | 1999-10-18 | 2003-03-04 | Sony Corporation | System and method to compile instructions to manipulate linguistic structures into separate functions |
US7016977B1 (en) * | 1999-11-05 | 2006-03-21 | International Business Machines Corporation | Method and system for multilingual web server |
US6857022B1 (en) * | 2000-02-02 | 2005-02-15 | Worldlingo.Com Pty Ltd | Translation ordering system |
US20050021517A1 (en) * | 2000-03-22 | 2005-01-27 | Insightful Corporation | Extended functionality for an inverse inference engine based web search |
US20020040292A1 (en) * | 2000-05-11 | 2002-04-04 | Daniel Marcu | Machine translation techniques |
US20020046018A1 (en) * | 2000-05-11 | 2002-04-18 | Daniel Marcu | Discourse parsing and summarization |
US20020002451A1 (en) * | 2000-06-30 | 2002-01-03 | Tatsuya Sukehiro | Translating system and translating apparatus |
US7174289B2 (en) * | 2000-06-30 | 2007-02-06 | Oki Electric Industry Co., Ltd. | Translating system and translating apparatus in which translatable documents are associated with permission to translate |
US20020046262A1 (en) * | 2000-08-18 | 2002-04-18 | Joerg Heilig | Data access system and method with proxy and remote processing |
US6983239B1 (en) * | 2000-10-25 | 2006-01-03 | International Business Machines Corporation | Method and apparatus for embedding grammars in a natural language understanding (NLU) statistical parser |
US6999925B2 (en) * | 2000-11-14 | 2006-02-14 | International Business Machines Corporation | Method and apparatus for phonetic context adaptation for improved speech recognition |
US6885985B2 (en) * | 2000-12-18 | 2005-04-26 | Xerox Corporation | Terminology translation for unaligned comparable corpora using category based translation probabilities |
US20040068411A1 (en) * | 2001-02-22 | 2004-04-08 | Philip Scanlan | Translation information segment |
US7689405B2 (en) * | 2001-05-17 | 2010-03-30 | Language Weaver, Inc. | Statistical method for building a translation memory |
US20030009322A1 (en) * | 2001-05-17 | 2003-01-09 | Daniel Marcu | Statistical method for building a translation memory |
US7177792B2 (en) * | 2001-05-31 | 2007-02-13 | University Of Southern California | Integer programming decoder for machine translation |
US7191115B2 (en) * | 2001-06-20 | 2007-03-13 | Microsoft Corporation | Statistical method and apparatus for learning translation relationships among words |
US20030023423A1 (en) * | 2001-07-03 | 2003-01-30 | Kenji Yamada | Syntax-based statistical translation model |
US7024351B2 (en) * | 2001-08-21 | 2006-04-04 | Microsoft Corporation | Method and apparatus for robust efficient parsing |
US7013262B2 (en) * | 2002-02-12 | 2006-03-14 | Sunflare Co., Ltd | System and method for accurate grammar analysis using a learners' model and part-of-speech tagged (POST) parser |
US20040015342A1 (en) * | 2002-02-15 | 2004-01-22 | Garst Peter F. | Linguistic support for a recognizer of mathematical expressions |
US7340388B2 (en) * | 2002-03-26 | 2008-03-04 | University Of Southern California | Statistical translation using a large monolingual corpus |
US20040030551A1 (en) * | 2002-03-27 | 2004-02-12 | Daniel Marcu | Phrase to phrase joint probability model for statistical machine translation |
US20040024581A1 (en) * | 2002-03-28 | 2004-02-05 | Philipp Koehn | Statistical machine translation |
US7031911B2 (en) * | 2002-06-28 | 2006-04-18 | Microsoft Corporation | System and method for automatic detection of collocation mistakes in documents |
US20040035055A1 (en) * | 2002-08-21 | 2004-02-26 | Tianli Zhu | Sulfur control for fuel processing system for fuel cell power plant |
US7349839B2 (en) * | 2002-08-27 | 2008-03-25 | Microsoft Corporation | Method and apparatus for aligning bilingual corpora |
US20040059708A1 (en) * | 2002-09-24 | 2004-03-25 | Google, Inc. | Methods and apparatus for serving relevant advertisements |
US6996520B2 (en) * | 2002-11-22 | 2006-02-07 | Transclick, Inc. | Language translation system and method using specialized dictionaries |
US7209875B2 (en) * | 2002-12-04 | 2007-04-24 | Microsoft Corporation | System and method for machine learning a confidence metric for machine translation |
US7356457B2 (en) * | 2003-02-28 | 2008-04-08 | Microsoft Corporation | Machine translation using learned word associations without referring to a multi-lingual human authored dictionary of content words |
US7346493B2 (en) * | 2003-03-25 | 2008-03-18 | Microsoft Corporation | Linguistically informed statistical models of constituent structure for ordering in sentence realization for a natural language generation system |
US7319949B2 (en) * | 2003-05-27 | 2008-01-15 | Microsoft Corporation | Unilingual translator |
US20050033565A1 (en) * | 2003-07-02 | 2005-02-10 | Philipp Koehn | Empirical methods for splitting compound words with application to machine translation |
US20050038643A1 (en) * | 2003-07-02 | 2005-02-17 | Philipp Koehn | Statistical noun phrase translation |
US7346487B2 (en) * | 2003-07-23 | 2008-03-18 | Microsoft Corporation | Method and apparatus for identifying translations |
US20050026131A1 (en) * | 2003-07-31 | 2005-02-03 | Elzinga C. Bret | Systems and methods for providing a dynamic continual improvement educational environment |
US20050060160A1 (en) * | 2003-09-15 | 2005-03-17 | Roh Yoon Hyung | Hybrid automatic translation apparatus and method employing combination of rule-based method and translation pattern method, and computer-readable medium thereof |
US20050075858A1 (en) * | 2003-10-06 | 2005-04-07 | Microsoft Corporation | System and method for translating from a source language to at least one target language utilizing a community of contributors |
US7496497B2 (en) * | 2003-12-18 | 2009-02-24 | Taiwan Semiconductor Manufacturing Co., Ltd. | Method and system for selecting web site home page by extracting site language cookie stored in an access device to identify directional information item |
US7698125B2 (en) * | 2004-03-15 | 2010-04-13 | Language Weaver, Inc. | Training tree transducers for probabilistic operations |
US20060015320A1 (en) * | 2004-04-16 | 2006-01-19 | Och Franz J | Selection and use of nonstatistical translation components in a statistical machine translation framework |
US20060015323A1 (en) * | 2004-07-13 | 2006-01-19 | Udupa Raghavendra U | Method, apparatus, and computer program for statistical translation decoding |
US7206736B2 (en) * | 2004-07-14 | 2007-04-17 | Microsoft Corporation | Method and apparatus for improving statistical word alignment models using smoothing |
US20060018541A1 (en) * | 2004-07-21 | 2006-01-26 | Microsoft Corporation | Adaptation of exponential models |
US20060020448A1 (en) * | 2004-07-21 | 2006-01-26 | Microsoft Corporation | Method and apparatus for capitalizing text using maximum entropy |
US7680646B2 (en) * | 2004-12-21 | 2010-03-16 | Xerox Corporation | Retrieval method for translation memories containing highly structured documents |
US20090083023A1 (en) * | 2005-06-17 | 2009-03-26 | George Foster | Means and Method for Adapted Language Translation |
US20070016400A1 (en) * | 2005-06-21 | 2007-01-18 | Radu Soricutt | Weighted system of expressing language information using a compact notation |
US20070033001A1 (en) * | 2005-08-03 | 2007-02-08 | Ion Muslea | Identifying documents which form translated pairs, within a document collection |
US20070094169A1 (en) * | 2005-09-09 | 2007-04-26 | Kenji Yamada | Adapter for allowing both online and offline training of a text to text system |
US20080052061A1 (en) * | 2006-08-25 | 2008-02-28 | Kim Young Kil | Domain-adaptive portable machine translation device for translating closed captions using dynamic translation resources and method thereof |
US20100017293A1 (en) * | 2008-07-17 | 2010-01-21 | Language Weaver, Inc. | System, method, and computer program for providing multilingual text advertisments |
US20110029300A1 (en) * | 2009-07-28 | 2011-02-03 | Daniel Marcu | Translating Documents Based On Content |
Cited By (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8214196B2 (en) | 2001-07-03 | 2012-07-03 | University Of Southern California | Syntax-based statistical translation model |
US8234106B2 (en) | 2002-03-26 | 2012-07-31 | University Of Southern California | Building a translation lexicon from comparable, non-parallel corpora |
US8548794B2 (en) | 2003-07-02 | 2013-10-01 | University Of Southern California | Statistical noun phrase translation |
US8296127B2 (en) | 2004-03-23 | 2012-10-23 | University Of Southern California | Discovery of parallel text portions in comparable collections of corpora and training using comparable texts |
US8666725B2 (en) | 2004-04-16 | 2014-03-04 | University Of Southern California | Selection and use of nonstatistical translation components in a statistical machine translation framework |
US8977536B2 (en) | 2004-04-16 | 2015-03-10 | University Of Southern California | Method and system for translating information with a higher probability of a correct translation |
US8600728B2 (en) | 2004-10-12 | 2013-12-03 | University Of Southern California | Training for a text-to-text application which uses string to tree conversion for training and decoding |
US8886517B2 (en) | 2005-06-17 | 2014-11-11 | Language Weaver, Inc. | Trust scoring for language translation systems |
US10319252B2 (en) | 2005-11-09 | 2019-06-11 | Sdl Inc. | Language capability assessment and training apparatus and techniques |
US8943080B2 (en) | 2006-04-07 | 2015-01-27 | University Of Southern California | Systems and methods for identifying parallel documents and sentence fragments in multilingual document collections |
US8886518B1 (en) | 2006-08-07 | 2014-11-11 | Language Weaver, Inc. | System and method for capitalizing machine translated text |
US8433556B2 (en) | 2006-11-02 | 2013-04-30 | University Of Southern California | Semi-supervised training for statistical word alignment |
US9122674B1 (en) | 2006-12-15 | 2015-09-01 | Language Weaver, Inc. | Use of annotations in statistical machine translation |
US8468149B1 (en) | 2007-01-26 | 2013-06-18 | Language Weaver, Inc. | Multi-lingual online community |
US8615389B1 (en) | 2007-03-16 | 2013-12-24 | Language Weaver, Inc. | Generation and exploitation of an approximate language model |
US8831928B2 (en) | 2007-04-04 | 2014-09-09 | Language Weaver, Inc. | Customizable machine translation service |
US8825466B1 (en) | 2007-06-08 | 2014-09-02 | Language Weaver, Inc. | Modification of annotated bilingual segment pairs in syntax-based machine translation |
US8990064B2 (en) | 2009-07-28 | 2015-03-24 | Language Weaver, Inc. | Translating documents based on content |
US8676563B2 (en) | 2009-10-01 | 2014-03-18 | Language Weaver, Inc. | Providing human-generated and machine-generated trusted translations |
US8380486B2 (en) | 2009-10-01 | 2013-02-19 | Language Weaver, Inc. | Providing machine-generated translations and corresponding trust levels |
KR101764941B1 (en) | 2010-01-07 | 2017-08-03 | 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 | Efficient immutable syntax representation with incremental change |
US10564944B2 (en) | 2010-01-07 | 2020-02-18 | Microsoft Technology Licensing, Llc | Efficient immutable syntax representation with incremental change |
US10984429B2 (en) | 2010-03-09 | 2021-04-20 | Sdl Inc. | Systems and methods for translating textual content |
US10417646B2 (en) | 2010-03-09 | 2019-09-17 | Sdl Inc. | Predicting the cost associated with translating textual content |
US11003838B2 (en) | 2011-04-18 | 2021-05-11 | Sdl Inc. | Systems and methods for monitoring post translation editing |
US8694303B2 (en) | 2011-06-15 | 2014-04-08 | Language Weaver, Inc. | Systems and methods for tuning parameters in statistical machine translation |
US8886515B2 (en) | 2011-10-19 | 2014-11-11 | Language Weaver, Inc. | Systems and methods for enhancing machine translation post edit review processes |
US8942973B2 (en) | 2012-03-09 | 2015-01-27 | Language Weaver, Inc. | Content page URL translation |
US10261994B2 (en) | 2012-05-25 | 2019-04-16 | Sdl Inc. | Method and system for automatic management of reputation of translators |
US10402498B2 (en) | 2012-05-25 | 2019-09-03 | Sdl Inc. | Method and system for automatic management of reputation of translators |
US9152622B2 (en) | 2012-11-26 | 2015-10-06 | Language Weaver, Inc. | Personalized machine translation via online adaptation |
KR101764994B1 (en) | 2013-05-31 | 2017-08-03 | 엠파이어 테크놀로지 디벨롭먼트 엘엘씨 | Incremental reasoning based on scalable and dynamical semantic data |
US9213694B2 (en) | 2013-10-10 | 2015-12-15 | Language Weaver, Inc. | Efficient online domain adaptation |
US10061768B2 (en) * | 2013-12-25 | 2018-08-28 | Kabushiki Kaisha Toshiba | Method and apparatus for improving a bilingual corpus, machine translation method and apparatus |
US20150186361A1 (en) * | 2013-12-25 | 2015-07-02 | Kabushiki Kaisha Toshiba | Method and apparatus for improving a bilingual corpus, machine translation method and apparatus |
US10180940B2 (en) * | 2015-09-23 | 2019-01-15 | Alibaba Group Holding Limited | Method and system of performing a translation |
WO2017051256A3 (en) * | 2015-09-23 | 2017-06-29 | Alibaba Group Holding Limited | Method and system of performing a translation |
CN106547743A (en) * | 2015-09-23 | 2017-03-29 | 阿里巴巴集团控股有限公司 | A kind of method translated and its system |
US20170083513A1 (en) * | 2015-09-23 | 2017-03-23 | Alibaba Group Holding Limited | Method and system of performing a translation |
US10572976B2 (en) | 2017-10-18 | 2020-02-25 | International Business Machines Corporation | Enhancing observation resolution using continuous learning |
CN110097886A (en) * | 2019-04-29 | 2019-08-06 | 贵州小爱机器人科技有限公司 | Intension recognizing method and device, storage medium, terminal |
Also Published As
Publication number | Publication date |
---|---|
US20050033565A1 (en) | 2005-02-10 |
US7711545B2 (en) | 2010-05-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7711545B2 (en) | Empirical methods for splitting compound words with application to machine translation | |
US8548794B2 (en) | Statistical noun phrase translation | |
Koehn et al. | Empirical methods for compound splitting | |
Koehn | Noun phrase translation | |
US8209163B2 (en) | Grammatical element generation in machine translation | |
US7574348B2 (en) | Processing collocation mistakes in documents | |
Popovic et al. | POS-based Word Reorderings for Statistical Machine Translation. | |
US7496496B2 (en) | System and method for machine learning a confidence metric for machine translation | |
Cap et al. | How to produce unseen teddy bears: Improved morphological processing of compounds in SMT | |
Ramanathan et al. | Clause-based reordering constraints to improve statistical machine translation | |
Farhath et al. | Integration of bilingual lists for domain-specific statistical machine translation for sinhala-tamil | |
Elming et al. | Syntactic reordering for English-Arabic phrase-based machine translation | |
Axelrod et al. | Class-based n-gram language difference models for data selection | |
Escartín | Chasing the Perfect Splitter: A Comparison of Different Compound Splitting Tools. | |
Mehay et al. | BLEUATRE: Flattening syntactic dependencies for MT evaluation | |
Yılmaz et al. | TÜBİTAK Turkish-English submissions for IWSLT 2013 | |
Andreas et al. | Fuzzy syntactic reordering for phrase-based statistical machine translation | |
Zhang et al. | Adapting an example-based translation system to Chinese | |
Menezes et al. | Syntactic models for structural word insertion and deletion during translation | |
Wu et al. | Improving domain-specific word alignment with a general bilingual corpus | |
Specia et al. | N-best reranking for the efficient integration of word sense disambiguation and statistical machine translation | |
Chen et al. | A statistical method for translating Chinese into under-resourced minority languages | |
Ghaffar et al. | English to arabic statistical machine translation system improvements using preprocessing and arabic morphology analysis | |
Ji et al. | Phonetic name matching for cross-lingual spoken sentence retrieval | |
Turchi et al. | Knowledge expansion of a statistical machine translation system using morphological resources |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: UNIVERSITY OF SOUTHERN CALIFORNIA, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KOEHN, PHILIPP;REEL/FRAME:024575/0255 Effective date: 20100622 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |