By virtue of how many words, phrases, and grammar rules there are, you can only imagine how difficult it is for a person to deliver a translation from one language to another that accurately conveys the thought and nuance behind even the simplest sentence, let alone how difficult it would be for a machine. This, however, was a challenge that Google wanted to tackle head on, and today, the results of all those years spent working on a machine learning translation system were finally unveiled.
Languages are naturally phrase-based, so letting machines learn as many of those phrases and the subtleties behind the language as possible so that they could be applied to the translation was essential. Getting machines to do all that requires a lot of data, and adding complex language rules into the mix requires neural networks. While Google may not be the only company that has been looking into this method for more precise and accurate translations, they managed to be the first to get it done.
The Google Neural Machine Translation system (GNMT) uses state-of-the-art training techniques that significantly improve machine translation quality. It relies on long short term memory recurrent neural networks (LSTM-RNNs) and neural networks that have been trained by graphics processing units (GPUs), and tensor processing units (TPUs) to crunch data more efficiently. It all adds up to a new system that can lower translation errors by more than 55 to 85 percent.
Narrowing The Gap
Right now, GNMT is the most effective language system that uses neural networks to look at a sentence as a whole while still factoring in the smaller elements that add to its meaning, quite similar to how humans try to process language and understand the nuances behind a particular statement beyond the words.
Of course, machine translation is still far from perfect. Despite its advances, GNMT can still mistranslate, particularly when it encounters proper names or rare words, which prompt the system to, again, translate individual words instead of looking at them within the context of the whole. Clearly, there is still a gap between human and machine translations, but with GNMT, it is getting smaller.
But considering that Google has pioneered the system for Chinese-to-English translation (languages with a combined 1.5 billion speakers worldwide), GNMT is a major accomplishment that could revolutionize global communication.