Google Introduces GNMT: Neural Machine Translation Built for Production

ArticleYonghui Wu, Mike Schuster, Zhifeng Chen, et al.Research

Google researchers present GNMT (Google's Neural Machine Translation system), addressing long-standing obstacles in neural translation such as high compute costs during training, slow inference, and difficulties handling rare words.

Key points

  1. GNMT is built on a deep LSTM network containing 8 encoder and 8 decoder layers with attention and residual connections.
  2. To improve parallelisation and reduce training runtime, the attention mechanism connects the bottom decoder layer to the top encoder layer.
  3. Low-precision arithmetic is used during inference to accelerate final translation speeds.
  4. Words are split into sub-word units ('wordpieces') for both input and output to effectively handle rare terms without ballooning vocabulary size.
  5. Beam search incorporates length normalisation and a coverage penalty to ensure translated sentences cover all elements of the source input.
  6. Human side-by-side evaluations on isolated simple sentences showed an average error reduction of 60% compared to Google's previous phrase-based production system.

Why it matters

While neural machine translation promised higher fluency than traditional phrase-based models, high computational requirements and poor handling of rare words prevented production deployment. GNMT introduced structural and computational techniques that made large-scale production use feasible.

Analysis

The paper tackles production bottlenecks across model design and runtime execution. The sub-word unit approach bridges the divide between character-level flexibility and word-level efficiency. Combined with low-precision arithmetic for fast serving and beam search coverage penalties, the authors demonstrated that neural translation can outperform existing phrase-based systems on standard WMT'14 benchmarks while meeting real-world latency demands.

Mentioned links

Found in

Summary generated by AI (Gemini 3.8 Flash, 27 September 2026). It may contain errors – the original source is authoritative.

Related entries

Similar in content, found by the AI search.

  • Article:Rico Sennrich, Barry Haddow, Alexandra Birch

    Neural Machine Translation of Rare Words with Subword Units

    Rico Sennrich, Barry Haddow, and Alexandra Birch present an approach enabling neural machine translation (NMT) systems to handle rare and out-of-vocabulary words using subword units. Instead of fixed vocabularies and dictionary back-offs, the technique employs segmentation algorithms like Byte Pair Encoding (BPE) for open-vocabulary translation.

    AI & LLMs· Research

  • Article:Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin

    Attention Is All You Need: Introducing the Transformer Architecture

    The authors introduce the Transformer, a network architecture that completely replaces recurrence and convolutions with attention mechanisms.

    AI & LLMs· Research

  • Article:Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio

    Neural Machine Translation by Jointly Learning to Align and Translate

    In this paper, Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio propose an approach that resolves the fixed-length vector bottleneck in encoder-decoder translation models through soft search.

    AI & LLMs· Research

  • Article:Maximilian Beck, Korbinian Pöppel, Markus Spanring, Andreas Auer, Oleksandra Prudnikova, Michael Kopp, Günter Klambauer, Johannes Brandstetter, Sepp Hochreiter

    xLSTM: Extended Long Short-Term Memory

    A research team led by Sepp Hochreiter introduces xLSTM, an extension of the original Long Short-Term Memory architecture designed for large-scale language modelling. The approach addresses historical scaling limits of LSTMs and demonstrates competitive performance against state-of-the-art Transformers and State Space Models.

    AI & LLMs· Research

Back to the knowledge base

Let's talk about your project

Get in touch

Locations

  • Mattersburg
    Johann Nepomuk Bergerstraße 7/2/14
    7210 Mattersburg, Austria
  • Vienna
    Ungargasse 64-66/3/404
    1030 Wien, Austria

Parts of this content were created with the assistance of AI.