Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling https://github.com/tensorflow/lingvo
Jonathan Shen Affiliation: Patrick Nguyen Affiliation: Yonghui Wu Affiliation: Zhifeng Chen Affiliation: Mia X. Chen Affiliation: Ye Jia Affiliation: Anjuli Kannan Affiliation: Tara Sainath Affiliation: Yuan Cao Affiliation: Chung-Cheng Chiu Affiliation: Yanzhang He Affiliation: Jan Chorowski Affiliation: Smit Hinsu Affiliation: Stella Laurenzo Affiliation: James Qin Affiliation: Orhan Firat Affiliation: Wolfgang Macherey Affiliation: Suyog Gupta Affiliation: Ankur Bapna Affiliation: Shuyuan Zhang Affiliation: Ruoming Pang Affiliation: Ron J. Weiss Affiliation: Rohit Prabhavalkar Affiliation: Qiao Liang Affiliation: Benoit Jacob Affiliation: Bowen Liang Affiliation: HyoukJoong Lee Affiliation: Ciprian Chelba Affiliation: Sébastien Jean Affiliation: Bo Li Affiliation: Melvin Johnson Affiliation: Rohan Anil Affiliation: Rajat Tibrewal Affiliation: Xiaobing Liu Affiliation: Akiko Eriguchi Affiliation: Navdeep Jaitly Affiliation: Naveen Ari Affiliation: Colin Cherry Affiliation: Parisa Haghani Affiliation: Otavio Good Affiliation: Youlong Cheng Affiliation: Raziel Alvarez Affiliation: Isaac Caswell Affiliation: Wei-Ning Hsu Affiliation: Zongheng Yang Affiliation: Kuan-Chieh Wang Affiliation: Ekaterina Gonina Affiliation: Katrin Tomanek Affiliation: Ben Vanik Affiliation: Zelin Wu Affiliation: Llion Jones Affiliation: Mike Schuster Affiliation: Yanping Huang Affiliation: Dehao Chen Affiliation: Kazuki Irie Affiliation: George Foster Affiliation: John Richardson Affiliation: Klaus Macherey Affiliation: Antoine Bruguier Affiliation: Heiga Zen Affiliation: Colin Raffel Affiliation: Shankar Kumar Affiliation: Kanishka Rao Affiliation: David Rybach Affiliation: Matthew Murray Affiliation: Vijayaditya Peddinti Affiliation: Maxim Krikun Affiliation: Michiel A. U. Bacchiani Affiliation: Thomas B. Jablin Affiliation: Rob Suderman Affiliation: Ian Williams Affiliation: Benjamin Lee Affiliation: Deepti Bhatia Affiliation: Justin Carlson Affiliation: Semih Yavuz Affiliation: Yu Zhang Affiliation: Ian McGraw Affiliation: Max Galkin Affiliation: Qi Ge Affiliation: Golan Pundak Affiliation: Chad Whipkey Affiliation: Todd Wang Affiliation: Uri Alon Affiliation: Dmitry Lepikhin Affiliation: Ye Tian Affiliation: Sara Sabour Affiliation: William Chan Affiliation: Shubham Toshniwal Affiliation: Baohua Liao Affiliation: Michael Nirschl Affiliation: Pat Rondon Affiliation:
Abstract
Lingvo is a Tensorflow framework offering a complete solution for collaborative deep learning research, with a particular focus towards sequence-to-sequence models. Lingvo models are composed of modular building blocks that are flexible and easily extensible, and experiment configurations are centralized and highly customizable. Distributed training and quantized inference are supported directly within the framework, and it contains existing implementations of a large number of utilities, helper functions, and the newest research ideas. Lingvo has been used in collaboration by dozens of researchers in more than 20 papers over the last two years. This document outlines the underlying design of Lingvo and serves as an introduction to the various pieces of the framework, while also offering examples of advanced features that showcase the capabilities of the framework.
原文 arXiv:1902.08295;中英对照 + 大白话阅读 https://aha.fim.ai/paper/1902.08295v1