Skip to main content

Ctrl+K

MT History — Reproducible Machine Translation from 1949

Machine Translation, 1949 → Today

Orientation

🕰️ The Time Machine
MT History — Reproducible Machine Translation from 1949

Part 0 — Before MT Was MT

00 · Shannon (1948) — Entropy of Language
01 · Weaver (1949) — The Cryptanalysis Window
02 · Bar-Hillel (1960) — The Impossibility Argument

Part 1 — Direct Transfer / RBMT (1954–1970)

10 · Georgetown-IBM Demo (1954) — RU→EN
11 · Soviet Mirror Program (1955) — EN→RU
12 · Transfer-Based MT / SYSTRAN Lineage
13 · Interlingua — Toy UNL Round-Trip

Part 2 — Example-Based MT (1984–1995)

20 · Example-Based MT — Nagao (1984)

Part 3 — Statistical MT (1990–2014)

30 · The Noisy Channel Model — Brown et al. (1990)
31 · IBM Model 1 — Full EM Implementation
32 · IBM Models 2–5 + HMM Alignment
33 · Phrase-Based SMT — Stack Decoder
34 · n-gram Language Models with Kneser-Ney Smoothing
35 · Hierarchical Phrase-Based MT — Chiang (2005)

Part 4 — Neural MT (2013–2017)

40 · The Neural Shift — Motivation & Reading
41 · RNN Encoder–Decoder from Scratch
42 · Bahdanau Additive Attention
43 · ConvS2S Sketch — Gehring et al.

Part 5 — Transformer Era (2017–)

50 · Full Transformer from Scratch
51 · BPE & SentencePiece from Scratch
52 · Scaling — WMT, Back-Translation, Filtering

Part 6 — Multilingual & Low-Resource MT (2019–)

60 · Multilingual NMT — Language Token Trick
61 · Low-Resource MT — Pivoting & Data Aug.
62 · M2M-100 / NLLB Architecture
63 · LLM-Based MT — ALMA, Tower, Prompting

Part 7 — Evaluation

70 · MT Evaluation — BLEU to COMET from Scratch
71 · Human Evaluation — MQM, DA, Ranking
72 · Benchmarks — Linguini, DecipherBench

Repository
Open issue

Search

Ctrl+K

By Eduardo Sanchez

© Copyright 2024.