Entropy– and Distance-Regularized Attention Improves Low-Resource Neural Machine Translation

EaDRA (Entropy– and Distance-Regularized Attention), which introduces an inductive bias to prioritize essential elements and guide the attention mechanism accordingly, demonstrates significant improvements in translation quality, while incurring negligible computational cost.