Multilinear Operators for Arithmetic Tasks
Pinned
This project explored whether sequence-to-sequence models could be built entirely from multilinear operations, without softmax attention, nonlinear activations, or positional encodings, and resulted in MuSe, a multilinear sequence model designed for arithmetic tasks such as addition, multiplication, and parity.