MatMul-free LM removes matrix multiplications from language model architectures to make them faster and much more memory-efficient.
Cibo e viaggi / Food and travel notes by Livio Acerbo

MatMul-free LM removes matrix multiplications from language model architectures to make them faster and much more memory-efficient.