Matrix multiplication provides a series of fast multiply and add operations in parallel, and it is built into the hardware of GPUs and AI processing cores (see Tensor core). See compute-in-memory.

Part of the process of running LLMs involves performing matrix multiplication (MatMul), where data is combined with weights in neural networks to provide likely best answers to queries.