Article:Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean
Efficient Estimation of Word Representations in Vector Space
A research team led by Tomas Mikolov introduces two novel model architectures designed to compute continuous vector representations of words from massive datasets. The approach delivers higher accuracy with substantially lower computational requirements than prior neural network methods.
From Video: Building an LLM from Scratch: Neural Networks, Tokenization, and Transformers