One-bit large language models (LLMs) have emerged as a promising approach to making generative AI more accessible and affordable. By representing model weights with a very limited number of bits, ...

The idea of simplifying model weights isn’t a completely new one in AI research. For years, researchers have been experimenting with quantization techniques that squeeze their neural network weights ...