
Microsoft has launched a groundbreaking compact large language model (LLM) named BitNet b1.58 2B4T, which stands out for its remarkable efficiency and suitability for less powerful hardware. This new model, containing 2 billion parameters, leverages an innovative 1.58-bit format, employing weights of -1, 0, and 1, dramatically reducing the memory requirement to just 400MB. This is a notable reduction compared