Tsinghua University and Harbin Institute of Technology jointly proposed a large model 1bit extreme compression framework OneBit

A joint study by Tsinghua University and Harbin Institute of Technology proposed a large model 1-bit extreme compression framework called OneBit. This framework achieved a large model weight compression of more than 90% for the first time while retaining most (83%) of the capabilities. This research result is of great significance for the deployment of large models on PCs and even smartphones.