GLM

An open-source bilingual language model using an autoregressive blank-filling objective to unify NLU and text generation.

GLM (General Language Model) bridges the gap between BERT-style understanding and GPT-style generation. Developed by the Knowledge Engineering Group at Tsinghua University, this architecture uses a unique blank-filling objective to master diverse NLP tasks. The GLM-130B variant features 130 billion parameters and supports 2D positional encoding, delivering high-performance results on both English and Chinese benchmarks. By optimizing for zero-shot transfer and efficient fine-tuning, GLM provides a versatile alternative to proprietary LLMs for developers and researchers.

https://github.com/THUDM/GLM