Key Large Language Models (LLMs) in China

Avoid hype and explore AI & ML in depth and width. Get the full perspective: news, company profiles, AI history, global AI policies, and investment trends from the industry experts

1. CPM (2020, 2.6B)

   • Paper: https://arxiv.org/pdf/2012.00413.pdf

   • https://Code: https://https://github.com/TsinghuaAI/CPM-1-Generate

2. M6 (2021, 100B)

   • Paper: https://arxiv.org/pdf/2103.00823.pdf

3. PLUG (2021, 27B)

   • Article: https://www.infoq.cn/article/EFIHo75sQsVqLvFTruKE#alibaba

4. PanGu-α (2021, 207B)

   • Paper: https://arxiv.org/pdf/2104.12369.pdf

5. ConSERT (2021, 345B)

   • Paper: https://arxiv.org/pdf/2105.11741.pdf

Every day we post helpful lists and bite-sized explanations on our Twitter. Please join us there!

Some key LLMs in China

1. CPM (2020, 2.6B) @Tsinghua_Uni
2. M6 (2021, 100B) @AlibabaGroup, @Tsinghua_Uni
3. PLUG (2021, 27B) @AlibabaGroup
4. PanGu-α (2021, 207B) @Huawei, Recurrent AI, @PKU1898, Peng Cheng Lab
5. ConSERT (2021, 345B) @meituan

Links to papers 🧵

— TuringPost (@TheTuringPost)
May 16, 2023