Untitled

List of Basic Model

模型名称 发布时间 发布机构 参数规模 Token 规模 相关资料 是否开源
T5 2019-10 Google 13B https://arxiv.org/pdf/1910.10683.pdf ‣ Y
GPT-3 2020-05 OpenAI 175B 300B https://arxiv.org/pdf/2005.14165.pdf
LaMDA 2021-05 Google 137B 2.8T https://arxiv.org/pdf/2201.08239.pdf
OPT 2022-05 Meta 125M-175B 180B https://arxiv.org/pdf/2205.01068.pdf https://github.com/facebookresearch/metaseq/tree/main/projects/OPT
https://www.bilibili.com/video/BV1XT411v7c9 Y
GLM-130B 2022-08 THU 130B 400B https://arxiv.org/pdf/2210.02414.pdf ‣ Y
LLaMA 2023-02 Meta 7B-65B 1.4T https://arxiv.org/pdf/2302.13971v1.pdf https://github.com/facebookresearch/llama
https://zhuanlan.zhihu.com/p/618776565 Y
BLOOM 202-07 BigScience 176B 366B https://arxiv.org/pdf/2211.05100.pdf https://huggingface.co/bigscience Y

List of Finetuned Model

模型名称 发布时间 发布机构 参数规模 基础模型 相关资料 是否开源
GPT-3.5 2021-06 OpenAI 175B GPT-3 https://platform.openai.com/docs/models/gpt-3-5
T0 2021-10 Hugging Face 13B T5 https://arxiv.org/pdf/2110.08207.pdf https://huggingface.co/bigscience/T0 Y
BLOOMZ 2022-11 Hugging Face 137B BLOOM https://arxiv.org/pdf/2211.01786.pdf ‣ Y
ChatGPT 2022-11 OpenAI 173B GPT-3.5 https://openai.com/blog/chatgpt
Alpaca 2023-03-14 Standford 7B LLaMA https://crfm.stanford.edu/2023/03/13/alpaca.html Y
ChatGLM 2023-03-14 Tsinghua 6B/130B GLM https://chatglm.cn/blog Y
Bard 2023-03-21 Google 137B LaMDA https://bard.google.com/
Dolly 2023-03-22 https://huggingface.co/databricks/dolly-v1-6b
GPT4All-7B 2023-03-29 nomic.ai LLaMA ‣ Y
Vicuna 2023-03-31 UCB 7B/13B LLaMA-13b ‣
https://twitter.com/lmsysorg/status/1641529839038640128
https://twitter.com/AlphaSignalAI/status/1641854039187914765
https://zhuanlan.zhihu.com/p/619257262 Y
Baize 2023-04-03 UCSD LLaMA ‣ https://huggingface.co/spaces/project-baize/baize-lora-7B Y
StackLLaMa 2023-04-05 Hugging Face 7B LLaMA https://huggingface.co/spaces/trl-lib/stack-llama Y
Chinese-LLaMA-Alpaca 2023-04-07 7B/13B LLaMA Chinese-LLaMA-Alpaca Y
OpenAssistant 2023-04-16 https://twitter.com/omarsar0/status/1647339407173664772

Untitled

Untitled

More