大模型入门指南· 第 3 / 3 页
总结
说来可笑，ChatGPT 的开发者 OpenAI 并不像其名字那样开放，ChatGPT 的源码与模型数据是不对外开放的，但不久， Meta 在 2023 年 2 月份开源了 LLaMA 1([19])，并在 7 月接着发布了进阶的Llama 2([20])，而且允许商用。 Meta 此举无疑极大推进的大模型的发展，坊间甚至一度流传这么一篇文章：Google "We Have No Moat, And Neither Does OpenAI"，说 Meta 才是大模型时代的最大赢家， OpenAI、Google 都要靠边站。
大模型时代到来了，你的工作离被取代还远吗？
参考
Announcing GPTQ & GGML Quantized LLM support for Huggingface Transformers – PostgresML([21])
- Beginner's guide to Llama models([22])
Demystifying Tokens in LLMs: Understanding the Building Blocks of Large Language Models 🧱🔍([23])
Awesome-LLM: a curated list of Large Language Model([24])
- 搞懂语言大模型（番外）：40+应用案例精选([25])
参考资料
[1] 大模型: https://en.wikipedia.org/wiki/Large_language_model
[2] Token: https://learn.microsoft.com/en-us/semantic-kernel/prompt-engineering/tokens
[3] embedding: https://learn.microsoft.com/en-us/semantic-kernel/memories/embeddings
[4] Attention Is All You Need: https://arxiv.org/abs/1706.03762
[5] GPTQ: https://arxiv.org/abs/2210.17323
[6] TheBloke: https://huggingface.co/TheBloke
[7] ggerganov/llama.cpp: Port of Facebook's LLaMA model in C/C++: https://github.com/ggerganov/llama.cpp
[8] ggerganov/whisper.cpp: Port of OpenAI's Whisper model in C/C++: https://github.com/ggerganov/whisper.cpp
[9] Llama-2-7B-Chat-GGML: https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML
[10] ggerganov/whisper.cpp: https://huggingface.co/ggerganov/whisper.cpp/tree/main
[11] Bard: https://bard.google.com/
[12] Copilot: https://github.com/features/copilot
[13] Tabnine: https://www.tabnine.com/
[14] Codeium: https://codeium.com/
[15] Amazon CodeWhisperer: https://aws.amazon.com/codewhisperer/
[16] SourceGraph Cody: https://about.sourcegraph.com/cody
[17] Tabby: https://tabbyml.github.io/tabby/
[18] fauxpilot/fauxpilot: https://github.com/fauxpilot/fauxpilot
[19] LLaMA 1: https://ai.meta.com/blog/large-language-model-llama-meta-ai/
[20] Llama 2: https://ai.meta.com/blog/llama-2/
[21] Announcing GPTQ & GGML Quantized LLM support for Huggingface Transformers – PostgresML: https://postgresml.org/blog/announcing-gptq-and-ggml-quantized-llm-support-for-huggingface-transformers
[22] Beginner's guide to Llama models: https://agi-sphere.com/llama-guide/
[23] Demystifying Tokens in LLMs: Understanding the Building Blocks of Large Language Models 🧱🔍: https://www.linkedin.com/pulse/demystifying-tokens-llms-understanding-building-blocks-lukas-selin/
[24] Awesome-LLM: a curated list of Large Language Model: https://github.com/Hannibal046/Awesome-LLM
[25] 搞懂语言大模型（番外）：40+应用案例精选: https://sspai.com/post/80071