granite3-dense

IBM Granite **2B** 和 **8B** 模型是文本专用的稠密 LLM，在超过 12 万亿个词元的数据上训练，在 IBM 的初始测试中，在性能和速度方面比其前代产品有了显着的改进。Granite-8B-Instruct 在 OpenLLM Leaderboard v1 和 OpenLLM Leaderboard v2 基准测试中，现在在性能上与 Llama 3.1 8B-Instruct 相媲美。

**它们旨在支持基于工具的用例**，并支持检索增强生成 (RAG)，简化代码生成、翻译和错误修复。

参数大小

ollama run granite3-dense:2b

ollama run granite3-dense:8b

支持的语言

英语、德语、西班牙语、法语、日语、葡萄牙语、阿拉伯语、捷克语、意大利语、韩语、荷兰语、简体中文

功能

摘要
文本分类
文本提取
问答
检索增强生成 (RAG)
与代码相关
函数调用
多语言对话用例

Granite 专家混合模型

Granite 专家混合模型有 **1B 和 3B** 参数大小，旨在实现 **低延迟使用**。

查看模型页面

了解更多

**开发人员：**IBM 研究院
**GitHub 代码库：**ibm-granite/granite-3.0-language-models
**网站**：Granite 文档
**发布时间：**2024 年 10 月 21 日
**许可证：**Apache 2.0.

![An illustration of Ollama holding a beautiful flower with the IBM Rebus logo of the Eye, Bee and M, made by Paul Rand.](https://ollama.org.cn/assets/library/granite3-dense/e2955da9-fee8-45d1-81ed-fe313f4e83eb)

### Granite dense models

The IBM Granite **2B** and **8B** models are text-only dense LLMs trained on over 12 trillion tokens of data, demonstrated significant improvements over their predecessors in performance and speed in IBM's initial testing. Granite-8B-Instruct now rivals Llama 3.1 8B-Instruct across both OpenLLM Leaderboard v1 and OpenLLM Leaderboard v2 benchmarks.

**They are designed to support tool-based use cases** and for retrieval augmented generation (RAG), streamlining code generation, translation and bug fixing.

## Parameter Sizes

**2B:**
  
`ollama run granite3-dense:2b`

**8B:**

`ollama run granite3-dense:8b`

## Supported Languages
English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, Chinese (Simplified)

### Capabilities
* Summarization
* Text classification
* Text extraction
* Question-answering
* Retrieval Augmented Generation (RAG)
* Code related 
* Function-calling
* Multilingual dialog use cases

### Granite mixture of experts models

The Granite mixture of experts models are available in **1B and 3B** parameter sizes designed for **low latency usage**.

[See model page](https://ollama.org.cn/library/granite3-moe)

### Learn more

- **Developers:** IBM Research
- **GitHub Repository:** [ibm-granite/granite-3.0-language-models](https://github.com/ibm-granite/granite-3.0-language-models)
- **Website**: [Granite Docs](https://www.ibm.com/granite/docs/)
- **Release Date**: October 21st, 2024
- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0).

粘贴、拖放或点击上传图像 (.png, .jpeg, .jpg, .svg, .gif)