granite3-moe:3b-instruct-q5_K_S

![An illustration of Ollama holding a beautiful flower with the IBM Rebus logo of the Eye, Bee and M, made by Paul Rand.](http://ollama.org.cn/assets/library/granite3-moe/6ea49528-3ff2-4fcc-98b2-01f6104254d2)

### Granite mixture of experts models

The IBM Granite **1B and 3B models** are the first mixture of experts (MoE) Granite models from IBM designed for low latency usage.

The models are trained on over 10 trillion tokens of data, the Granite MoE models are ideal for deployment in on-device applications or situations requiring instantaneous inference.

## Parameter Sizes

**1B:**
  
`ollama run granite3-moe:1b`

**3B:**

`ollama run granite3-moe:3b`

## Supported Languages
English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, Chinese (Simplified)

### Capabilities
* Summarization
* Text classification
* Text extraction
* Question-answering
* Retrieval Augmented Generation (RAG)
* Code related 
* Function-calling
* Multilingual dialog use cases

### Granite dense models

The Granite dense models are available in **2B and 8B** parameter sizes designed to support tool-based use cases and for retrieval augmented generation (RAG), streamlining code generation, translation and bug fixing.

[See model page](http://ollama.org.cn/library/granite3-dense)

### Learn more

- **Developers:** IBM Research
- **GitHub Repository:** [ibm-granite/granite-3.0-language-models](https://github.com/ibm-granite/granite-3.0-language-models)
- **Website**: [Granite Docs](https://www.ibm.com/granite/docs/)
- **Release Date**: October 21st, 2024
- **License:** [Apache 2.0](http://apache.ac.cn/licenses/LICENSE-2.0).

粘贴、拖放或点击上传图片 (.png, .jpeg, .jpg, .svg, .gif)