orca-mini

Orca Mini是基于Llama和Llama 2模型训练的，使用论文“Orca: Progressive Learning from Complex Explanation Traces of GPT-4”中定义的方法创建的Orca Style数据集。有两个版本可用。最初的基于Llama的Orca Mini，参数量分别为30亿、70亿和130亿；以及基于Llama 2的v3版本，参数量分别为70亿、130亿和700亿。

使用

CLI

打开终端并运行ollama run orca-mini

API

示例

  curl -X POST https://127.0.0.1:11434/api/generate -d '{
    "model": "orca-mini",
    "prompt":"Why is the sky blue?"
   }'

内存需求

7b模型通常需要至少8GB的内存
13b模型通常需要至少16GB的内存
70b模型通常需要至少64GB的内存

参考

3b参数的原始来源: Pankaj Mathur

7b参数的原始来源: Pankaj Mathur

13b参数的原始来源: Pankaj Mathur

Ollama上的Orca Mini v3源代码

13b参数的原始来源: Pankaj Mathur

70b参数的来源: Pankaj Mathur

Orca: Progressive Learning from Complex Explanation Traces of GPT-4

Orca Mini is a Llama and Llama 2 model trained on Orca Style datasets created using the approaches defined in the paper, Orca: Progressive Learning from Complex Explanation Traces of GPT-4. There are two variations available. The original Orca Mini based on Llama in 3, 7, and 13 billion parameter sizes, and v3 based on Llama 2 in 7, 13, and 70 billion parameter sizes.

## Usage

### CLI

Open the terminal and run `ollama run orca-mini`

### API

Example:

```bash
  curl -X POST https://127.0.0.1:11434/api/generate -d '{
    "model": "orca-mini",
    "prompt":"Why is the sky blue?"
   }'
  ```

## Memory requirements

- 7b models generally require at least 8GB of RAM
- 13b models generally require at least 16GB of RAM
- 70b models generally require at least 64GB of RAM

## Reference

3b parameters original source:
 [Pankaj Mathur](https://hugging-face.cn/psmathur/orca_mini_3b)

7b parameters original source:
 [Pankaj Mathur](https://hugging-face.cn/psmathur/orca_mini_7b)

13b parameters original source:
 [Pankaj Mathur](https://hugging-face.cn/psmathur/orca_mini_13b)

**Orca Mini v3 source on Ollama**

13b parameters original source:
 [Pankaj Mathur](https://hugging-face.cn/psmathur/orca_mini_v3_13b)

70b parameters source:
 [Pankaj Mathur](https://hugging-face.cn/psmathur/orca_mini_v3_70b)

[Orca: Progressive Learning from Complex Explanation Traces of GPT-4](https://arxiv.org/abs/2306.02707 )

粘贴、拖放或点击上传图像（.png、.jpeg、.jpg、.svg、.gif）