minicpm-v:8b-2.6-q5_K_S

MiniCPM-V 2.6 是 MiniCPM-V 系列中最新且功能最强大的模型。该模型基于 SigLip-400M 和 Qwen2-7B 构建，总共有 8B 参数。与 MiniCPM-Llama3-V 2.5 相比，它在性能上有了显著提升，并为多图像和视频理解引入了新功能。 MiniCPM-V 2.6 的显著特点包括

🔥 领先性能：MiniCPM-V 2.6 在最新版本的 OpenCompass 上取得了 65.2 的平均分，OpenCompass 是对 8 个流行基准的综合评估。仅有 8B 参数，它在单图像理解方面超越了广泛使用的专有模型，如 GPT-4o mini、GPT-4V、Gemini 1.5 Pro 和 Claude 3.5 Sonnet。
🖼️ 多图像理解和上下文学习。 MiniCPM-V 2.6 还可以执行多图像的对话和推理。它在流行的多图像基准测试（如 Mantis-Eval、BLINK、Mathverse mv 和 Sciverse mv）上实现了最先进的性能，并且在上下文学习能力方面也显示出前景。
💪 强大的 OCR 能力：MiniCPM-V 2.6 可以处理任何宽高比且高达 180 万像素（例如，1344x1344）的图像。它在 OCRBench 上实现了最先进的性能，超越了 GPT-4o、GPT-4V 和 Gemini 1.5 Pro 等专有模型。基于最新的 RLAIF-V 和 VisCPM 技术，它具有值得信赖的行为，在 Object HalBench 上的幻觉率明显低于 GPT-4o 和 GPT-4V，并支持英语、中文、德语、法语、意大利语、韩语等多种语言能力。
🚀 卓越的效率：除了友好的尺寸外，MiniCPM-V 2.6 还显示出最先进的令牌密度（即，编码到每个视觉令牌中的像素数）。在处理 180 万像素图像时，它仅生成 640 个令牌，比大多数模型少 75%。这直接提高了推理速度、首个令牌延迟、内存使用量和功耗。

参考

GitHub

Hugging Face

> Note: this model requires [Ollama 0.3.10](https://github.com/ollama/ollama/releases/tag/v0.3.10) or later.

MiniCPM-V 2.6 is the latest and most capable model in the MiniCPM-V series. The model is built on SigLip-400M and Qwen2-7B with a total of 8B parameters. It exhibits a significant performance improvement over MiniCPM-Llama3-V 2.5, and introduces new features for multi-image and video understanding. Notable features of MiniCPM-V 2.6 include:

* **🔥 Leading Performance**: MiniCPM-V 2.6 achieves an average score of 65.2 on the latest version of OpenCompass, a comprehensive evaluation over 8 popular benchmarks. With only 8B parameters, it surpasses widely used proprietary models like GPT-4o mini, GPT-4V, Gemini 1.5 Pro, and Claude 3.5 Sonnet for single image understanding.

* **🖼️ Multi Image Understanding and In-context Learning**. MiniCPM-V 2.6 can also perform conversation and reasoning over multiple images. It achieves state-of-the-art performance on popular multi-image benchmarks such as Mantis-Eval, BLINK, Mathverse mv and Sciverse mv, and also shows promising in-context learning capability.

* **💪 Strong OCR Capability**: MiniCPM-V 2.6 can process images with any aspect ratio and up to 1.8 million pixels (e.g., 1344x1344). It achieves state-of-the-art performance on OCRBench, surpassing proprietary models such as GPT-4o, GPT-4V, and Gemini 1.5 Pro. Based on the the latest RLAIF-V and VisCPM techniques, it features trustworthy behaviors, with significantly lower hallucination rates than GPT-4o and GPT-4V on Object HalBench, and supports multilingual capabilities on English, Chinese, German, French, Italian, Korean, etc.

* **🚀 Superior Efficiency**: In addition to its friendly size, MiniCPM-V 2.6 also shows state-of-the-art token density (i.e., number of pixels encoded into each visual token). It produces only 640 tokens when processing a 1.8M pixel image, which is 75% fewer than most models. This directly improves the inference speed, first-token latency, memory usage, and power consumption.

## Refrences

[GitHub](https://github.com/OpenBMB/MiniCPM-V)

[Hugging Face](http://hugging-face.cn/openbmb/MiniCPM-V-2_6)

粘贴、拖放或点击上传图片 (.png, .jpeg, .jpg, .svg, .gif)