Large Language Models

This document explains how to run the large language model (LLM) example application on a host device equipped with the Radxa AICore AX-M1.

📄️ Qwen2.5-1.5B-Instruct

This document explains how to run the Qwen2.5-1.5B example application on a host device equipped with the Radxa AICore AX-M1.

📄️ Qwen3-1.7B

This document explains how to run the Qwen3-1.7B example application on a host device equipped with the Radxa AICore AX-M1.

📄️ MiniCPM4-0.5B

This document explains how to run the MiniCPM4-0.5B example application on a host device equipped with the Radxa AICore AX-M1.

📄️ DeepSeek-R1-Qwen-1.5B

This document explains how to run the DeepSeek-R1-Qwen-1.5B example application on a host device equipped with the Radxa AICore AX-M1.

📄️ DeepSeek-R1-Qwen-7B

This document explains how to run the DeepSeek-R1-Distill-Qwen-7B-GPTQ-Int4 example application on a host device equipped with the Radxa AICore AX-M1.

📄️ SmolLM2-360M-Instruct

This document explains how to run the SmolLM2-360M-Instruct example application on a host device equipped with the Radxa AICore AX-M1.