Large language models

This section provides sample demo usage for large language models (LLM).

📄️ Qwen2.5-1.5B-Instruct

This document explains how to run the Qwen2.5-1.5B sample application on a host device equipped with the Radxa AICore AX-M1.

📄️ Qwen3-1.7B

This document explains how to run the Qwen3-1.7B sample application on a host device equipped with the Radxa AICore AX-M1.

📄️ MiniCPM4-0.5B

This document explains how to run the MiniCPM4-0.5B sample application on a host device equipped with the Radxa AICore AX-M1.

📄️ DeepSeek-R1-Qwen-1.5B

This document explains how to run the DeepSeek-R1-Qwen-1.5B sample application on a host device equipped with the Radxa AICore AX-M1.

📄️ DeepSeek-R1-Qwen-7B

This document explains how to run the DeepSeek-R1-Distill-Qwen-7B-GPTQ-Int4 sample application on a host device equipped with the Radxa AICore AX-M1.

📄️ SmolLM2-360M-Instruct

This document explains how to run the SmolLM2-360M-Instruct sample application on a host device equipped with the Radxa AICore AX-M1.