Developer Guide

The Developer Guide explains how to build, run, configure, debug, and extend Cube AI. It includes the local development workflow and advanced topics such as private model upload and fine-tuning.

Sections

• Building and Running Cube AI
• Using vLLM and Ollama Backends
• Configuring the Environment
• Chat UI
• Hardware Abstraction Layer (HAL)
• Cloud-Init - Ubuntu-based deployment with cloud-init provisioning
• CVM Management
• Private Model Upload - Deploy custom models via HAL build-time config, cloud-init, or runtime upload
• Fine-Tuning Models
• Guardrails - AI safety controls for input validation and output sanitization

Use the sidebar to navigate through each topic.