llama-quantize command. Add --run to
execute it; Arka creates the output directory automatically. Install a
llama.cpp build exposing llama-quantize before running conversions.Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Create smaller GGUF models with a safe preview-first workflow.
arka quantize model-f16.gguf --output model-q4.gguf --type Q4_K_M
arka quantize model-f16.gguf --output model-q4.gguf --type Q4_K_M --run
llama-quantize command. Add --run to
execute it; Arka creates the output directory automatically. Install a
llama.cpp build exposing llama-quantize before running conversions.Was this page helpful?