Skip to main content
This page lists all quantization methods supported by SynapsAI Cloud.
TaskAvailable Quantizations
text-generationBitsAndBytes Int8, BitsAndBytes Int4, EETQ, Quanto Int8, Quanto Int4, Quanto FP8, Fbgemm FP8
image-text-to-textBitsAndBytes Int8, BitsAndBytes Int4, EETQ, Quanto Int8, Quanto Int4, Quanto FP8, Fbgemm FP8
audio-text-to-textBitsAndBytes Int8, BitsAndBytes Int4, EETQ, Quanto Int8, Quanto Int4, Quanto FP8, Fbgemm FP8
video-text-to-textBitsAndBytes Int8, BitsAndBytes Int4, EETQ, Quanto Int8, Quanto Int4, Quanto FP8, Fbgemm FP8
image-to-imageBitsAndBytes Int8, BitsAndBytes Int4
unconditional-image-generationBitsAndBytes Int8, BitsAndBytes Int4
text-to-imageBitsAndBytes Int8, BitsAndBytes Int4
text2text-generationBitsAndBytes Int8, BitsAndBytes Int4
summarizationBitsAndBytes Int8, BitsAndBytes Int4
translationBitsAndBytes Int8, BitsAndBytes Int4
⌘I