RedHatAI
/

gemma-4-12B-it-FP8-Dynamic

image-text-to-text

compressed-tensors

Model card Files Files and versions

robgreenberg3 commited on Aug 13

Commit

b46b703

·

verified ·

1 Parent(s): 09b45ec

Update README.md

Files changed (1) hide show

README.md +5 -1

README.md CHANGED Viewed

@@ -24,8 +24,12 @@ validated_on:
   - vLLM 0.24.0
 ---
-# NVFP4 Quantized RedHatAI/gemma-4-12B-it-NVFP4
 This is a preliminary version (and subject to change) of FP8_Dynamic quantized [google/gemma-4-12B-it](https://huggingface.co/google/gemma-4-12B-it) model.
 The model has both weights and activations quantized to FP8_Dynamic format with [vllm-project/llm-compressor](https://github.com/vllm-project/llm-compressor).

   - vLLM 0.24.0
 ---
+<h1 align: center; style="display: flex; align-items: center; gap: 10px; margin: 0;">
+  gemma-4-12B-it-FP8-Dynamic
+  <img src="https://www.redhat.com/rhdc/managed-files/Catalog-Validated_model_0.png" alt="Model Icon" width="40" style="margin: 0; padding: 0;" />
+</h1>
+# FP8 Quantized RedHatAI/gemma-4-12B-it-FP8
 This is a preliminary version (and subject to change) of FP8_Dynamic quantized [google/gemma-4-12B-it](https://huggingface.co/google/gemma-4-12B-it) model.
 The model has both weights and activations quantized to FP8_Dynamic format with [vllm-project/llm-compressor](https://github.com/vllm-project/llm-compressor).