mlabonne/FineTome-100k
Viewer • Updated • 100k • 20.7k • 269
How to use mlx-community/dolphin-2.9.4-gemma2-2b-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir dolphin-2.9.4-gemma2-2b-mlx mlx-community/dolphin-2.9.4-gemma2-2b-mlx
The Model mlx-community/dolphin-2.9.4-gemma2-2b-mlx was converted to MLX format from cognitivecomputations/dolphin-2.9.4-gemma2-2b using mlx-lm version 0.17.0.
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/dolphin-2.9.4-gemma2-2b-mlx")
response = generate(model, tokenizer, prompt="hello", verbose=True)
Quantized
Base model
google/gemma-2-2b