Instructions to use PrunaAI/katanemo-Arch-Router-1.5B-HQQ-4bit-smashed with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Pruna AI
How to use PrunaAI/katanemo-Arch-Router-1.5B-HQQ-4bit-smashed with Pruna AI:
from pruna import PrunaModel model = PrunaModel.from_pretrained("PrunaAI/katanemo-Arch-Router-1.5B-HQQ-4bit-smashed") - Notebooks
- Google Colab
- Kaggle
Ctrl+K