Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
443
20
404
John Leimgruber III
PRO
ubergarm
Follow
call-ret's profile picture
coughdrop's profile picture
knarp's profile picture
421 followers
·
65 following
https://blog.aifoundry.org/p/adventures-in-model-quantization
ubergarm
john-leimgruber
AI & ML interests
Open LLMs and Astrophotography image processing.
Recent Activity
new
activity
about 21 hours ago
RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF:
Yay more ik quants!
liked
a model
about 21 hours ago
RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF
new
activity
1 day ago
RDson/Qwen3.6-27B-MTP-Q4_K_M-GGUF:
提速效果不理想
View all activity
Organizations
ubergarm
's activity
All
Models
Datasets
Spaces
Buckets
Papers
Collections
Community
Posts
Upvotes
Likes
Articles
New activity in
RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF
about 21 hours ago
Yay more ik quants!
❤️
1
#1 opened about 21 hours ago by
ubergarm
liked
a model
about 21 hours ago
RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF
Text Generation
•
27B
•
Updated
5 days ago
•
20.7k
•
6
New activity in
RDson/Qwen3.6-27B-MTP-Q4_K_M-GGUF
1 day ago
提速效果不理想
7
#1 opened 7 days ago by
androidli
liked
a model
1 day ago
Lorbus/Qwen3.6-27B-int4-AutoRound
Image-Text-to-Text
•
6B
•
Updated
15 days ago
•
365k
•
87
New activity in
Lorbus/Qwen3.6-27B-int4-AutoRound
1 day ago
How does this fair against other quants without MTP like unsloth?
👍
1
1
#4 opened 12 days ago by
Crigges
New activity in
ubergarm/Qwen3.6-27B-GGUF
1 day ago
How to use MTP in GGUF?
17
#2 opened 7 days ago by
Friedland
liked
a model
1 day ago
google/gemma-4-31B-it-assistant
Any-to-Any
•
0.5B
•
Updated
2 days ago
•
19.9k
•
130
liked
a model
2 days ago
RDson/Qwen3.6-27B-MTP-Q4_K_M-GGUF
27B
•
Updated
8 days ago
•
2.35k
•
15
updated
a model
3 days ago
ubergarm/Qwen3.6-27B-GGUF
Text Generation
•
27B
•
Updated
3 days ago
•
8.91k
•
18
New activity in
ubergarm/Qwen3.6-27B-GGUF
6 days ago
Q6_0 use over Q6_K?
2
#3 opened 6 days ago by
resynth
New activity in
ubergarm/Qwen3.6-27B-GGUF
8 days ago
Great model for single GPU use cases.
🔥
4
16
#1 opened 12 days ago by
phakio
liked
a model
9 days ago
XiaomiMiMo/MiMo-V2.5-Pro
Text Generation
•
1T
•
Updated
9 days ago
•
20.9k
•
465
New activity in
ubergarm/Qwen3.5-122B-A10B-GGUF
10 days ago
How to split this model between 2 (3) GPUs and CPU/RAM ?
30
#12 opened about 2 months ago by
mancub
updated
a model
10 days ago
ubergarm/Kimi-K2.6-GGUF
Text Generation
•
1T
•
Updated
10 days ago
•
5.67k
•
35
liked
a model
13 days ago
bartowski/Qwen_Qwen3.6-27B-GGUF
Image-Text-to-Text
•
27B
•
Updated
14 days ago
•
85.1k
•
32
New activity in
ubergarm/Qwen3.5-35B-A3B-GGUF
13 days ago
Any plans to release Qwen3.6 ?
1
#3 opened 13 days ago by
ittokasso
updated
a model
13 days ago
ubergarm/Qwen3.5-27B-GGUF
Text Generation
•
27B
•
Updated
13 days ago
•
1.96k
•
16
New activity in
ubergarm/Qwen3.5-27B-GGUF
13 days ago
smol-IQ4_NL with turboquant is outstanding for 24GB VRAM
🔥
1
3
#7 opened 14 days ago by
IHaveNoClueAndIMustPost
published
a model
13 days ago
ubergarm/Qwen3.6-27B-GGUF
Text Generation
•
27B
•
Updated
3 days ago
•
8.91k
•
18
New activity in
ubergarm/Kimi-K2.6-GGUF
13 days ago
Much faster IQ2_KS quantization PPL results?
3
#10 opened 14 days ago by
gghfez
Load more