Text Generation
Transformers
PyTorch
Safetensors
English
maba
maba-v1
maba-v1.1
recurrent
gated-deltanet
gdn
gdn-2
linear-attention
linear-recurrence
state-space-model
ssm
gqa
grouped-query-attention
swiglu
rmsnorm
rope
speculative-decoding
mtp
multi-token-prediction
tinystories
100m
nlp
casual-lm
transformer
qwen
minicpm
benchmark
Commit ·
9ffe417
1
Parent(s): dfa2d26
commit16
Browse files- config.json +3 -2
config.json
CHANGED
|
@@ -49,6 +49,7 @@
|
|
| 49 |
"eps": 1e-06,
|
| 50 |
"rms_norm_eps": 1e-06,
|
| 51 |
"init_std": 0.02,
|
| 52 |
-
"torch_dtype": "
|
| 53 |
-
"transformers_version": "4.49.0"
|
|
|
|
| 54 |
}
|
|
|
|
| 49 |
"eps": 1e-06,
|
| 50 |
"rms_norm_eps": 1e-06,
|
| 51 |
"init_std": 0.02,
|
| 52 |
+
"torch_dtype": "float32",
|
| 53 |
+
"transformers_version": "4.49.0",
|
| 54 |
+
"model_version": "1.1.0"
|
| 55 |
}
|