Jccc-l/procqa_cpp
Viewer • Updated • 418k • 124
How to use Jccc-l/Qwen2.5-0.5B-LoRA-ProCQA-cpp-GPTQ-Int8 with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("question-answering", model="Jccc-l/Qwen2.5-0.5B-LoRA-ProCQA-cpp-GPTQ-Int8") # Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Jccc-l/Qwen2.5-0.5B-LoRA-ProCQA-cpp-GPTQ-Int8", dtype="auto")Configuration Parsing Warning:Config file config.json cannot be fetched (too big)
Base model
Qwen/Qwen2.5-0.5B