Instructions to use Naphula/Dark-World-24B-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Naphula/Dark-World-24B-v1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Naphula/Dark-World-24B-v1")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Naphula/Dark-World-24B-v1")
model = AutoModelForCausalLM.from_pretrained("Naphula/Dark-World-24B-v1")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Naphula/Dark-World-24B-v1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Naphula/Dark-World-24B-v1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Naphula/Dark-World-24B-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Naphula/Dark-World-24B-v1

SGLang

How to use Naphula/Dark-World-24B-v1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Naphula/Dark-World-24B-v1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Naphula/Dark-World-24B-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Naphula/Dark-World-24B-v1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Naphula/Dark-World-24B-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Naphula/Dark-World-24B-v1 with Docker Model Runner:
```
docker model run hf.co/Naphula/Dark-World-24B-v1
```
Browse Quantizations to use this model in llama.cpp, Ollama, LM Studio, or any compatible app.

Dark World 24B v1

A creative, evil, and uncensored merge.

The Dark World is an alternate version of the human universe (the Normal World, or Light World) where biomechanical creatures (known as Dark Worlders) dwell. Every building or individual in the Normal World has another version of themselves in the Dark World.

The Dark World has always existed since the Normal World came into existence, as a negative counterpart of sorts. It exists as a "dark side" of the Normal World: what humans would consider insane, the Dark Worlders see as sane; what humans perceive to be painful, Dark Worlders see as pleasurable. Those counterparts which are absent have either been lost through time or catastrophe. Events in either world can affect events in its counterpart - especially electromagnetic correlations.

The sun never shines in the Dark World, but there still exists a concept of "day" and "night" within. While humans are unable to discern this, Dark Worlders are able to tell. However, few Dark Worlders concern themselves with temporal ideas of day or night, save for the soldiers and sentries.

In their relationship to humans, the Dark Worlders can range from friendly (such as the Keeper of the Scrolls) to hostile (Drekketh Guard). The vast majority of Dark Worlders wish to live in peaceful coexistence with Normal Worlders. Though Normal World visitors are rare, a few have managed over the centuries to find portals to the Dark World. By contrast, Dark Worlders are not able to cross into the Normal World, as they need the chaos of their world in order to exist.

architecture: MistralForCausalLM
merge_method: karcher
dtype: bfloat16
models:
  - model: Naphula/BeaverAI_Fallen-Mistral-Small-3.1-24B-v1e_textonly
  - model: Naphula/Evilmind-24B-v1
  - model: TheDrummer/Magidonia-24B-v4.2.0
  - model: trashpanda-org/MS3.2-24B-Mullein-v2
parameters:
tokenizer:
source: union
chat_template: auto