Inkling-Small-NVFP4

Catalog model officially supported by Inference Endpoints.

This model is from our Model Catalog, and comes with pre-configured recipes. Deployment has been verified by Hugging Face.

$10 / h

per running replica

Let your agents deploy it

Use the hf CLI or connect our MCP server so your AI assistant can manage your endpoints directly, then copy a prompt for it to deploy this model.

Amazon Web Services

Microsoft Azure

Google Cloud Platform

Nvidia H200

2x GPUs · 282 GB 46x vCPUs · 512 GB

$10 / h

Catalog Recipe Pre-selected hardware for the current recipe.

Private Public Authenticated

Only you can access your endpoint, using a Hugging Face Token generated from your personal account.

Automatic Scale-to-Zero

Endpoints scaled to 0 replicas are not billed. They may take some time to scale back up once they start receiving requests again.

Number of replicas

Automatically scale the number of replicas within Min and Max based on compute usage. Min is always 0 if Scale-To-Zero is active.

Min Max

More options

Autoscaling Strategy

Control what type of trigger will cause your Endpoint to scale up.

Hardware Usage Pending Requests

Hardware Utilization Threshold (%)

A scale up event will be triggered if the average hardware utilisation (%) exceeds this threshold for more than 20 seconds.

This Catalog Recipe comes with a pre-configured vLLM engine.

This Catalog Recipe comes with pre-configured env values.

VPC Config

Check to activate and configure AWS PrivateLink

Use AWS PrivateLink