Cluster Models.
Community models. All are accessed via the same OpenAI-compatible API
with the same base URL.
glm5.3 - 753B MoE
multimodal text generation & chat · agentic coding
Premium tier: callable only with a key on the GLM 5.3 premium membership. ~753B parameter MoE model, focused on coding and long-horizon agentic tasks. 1M token context. Multimodal: it takes images, audio and video as well as text. Tool calling and reasoning (emits a reasoning trace). 3,000M token quota per member, and the counter goes back to zero when your billing period starts. Also capped at 400M tokens per rolling 4h window, which is the limit a heavy coding-agent run reaches first.
- Type
- MoE (~753B total)
- Quantization
- NVFP4
- Attention
- Sparse attention
- Context
- 1M tokens
- Input modalities
- text · image · audio · video
- Output modalities
- text
- Allowance / billing period
- 3,000M tokens / member
- Rolling 4h window
- 400M tokens
capabilities
- Tool calling (function calling)
- Reasoning control (
reasoning_effort:minimaltomax; always reasons,noneis applied asminimal) · details - Vision (image input)
- Audio (audio input)
- Video (video input)
- Coding and long-horizon agentic tasks
- 1M token context
- Streaming generation (SSE)
- Requires the GLM 5.3 premium tier
deepseek-v4-flash - 305B MoE
text generation, chat & vision
305B parameter MoE model, served as the Vision-Exp variant: it takes images as input. 1M token context. Tool calling and reasoning. 3B token monthly quota per member. Structured output depends on the host: on api.helmcode.com, response_format json_schema and json_object are accepted; on api.nan.builders, json_object is supported (the prompt must contain the word JSON, otherwise it is rejected with a 400) and json_schema is rejected with a 400. json_object guarantees syntactically valid JSON only, not its shape: describe the schema in the prompt. For schema-constrained output on api.nan.builders, use qwen3.6 or gemma4, where json_schema with strict constrains fields, types and required keys; or, on this model, force one function tool whose parameters is your schema (see Examples). While reasoning is on, a max_tokens below 16384 is raised to 16384 so the reasoning fits, so a prompt within 16384 tokens of the 1,048,576-token window is rejected with a 400 even with a small max_tokens (usually Context length exceeded, sometimes a generic Invalid request). With reasoning off (reasoning_effort "none" or any of its aliases) your max_tokens is used as sent.
- Type
- MoE (305B total)
- Quantization
- FP8
- Context
- 1M tokens
- Input modalities
- text · image
- Output modalities
- text
- Monthly quota
- 3B tokens / member
capabilities
- Tool calling
- Reasoning control (
reasoning_effort:noneturns it off ·minimaltomax) · details - Vision (image input)
- JSON mode (
json_object; on api.nan.builders the prompt must mention JSON) ·json_schema: 400 on api.nan.builders, accepted on api.helmcode.com - 1M token context
- Streaming generation (SSE)
glm5.3-flash - 320B-18B
multimodal text generation & chat
320B parameter MoE model (18B active), natively multimodal, with tool calling and reasoning. 1M token context. 2B token monthly quota per member. MIT license.
- Type
- MoE (320B total · 18B active)
- Quantization
- FP8
- Context
- 1M tokens
- Input modalities
- text · image
- Output modalities
- text
- Monthly quota
- 2B tokens / member
- License
- MIT
capabilities
- Tool calling (function calling)
- Reasoning control (
reasoning_effort:minimaltomax; always reasons,noneis applied asminimal) · details - Vision (image input)
- 1M token context
- Streaming generation (SSE)
qwen3.8-flash - 125B-6B
text generation, chat & vision
125B parameter MoE model (6B active), multimodal with vision, tool calling and reasoning on by default. 1M token context (1,048,576 tokens). 500M token monthly quota per member.
- Type
- MoE (125B total · 6B active)
- Context
- 1M tokens
- Max answer
- 131K tokens
- Input modalities
- text · image
- Output modalities
- text
- Monthly quota
- 500M tokens / member
- License
- qwen-community-1.0
capabilities
- Tool calling (XML format)
- Reasoning on by default (
reasoning_effort:noneturns it off ·minimaltomax) · details - Vision (image input)
- 1M token context
- Streaming generation (SSE)
mimo-v2.6-flash - omnimodal
omnimodal — text, vision & audio
The newest Xiaomi MiMo, natively omnimodal with vision and audio input. 1M token context. Tool calling and reasoning. 1.0B token monthly quota per member.
- Context
- 1M tokens
- Input modalities
- text · image · audio
- Output modalities
- text
- Monthly quota
- 1.0B tokens / member
capabilities
- Tool calling (function calling)
- Reasoning control (
reasoning_effort:noneturns it off ·lowtomax; recommendedmax_tokens ≥ 300) · details - Vision (image input)
- Audio (audio input)
- 1M token context
- Streaming generation (SSE)
gemma4 - 26B-A4B
text generation & chat
26B parameter MoE model (4B active), multimodal with vision. Tool calling and reasoning.
- Type
- MoE (26B total · 4B active)
- Quantization
- FP8
- Context
- 262K tokens
- Sampling
- temp=0.6, top_p=0.95
- Reasoning
- reasoning_config={}
capabilities
- Tool calling (XML format)
- Reasoning control (
reasoning_effort:noneorminimalturns it off ·lowtomax) · details - Multimodal (vision / images)
- Streaming generation (SSE)
qwen3.6 - 35B-A3B
text generation & chat
The previous generation. 35B parameter MoE, multimodal, with tool calling and reasoning. It still answers so that configurations naming it keep working, but deepseek-v4-flash is what to start from today.
- Type
- MoE (35B total)
- Active per token
- 3B
- Quantization
- FP8
- Context
- 262K tokens
- Speculative decoding
- MTP → ~2x throughput
- Sampling
- temp=0.6, top_p=0.95
- Reasoning
- reasoning_config={}
capabilities
- Tool calling (XML format)
- Reasoning control (
reasoning_effort:noneorminimalturns it off ·lowtomax) · details - Multimodal (vision / images)
- Streaming generation (SSE)
qwen3-embedding - 8B
vector embeddings
Vector embedding model. MMTEB score 70.58 — top-tier open models. Supports 100+ languages including Spanish and code.
- Dimension
- 4096
- Precision
- Float32 (CPU)
- RPM
- 60
- Batch size
- 32
use cases
- Cross-lingual similarity (ES↔EN: 0.915)
- Semantic search
- Text classification
- RAG / retrieval augmentation
rerank - Qwen3-Reranker-8B
semantic reranking
8B parameter reranking model (BF16). Reorders a list of documents by relevance to a query. Completes the RAG stack alongside qwen3-embedding: first retrieve top-K via embeddings, then rerank for precision. Supports 100+ languages including Spanish, code retrieval, and cross-lingual. Top-tier on MTEB reranking benchmarks.
- Parameters
- 8B
- Precision
- BF16
- Endpoints
- /v1/rerank · /v2/rerank
- Languages
- 100+
use cases
- Reranking in RAG pipelines (embedding → rerank → LLM)
- Cross-lingual search (ES↔EN, etc.)
- Code retrieval
- Query-document relevance scoring
kokoro - v1.0
text-to-speech
82M parameter TTS with 67 voice packs. Sub-second latency on CPU.
- Latency
- < 1s
- Parameters
- 82M
- RPM
- 15
available voices
- af_heart — English (female)
- ef_dora — Spanish (female)
- em_alex — Spanish (male)
- 67 voice packs total (see full list)
whisper - large-v3
speech-to-text
CPU-based STT with CTranslate2 and INT8. ~1x realtime. 99+ languages.
- Size
- ~3 GB (INT8)
- WER ES
- ~3.2%
- RPM
- 10
capabilities
- Audio-to-text transcription
- 99+ languages
- Automatic language detection
- OpenAI-compatible API
known limitations
- File size limit — 25 MB
- Maximum size per request. Compressed formats (OGG/Opus, MP3) make better use of this limit than uncompressed WAV.
- Timeout — audios > 2 min duration
- Whisper processes on CPU at ~1x realtime. For audios longer than ~2 minutes, the proxy may return a
524(timeout) error before transcription completes. Use compressed formats like OGG/Opus and split long files into ≤ 2 minute segments to avoid this. - Recommended formats
OGG/OpusandMP3— smaller files, same transcription quality. A 60-minute audio in OGG/Opus at 48 kbps takes ~20 MB vs ~550 MB in WAV.
flux-2-klein
image generation
FLUX diffusion model for text-to-image and image-to-image. Compatible with OpenAI's Images API (/v1/images/generations and /v1/images/edits). Requires inference-tier membership.
- Type
- Diffusion (FLUX)
- Modalities
- text→image · image→image
- Resolution
- 256–1536 px (multiples of 16)
- Images / request
- 1–4 (n)
- Monthly quota
- 100 requests / member
capabilities
- Text-to-image (
/v1/images/generations) - Image-to-image with up to 4 references (
/v1/images/edits) - Output as temporary URL (R2, ~60 min) or base64
- Reproducibility via
seedandguidancecontrol
qwen-image-2.1
image generation
Qwen image model for text-to-image with strong prompt adherence and clean text rendering inside the image. Compatible with OpenAI's Images API (/v1/images/generations). Requires inference-tier membership.
- Type
- Diffusion (Qwen-Image)
- Modalities
- text→image
- Resolution
- 512–1280 px (multiples of 16)
- Images / request
- 1–4 (n)
- Monthly quota
- 100 requests / member (shared with flux-2-klein)
capabilities
- Text-to-image (
/v1/images/generations) - Output as temporary URL (R2, ~60 min) or base64
- Reproducibility via
seed(0–2147483647)
Controlling reasoning.
Every chat model above reasons before it answers. The reasoning arrives
separately from the answer: in message.reasoning_content on Chat Completions,
as a reasoning output item on Responses. One parameter controls it, the same
on every model:
| API | Parameter |
|---|---|
Chat Completions (/v1/chat/completions) | reasoning_effort |
Responses (/v1/responses) | reasoning: {"effort": ...} |
The values, from no reasoning to the deepest: none, minimal, low,
medium, high, xhigh, max.
To turn reasoning off, send none. That is the whole switch. It works on
every model except GLM, which cannot stop reasoning (see the table).
Code written for another provider keeps working: we also accept
thinking: {"type": "disabled"}, reasoning: {"enabled": false},
enable_thinking: false and chat_template_kwargs: {"enable_thinking": false},
at the top level of the body or inside extra_body. Each one means exactly
none. If a request carries both a value and one of these, the value wins.
| Model | Off switch (none) | The other values |
|---|---|---|
deepseek-v4-flash | Off. No reasoning tokens. | minimal to max steer how much it reasons. They are hints the model follows, not hard caps. |
qwen3.8-flash | Off. No reasoning tokens. | Reasoning is on by default; minimal to max steer its depth (hints, not caps). |
mimo-v2.6-flash | Off. No reasoning tokens. | low, medium, high, max. minimal is applied as low and xhigh as max. |
qwen3.6 · gemma4 | Off. minimal turns it off too. | On Chat Completions they cap the reasoning phase: low 2,048, medium 8,192, high 16,384, xhigh and max 32,768 tokens. On Responses only on and off apply: any value but none or minimal reasons with the default 16,384-token budget. |
glm5.3 · glm5.3-flash | Not possible: GLM always reasons. none is applied as minimal, its shortest reasoning (a few tokens). | minimal to max; higher values reason longer before answering. |
With no parameter every model reasons (qwen3.6 and gemma4 with a
16,384-token budget). Reasoning costs latency and its tokens count toward
max_tokens. Use only the values listed here.
Any other value is passed through unchanged and is not part of this contract: depending
on the model it is rejected with a 400 or ignored.
curl https://api.nan.builders/v1/chat/completions \
-H "Authorization: Bearer $NAN_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "deepseek-v4-flash",
"reasoning_effort": "none",
"messages": [{"role": "user", "content": "Write a one-line summary of the CAP theorem."}]
}'
On Helmcode, use https://api.helmcode.com/v1 as the base URL; everything else is identical.
With the OpenAI SDK, on Chat Completions and on Responses:
# pip install openai
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["NAN_API_KEY"],
base_url="https://api.nan.builders/v1", # Helmcode: https://api.helmcode.com/v1
)
chat = client.chat.completions.create(
model="deepseek-v4-flash",
reasoning_effort="none",
messages=[{"role": "user", "content": "Write a one-line summary of the CAP theorem."}],
)
print(chat.choices[0].message.content)
resp = client.responses.create(
model="deepseek-v4-flash",
reasoning={"effort": "none"},
input="Write a one-line summary of the CAP theorem.",
)
print(resp.output_text)
If your version of the Python SDK does not know the parameter yet (it raises TypeError: ... unexpected keyword argument), send it through extra_body; it reaches the API exactly the same:
chat = client.chat.completions.create(
model="deepseek-v4-flash",
extra_body={"reasoning_effort": "none"},
messages=[{"role": "user", "content": "Write a one-line summary of the CAP theorem."}],
)
In Node, with the same names as the HTTP API:
// npm install openai
import OpenAI from 'openai';
const client = new OpenAI({
apiKey: process.env.NAN_API_KEY,
baseURL: 'https://api.nan.builders/v1', // Helmcode: https://api.helmcode.com/v1
});
const chat = await client.chat.completions.create({
model: 'deepseek-v4-flash',
reasoning_effort: 'none',
messages: [{ role: 'user', content: 'Write a one-line summary of the CAP theorem.' }],
});
console.log(chat.choices[0].message.content);
const resp = await client.responses.create({
model: 'deepseek-v4-flash',
reasoning: { effort: 'none' },
input: 'Write a one-line summary of the CAP theorem.',
});
console.log(resp.output_text);
TypeScript: if your SDK version types the parameter as a union that lacks a value you send (for example max), add // @ts-expect-error on the line above it, or cast the params object. The API accepts every value in the table.
const chat = await client.chat.completions.create({
model: 'deepseek-v4-flash',
reasoning_effort: 'max' as any, // older SDK types do not list 'max'
messages: [{ role: 'user', content: 'Write a one-line summary of the CAP theorem.' }],
});
Long outputs: stream them.
A request without stream: true returns nothing until the whole answer is ready, and it has to be ready within 120 seconds. Past that, the connection is closed with a 524 (or an error a few seconds earlier), whatever the model. At deepseek-v4-flash speeds that is roughly 10,000 to 15,000 output tokens; slower models, and reasoning models that think before they answer, fit less.
If you ask for long outputs (a large max_tokens, long code files, agents that write whole documents), use stream: true. A stream has no total time limit while it keeps producing: tokens reach you as they are generated, however long the answer runs. The one exception is a turn that produces only reasoning for a long time, see the reasoning-only stream limit below. Every chat model supports streaming on both endpoints (/v1/chat/completions and /v1/responses).
Reasoning-only stream limit.
Reasoning-heavy prompts can keep a model thinking for a long time before it writes anything. When a streaming turn has produced only reasoning — no content, no tool calls — for 420 seconds, the platform closes the turn instead of letting it run into a dead end. A turn that is demonstrably thinking — it has already produced more than 45,000 reasoning characters — gets until 600 seconds. The reasoning-character budget also scales with the size of your prompt: roughly 150,000 characters of headroom plus half the prompt’s size in characters, capped at 300,000. When the platform closes the turn you receive finish_reason: "length" on an empty delta, followed by a usage chunk.
That usage chunk is an estimate of what the attempt consumed up to the cut
(prompt and reasoning tokens), marked "estimated": true, "billed": false —
turns closed this way are not charged against your quota — and carries a
nan_truncation marker so clients can tell this closure apart from a real
context-length cut. Request it with stream_options: {"include_usage": true}.
Two things worth knowing:
- The limit does not cap your output. The first visible token of content or any tool call disarms it for the rest of the turn: answers that write as they go are never cut, however long they run.
- If a turn closes this way, the model was still planning when it hit the
ceiling. Lower
reasoning_effortwhere the model supports it (table above), or restructure the prompt so the model starts writing early.
The limit exists to bound a known failure mode of thinking models: they occasionally plan without converging for 10–25 minutes and burn their whole output budget with zero visible output. The bounds sit above the reasoning traces of healthy converging turns in our production traffic, and only tighten when a stream is stuck.
Rate limits
rate limits per API key
- Requests / min
- 60 rpm
- Concurrent requests
- per model — see the per-model limits below
- Across all models
- 7 (base plan) · 10 (premium plan) simultaneous requests per key
concurrent requests per model
Concurrency is enforced per model, not per API key.
- glm5.3
- 7 (base plan) · 10 (premium plan)
- glm5.3-flash
- 7 (base plan) · 10 (premium plan)
- deepseek-v4-flash
- 7 (base plan) · 10 (premium plan)
- qwen3.8-flash
- 7 (base plan) · 10 (premium plan)
- mimo-v2.6-flash
- 5
- qwen3.6
- 5
- gemma4
- 5
Audio, embedding and rerank endpoints have no concurrency limit.
glm5.3 · premium tier limits
- Rolling 4h window
- 400M tokens
- Allowance / billing period
- 3,000M tokens
- Context window
- 1M tokens
- Concurrent requests
- 10
400M tokens per rolling 4 hours is the limit a heavy coding-agent run reaches first, well before the allowance. Once you hit it, glm5.3 requests are rejected until the window slides forward: it is a rolling window, not a daily reset. The allowance counter goes back to zero when your billing period starts, and if you upgrade part-way into a period that first allowance is prorated to the share of the period you paid for.
tokens / min per model
- deepseek-v4-flash
- 1.5M tpm
- mimo-v2.6-flash
- 1.5M tpm
- qwen3.6
- 1.5M tpm
- gemma4
- 1.5M tpm
requests / min per model
- rerank
- 1000 rpm