Laguna-S-2.1
- Repository
- poolside/Laguna-S-2.1
- Engine
- vLLM
- Listed
- 26 Jul 2026
- Status
- Popular
Use on OpenRouter · Use on Vercel AI Gateway · Release blog post
- Serves
- Chat, Reasoning
- Parameters
- 7.3B
- Context
- 1,048,576 tokens
- Weights
- 235 GB
- License
- openmdw-1.1
Capabilities
Read from the model's capability tags. Requests are admitted per tag.
- Chat
chat -
POST /v1/chat/completionsPOST /v1/responses
Endpoint task mode
generate
- Inputs
- Text
- Reasoning effort
reasoning_effort - none, low, medium, high
- Values a request may send; the model family sets the vocabulary.
- Structured output
structured_output - not yet probed
- Admitted until the capability probe observes the model.
- Forced tool choice
forced_tool_choice - not yet probed
- Admitted until the capability probe observes the model.
Launch settings
Every engine serving the model starts with these.
Set by the owner. auto: the serving node derives it. default: the platform's value, left in place.
- Engine
- vLLM
- Context window
--max-model-len - 1,048,576 tokens
- Quantization
--quantization - none default
- Weights load as stored, bfloat16.
- KV cache dtype
--kv-cache-dtype - auto
- No flag: the checkpoint's KV quantization, else the model dtype.
- Scheduling policy
--scheduling-policy - priority default
- Interactive requests ahead of batch work; same-class traffic in arrival order.
- Tool-call parser
--tool-call-parser - Set by the owner: poolside_v1
- Reasoning parser
--reasoning-parser - Set by the owner: poolside_v1
- Sampling defaults
generation_config.json - temperature 1, top_p 1
- Used when a request leaves them out.
- Trust remote code
--trust-remote-code - on default
- Python shipped in the bundle may run at load (the default).
Engine tuning
Every setting auto: the serving node derives each one.
Set by the owner. auto: the serving node derives it.
Mixture of experts
- Expert parallel
--enable-expert-parallel - auto
- Expert load balancing
--enable-eplb - auto
- All-to-all backend
--all2all-backend - auto
Memory and batching
- GPU memory utilization
--gpu-memory-utilization - auto
- Max sequences
--max-num-seqs - auto
- Max batched tokens
--max-num-batched-tokens - auto
- Long-prefill threshold
--long-prefill-token-threshold - auto
Execution
- Enforce eager
--enforce-eager - auto
- Prefix caching
--enable-prefix-caching - auto
- Async scheduling
--no-async-scheduling - auto
- Custom all-reduce
--disable-custom-all-reduce - auto
Speculative decoding
Draft tokens checked by the model in one pass.
- Speculative decoding
- Set by the owner: on for every endpoint
- Method
- Set by the owner: dflash
- A DFlash block drafter trained for the target.
- Speculative tokens
num_speculative_tokens - Set by the owner: 7
- Draft model
- Set by the owner: Laguna-XS-2.1-DFlash
Architecture
Read from the model's files at upload.
- Architecture
- laguna
- Parameters
- 7,260,635,136
- Layers
num_hidden_layers - 48
- Hidden size
hidden_size - 3,072
- Attention heads
num_attention_heads - 48 (8 KV)
- Experts
- 256, 10 per token
- Vocabulary
vocab_size - 100,352
- Native dtype
torch_dtype - bfloat16
- Weights on disk
- 235 GB, safetensors
Call it
Create an endpoint for the model, then send it a request in the OpenAI shape.
# Create an endpoint for this model, then provision it.
# --tier-id is the service tier to run on; pick one at /endpoints/new.
erectl endpoints create \
--name "My endpoint" \
--slug my-endpoint \
--model-id A867CE8C-8CE2-4DB5-A5EE-351C5860E6B0 \
--tier-id <tier-id>
# provision takes the endpoint UUID returned by create
erectl endpoints provision <endpoint-id>
# Call it. Requests are routed by /<project-id>/<endpoint-slug>.
curl https://api.erebine.ai/proj_ABC123/my-endpoint/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $EREBINE_API_KEY" \
-d '{
"model": "Laguna-S-2.1",
"messages": [{"role": "user", "content": "Hello, world!"}],
"stream": true
}'Model card
As published with poolside/Laguna-S-2.1. Images are left out; its HTML tables are set as tables.
Laguna S 2.1
Laguna S 2.1 is a 118B total parameter Mixture-of-Experts model with 8B activated
parameters per token, designed for agentic coding and long-horizon work. It sits
between Laguna XS 2.1 (33B-A3B) and
Laguna M.1 (225B-A23B) in the Laguna series and shares the family recipe: a
token-choice router with softplus gating over 256 routed experts plus one shared
expert, grouped-query attention, and interleaved full/sliding-window attention.
Highlights
- Mixed SWA and global attention layout: 48 layers in a 1:3 global-to-SWA ratio
- 1M context: 1,048,576-token context window
- Native reasoning support: interleaved thinking between tool calls, with
enable_thinking
- Speculative decoding: a trained
- Quantized variants:
- OpenMDW-1.1 license: Use and modify the model and associated materials freely
Model overview
- Number of parameters: 118B total, ~8B activated per token
- Layers: 48 (12 global attention, 36 sliding-window attention)
- Experts: 256 routed (top-10) plus 1 shared expert
- Attention: grouped-query, 8 KV heads, head dim 128; per-head softplus output gating
- Sliding window: 512 tokens
- Context window: 1,048,576 tokens
- Vocabulary: 100,352 tokens (Laguna family tokenizer)
- Modality: text-to-text
- Reasoning: interleaved thinking with preserved thinking
Benchmark results
| Model | Size | Terminal-Bench 2.1 | SWE-bench Multilingual | SWE-Bench Pro (Public Dataset) | DeepSWE | SWE Atlas (Codebase QnA) | Toolathlon Verified |
|---|---|---|---|---|---|---|---|
| Laguna S 2.1 | 118B-A8B | 70.2% | 78.5% | 59.4% | 40.4% | 46.2% | 49.7% |
| Tencent Hy3 | 295B-A21B | 71.7% | 75.8% | 57.9% | - | - | - |
| Inkling | 975B-A41B | 63.8% | - | 54.3% | - | - | 45.5%* |
| Nemotron 3 Ultra | 550B-A55B | 56.4% | 67.7% | - | - | - | 34.3%* |
| DeepSeek-V4-Pro Max | 1.6T-A49B | 64.0% | 76.2% | 55.4% | 9.0% | 27.2% | 55.9% |
| Kimi K3 | 2800B-A50B | 88.3% | - | - | 69% | - | - |
| Qwen 3.7 Max | - | 74.5%* | 78.3% | 60.6% | - | - | - |
| Muse Spark 1.1 | - | 80% | - | 61.5% | 53.3% | 42.2%* | 75.6% |
| Claude Fable 5 | - | 88% | - | 80.3% | 70% | - | - |
Benchmarks as of 21 July 2026. Laguna S 2.1 in bold; a dash (-) marks a benchmark a model was not evaluated on. Scores marked * are as reported by third parties: Terminal-Bench 2.1 and DeepSWE via Artificial Analysis, SWE Atlas via Scale AI's official leaderboard, and Toolathlon Verified via its official leaderboard. Full evaluation trajectories: trajectories.poolside.ai.
Usage
Laguna S 2.1 uses the same laguna architecture as Laguna XS 2.1, so the same
engine integrations apply (vLLM, SGLang, Transformers, TRT-LLM, llama.cpp). At 118B
parameters the BF16 checkpoint needs multiple GPUs (roughly 236GB of weights);
quantized variants reduce this substantially.
vLLM
vllm serve \
--model poolside/Laguna-S-2.1 \
--tensor-parallel-size 4 \
--tool-call-parser poolside_v1 \
--reasoning-parser poolside_v1 \
--enable-auto-tool-choice \
--served-model-name laguna \
--default-chat-template-kwargs '{"enable_thinking": true}'Note.
Optional: speculative decoding with DFlash. Pair with the
Laguna S 2.1 DFlash draft model
by adding
--speculative-config '{"model":"poolside/Laguna-S-2.1-DFlash","num_speculative_tokens":7,"method":"dflash"}'.
SGLang
python -m sglang.launch_server \
--model-path poolside/Laguna-S-2.1 \
--tp-size 4 \
--reasoning-parser poolside_v1 \
--tool-call-parser poolside_v1 \
--trust-remote-codeTRT-LLM
trtllm-serve poolside/Laguna-S-2.1 --trust-remote-code \
--tool_parser poolside_v1 --reasoning_parser lagunaNote the flag names differ from vLLM's (--tool_parser, and the reasoning parser
is laguna, not poolside_v1).
llama.cpp
GGUF conversions are available at
poolside/Laguna-S-2.1-GGUF.
Serve with poolside's llama.cpp fork, branch
laguna, which carries
full Laguna support including DFlash speculative decoding. (Base Laguna support
is also in upstream review:
ggml-org/llama.cpp#25165.)
git clone --branch laguna https://github.com/poolsideai/llama.cpp
cd llama.cpp && cmake -B build && cmake --build build -j
./build/bin/llama-server -m laguna-s-2.1-Q4_K_M.gguf --jinja --port 8000
# with DFlash speculative decoding:
./build/bin/llama-server -m laguna-s-2.1-Q4_K_M.gguf \
-md laguna-s-2.1-DFlash-BF16.gguf \
--spec-type draft-dflash --spec-draft-n-max 7 -fa on --jinja --port 8000Controlling reasoning
Laguna S 2.1 has native reasoning support and works best with preserved thinking:
keep reasoning_content from prior assistant messages in the message history.
The model will generally reason before calling tools and between tool calls, and
may stop reasoning in follow-up steps if prior thinking blocks are dropped.
Thinking is controlled per request via the chat template:
extra_body={"chat_template_kwargs": {"enable_thinking": False}}or at the server level with
--default-chat-template-kwargs '{"enable_thinking": true}'. For agentic coding
use cases we recommend enabling thinking and preserving reasoning in the message
history.
License
This model is licensed under the OpenMDW-1.1 License.
Intended and Responsible Use
Laguna S 2.1 is designed for software engineering and agentic coding use cases, and you are responsible for confirming that it is appropriate for your intended application. Laguna S 2.1 is subject to the OpenMDW-1.1 License, and should be used consistently with Poolside's Acceptable Use Policy. We advise against circumventing Laguna S 2.1 safety guardrails without implementing substantially equivalent mitigations appropriate for your use case.
Please report security vulnerabilities or safety concerns to security@poolside.ai.