IN LAUNCH VALIDATION
Qwen3.8-27B Abliterated.
The exact model artifact, compression method, hardware, interface, and known constraints behind AblitAI's launch endpoint.
Status: launch validation. AblitAI has not yet published throughput, quality, or reliability benchmarks for this deployment.
Identity
| Stable API ID | qwen3.8-27b-abliterated |
|---|---|
| Selected repository | twolven/Qwen3.8-27B-abliterated-AWQ-MTP at the active pinned revision |
| Running revision | c2f5341e7c9a1c55e6d61cfc8e6d0ca897bd7443; matched across the active process arguments, local snapshot, and repository ref on 4 September 2026 |
| Modality | Text input and text output |
| License | Apache-2.0 notices and attribution preserved |
Quantization
The selected community artifact uses llm-compressor 0.13.0 with asymmetric AWQ W4A16 quantization, group size 128. Its model card reports calibration on 128 UltraChat samples of 1,024 tokens. Quantization reduces memory use and may change output quality relative to higher-precision weights.
Current validation route
| GPU | One NVIDIA RTX 3090 Ti |
|---|---|
| Inference server | vLLM 0.28.0; the hosting-image digest has not been independently recorded |
| Artifact | Community AWQ W4A16 build at immutable revision c2f5341e7c9a1c55e6d61cfc8e6d0ca897bd7443 |
| Total context | 8,192 tokens |
| Maximum output | 4,096 tokens |
| Concurrent sequences | 2 |
Serving configuration
| Inference image | vLLM 0.28.0 |
|---|---|
| Artifact | Revision c2f5341e7c9a1c55e6d61cfc8e6d0ca897bd7443 |
| Future candidate context | 32,768 tokens (revalidation plan only; not the current service limit) |
| Maximum output | 4,096 tokens |
| Concurrent sequences | 2 |
| Default mode | Non-thinking |
The running revision, vLLM version, limits, and defaults above are deployed. Paid access stays closed until stability, backup, monitoring, legal, and payment acceptance gates pass.
API capabilities
Text Chat Completions and SSE streaming are implemented. Images, audio, explicit thinking mode, and tools remain unavailable on the public route while final compatibility work is tested. Codex, Claude Code, and OpenCode are not yet advertised as supported.
Behavior and safety
“Abliterated” refers to a community modification intended to reduce some refusal tendencies. It is not a guarantee of correctness, neutrality, capability, or unrestricted lawful use. Customers remain bound by the Acceptable Use Policy.
Change control
The active model process is pinned instead of tracking the repository's latest branch. The vLLM package version is verified, while the hosting-image digest remains unrecorded. Any model, quantization, context, parser, or serving change restarts the relevant validation and burn-in gates.