← back to catalog · registered 2026-08-22 13:56

ThatCultivator/sarvam-30b-Uncensored-gguf

Name: ThatCultivator/sarvam-30b-Uncensored-gguf
Author: ThatCultivator

Your rig guess connected

? Why do I need an app?

Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/ThatCultivator%2Fsarvam-30b-Uncensored-gguf"

Response includes

classification m-uncensored
files 5
hub_downloads_all_time 2,607
author_summary 1 models
readme_text full

10 credits · hourly refresh · ~4 KB payload Get an API key →

Abliteration classifier · v1.0.0

M-U

Primary method

Uncensored (method unknown)

No other method signals detected in this model.

Confidence

LOW

Why this label 3 signals

Weak or ambiguous signals. Best guess based on catalog patterns; treat as tentative and check the evidence below.

'uncensored' in name/tags but no 'abliterated' marker
method not identifiable from author declaration alone
may be DPO fine-tune, prompt engineering, or unknown technique

Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

Downloads · lifetime

151 last 30d - cooling

Likes

Model age

7mo ago

created 2026-03-10

Downloads over time

Mar 11 → Oct 11 · 70 snapshots · spans 214 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

aoxo/sarvam-30b-uncensored↓ 159 this lineage

ThatCultivator/sarvam-30b-Uncensored-gguf↓ 151

Metadata

License

apache-2.0

Quantizations

Q3_K Q4_K Q6_K

Files by quantization

Q6_K 1 file 24.6 GB

sarvam-30b-uncensored.Q6_K.gguf

24.6 GB

85100781

download

Q4_K 1 file 18.2 GB

sarvam-30b-uncensored.Q4_K_M.gguf

18.2 GB

82035e09

download

Q3_K 1 file 14.6 GB

sarvam-30b-uncensored.Q3_K_M.gguf

14.6 GB

9198853a

download

Auxiliary files 2 files 2.55 KB

.gitattributes	1.69 KB	72965c43	download
README.md	886 B	ed71cccd	download

README current version from Hugging Face

base_model:

aoxo/sarvam-30b-uncensored
sarvamai/sarvam-30b
pipeline_tag: text-generation
license: apache-2.0

Sarvam-30b-uncensored

This is the quantized version of the aoxo/sarvam-30b-uncensored model that is a finetune of the base model sarvamai/sarvam-30b.

Why use this?

The original finetune is in the bf16 format, which requires significantly stronger hardware than the average consumer-grade hardware.
To solve this problem, I have GGUF quantized the finetuned uncensored model and now it can comfortably run on consumer hardware.

Quantization details

Original model size: ~60gb
Quantization method: GGUF Q4_K_M, GGUF Q6_K
Post-Quantization size: ~19gb, ~26gb

Tested on:

L4 gpu (24gb)

NOTE: I might release other quants like Q8_0 if there's demand.

README history 3 versions

The author's README evolved over time. Click a version to see its content at that point.

2026-03-12Update README.mdceedf70886 B
Loading...
2026-03-10Update README.md6b82a0e857 B
Loading...
2026-03-10Create README.mdb252dbf849 B
Loading...

Discussions 2 threads

2026-05-12can't be run on llama.cppopen3 💬#2
Loading...
2026-03-10New Abliterated Versionclosed5 💬#1
Loading...

Continue on Hugging Face →

ThatCultivator/sarvam-30b-Uncensored-gguf

The browser can't see your hardware

The Abliteration app is integrated with your machine

And you can chat with any model, right now

Uncensored (method unknown)

Genealogy 0 direct forks

Metadata

Related

Files by quantization

README current version from Hugging Face

Sarvam-30b-uncensored

Why use this?

Quantization details

Tested on:

NOTE: I might release other quants like Q8_0 if there's demand.

README history 3 versions

Discussions 2 threads

Run models on your own machine, not in the cloud.