license: apache-2.0
base_model: huihui-ai/Huihui-gemma-4-E4B-it-abliterated
pipeline_tag: text-generation
library_name: litert-lm
tags:

• gemma-4
• gemma
• litert
• litert-lm
• abliterated
• edge-ai
• on-device
• conversion

Huihui Gemma 4 E4B Abliterated — LiteRT-LM

A LiteRT-LM conversion of
huihui-ai/Huihui-gemma-4-E4B-it-abliterated.

This repository contains a ready-to-run .litertlm bundle converted from the
original Hugging Face BF16 Safetensors checkpoint for use with
Google LiteRT-LM.

This repository is not a new fine-tune and does not claim authorship of the
original model weights. It is a runtime-format conversion of the Huihui model.

Model lineage

google/gemma-4-E4B
        ↓
google/gemma-4-E4B-it
        ↓
huihui-ai/Huihui-gemma-4-E4B-it-abliterated
        ↓
BF16 Safetensors
        ↓
litert-torch export_hf
        ↓
Huihui-gemma-4-E4B-it-abliterated.litertlm

About the source model

The source model was published by
huihui-ai as an abliterated variant of
google/gemma-4-E4B-it.

According to the original model card, abliteration significantly reduces the
model's refusal behavior and safety filtering. This conversion does not
restore or add safety alignment.

Please read the source model card before use:

• https://huggingface.co/huihui-ai/Huihui-gemma-4-E4B-it-abliterated

Conversion

The model was converted from the original Hugging Face Safetensors checkpoint
using the LiteRT Torch Hugging Face exporter.

The conversion command was:

litert-torch export_hf \
  --model="$HOME/Models/huggingface/huihui-gemma-4-e4b" \
  --output_dir="$HOME/Models/litert/huihui-gemma-4-e4b" \
  --externalize_embedder \
  --jinja_chat_template_override=litert-community/gemma-4-E4B-it-litert-lm

The LiteRT-compatible Gemma 4 E4B chat template was taken from:

litert-community/gemma-4-E4B-it-litert-lm

The resulting bundle is:

Huihui-gemma-4-E4B-it-abliterated.litertlm

No GGUF or Ollama model was used as an intermediate format.

Download

Install the Hugging Face CLI if needed:

pip install -U huggingface_hub

Download only the LiteRT-LM bundle:

hf download \
  vokash3/Huihui-gemma-4-E4B-it-abliterated-LiteRT-LM \
  Huihui-gemma-4-E4B-it-abliterated.litertlm \
  --local-dir .

This produces:

./Huihui-gemma-4-E4B-it-abliterated.litertlm

Run with LiteRT-LM

Install the current LiteRT-LM CLI:

uv tool install litert-lm

Run the model:

litert-lm run \
  ./Huihui-gemma-4-E4B-it-abliterated.litertlm \
  --prompt="Hello! Tell me briefly who you are."

For an interactive run:

litert-lm run ./Huihui-gemma-4-E4B-it-abliterated.litertlm

Available backends and CLI options can change as LiteRT-LM evolves, so check the
installed version before using backend-specific flags:

litert-lm run --help

Benchmark

LiteRT-LM also provides a benchmark command:

litert-lm benchmark ./Huihui-gemma-4-E4B-it-abliterated.litertlm

This is preferable to quoting performance numbers from another machine, since
throughput and memory usage depend strongly on the hardware, backend and current
LiteRT-LM version.

Platforms

LiteRT-LM is designed for on-device inference across supported desktop and edge
platforms. Consult the upstream project for the current platform/backend support
matrix:

• https://github.com/google-ai-edge/LiteRT-LM

The .litertlm file in this repository was created as a portable LiteRT-LM
bundle rather than a GGUF model for llama.cpp/Ollama.

Android / Google AI Edge Gallery limitation

The current .litertlm bundle is a text-only custom export.

Inspection with litert-lm-peek shows the bundle contains:

LlmMetadataProto
ExecutorMetadataProto
HF_Tokenizer_Zlib
tf_lite_prefill_decode
tf_lite_embedder
tf_lite_per_layer_embedder

It does not contain Gemma 4 audio executor sections such as:

tf_lite_audio_encoder_hw
tf_lite_audio_adapter
tf_lite_end_of_audio

As a result, the current Google AI Edge Gallery Android app may fail to initialize
this model with an error (in AI Chat mode) similar to:

Failed to create conversation:
NOT_FOUND: TF_LITE_AUDIO_ENCODER_HW not found in the model.

This does not mean the .litertlm file is corrupted. The same bundle works for
text generation with the LiteRT-LM desktop/runtime CLI.

The issue is caused by a mismatch between the current custom Gemma 4 text-only export
and Google AI Edge Gallery, which expects additional Gemma 4 multimodal/audio sections.

Until this custom-export path is supported end-to-end, consider the current compatibility
status to be:

LiteRT-LM desktop / text inference: supported
Google AI Edge Gallery Android: currently not supported

Relevant upstream discussions:

• LiteRT Torch audio encoder export issue:
  https://github.com/google-ai-edge/litert-torch/issues/1039
• LiteRT-LM Gemma 4 bundle / audio section discussion:
  https://github.com/google-ai-edge/LiteRT-LM/issues/2498

Important notes and limitations

• This is a conversion, not a separately trained model.
• Behavioral characteristics of the source Huihui model remain relevant.
• The source model has substantially reduced refusal/safety behavior.
• Output can include sensitive, controversial, unsafe, inaccurate or otherwise
  undesirable content.
• Users should review outputs before using them in production or public-facing
  applications.
• Runtime behavior may differ from Transformers or GGUF builds because of
  differences in quantization, execution backend, sampling, prompt formatting
  and runtime implementation.
• Exact token-for-token parity with the original Safetensors checkpoint is not
  expected.
• This repository does not provide independent benchmark or quality claims.
• The conversion is primarily intended for LiteRT-LM text-generation use.

License and upstream terms

The source Huihui repository is published on Hugging Face with the
Apache-2.0 license metadata.

Users should also review the terms, notices and usage requirements associated
with the upstream Gemma model family and the original Huihui model before
redistribution or deployment.

Upstream resources:

• Huihui source model:
  https://huggingface.co/huihui-ai/Huihui-gemma-4-E4B-it-abliterated
• Google Gemma 4 E4B IT:
  https://huggingface.co/google/gemma-4-E4B-it
• LiteRT-LM:
  https://github.com/google-ai-edge/LiteRT-LM
• LiteRT Torch:
  https://github.com/google-ai-edge/litert-torch
• LiteRT Community Gemma 4 E4B:
  https://huggingface.co/litert-community/gemma-4-E4B-it-litert-lm

Credits

• Google — Gemma 4 and LiteRT/LiteRT-LM
• huihui-ai — Huihui-gemma-4-E4B-it-abliterated
• LiteRT Community — LiteRT-LM Gemma 4 reference bundle and compatible chat
  template
• vokash3 — LiteRT-LM conversion and packaging in this repository

Repository contents

.
├── README.md
└── Huihui-gemma-4-E4B-it-abliterated.litertlm

Reproducibility summary

Source:
huihui-ai/Huihui-gemma-4-E4B-it-abliterated

Source format:
BF16 Safetensors

Exporter:
litert-torch export_hf

Options:
--externalize_embedder
--jinja_chat_template_override=litert-community/gemma-4-E4B-it-litert-lm

Output:
Huihui-gemma-4-E4B-it-abliterated.litertlm (~7.7 GB)