license: apache-2.0
license_link: https://ai.google.dev/gemma/docs/gemma_4_license
library_name: transformers
pipeline_tag: any-to-any
tags:
- gemma4
- gemma
- paroquant
base_model: - huihui-ai/Huihui-gemma-4-E2B-it-abliterated-v2
Jeethu/Huihui-gemma-4-E2B-it-abliterated-v2-PARO
Pairwise Rotation Quantization for Efficient Reasoning LLM Inference
ParoQuant is the state-of-the-art INT4 quantization for LLMs. It closes the accuracy gap with FP16 while running at near-AWQ speed. Supports NVIDIA GPUs (vLLM, Transformers) and Apple Silicon (MLX). For more information, see https://github.com/z-lab/paroquant.
Jeethu/Huihui-gemma-4-E2B-it-abliterated-v2-PARO is a 4-bit huihui-ai/Huihui-gemma-4-E2B-it-abliterated-v2 quantized with ParoQuant.