license: apache-2.0
base_model: anaaaaaa13421312/gemma-4-31B-it-abliterated-Japanese-RP
base_model_relation: quantized
library_name: llm-compressor
tags:
- compressed-tensors
- gemma4
- fp8_dynamic
- japanese
- roleplay
- not-for-all-audiences
gemma-4-31B-it-abliterated-Japanese-RP-FP8-Dynamic
anaaaaaa13421312/gemma-4-31B-it-abliterated-Japanese-RP を llmcompressor.model_free_ptq(scheme="FP8_DYNAMIC")でデータフリー量子化したチェックポイントです。
- Format:
compressed-tensors - Scheme:
FP8_DYNAMIC - Target: FP8 (E4M3 per-channel static weights + dynamic per-token activations) for RunPod 48GB GPUs (L40S / RTX 6000 Ada / A40 Marlin) and TPU v7x.
- Unquantized (BF16 preserved):
lm_head, vision/audio modules,embed_tokens, norms