license: gemma
library_name: transformers
pipeline_tag: image-text-to-text
base_model: google/gemma-3-12b-it
model_index:

• name: gemma-3-12b-it-norm-preserved-biprojected-abliterated
  results:
  • task:
    type: text-generation
    name: Text Generation
    dataset:
    name: MMLU (5-shot)
    type: cais/mmlu
    config: main
    split: test
    args:
    num_few_shot: 5
    
    metrics:
    • type: acc
      value: 0.6985
      name: accuracy
      source:
      url: N/A
      name: N/A

gemma-3-12b-it-norm-preserved-biprojected-abliterated

This model was derived from google/gemma-3-12b-it.

Projected abliteration has been applied in determining refusal direction, along with a second round of removal of projected contribution onto the harmless direction of layer targeted for intervention.
Additionally, instead of subtracting/ablating away the refusal direction in toto, only the directional component of the refusal direction was removed, preserving the norms of the layers subjected to intervention.
The details of norm preservation can be found in the article on Norm-Preserving Biprojected Abliteration.
The net result should further reduce model damage compared to prior attempts; no subsequent fine-tuning was applied to repair damage.
This model refuses far less often than the original model, yet still retains awareness of safety and harms.

More details to follow.