Imatrix repair of abliteration artifacts during GGUF quantization
commands
git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make ./llama-imatrix -m model.gguf -f imatrix_calib.txt -o imatrix.dat ./llama-quantize --imatrix imatrix.dat model.gguf model-IQ4_NL.gguf IQ4_NL