lilcheaty / Model details
flint-abliterated-GGUF
lilcheaty/flint-abliterated-GGUF
Family: Unknown. No supported family evidence recorded.
About this model
lilcheaty's flint-abliterated-GGUF repository provides a GGUF quantization of a weight-edited derivative of RecursiveSI/flint. The creator describes the change as removing one estimated refusal direction from selected weights, applied shard by shard to the official BF16 weights, and states it is not an official Recursive release. The repository contains flint-abliterated-Q3_K_M.gguf, quantized to Q3_K_M from the edited BF16 checkpoint, under the Apache 2.0 license. According to the model card, in a small selected comparison the edited Q3_K_M model gave 0/20 explicit final-answer refusals on held-out refusal prompts and 0/20 refusals on normal coding prompts, with all 40 responses completed; the creator notes this is not a general safety, compliance or coding benchmark. The creator also says Flint GGUF requires llama.cpp PR #30928 until it merges.
Description sources
Source-based description, not an independent evaluation. Check the linked sources for the creator’s claims and limitations.
Size and formats
- Base model
- RecursiveSI/flint
- Parameters
- Unknown
- Main repository formats
- GGUF
- License tag
- apache-2.0
- Languages
- Unknown
- Last updated
- 2026-10-22 · 05:24:21.000 UTC
What changed
Model types are creator-reported, not independently tested. These labels describe source metadata, not a guarantee of behavior.
- abliteratedsource tag:
abliterated
- abliteratedmodel name:
flint-abliterated-GGUF
- fine-tunedsource tag:
base_model:finetune:RecursiveSI/flint
Family evidence
These groupings are source-reported. Explicit base identifiers take priority over generic architecture tags.
- No supported family evidence recorded.
Available versions
Versions appear here only when they explicitly name this exact model as their source. Check each repository for available files.
- Main repository files ↗GGUF
- No other explicitly linked versions recorded.
Customize or build on this model
Listed from public GitHub data, not tested by us. Read the code and license before you run anything.
Tools to customize it further
Make a smaller download (quantize)
- llama.cpp ↗ ★ 132,124
Runs models locally and includes the tools behind most GGUF files. A conversion script turns Hugging Face weights into GGUF, and llama-quantize shrinks a high-precision GGUF to lower-bit formats, which can cost some accuracy.
Learn the techniques
- LLM Course ↗ ★ 84,633
A free course with roadmaps and Colab notebooks. Its notebooks include one-click tools for merging with MergeKit, quantizing to GGUF, GPTQ, EXL2, AWQ and HQQ, and automatic abliteration with custom datasets.
Source provenance
- Downloads
- 1,196
- Likes
- 6
- Metadata checked
- 2026-10-24 · 12:14:47 UTC
- First seen in index
- 2026-10-24 · 12:14:47 UTC
- Source revision
- 8866ae70d1726eee740c743bd6f94dbdee108e27
Source-card excerpt
Source model card excerpt: Flint abliterated Q3 K M This is a weight-edited derivative of RecursiveSI/flint, released under the same Apache 2.0 license. Recursive developed the base model.
From lilcheaty/flint-abliterated-GGUF. Creator model-card excerpt, not an independent review.
Inspect before you run
Low refusal is not proof of correctness. Outputs can be inaccurate, harmful, or biased. Review the model card, license and files yourself. A license tag is not commercial-use advice. Parameter counts are source metadata; no hardware compatibility is implied.
This directory does not run, host, redistribute, or test model weights.
Collection rules & limitations ↗