failspy / Model details
Phi-3-medium-4k-instruct-abliterated-v3-GGUF
failspy/Phi-3-medium-4k-instruct-abliterated-v3-GGUF
Family: Unknown. No supported family evidence recorded.
About this model
failspy's GGUF release of an abliterated derivative of microsoft/Phi-3-medium-4k-instruct. The creator describes the change as orthogonalizing the strongest refusal directions from the model's weights, aiming to inhibit refusal while leaving other behavior unchanged; it is not guaranteed to stop refusing or lecturing. According to the model card, the creator tested this version and found it more likely to hallucinate than the original but generally as stable. The card describes the underlying modification as orthogonalized bfloat16 safetensor weights, while this repository distributes GGUF weights under the MIT license.
Description sources
Source-based description, not an independent evaluation. Check the linked sources for the creator’s claims and limitations.
Size and formats
- Base model
- Unknown
- Parameters
- Unknown
- Main repository formats
- GGUF
- License tag
- mit
- Languages
- multilingual
- Last updated
- 2024-05-22 · 21:02:40.000 UTC
What changed
Model types are creator-reported, not independently tested. These labels describe source metadata, not a guarantee of behavior.
- abliteratedmodel name:
Phi-3-medium-4k-instruct-abliterated-v3-GGUF
Family evidence
These groupings are source-reported. Explicit base identifiers take priority over generic architecture tags.
- No supported family evidence recorded.
Available versions
Versions appear here only when they explicitly name this exact model as their source. Check each repository for available files.
- Main repository files ↗GGUF
- No other explicitly linked versions recorded.
Link to this listing
Made or quantized this model? Paste one of these into your model card or README so people can find this listing.
Markdown
[Listed on Custom Clankers](https://customclankers.com/models/failspy-phi-3-medium-4k-instruct-abliterated-v3-gguf-c0ad2a304fd3/)HTML
<a href="https://customclankers.com/models/failspy-phi-3-medium-4k-instruct-abliterated-v3-gguf-c0ad2a304fd3/">Listed on Custom Clankers</a>Plain text links only: no image, no script, nothing loaded from this site.
Customize or build on this model
Listed from public GitHub data, not tested by us. Read the code and license before you run anything.
Tools to customize it further
Make a smaller download (quantize)
- llama.cpp ↗ ★ 132,209
Runs models locally and includes the tools behind most GGUF files. A conversion script turns Hugging Face weights into GGUF, and llama-quantize shrinks a high-precision GGUF to lower-bit formats, which can cost some accuracy.
Learn the techniques
- LLM Course ↗ ★ 84,653
A free course with roadmaps and Colab notebooks. Its notebooks include one-click tools for merging with MergeKit, quantizing to GGUF, GPTQ, EXL2, AWQ and HQQ, and automatic abliteration with custom datasets.
Source provenance
- Downloads
- 174
- Likes
- 28
- Metadata checked
- 2026-10-24 · 16:13:40 UTC
- First seen in index
- 2026-10-24 · 16:13:40 UTC
- Source revision
- df6e6b1a67ef0e885b579c7a02eb648d9e2c5e88
Source-card excerpt
Source model card excerpt: Phi-3-medium-4k-instruct-abliterated-v3 My Jupyter "cookbook" to replicate the methodology can be found here, refined library coming soon Phi-3-abliterated statement Took me a while to wizard
From failspy/Phi-3-medium-4k-instruct-abliterated-v3-GGUF. Creator model-card excerpt, not an independent review.
Inspect before you run
Low refusal is not proof of correctness. Outputs can be inaccurate, harmful, or biased. Review the model card, license and files yourself. A license tag is not commercial-use advice. Parameter counts are source metadata; no hardware compatibility is implied.
This directory does not host or redistribute model weights. Refusal profiles are measured by us on a fixed prompt set; all other behavior claims are source-reported.
Collection rules & limitations ↗New-model alerts
Get an email when new uncensored and abliterated models are listed
Weekly at most. Unsubscribe any time.