bartowski / Model details
Qwen2.5-14B_Uncensored_Instruct-GGUF
bartowski/Qwen2.5-14B_Uncensored_Instruct-GGUF
About this model
This repository by bartowski contains GGUF quantizations of SicariusSicariiStuff/Qwen2.5-14B_Uncensored_Instruct. The creator says the quants were made with llama.cpp release b3787 using the imatrix option and a calibration dataset. The model card lists many GGUF files, from f16 to IQ2_M, and describes Q4_K_M as the default size for most use cases; it also says I-quants may offer better performance for their size on cuBLAS or rocBLAS. The card provides a ChatML-style prompt format with system, user, and assistant turns. The repository is licensed under Apache 2.0.
Description sources
Source-based description, not an independent evaluation. Check the linked sources for the creator’s claims and limitations.
Size and formats
- Base model
- SicariusSicariiStuff/Qwen2.5-14B_Uncensored_Instruct
- Parameters
- Unknown
- Main repository formats
- GGUF
- License tag
- apache-2.0
- Languages
- en
- Last updated
- 2024-09-22 · 23:01:24.000 UTC
What changed
Model types are creator-reported, not independently tested. These labels describe source metadata, not a guarantee of behavior.
- uncensoredmodel name:
Qwen2.5-14B_Uncensored_Instruct-GGUF
Family evidence
These groupings are source-reported. Explicit base identifiers take priority over generic architecture tags.
- Qwen: Base model: SicariusSicariiStuff/Qwen2.5-14B_Uncensored_Instruct
Available versions
Versions appear here only when they explicitly name this exact model as their source. Check each repository for available files.
- Main repository files ↗GGUF
- No other explicitly linked versions recorded.
Download sources
ModelScope distribution ↗- Distribution checked: ModelScope · 2026-10-24 · 06:34:24 UTC
Distribution links are not independent reviews or runtime compatibility guarantees. Check each source’s exact files and instructions.
Customize or build on this model
Listed from public GitHub data, not tested by us. Read the code and license before you run anything.
Tools to customize it further
Make a smaller download (quantize)
- llama.cpp ↗ ★ 132,124
Runs models locally and includes the tools behind most GGUF files. A conversion script turns Hugging Face weights into GGUF, and llama-quantize shrinks a high-precision GGUF to lower-bit formats, which can cost some accuracy.
Learn the techniques
- LLM Course ↗ ★ 84,633
A free course with roadmaps and Colab notebooks. Its notebooks include one-click tools for merging with MergeKit, quantizing to GGUF, GPTQ, EXL2, AWQ and HQQ, and automatic abliteration with custom datasets.
Source provenance
- Downloads
- 34,242
- Likes
- 80
- Metadata checked
- 2026-10-24 · 04:11:48 UTC
- First seen in index
- 2026-10-24 · 04:11:48 UTC
- Source revision
- 2e7d5957ae9b9434ab58620f1073cae1fd0cf60a
Source-card excerpt
Source model card excerpt: Llamacpp imatrix Quantizations of Qwen2.5-14B Uncensored Instruct Using llama.cpp release b3787 for quantization. Original model: All quants made using imatrix option with dataset from
From bartowski/Qwen2.5-14B_Uncensored_Instruct-GGUF. Creator model-card excerpt, not an independent review.
Inspect before you run
Low refusal is not proof of correctness. Outputs can be inaccurate, harmful, or biased. Review the model card, license and files yourself. A license tag is not commercial-use advice. Parameter counts are source metadata; no hardware compatibility is implied.
This directory does not run, host, redistribute, or test model weights.
Collection rules & limitations ↗