This repository was archived by the owner on Feb 6, 2026. It is now read-only.
Description Overview
This repo contains scripts for quantizing models. Once the HuggingFace MCP is configured in srt-concierge, we can automate the upload process.
Current Workflow (Manual)
Run quantization script
Manually upload to HuggingFace
Manually update model card
Manually announce on social media
Proposed Workflow (Automated)
Run quantization script
Ask concierge: "Upload [model] to HuggingFace and announce"
Concierge uses HuggingFace MCP to:
Create model repo (if needed)
Upload model files
Generate/update model card
Concierge uses Twitter MCP to announce
Model Card Template
Standard template for AWQ quantized models:
# {model_name}-AWQ
AWQ quantized version of [ {original_model}] ( {original_url} )
## Quantization Details
- Method: AWQ (Activation-aware Weight Quantization)
- Bits: 4-bit
- Group Size: 128
- Tool: [ AutoAWQ] ( https://github.com/casper-hansen/AutoAWQ )
## Usage
Compatible with vLLM, TGI, and other AWQ-supporting frameworks.
## Deployment
Currently deployed on [ SolidRusT AI] ( https://solidrust.ai ) inference platform.
## Credits
Quantized by [ SolidRusT Networks] ( https://huggingface.co/solidrust )
Success Criteria
Depends On
srt-concierge #70: Add Social Media MCP Servers
Reactions are currently unavailable
Overview
This repo contains scripts for quantizing models. Once the HuggingFace MCP is configured in srt-concierge, we can automate the upload process.
Current Workflow (Manual)
Proposed Workflow (Automated)
Model Card Template
Standard template for AWQ quantized models:
Success Criteria
Depends On