Inference Providers
Active filters: AWQ
QuantTrio/Qwen3.5-122B-A10B-AWQ
Image-Text-to-Text
• 125B • Updated • 40k
• 21
QuantTrio/Qwen3.5-27B-AWQ
Image-Text-to-Text
• 28B • Updated • 247k
• 24
Image-Text-to-Text
• 10B • Updated • 158k
• 7
QuantTrio/MiniMax-M2.5-AWQ
Text Generation
• 229B • Updated • 81k
• 11
QuantTrio/Qwen3.5-35B-A3B-AWQ
Image-Text-to-Text
• 36B • Updated • 130k
• 11
abhinavkulkarni/mosaicml-mpt-7b-instruct-w4-g128-awq
Text Generation
• Updated • 1
abhinavkulkarni/mosaicml-mpt-7b-chat-w4-g128-awq
Text Generation
• 1B • Updated • 5
abhinavkulkarni/VMware-open-llama-7b-open-instruct-w4-g128-awq
Text Generation
• Updated • 2
abhinavkulkarni/VMware-open-llama-13b-open-instruct-w4-g128-awq
Text Generation
• Updated • 4
• 3
abhinavkulkarni/tiiuae-falcon-7b-instruct-w4-g64-awq
Text Generation
• Updated • 9
• 5
abhinavkulkarni/psmathur-orca_mini_v2_7b-w4-g128-awq
Text Generation
• Updated • 3
• 2
abhinavkulkarni/Salesforce-codegen25-7b-multi-w4-g128-awq
Text Generation
• Updated • 8
• 2
abhinavkulkarni/psmathur-orca_mini_v2_13b-w4-g128-awq
Text Generation
• Updated • 3
• 2
abhinavkulkarni/mosaicml-mpt-30b-instruct-w4-g128-awq
Text Generation
• Updated • 2
• 2
abhinavkulkarni/mosaicml-mpt-30b-chat-w4-g128-awq
Text Generation
• 4B • Updated • 4
abhinavkulkarni/VMware-open-llama-7b-v2-open-instruct-w4-g128-awq
Text Generation
• Updated • 2
abhinavkulkarni/tiiuae-falcon-40b-instruct-w4-g128-awq
Text Generation
• Updated • 6
• 2
abhinavkulkarni/Salesforce-codegen25-7b-instruct-w4-g128-awq
Text Generation
• Updated • 10
• 3
abhinavkulkarni/meta-llama-Llama-2-7b-chat-hf-w4-g128-awq
Text Generation
• Updated • 11
• 6
abhinavkulkarni/meta-llama-Llama-2-13b-chat-hf-w4-g128-awq
Text Generation
• Updated • 4
• 1
abhinavkulkarni/stabilityai-StableBeluga-7B-w4-g128-awq
Text Generation
• Updated • 4
• 1
abhinavkulkarni/stabilityai-StableBeluga-13B-w4-g128-awq
Text Generation
• Updated • 2
• 1
abhinavkulkarni/codellama-CodeLlama-7b-Instruct-hf-w4-g128-awq
Text Generation
• Updated • 5
abhinavkulkarni/codellama-CodeLlama-7b-Python-hf-w4-g128-awq
Text Generation
• Updated • 4
abhinavkulkarni/codellama-CodeLlama-13b-Instruct-hf-w4-g128-awq
Text Generation
• 2B • Updated • 3
abhinavkulkarni/codellama-CodeLlama-13b-Python-hf-w4-g128-awq
Text Generation
• Updated • 1
xDAN-AI/xDAN-L1-Chat-RL-v1-awq
Text Generation
• 7B • Updated solidrust/Noromaid-7B-0.4-DPO-AWQ
Text Generation
• 7B • Updated • 12
• 1
solidrust/WestLake-7B-v2-AWQ
Text Generation
• 7B • Updated • 5
• 4
solidrust/WestLake-7B-v2-laser-AWQ
Text Generation
• 7B • Updated • 1
• 1