azureFoundry/HuggingFace/thebloke-llama-2-7b-gptq@1
`TheBloke/Llama-2-7B-GPTQ` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.co/TheBloke/Llama-2-7B-GPTQ) - [Text Generation Inference Documentation](
- Input modalities
- text
- Output modalities
- text
Benchmarks
- Open LLM Leaderboard v1: 48.48%
vertexAI/publishers/hf-thebloke/models/llama-pro-8b-instruct-awq@001
- Input modalities
- text
- Output modalities
- text
azureFoundry/HuggingFace/thebloke-llama-pro-8b-instruct-gptq@1
`TheBloke/LLaMA-Pro-8B-Instruct-GPTQ` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.co/TheBloke/LLaMA-Pro-8B-Instruct-GPTQ) - [Text Generation Inf
- Input modalities
- text
- Output modalities
- text
vertexAI/publishers/hf-thebloke/models/llava-v1.5-13b-awq@001
- Input modalities
- text
- Output modalities
- text
vertexAI/publishers/hf-thebloke/models/luna-ai-llama2-uncensored-awq@001
- Input modalities
- text
- Output modalities
- text
huggingface/TheBloke/manticore-13b-chat-pyg-GPTQ
- Input modalities
- text
- Output modalities
- text
Benchmarks
- Open LLM Leaderboard v1: 53.11%
huggingface/TheBloke/Manticore-13B-Chat-Pyg-Guanaco-SuperHOT-8K-GPTQ
- Input modalities
- text
- Output modalities
- text
Benchmarks
- Open LLM Leaderboard v1: 49.466%
huggingface/TheBloke/medalpaca-13B-GPTQ-4bit
- Input modalities
- text
- Output modalities
- text
Benchmarks
- Open LLM Leaderboard v1: 30.624%
vertexAI/publishers/hf-thebloke/models/medicine-llm-awq@001
- Input modalities
- text
- Output modalities
- text
vertexAI/publishers/hf-thebloke/models/meditron-70b-gptq@001
- Input modalities
- text
- Output modalities
- text
azureFoundry/HuggingFace/thebloke-meditron-7b-awq@2
`TheBloke/meditron-7B-AWQ` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.co/TheBloke/meditron-7B-AWQ) - [Text Generation Inference Documentation](
- Input modalities
- text
- Output modalities
- text
azureFoundry/HuggingFace/thebloke-mistral-7b-instruct-v0.1-awq@1
`TheBloke/Mistral-7B-Instruct-v0.1-AWQ` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-AWQ) - [Text Generation
- Input modalities
- text
- Output modalities
- text
azureFoundry/HuggingFace/thebloke-mistral-7b-instruct-v0.1-gptq@1
`TheBloke/Mistral-7B-Instruct-v0.1-GPTQ` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GPTQ) - [Text Generati
- Input modalities
- text
- Output modalities
- text
vertexAI/publishers/hf-thebloke/models/mistral-7b-instruct-v0.2-awq@001
- Input modalities
- text
- Output modalities
- text
vertexAI/publishers/hf-thebloke/models/mistral-7b-instruct-v0.2-gptq@001
- Input modalities
- text
- Output modalities
- text
azureFoundry/HuggingFace/thebloke-mistral-7b-openorca-awq@1
`TheBloke/Mistral-7B-OpenOrca-AWQ` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-AWQ) - [Text Generation Inference
- Input modalities
- text
- Output modalities
- text
azureFoundry/HuggingFace/thebloke-mistral-7b-openorca-gptq@1
`TheBloke/Mistral-7B-OpenOrca-GPTQ` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GPTQ) - [Text Generation Inferen
- Input modalities
- text
- Output modalities
- text
vertexAI/publishers/hf-thebloke/models/mistral-7b-v0.1-awq@001
- Input modalities
- text
- Output modalities
- text