TitanML/tiny-mixtral-AWQ-4bit

`TitanML/tiny-mixtral-AWQ-4bit` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://…

azureFoundry/HuggingFace/titanml-tiny-mixtral-awq-4bit@1

`TitanML/tiny-mixtral-AWQ-4bit` powered by Text Generation Inference (TGI)

- [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.co/TitanML/tiny-mixtral-AWQ-4bit) - [Text Generation Inference Documentation](https://huggingface.co/docs/text-generation-inference)

### Send Request

You can use cURL or any REST Client to send a request to the AzureML endpoint with your AzureML token.

```bash curl <AZUREML_ENDPOINT_URL> \ -X POST \ -d '{"inputs":"What is Deep Learning?"}' \ -H "Authorization: Bearer <AZUREML_TOKEN>" \ -H "Content-Type: application/json" ```

### Supported Parameters

- **inputs** (string): Input prompt. - **parameters** (object): - **best_of** (integer): Generate best_of sequences and return the one if the highest token logprobs. - **decoder_input_details** (boolean): Whether to return decoder input token logprobs and ids. - **details** (boolean): Whether to retu

Specifications & capabilities

Input
text
Output
text
Published model ID
tiny-mixtral-AWQ-4bit

Provider specifications & access

1–2 / 2

TitanML/tiny-mixtral-AWQ-4bit ↗

source model id
HuggingFace/titanml-tiny-mixtral-awq-4bit@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
unknown
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    TitanML/tiny-mixtral-AWQ-4bit ↗

    source model id
    HuggingFace/titanml-tiny-mixtral-awq-4bit@2
    hosting
    foundry-managed-compute
    platforms
    • Microsoft Foundry
    license
    unknown
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      Original sources

      1–5 / 5

      Hugging Face · TitanML/tiny-mixtral-AWQ-4bit ↗

      Microsoft Foundry · Model page ↗

      Microsoft Foundry · Model page ↗

      Microsoft Foundry · Model documentation ↗

      Microsoft Foundry · Catalog ↗

      Source links

      1–1 / 1

      Explore more models

      Models

      Loading
      EVIDENCE / COMPARISON

      Benchmarks

      Explore every benchmark

      Loading

      These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

      Install TensorTrace