Efficient-Large-Model/gemma-2-2b-it

`Efficient-Large-Model/gemma-2-2b-it` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](ht…

azureFoundry/HuggingFace/efficient-large-model-gemma-2-2b-it@1

Efficient-Large-Model/gemma-2-2b-it powered by Text Generation Inference (TGI)

Send Request

You can use cURL or any REST Client to send a request to the AzureML endpoint with your AzureML token.

curl <AZUREML_ENDPOINT_URL> \
    -X POST \
    -d '{"inputs":"What is Deep Learning?"}' \
    -H "Authorization: Bearer <AZUREML_TOKEN>" \
    -H "Content-Type: application/json"

Supported Parameters

  • inputs (string): Input prompt.
  • parameters (object):
    • best_of (integer): Generate best_of sequences and return the one if the highest token logprobs.
    • decoder_input_details (boolean): Whether to return decoder input token logprobs and ids.
    • details (boolean): Whe

Specifications & capabilities

Input
text
Output
text
Published model ID
gemma-2-2b-it

Provider specifications & access

1–2 / 2

Efficient-Large-Model/gemma-2-2b-it ↗

source model id
HuggingFace/efficient-large-model-gemma-2-2b-it@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
gemma
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    Efficient-Large-Model/gemma-2-2b-it ↗

    source model id
    HuggingFace/efficient-large-model-gemma-2-2b-it@2
    hosting
    foundry-managed-compute
    platforms
    • Microsoft Foundry
    license
    gemma
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      Original sources

      1–5 / 5

      Hugging Face · Efficient-Large-Model/gemma-2-2b-it ↗

      Microsoft Foundry · Model page ↗

      Microsoft Foundry · Model page ↗

      Microsoft Foundry · Model documentation ↗

      Microsoft Foundry · Catalog ↗

      Source links

      1–1 / 1

      Explore more models

      Models

      Loading
      EVIDENCE / COMPARISON

      Benchmarks

      Explore every benchmark

      Loading

      These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

      Install TensorTrace