01-ai/Yi-34B-Chat

`01-ai/Yi-34B-Chat` powered by Text Generation Inference. - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.co/01…

azureFoundry/HuggingFace/01-ai-yi-34b-chat@1

01-ai/Yi-34B-Chat powered by Text Generation Inference.

Send Request

You can use cURL or any REST Client to sent request. Just add your token and test.

curl https://YOUR-URL.com -X POST -d '{"inputs":"Once upon a time,"}' -H "Authorization: Bearer <TOKEN>" -H "Content-Type: application/json"

Supported Parameter

You can use different parameters to control the generation, defining them in the parameters attribute of the payload. As of today, the following parameters are supported:

  • temperature: Controls randomness in the model. Lower values will make the model more deterministic and higher values will make the model more random. Default value is 1.0.
  • max_new_tokens: The maximum number of tokens to generate. Default value is 20, max value is 512.
  • repetition_penalty: Controls the likelihood of repetition.

Specifications & capabilities

Input
text
Output
text
Published model ID
Yi-34B-Chat

Evaluations

41–41 / 41

Open LLM Leaderboard v1

19.788%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 GSM8K
dimension
math
metric
Accuracy
rank
4293
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
a99ec35331cbfc9da596af7d4538fe2efecff03c
source_flagged
true
missing_metrics
    dataset_revision
    791ca1c841030008c6c266562c2b88c9b7196550
    metric_population
    7260
    ranking_population
    7260
    source_flag_anomaly
    true
    evaluated at
    2023-11-23T10:23:14.000Z
    source model id
    01-ai/Yi-34B-Chat
    Original result ↗

    Provider specifications & access

    1–2 / 2

    01-ai/Yi-34B-Chat ↗

    source model id
    HuggingFace/01-ai-yi-34b-chat@1
    hosting
    foundry-managed-compute
    platforms
    • Microsoft Foundry
    license
    apache-2.0
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      01-ai/Yi-34B-Chat ↗

      source model id
      HuggingFace/01-ai-yi-34b-chat@2
      hosting
      foundry-managed-compute
      platforms
      • Microsoft Foundry
      license
      apache-2.0
      architecture
      input_modalities
      • text
      output_modalities
      • text
      capabilities

        Original sources

        1–8 / 8

        Hugging Face · 01-ai/Yi-34B-Chat ↗

        Microsoft Foundry · Model page ↗

        Microsoft Foundry · Model page ↗

        Microsoft Foundry · Model documentation ↗

        Hugging Face · Catalog ↗

        Hugging Face · Catalog ↗

        Hugging Face · Catalog ↗

        Microsoft Foundry · Catalog ↗

        Source links

        1–4 / 4

        Explore more models

        Models

        Loading
        EVIDENCE / COMPARISON

        Benchmarks

        Explore every benchmark

        Loading

        These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

        Install TensorTrace