bigscience/bloomz
`bigscience/bloomz` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.…
azureFoundry/HuggingFace/bigscience-bloomz@5
bigscience/bloomz powered by Text Generation Inference (TGI)
Send Request
You can use cURL or any REST Client to send a request to the AzureML endpoint with your AzureML token.
curl <AZUREML_ENDPOINT_URL> \
-X POST \
-d '{"inputs":"What is Deep Learning?"}' \
-H "Authorization: Bearer <AZUREML_TOKEN>" \
-H "Content-Type: application/json"
Supported Parameters
- inputs (string): Input prompt.
- parameters (object):
- best_of (integer): Generate best_of sequences and return the one if the highest token logprobs.
- decoder_input_details (boolean): Whether to return decoder input token logprobs and ids.
- details (boolean): Whether to return generation details.
- do_sample (boolean): Activate logits sampling.
- frequency_penalty (float): The parameter for frequency penalty. 1.0 means no penalty Penalize new tokens based on their existing frequency in the text so far, decreasing the model’s likelihood to repeat the same line verbatim.
- grammar (object): One of the following
- #1 (object):
- type (enum): Possible values: json.
- value (string): A string that represents a JSON Schema. JSON Schema is a declarative language that allows to annotate JSON documents with types and descriptions.
- #2 (object):
- type (enum): Possible values: regex.
- value (string): The regular expression.
- #3 (object):
- type (enum): Possible values: json_schema.
- value (object):
- name (string): Optional name identifier for the schema
- schema (object): The actual JSON schema definition
- max_new_tokens (integer): Maximum number of tokens to generate.
- repetition_penalty (float): The parameter for repetition penalty. 1.0 means no penalty. See this paper for more details.
- return_full_text (boolean): Whether to prepend the prompt to the generated text
- seed (integer): Random sampling seed.
- stop (string[]): Stop generating tokens if a member of stop is generated.
- temperature (float): The value used to module the logits distribution.
- top_k (integer): The number of highest probability vocabulary tokens to keep for top-k-filtering.
- top_n_tokens (integer): The number of highest probability vocabulary tokens to keep for top-n-filtering.
- top_p (float): Top-p value for nucleus sampling.
- truncate (integer): Truncate inputs tokens to the given size.
- typical_p (float): Typical Decoding mass See Typical Decoding for Natural Language Generation for more information.
- watermark (boolean): Watermarking with A Watermark for Large Language Models.
- stream (boolean): Whether to stream the output tokens or not. Defaults to false.
Example payload
{
"inputs": "What is Deep Learning?",
"parameters": {
"do_sample": true,
"top_p": 0.95,
"temperature": 0.2,
"top_k": 50,
"max_new_tokens": 256,
"repetition_penalty": 1.03,
"stop": ["\nUser:", "<|endoftext|>", "</s>"]
}
}
OpenAI Chat Completion API compatibility
Additionally, Text Generation Inference (TGI) offers an OpenAI Chat Completion API compatible layer under the endpoint /v1/chat/completions,
check the full specification in the OpenAI Chat Completion Create Documentation.
Specifications & capabilities
- Input
- text
- Output
- text
- Published model ID
- bloomz
Evaluations
1–10 / 10
0
- source id
- toolBench
- leaderboard name
- WebShop Long
- dimension
- toolUse
- metric
- WebShop Long
- rank
- 6
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- shots
- 3
- suite
- SambaNova ToolBench
- tuned_on_toolbench
- False
- metric_kind
- WebShop Long
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- results.json
- source_revision
- ec63fbf3e95dc80fdddb584b650e52889dbd61140b97ba8ef7b6f1dd4dc7b615
- metric_population
- 41
- benchmark_evaluation
- true
- source model id
- bloomz
Original result ↗85%
- source id
- toolBench
- leaderboard name
- The Cat API
- dimension
- toolUse
- metric
- The Cat API
- rank
- 13
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- shots
- 3
- suite
- SambaNova ToolBench
- tuned_on_toolbench
- False
- metric_kind
- The Cat API
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- results.json
- source_revision
- ec63fbf3e95dc80fdddb584b650e52889dbd61140b97ba8ef7b6f1dd4dc7b615
- metric_population
- 41
- benchmark_evaluation
- true
- source model id
- bloomz
Original result ↗1
- source id
- toolBench
- leaderboard name
- WebShop Short
- dimension
- toolUse
- metric
- WebShop Short
- rank
- 19
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- shots
- 3
- suite
- SambaNova ToolBench
- tuned_on_toolbench
- False
- metric_kind
- WebShop Short
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- results.json
- source_revision
- ec63fbf3e95dc80fdddb584b650e52889dbd61140b97ba8ef7b6f1dd4dc7b615
- metric_population
- 41
- benchmark_evaluation
- true
- source model id
- bloomz
Original result ↗58%
- source id
- toolBench
- leaderboard name
- Open Weather
- dimension
- toolUse
- metric
- Open Weather
- rank
- 23
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- shots
- 3
- suite
- SambaNova ToolBench
- tuned_on_toolbench
- False
- metric_kind
- Open Weather
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- results.json
- source_revision
- ec63fbf3e95dc80fdddb584b650e52889dbd61140b97ba8ef7b6f1dd4dc7b615
- metric_population
- 41
- benchmark_evaluation
- true
- source model id
- bloomz
Original result ↗22.5%
- source id
- toolBench
- leaderboard name
- Trip Booking
- dimension
- toolUse
- metric
- Trip Booking
- rank
- 23
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- shots
- 3
- suite
- SambaNova ToolBench
- tuned_on_toolbench
- False
- metric_kind
- Trip Booking
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- results.json
- source_revision
- ec63fbf3e95dc80fdddb584b650e52889dbd61140b97ba8ef7b6f1dd4dc7b615
- metric_population
- 41
- benchmark_evaluation
- true
- source model id
- bloomz
Original result ↗14.3%
- source id
- toolBench
- leaderboard name
- Google Sheets
- dimension
- toolUse
- metric
- Google Sheets
- rank
- 23
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- shots
- 3
- suite
- SambaNova ToolBench
- tuned_on_toolbench
- False
- metric_kind
- Google Sheets
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- results.json
- source_revision
- ec63fbf3e95dc80fdddb584b650e52889dbd61140b97ba8ef7b6f1dd4dc7b615
- metric_population
- 41
- benchmark_evaluation
- true
- source model id
- bloomz
Original result ↗27.8%
- source id
- toolBench
- leaderboard name
- Avg.
- dimension
- toolUse
- metric
- Avg.
- rank
- 24
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- shots
- 3
- suite
- SambaNova ToolBench
- tuned_on_toolbench
- False
- metric_kind
- Avg.
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- results.json
- source_revision
- ec63fbf3e95dc80fdddb584b650e52889dbd61140b97ba8ef7b6f1dd4dc7b615
- metric_population
- 41
- benchmark_evaluation
- true
- source model id
- bloomz
Original result ↗36%
- source id
- toolBench
- leaderboard name
- Home Search
- dimension
- toolUse
- metric
- Home Search
- rank
- 25
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- shots
- 3
- suite
- SambaNova ToolBench
- tuned_on_toolbench
- False
- metric_kind
- Home Search
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- results.json
- source_revision
- ec63fbf3e95dc80fdddb584b650e52889dbd61140b97ba8ef7b6f1dd4dc7b615
- metric_population
- 41
- benchmark_evaluation
- true
- source model id
- bloomz
Original result ↗1%
- source id
- toolBench
- leaderboard name
- Tabletop
- dimension
- toolUse
- metric
- Tabletop
- rank
- 34
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- shots
- 3
- suite
- SambaNova ToolBench
- tuned_on_toolbench
- False
- metric_kind
- Tabletop
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- results.json
- source_revision
- ec63fbf3e95dc80fdddb584b650e52889dbd61140b97ba8ef7b6f1dd4dc7b615
- metric_population
- 41
- benchmark_evaluation
- true
- source model id
- bloomz
Original result ↗4.9
- source id
- toolBench
- leaderboard name
- VirtualHome
- dimension
- toolUse
- metric
- VirtualHome
- rank
- 38
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- shots
- 3
- suite
- SambaNova ToolBench
- tuned_on_toolbench
- False
- metric_kind
- VirtualHome
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- results.json
- source_revision
- ec63fbf3e95dc80fdddb584b650e52889dbd61140b97ba8ef7b6f1dd4dc7b615
- metric_population
- 41
- benchmark_evaluation
- true
- source model id
- bloomz
Original result ↗Provider specifications & access
1–1 / 1
- source model id
- HuggingFace/bigscience-bloomz@5
- hosting
- foundry-managed-compute
- license
- bigscience-bloom-rail-1.0
Explore more models