third-intellect/Phi-3-mini-4k-instruct-orca-math-word-problems-200k-model-16bit

`third-intellect/Phi-3-mini-4k-instruct-orca-math-word-problems-200k-model-16bit` powered by Text Generation Inference. - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-onli…

azureFoundry/HuggingFace/third-intellect-phi-3-mini-4k-instruct-orca-math-word-problems-200k-model-16bit@1

`third-intellect/Phi-3-mini-4k-instruct-orca-math-word-problems-200k-model-16bit` powered by Text Generation Inference.

- [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.co/third-intellect/Phi-3-mini-4k-instruct-orca-math-word-problems-200k-model-16bit) ### Send Request You can use cURL or any REST Client to sent request. Just add your token and test.

``` curl https://YOUR-URL.com -X POST -d '{"inputs":"Once upon a time,"}' -H "Authorization: Bearer <TOKEN>" -H "Content-Type: application/json" ```

### Supported Parameter

You can use different parameters to control the generation, defining them in the parameters attribute of the payload. As of today, the following parameters are supported:

- temperature: Controls randomness in the model. Lower values will make the model more deterministic and higher values will make the model more random. Default value is 1.0. - max_new_tokens: The maximum number of tokens to generate. Default value is 20, max value is 512. - repetition_penalty: Controls the likelihood of repetition. Default is null. - seed: The seed to use for random generation. Default is null. - stop: A list of tokens to stop the generation. The generation will stop when one of the tokens is generated. - top_k: The number of highest probability vocabulary tokens to keep for top-k-filtering. Default value is null, which disables top-k-filtering. - top_p: The cumulative probability of parameter highest probability vocabulary tokens to keep for nucleus sampling, default to null - do_sample: Whether or not to use sampling; use greedy decoding otherwise. Default value is false. - best_of: Generate best_of sequences and return the one if the highest token logprobs, default to null. - details: Whether or not to return details about the generation. Default value is false. - return_full_text: Whether or not to return the full text or only the generated part. Default value is false. - truncate: Whether or not to truncate the input to the maximum length of the model. Default value is true. - typical_p: The typical probability of a token. Default value is null. - watermark: The watermark to use for the generation. Default value is false.

Example payload

```json { "inputs": "Create 3 ideas on what to do in Germany, Nuremberg. I want to go there in the summer.", "parameters": { "do_sample": true, "top_p": 0.95, "temperature": 0.2, "top_k": 50, "max_new_tokens": 256, "repetition_penalty": 1.03, "stop": [" User:", "<|endoftext|>", "</s>"] } } ```

Specifications & capabilities

Input
text
Output
text
Published model ID
Phi-3-mini-4k-instruct-orca-math-word-problems-200k-model-16bit

Provider specifications & access

1–1 / 1

Original sources

1–4 / 4

Hugging Face · third-intellect/Phi-3-mini-4k-instruct-orca-math-word-problems-200k-model-16bit ↗

Microsoft Foundry · Model page ↗

Microsoft Foundry · Model documentation ↗

Microsoft Foundry · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace