jinaai/ReaderLM-v2

`jinaai/ReaderLM-v2` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface…

azureFoundry/HuggingFace/jinaai-readerlm-v2@1

jinaai/ReaderLM-v2 powered by Text Generation Inference (TGI)

Send Request

You can use cURL or any REST Client to send a request to the AzureML endpoint with your AzureML token.

curl <AZUREML_ENDPOINT_URL> \
    -X POST \
    -d '{"inputs":"What is Deep Learning?"}' \
    -H "Authorization: Bearer <AZUREML_TOKEN>" \
    -H "Content-Type: application/json"

Supported Parameters

You can use different parameters to control the generation, defining them in the parameters attribute of the payload. As of today, the following parameters are supported:

  • temperature: Controls randomness in the model. Lower values will make the model more deterministic and higher values will make the model more random. Default value is 1.0.
  • max_new_tokens: The maximum number of tokens to generate. Default value is 20, max value is 512.
  • repetition_penalty: Controls the likelihood of repetition. Default is null.
  • seed: The seed to use for random generation. Default is null.
  • stop: A list of tokens to stop the generation. The generation will stop when one of the tokens is generated.
  • top_k: The number of highest probability vocabulary tokens to keep for top-k-filtering. Default value is null, which disables top-k-filtering.
  • top_p: The cumulative probability of parameter highest probability vocabulary tokens to keep for nucleus sampling, default to null
  • do_sample: Whether or not to use sampling; use greedy decoding otherwise. Default value is false.
  • best_of: Generate best_of sequences and return the one if the highest token logprobs, default to null.
  • details: Whether or not to return details about the generation. Default value is false.
  • return_full_text: Whether or not to return the full text or only the generated part. Default value is false.
  • truncate: Whether or not to truncate the input to the maximum length of the model. Default value is true.
  • typical_p: The typical probability of a token. Default value is null.
  • watermark: The watermark to use for the generation. Default value is false.

Example payload

{
  "inputs": "What is Deep Learning?",
  "parameters": {
    "do_sample": true,
    "top_p": 0.95,
    "temperature": 0.2,
    "top_k": 50,
    "max_new_tokens": 256,
    "repetition_penalty": 1.03,
    "stop": ["\nUser:", "<|endoftext|>", "</s>"]
  }
}

Specifications & capabilities

Input
text
Output
text
Published model ID
ReaderLM-v2

Provider specifications & access

1–2 / 2

jinaai/ReaderLM-v2 ↗

source model id
HuggingFace/jinaai-readerlm-v2@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
cc-by-nc-4.0
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    jina ↗

    source model id
    jina-ai/ReaderLM-v2
    hosting
    jina-catalog-only
    platforms
    • Jina AI
    context length
    524288
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      Source specification observations

      1–1 / 1

      jina ↗

      field
      context_length
      value
      524288
      normalized value
      524288
      scope
      source-model
      source id
      jina
      confidence
      1

      Original sources

      1–8 / 8

      Jina AI · Model page ↗

      Hugging Face · jinaai/ReaderLM-v2 ↗

      Microsoft Foundry · Model page ↗

      Microsoft Foundry · Model documentation ↗

      arXiv · Paper · 2503.01151 ↗

      Jina AI · Source snapshot ↗

      Jina AI · Catalog ↗

      Microsoft Foundry · Catalog ↗

      Source links

      1–3 / 3

      Explore more models

      Models

      Loading
      EVIDENCE / COMPARISON

      Benchmarks

      Explore every benchmark

      Loading

      These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

      Install TensorTrace