microsoft/bitnet-b1.58-2B-4T

`microsoft/bitnet-b1.58-2B-4T` powered by Hugging Face Inference Toolkit - [Original Model Card](https://huggingface.co/microsoft/bitnet-b1.58-2B-4T) ### Send Request You can use cURL or any REST Cli…

azureFoundry/HuggingFace/microsoft-bitnet-b1-58-2b-4t@3

microsoft/bitnet-b1.58-2B-4T powered by Hugging Face Inference Toolkit

Send Request

You can use cURL or any REST Client to send a request to the AzureML endpoint with your AzureML token.

curl <AZUREML_ENDPOINT_URL> \
    -X POST \
    -d '{"inputs":"System: You are a helpful assistant that responds like a pirate<|eot_id|>User: What is Deep Learning?<|eot_id|>Assistant: ","parameters":{"max_new_tokens":10,"seed":42}}' \
    -H "Authorization: Bearer <AZUREML_TOKEN>" \
    -H "Content-Type: application/json"

Supported Parameters

Find below the parameters that control the length of the output:

  • max_length: The maximum length the generated tokens can have. Corresponds to the length of the input prompt + max_new_tokens. Its effect is overridden by max_new_tokens, if also set. Defaults to 20.
  • max_new_tokens: The maximum numbers of tokens to generate, ignoring the number of tok

Specifications & capabilities

Input
text
Output
text
Published model ID
bitnet-b1.58-2B-4T

Provider specifications & access

1–6 / 6

microsoft/bitnet-b1.58-2B-4T ↗

source model id
HuggingFace/microsoft-bitnet-b1-58-2b-4t@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
mit
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    microsoft/bitnet-b1.58-2B-4T ↗

    source model id
    HuggingFace/microsoft-bitnet-b1.58-2b-4t@1
    hosting
    foundry-managed-compute
    platforms
    • Microsoft Foundry
    license
    mit
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      microsoft/bitnet-b1.58-2B-4T ↗

      source model id
      HuggingFace/microsoft-bitnet-b1-58-2b-4t@2
      hosting
      foundry-managed-compute
      platforms
      • Microsoft Foundry
      license
      mit
      architecture
      input_modalities
      • text
      output_modalities
      • text
      capabilities

        microsoft/bitnet-b1.58-2B-4T ↗

        source model id
        HuggingFace/microsoft-bitnet-b1-58-2b-4t@3
        hosting
        foundry-managed-compute
        platforms
        • Microsoft Foundry
        license
        mit
        architecture
        input_modalities
        • text
        output_modalities
        • text
        capabilities

          microsoft/bitnet-b1.58-2B-4T ↗

          source model id
          HuggingFace/microsoft-bitnet-b1-58-2b-4t@4
          hosting
          foundry-managed-compute
          platforms
          • Microsoft Foundry
          license
          mit
          architecture
          input_modalities
          • text
          output_modalities
          • text
          capabilities

            microsoft/bitnet-b1.58-2B-4T ↗

            source model id
            HuggingFace/microsoft-bitnet-b1-58-2b-4t@5
            hosting
            foundry-managed-compute
            platforms
            • Microsoft Foundry
            license
            mit
            architecture
            input_modalities
            • text
            output_modalities
            • text
            capabilities

              Original sources

              1–9 / 9

              Hugging Face · microsoft/bitnet-b1.58-2B-4T ↗

              Microsoft Foundry · Model page ↗

              Microsoft Foundry · Model page ↗

              Microsoft Foundry · Model page ↗

              Microsoft Foundry · Model page ↗

              Microsoft Foundry · Model page ↗

              Microsoft Foundry · Model page ↗

              Microsoft Foundry · Model documentation ↗

              Microsoft Foundry · Catalog ↗

              Source links

              1–1 / 1

              Explore more models

              Models

              Loading
              EVIDENCE / COMPARISON

              Benchmarks

              Explore every benchmark

              Loading

              These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

              Install TensorTrace