Deci-DeciLM-7B · azureml v7

DeciLM-7B is a decoder-only text generation model with 7.04 billion parameters, released by Deci under the Apache 2.0 license. It is the top-performing 7B base language model on the Open LLM Leaderbo…

azureFoundry/azureml/Deci-DeciLM-7B@7

DeciLM-7B is a decoder-only text generation model with 7.04 billion parameters, released by Deci under the Apache 2.0 license. It is the top-performing 7B base language model on the Open LLM Leaderboard and uses variable Grouped-Query Attention (GQA) to achieve a superior balance between accuracy and computational efficiency. The model's architecture was generated using Deci's proprietary Neural Architecture Search technology, AutoNAC. DeciLM-7B is intended for commercial and research use in English and can be fine-tuned for various tasks and languages. However, like all large language models, its outputs are unpredictable and may generate responses that are inaccurate, biased, or otherwise objectionable. Developers planning to use DeciLM-7B should undertake thorough safety testing and tuning designed explicitly for their intended applications of the model before deployment.

Model Evaluation Sample

TaskUse caseDatasetPython sample (Notebook)CLI with YAML
Text generationText generation cnn_dailymail evaluate-model-text-generation.ipynbevaluate-model-text-generation.yml

Inference samples

Inference typePython sample (Notebook)CLI with YAML
Real timetext-generation-online-endpoint.ipynbtext-generation-online-endpoint.sh
Batchtext-generation-batch-endpoint.ipynbcoming soon

Sample inputs and outputs (for real-time inference)

Sample input

{
  "input_data": {
    "input_string": [
      "In a shocking finding, scientists discovered a herd of unicorns living in"
    ],
    "parameters": {
      "top_p": 0.95,
      "temperature": 0.6,
      "max_new_tokens": 100,
      "do_sample": true
    }
  }
}

Sample output

[
  {
    "0": "In a shocking finding, scientists discovered a herd of unicorns living in the Pacific Ocean. The discovery was made by a team of scientists who were studying the effects of climate change on the ocean. They found that the unicorns were using the ocean as a refuge from the warmer temperatures on land.\n\nA team of scientists from the University of California, San Diego, and the University of California, Los Angeles, made the discovery while studying the effects of climate change on the ocean. They found that the unicorns were using the ocean as a"
  }
]

Specifications & capabilities

Input
text
Output
text

Provider specifications & access

1–1 / 1

Deci-DeciLM-7B · azureml v7 ↗

source model id
azureml/Deci-DeciLM-7B@7
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
apache-2.0
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    Original sources

    1–3 / 3

    Microsoft Foundry · Model page ↗

    Microsoft Foundry · Model documentation ↗

    Microsoft Foundry · Catalog ↗

    Source links

    1–1 / 1

    Explore more models

    Models

    Loading
    EVIDENCE / COMPARISON

    Benchmarks

    Explore every benchmark

    Loading

    These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

    Install TensorTrace