Deci-DeciLM-7B-instruct · azureml v6

DeciLM-7B-instruct is a model for short-form instruction following, built by LoRA fine-tuning on the SlimOrca dataset. It is a derivative of the recently released DeciLM-7B language model, a pre-trai…

azureFoundry/azureml/Deci-DeciLM-7B-instruct@6

DeciLM-7B-instruct is a model for short-form instruction following, built by LoRA fine-tuning on the SlimOrca dataset. It is a derivative of the recently released DeciLM-7B language model, a pre-trained, high-efficiency generative text model with 7 billion parameters. DeciLM-7B-instruct is one of the best 7B instruct models obtained using simple LoRA fine-tuning, without relying on preference optimization techniques such as RLHF and DPO. DeciLM-7B-instruct is intended for commercial and research use in English. However, like all large language models, its outputs are unpredictable and may generate responses that are inaccurate, biased, or otherwise objectionable. Developers planning to use DeciLM-7B-instruct should undertake thorough safety testing and tuning designed explicitly for their intended applications of the model before deployment.

Model Evaluation Sample

TaskUse caseDatasetPython sample (Notebook)CLI with YAML
Text generationText generation cnn_dailymail evaluate-model-text-generation.ipynbevaluate-model-text-generation.yml

Inference samples

Inference typePython sample (Notebook)CLI with YAML
Real timetext-generation-online-endpoint.ipynbtext-generation-online-endpoint.sh
Batchtext-generation-batch-endpoint.ipynbcoming soon

Sample inputs and outputs (for real-time inference)

Sample input

{
  "input_data": {
    "input_string": [
      "How do I make the most delicious pancakes the world has ever tasted?"
    ],
    "parameters": {
      "top_p": 0.95,
      "temperature": 0.6,
      "max_new_tokens": 100,
      "do_sample": true
    }
  }
}

Sample output

[
  {
    "0": "How do I make the most delicious pancakes the world has ever tasted?\n\nAnswer: In a large bowl, whisk together the flour, sugar, baking powder, and salt. In a separate bowl, whisk together the milk, eggs, and melted butter. Pour the wet ingredients into the dry ingredients and stir until just combined. Add more milk if the batter seems too thick. Heat a non-stick pan or griddle over medium heat. Lightly grease the pan with butter or cooking spray. Pour about 1/4 cup of batter onto the"
  }
]

Specifications & capabilities

Input
text
Output
text

Provider specifications & access

1–1 / 1

Deci-DeciLM-7B-instruct · azureml v6 ↗

source model id
azureml/Deci-DeciLM-7B-instruct@6
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
apache-2.0
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    Original sources

    1–3 / 3

    Microsoft Foundry · Model page ↗

    Microsoft Foundry · Model documentation ↗

    Microsoft Foundry · Catalog ↗

    Source links

    1–1 / 1

    Explore more models

    Models

    Loading
    EVIDENCE / COMPARISON

    Benchmarks

    Explore every benchmark

    Loading

    These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

    Install TensorTrace