gpt2-large · azureml v12

GPT-2 Large is the 774M parameter version of GPT-2, a transformer-based language model created and released by OpenAI. The model is a pretrained model on English language using a causal language mode…

azureFoundry/azureml/gpt2-large@12

GPT-2 Large is the 774M parameter version of GPT-2, a transformer-based language model created and released by OpenAI. The model is a pretrained model on English language using a causal language modeling (CLM)

Training Details

See the associated paper for details on the modeling architecture, objective, compute infrastructure, and training details.

Training Data

The OpenAI team wanted to train this model on a corpus as large as possible. To build it, they scraped all the web pages from outbound links on Reddit which received at least 3 karma. Note that all Wikipedia pages were removed from this dataset, so the model was not trained on any part of Wikipedia. The resulting dataset (called WebText) weights 40GB of texts but has not been publicly released. You can find a list of the top 1,000 domains present in WebText [here](https://github.com/openai/gpt-2/blob/ma

Specifications & capabilities

Input
text
Output
text

Provider specifications & access

1–1 / 1

gpt2-large · azureml v12 ↗

source model id
azureml/gpt2-large@12
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
mit
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    Original sources

    1–3 / 3

    Microsoft Foundry · Model page ↗

    Microsoft Foundry · Model documentation ↗

    Microsoft Foundry · Catalog ↗

    Source links

    1–1 / 1

    Explore more models

    Models

    Loading
    EVIDENCE / COMPARISON

    Benchmarks

    Explore every benchmark

    Loading

    These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

    Install TensorTrace