microsoft/DialogRPT-human-vs-machine

# Demo Please try this [➤➤➤ Colab Notebook Demo (click me!)](https://colab.research.google.com/drive/1cAtfkbhqsRsT59y3imjR1APw3MHDMkuV?usp=sharing) | Context | Response | `human_vs_machine` score | |…

azureFoundry/HuggingFace/microsoft-dialogrpt-human-vs-machine@3

Demo

Please try this ➤➤➤ Colab Notebook Demo (click me!)

ContextResponsehuman_vs_machine score
I love NLP!I'm not sure if it's a good idea.0.000
I love NLP!Me too!0.605

The human_vs_machine score predicts how likely the response is from a human rather than a machine.

DialogRPT-human-vs-machine

Dialog Ranking Pretrained Transformers

How likely a dialog response is upvoted 👍 and/or gets replied 💬?

This is what DialogRPT is learned to predict. It is a set of dialog response ranking models proposed by Microsoft Research NLP Group trained on 100 + millions of human feedback data. It can be used to improve existing dialog generation model (e.g., DialoGPT) by re-ranking the generated response candidates.

Quick Links:

We considered the following tasks and provided corresponding pretrained models.

TaskDescriptionPretrained model
Human feedbackgiven a context and its two human responses, predict...
updown... which gets more upvotes?model card
width... which gets more direct replies?model card
depth... which gets longer follow-up thread?model card
Human-like (human vs fake)given a context and one human response, distinguish it with...
human_vs_rand... a random human responsemodel card
human_vs_machine... a machine generated responsethis model

Contact:

Please create an issue on our repo

Citation:

@inproceedings{gao2020dialogrpt,
    title={Dialogue Response RankingTraining with Large-Scale Human Feedback Data},
    author={Xiang Gao and Yizhe Zhang and Michel Galley and Chris Brockett and Bill Dolan},
    year={2020},
    booktitle={EMNLP}
}

microsoft/DialogRPT-human-vs-machine is a pre-trained language model available on the Hugging Face Hub. It's specifically designed for the text-classification task in the transformers library. If you want to learn more about the model's architecture, hyperparameters, limitations, and biases, you can find this information on the model's dedicated Model Card on the Hugging Face Hub.

Here's an example API request payload that you can use to obtain predictions from the model:

{
  "inputs": "I like you. I love you"
}

Specifications & capabilities

Published model ID
DialogRPT-human-vs-machine

Provider specifications & access

1–1 / 1

microsoft/DialogRPT-human-vs-machine ↗

source model id
HuggingFace/microsoft-dialogrpt-human-vs-machine@3
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
architecture
input_modalities
    output_modalities
      capabilities

        Original sources

        1–4 / 4

        Hugging Face · microsoft/DialogRPT-human-vs-machine ↗

        Microsoft Foundry · Model page ↗

        Microsoft Foundry · Model documentation ↗

        Microsoft Foundry · Catalog ↗

        Source links

        1–1 / 1

        Explore more models

        Models

        Loading
        EVIDENCE / COMPARISON

        Benchmarks

        Explore every benchmark

        Loading

        These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

        Install TensorTrace