shareAI/CodeLLaMA-chat-13b-Chinese
`shareAI/CodeLLaMA-chat-13b-Chinese` powered by Hugging Face Inference Toolkit - [Original Model Card](https://huggingface.co/shareAI/CodeLLaMA-chat-13b-Chinese) - [`question-answering` Task on Huggi…
azureFoundry/HuggingFace/shareai-codellama-chat-13b-chinese@1
shareAI/CodeLLaMA-chat-13b-Chinese powered by Hugging Face Inference Toolkit
Send Request
You can use cURL or any REST Client to send a request to the AzureML endpoint with your AzureML token.
curl <AZUREML_ENDPOINT_URL> \
-X POST \
-H "Authorization: Bearer <AZUREML_TOKEN>" \
-H "Content-Type: application/json" \
-d '{"question": "What is my name?", "context": "My name is Clara and I live in Berkeley."}'
Supported Parameters
- inputs (object): One (context, question) pair to answer
- context (string): The context to be used for answering the question
- question (string): The question to be answered
- parameters (object):
- top_k (integer): The number of answers to return (will be chosen by order of likelihood). Note that we return less than topk answers if there are not enough options available within the context.
- doc_stride (integer): If the context is too long to fit with the question for the model, it will be split in several chunks with some overlap. This argument controls the size of that overlap.
- max_answer_len (integer): The maximum length of predicted answers (e.g., only answers with a shorter length are considered).
- max_seq_len (integer): The maximum length of the total sentence (context + question) in tokens of each chunk passed to the model. The context will be split in several chunks (using docStride as overlap) if needed.
- max_question_len (integer): The maximum length of the question after tokenization. It will be truncated if needed.
- handle_impossible_answer (boolean): Whether to accept impossible as an answer.
- align_to_words (boolean): Attempts to align the answer to real words. Improves quality on space separated languages. Might hurt on non-space-separated languages (like Japanese or Chinese)
Check the full API Specification at the Hugging Face Inference documentation.
Specifications & capabilities
- Input
- text
- Output
- text
- Published model ID
- CodeLLaMA-chat-13b-Chinese
Evaluations
1–7 / 7
48.971%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 TruthfulQA
- dimension
- knowledge
- metric
- Accuracy
- rank
- 4065
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 675b3e35a9601683c2cb4ec7f1b11d2869842f36
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7170
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2023-10-16T12:46:18.000Z
- source model id
- shareAI/CodeLLaMA-chat-13b-Chinese
Original result ↗10.766%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 GSM8K
- dimension
- math
- metric
- Accuracy
- rank
- 4951
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 675b3e35a9601683c2cb4ec7f1b11d2869842f36
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2023-10-16T12:46:18.000Z
- source model id
- shareAI/CodeLLaMA-chat-13b-Chinese
Original result ↗67.877%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 Winogrande
- dimension
- reasoning
- metric
- Accuracy
- rank
- 5668
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 675b3e35a9601683c2cb4ec7f1b11d2869842f36
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2023-10-16T12:46:18.000Z
- source model id
- shareAI/CodeLLaMA-chat-13b-Chinese
Original result ↗44.838%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 Average
- dimension
- general
- metric
- Six-task average
- rank
- 5786
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Six-task average
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 675b3e35a9601683c2cb4ec7f1b11d2869842f36
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7170
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2023-10-16T12:46:18.000Z
- source model id
- shareAI/CodeLLaMA-chat-13b-Chinese
Original result ↗43.259%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 ARC
- dimension
- reasoning
- metric
- Accuracy
- rank
- 5872
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 675b3e35a9601683c2cb4ec7f1b11d2869842f36
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2023-10-16T12:46:18.000Z
- source model id
- shareAI/CodeLLaMA-chat-13b-Chinese
Original result ↗34.286%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 MMLU
- dimension
- knowledge
- metric
- Accuracy
- rank
- 5951
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 675b3e35a9601683c2cb4ec7f1b11d2869842f36
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2023-10-16T12:46:18.000Z
- source model id
- shareAI/CodeLLaMA-chat-13b-Chinese
Original result ↗63.872%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 HellaSwag
- dimension
- reasoning
- metric
- Accuracy
- rank
- 6046
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 675b3e35a9601683c2cb4ec7f1b11d2869842f36
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2023-10-16T12:46:18.000Z
- source model id
- shareAI/CodeLLaMA-chat-13b-Chinese
Original result ↗Provider specifications & access
1–1 / 1
- source model id
- HuggingFace/shareai-codellama-chat-13b-chinese@1
- hosting
- foundry-managed-compute
- license
- openrail
Safety assessments
1–1 / 1
31 / 100
- source id
- stanfordFMTI
- canonical model id
- azureFoundry/HuggingFace/shareai-codellama-chat-13b-chinese@1
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Meta
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 31 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Explore more models