LLM Human Preference Data - Ultrafeedback
UltraFeedback - Multi-Binarized using the Average of Preference Ratings (Cleaned
@kaggle.thedrcat_llm_human_preference_data_ultrafeedback
Ultrafeedback Ties
@kaggle.thedrcat_llm_human_preference_data_ultrafeedback.ultrafeedback_ties
- 40.23 MB
- 16142 rows
- 8 columns
sourceSource | promptPrompt | chosenChosen | chosen_ratingChosen-rating | chosen_modelChosen-model | rejectedRejected | rejected_ratingRejected-rating | rejected_modelRejected-model |
|---|---|---|---|---|---|---|---|
| evol_instruct | Incorporating birth/death dates, accomplishments, and societal impact, how can you create a program that utilizes data from a SQL database to generate a comprehensive ranking of historical figures based on their level of influence? Can you extend the scope of this inquiry by incorporating multi-dime… | [{'content': "Incorporating birth/death dates, accomplishments, and societal impact, how can you create a program that utilizes data from a SQL database to generate a comprehensive ranking of historical figures based on their level of influence? Can you extend the scope of this inquiry by incorporat… | 4.5 | gpt-3.5-turbo | [{'content': "Incorporating birth/death dates, accomplishments, and societal impact, how can you create a program that utilizes data from a SQL database to generate a comprehensive ranking of historical figures based on their level of influence? Can you extend the scope of this inquiry by incorporat… | 4.5 | vicuna-33b |
| evol_instruct | Let's play a puzzle game! Can you connect the dots and figure out how rising global temperatures, changes in precipitation patterns, and sea level rise are all connected? The solution lies in understanding how these factors impact ecosystems, biodiversity, and natural resources. So, can you solve th… | [{'content': "Let's play a puzzle game! Can you connect the dots and figure out how rising global temperatures, changes in precipitation patterns, and sea level rise are all connected? The solution lies in understanding how these factors impact ecosystems, biodiversity, and natural resources. So, ca… | 5 | llama-2-7b-chat | [{'content': "Let's play a puzzle game! Can you connect the dots and figure out how rising global temperatures, changes in precipitation patterns, and sea level rise are all connected? The solution lies in understanding how these factors impact ecosystems, biodiversity, and natural resources. So, ca… | 5 | wizardlm-70b |
| evol_instruct | Can you write a Ruby program to classify a given dog breed using machine learning? Here is some sample Ruby code that uses a pre-trained model to classify dog breeds: require 'tensorflow' # Load pre-trained model model = Tensorflow::Graph.new('model.pb') session = Tensorflow::Session.new session.ext… | [{'content': 'Can you write a Ruby program to classify a given dog breed using machine learning?\nHere is some sample Ruby code that uses a pre-trained model to classify dog breeds:\nrequire \'tensorflow\'\n# Load pre-trained model\nmodel = Tensorflow::Graph.new(\'model.pb\')\nsession = Tensorflow::… | 4.5 | ultralm-13b | [{'content': 'Can you write a Ruby program to classify a given dog breed using machine learning?\nHere is some sample Ruby code that uses a pre-trained model to classify dog breeds:\nrequire \'tensorflow\'\n# Load pre-trained model\nmodel = Tensorflow::Graph.new(\'model.pb\')\nsession = Tensorflow::… | 4.5 | wizardlm-13b |
| evol_instruct | Using Python, create a program that analyzes a given text for words that have homonyms (words with the same spelling but different meanings) and replaces them with their intended meaning. For example, "I saw a bear in the park" could be misinterpreted as "I saw bare skin in the park". Your program m… | [{'content': 'Using Python, create a program that analyzes a given text for words that have homonyms (words with the same spelling but different meanings) and replaces them with their intended meaning. For example, "I saw a bear in the park" could be misinterpreted as "I saw bare skin in the park". … | 4.5 | llama-2-13b-chat | [{'content': 'Using Python, create a program that analyzes a given text for words that have homonyms (words with the same spelling but different meanings) and replaces them with their intended meaning. For example, "I saw a bear in the park" could be misinterpreted as "I saw bare skin in the park". … | 4.5 | llama-2-70b-chat |
| evol_instruct | Imagine a situation where you are solving a crossword puzzle and the clue reads, "A strong feeling of determination towards one's desired profession, expressed without using any synonyms for thrill or enthusiasm." How would you fill in the blanks to complete the puzzle? | [{'content': 'Imagine a situation where you are solving a crossword puzzle and the clue reads, "A strong feeling of determination towards one\'s desired profession, expressed without using any synonyms for thrill or enthusiasm." How would you fill in the blanks to complete the puzzle?', 'role': 'use… | 4.5 | gpt-4 | [{'content': 'Imagine a situation where you are solving a crossword puzzle and the clue reads, "A strong feeling of determination towards one\'s desired profession, expressed without using any synonyms for thrill or enthusiasm." How would you fill in the blanks to complete the puzzle?', 'role': 'use… | 4.5 | llama-2-13b-chat |
| evol_instruct | To fully address the complex issue of bias detection and explanation in a given sentence, we need a multi-faceted approach that goes beyond just basic sentiment analysis. One way to accomplish this is by utilizing an advanced NLP algorithm that employs a variety of techniques, such as dependency par… | [{'content': "To fully address the complex issue of bias detection and explanation in a given sentence, we need a multi-faceted approach that goes beyond just basic sentiment analysis. One way to accomplish this is by utilizing an advanced NLP algorithm that employs a variety of techniques, such as … | 4.75 | mpt-30b-chat | [{'content': "To fully address the complex issue of bias detection and explanation in a given sentence, we need a multi-faceted approach that goes beyond just basic sentiment analysis. One way to accomplish this is by utilizing an advanced NLP algorithm that employs a variety of techniques, such as … | 4.75 | wizardlm-70b |
| evol_instruct | What is the difference between interactive and non-interactive user interfaces? | [{'content': 'What is the difference between interactive and non-interactive user interfaces?', 'role': 'user'} {'content': "Interactive and non-interactive user interfaces serve different purposes when it comes to human-computer interaction. Here's an overview of the major differences between the … | 5 | gpt-4 | [{'content': 'What is the difference between interactive and non-interactive user interfaces?', 'role': 'user'} {'content': "Interactive user interfaces (IUIs) and non-interactive user interfaces are two types of ways that users can interact with software systems or digital devices. The main differ… | 5 | vicuna-33b |
| evol_instruct | How can we analyze the impact of a viral outbreak on the daily routines and social interactions of a high school sophomore living in a heavily affected area, as well as their mental health and academic progress? Can we specifically explore how the teenager has adapted to online learning and virtual … | [{'content': "How can we analyze the impact of a viral outbreak on the daily routines and social interactions of a high school sophomore living in a heavily affected area, as well as their mental health and academic progress? Can we specifically explore how the teenager has adapted to online learnin… | 4.5 | llama-2-70b-chat | [{'content': "How can we analyze the impact of a viral outbreak on the daily routines and social interactions of a high school sophomore living in a heavily affected area, as well as their mental health and academic progress? Can we specifically explore how the teenager has adapted to online learnin… | 4.5 | wizardlm-70b |
| evol_instruct | Determine the degree of resemblance between a feline mammal with sharp retractable claws and a canine mammal with pointed ears and a bushy tail. Specifically, analyze the physical, behavioral, and genetic attributes of both animals to ascertain the level of similarity between them. The two objects i… | [{'content': 'Determine the degree of resemblance between a feline mammal with sharp retractable claws and a canine mammal with pointed ears and a bushy tail. Specifically, analyze the physical, behavioral, and genetic attributes of both animals to ascertain the level of similarity between them. The… | 4.75 | ultralm-13b | [{'content': 'Determine the degree of resemblance between a feline mammal with sharp retractable claws and a canine mammal with pointed ears and a bushy tail. Specifically, analyze the physical, behavioral, and genetic attributes of both animals to ascertain the level of similarity between them. The… | 4.75 | vicuna-33b |
| evol_instruct | In addition to translating the term 'giraffe' into French, please provide a detailed description of the giraffe's unique adaptations to its environment, including its long neck and spotted coat, as well as any notable behaviors or ecological roles. | [{'content': "In addition to translating the term 'giraffe' into French, please provide a detailed description of the giraffe's unique adaptations to its environment, including its long neck and spotted coat, as well as any notable behaviors or ecological roles.", 'role': 'user'} {'content': "The t… | 4.75 | wizardlm-13b | [{'content': "In addition to translating the term 'giraffe' into French, please provide a detailed description of the giraffe's unique adaptations to its environment, including its long neck and spotted coat, as well as any notable behaviors or ecological roles.", 'role': 'user'} {'content': '\'Gir… | 4.75 | wizardlm-70b |
CREATE TABLE ultrafeedback_ties (
"source" VARCHAR,
"prompt" VARCHAR,
"chosen" VARCHAR,
"chosen_rating" DOUBLE,
"chosen_model" VARCHAR,
"rejected" VARCHAR,
"rejected_rating" DOUBLE,
"rejected_model" VARCHAR
);