LLM Human Preference Data - Ultrafeedback
UltraFeedback - Multi-Binarized using the Average of Preference Ratings (Cleaned
@kaggle.thedrcat_llm_human_preference_data_ultrafeedback
Ultrafeedback
@kaggle.thedrcat_llm_human_preference_data_ultrafeedback.ultrafeedback
- 213.65 MB
- 157675 rows
- 8 columns
sourceSource | promptPrompt | chosenChosen | chosen_ratingChosen-rating | chosen_modelChosen-model | rejectedRejected | rejected_ratingRejected-rating | rejected_modelRejected-model |
|---|---|---|---|---|---|---|---|
| evol_instruct | Can you write a C++ program that prompts the user to enter the name of a country and checks if it borders the Mediterranean Sea? Here's some starter code to help you out: #include <iostream> #include <string> using namespace std; int main() { string country; // prompt user for input cout… | [{'content': 'Can you write a C++ program that prompts the user to enter the name of a country and checks if it borders the Mediterranean Sea? Here\'s some starter code to help you out:\n#include <iostream>\n#include <string>\nusing namespace std;\nint main() {\n string country;\n // prompt us… | 5 | starchat | [{'content': 'Can you write a C++ program that prompts the user to enter the name of a country and checks if it borders the Mediterranean Sea? Here\'s some starter code to help you out:\n#include <iostream>\n#include <string>\nusing namespace std;\nint main() {\n string country;\n // prompt us… | 1.25 | alpaca-7b |
| evol_instruct | Can you write a C++ program that prompts the user to enter the name of a country and checks if it borders the Mediterranean Sea? Here's some starter code to help you out: #include <iostream> #include <string> using namespace std; int main() { string country; // prompt user for input cout… | [{'content': 'Can you write a C++ program that prompts the user to enter the name of a country and checks if it borders the Mediterranean Sea? Here\'s some starter code to help you out:\n#include <iostream>\n#include <string>\nusing namespace std;\nint main() {\n string country;\n // prompt us… | 5 | starchat | [{'content': 'Can you write a C++ program that prompts the user to enter the name of a country and checks if it borders the Mediterranean Sea? Here\'s some starter code to help you out:\n#include <iostream>\n#include <string>\nusing namespace std;\nint main() {\n string country;\n // prompt us… | 4 | vicuna-33b |
| evol_instruct | Can you write a C++ program that prompts the user to enter the name of a country and checks if it borders the Mediterranean Sea? Here's some starter code to help you out: #include <iostream> #include <string> using namespace std; int main() { string country; // prompt user for input cout… | [{'content': 'Can you write a C++ program that prompts the user to enter the name of a country and checks if it borders the Mediterranean Sea? Here\'s some starter code to help you out:\n#include <iostream>\n#include <string>\nusing namespace std;\nint main() {\n string country;\n // prompt us… | 5 | starchat | [{'content': 'Can you write a C++ program that prompts the user to enter the name of a country and checks if it borders the Mediterranean Sea? Here\'s some starter code to help you out:\n#include <iostream>\n#include <string>\nusing namespace std;\nint main() {\n string country;\n // prompt us… | 1.25 | pythia-12b |
| evol_instruct | Suppose you are a content creator and want to generate compelling titles and descriptions for your YouTube videos automatically. You have decided to use GPT to solve this problem. Can you provide an example of how you would use GPT to generate titles and descriptions for your YouTube videos automati… | [{'content': 'Suppose you are a content creator and want to generate compelling titles and descriptions for your YouTube videos automatically. You have decided to use GPT to solve this problem.\nCan you provide an example of how you would use GPT to generate titles and descriptions for your YouTube … | 4.75 | gpt-4 | [{'content': 'Suppose you are a content creator and want to generate compelling titles and descriptions for your YouTube videos automatically. You have decided to use GPT to solve this problem.\nCan you provide an example of how you would use GPT to generate titles and descriptions for your YouTube … | 4.25 | llama-2-13b-chat |
| evol_instruct | Suppose you are a content creator and want to generate compelling titles and descriptions for your YouTube videos automatically. You have decided to use GPT to solve this problem. Can you provide an example of how you would use GPT to generate titles and descriptions for your YouTube videos automati… | [{'content': 'Suppose you are a content creator and want to generate compelling titles and descriptions for your YouTube videos automatically. You have decided to use GPT to solve this problem.\nCan you provide an example of how you would use GPT to generate titles and descriptions for your YouTube … | 4.75 | gpt-4 | [{'content': 'Suppose you are a content creator and want to generate compelling titles and descriptions for your YouTube videos automatically. You have decided to use GPT to solve this problem.\nCan you provide an example of how you would use GPT to generate titles and descriptions for your YouTube … | 3.25 | starchat |
| evol_instruct | Suppose you are a content creator and want to generate compelling titles and descriptions for your YouTube videos automatically. You have decided to use GPT to solve this problem. Can you provide an example of how you would use GPT to generate titles and descriptions for your YouTube videos automati… | [{'content': 'Suppose you are a content creator and want to generate compelling titles and descriptions for your YouTube videos automatically. You have decided to use GPT to solve this problem.\nCan you provide an example of how you would use GPT to generate titles and descriptions for your YouTube … | 4.75 | gpt-4 | [{'content': 'Suppose you are a content creator and want to generate compelling titles and descriptions for your YouTube videos automatically. You have decided to use GPT to solve this problem.\nCan you provide an example of how you would use GPT to generate titles and descriptions for your YouTube … | 4.5 | ultralm-65b |
| evol_instruct | Identify the interrelated economic, political, and social factors that contributed to the stock market crash of 1929, including but not limited to the impact of World War I on the global economy, the role of government policies such as the Smoot-Hawley Tariff Act, the effects of speculative investme… | [{'content': 'Identify the interrelated economic, political, and social factors that contributed to the stock market crash of 1929, including but not limited to the impact of World War I on the global economy, the role of government policies such as the Smoot-Hawley Tariff Act, the effects of specul… | 4.5 | vicuna-33b | [{'content': 'Identify the interrelated economic, political, and social factors that contributed to the stock market crash of 1929, including but not limited to the impact of World War I on the global economy, the role of government policies such as the Smoot-Hawley Tariff Act, the effects of specul… | 4.25 | mpt-30b-chat |
| evol_instruct | Identify the interrelated economic, political, and social factors that contributed to the stock market crash of 1929, including but not limited to the impact of World War I on the global economy, the role of government policies such as the Smoot-Hawley Tariff Act, the effects of speculative investme… | [{'content': 'Identify the interrelated economic, political, and social factors that contributed to the stock market crash of 1929, including but not limited to the impact of World War I on the global economy, the role of government policies such as the Smoot-Hawley Tariff Act, the effects of specul… | 4.5 | vicuna-33b | [{'content': 'Identify the interrelated economic, political, and social factors that contributed to the stock market crash of 1929, including but not limited to the impact of World War I on the global economy, the role of government policies such as the Smoot-Hawley Tariff Act, the effects of specul… | 4 | ultralm-13b |
| evol_instruct | Identify the interrelated economic, political, and social factors that contributed to the stock market crash of 1929, including but not limited to the impact of World War I on the global economy, the role of government policies such as the Smoot-Hawley Tariff Act, the effects of speculative investme… | [{'content': 'Identify the interrelated economic, political, and social factors that contributed to the stock market crash of 1929, including but not limited to the impact of World War I on the global economy, the role of government policies such as the Smoot-Hawley Tariff Act, the effects of specul… | 4.5 | vicuna-33b | [{'content': 'Identify the interrelated economic, political, and social factors that contributed to the stock market crash of 1929, including but not limited to the impact of World War I on the global economy, the role of government policies such as the Smoot-Hawley Tariff Act, the effects of specul… | 4.25 | wizardlm-7b |
| evol_instruct | How can I convert the decimal number 31 to binary format using JavaScript code? Can you provide the code for this conversion? | [{'content': 'How can I convert the decimal number 31 to binary format using JavaScript code? Can you provide the code for this conversion?', 'role': 'user'} {'content': "Yes, I can provide the JavaScript code for converting the decimal number 31 to binary format. Here's the code:\n```\nlet decimal… | 5 | mpt-30b-chat | [{'content': 'How can I convert the decimal number 31 to binary format using JavaScript code? Can you provide the code for this conversion?', 'role': 'user'} {'content': 'The following JavaScript code can be used to convert a decimal number to binary format:\n\nlet binary = Math.floor(decimalNum).t … | 3.75 | alpaca-7b |
CREATE TABLE ultrafeedback (
"source" VARCHAR,
"prompt" VARCHAR,
"chosen" VARCHAR,
"chosen_rating" DOUBLE,
"chosen_model" VARCHAR,
"rejected" VARCHAR,
"rejected_rating" DOUBLE,
"rejected_model" VARCHAR
);