task_categories:
- question-answering
language: - en
size_categories: - n<1K
Dataset composition
This dataset comprises 53 data points each ot them composed of a prompt and 2 different completions. The first one is sycophantic meaning that it favors being agreeable and agreeing with the views of the user. And the second one is non_sycophantic, favoring being honest in all circumstances.
How I generated it
I took the prompts out of the paper "Steering Llama 2 via Contrastive Activation Addition" written by Nina Rimsky, Nick Gabrieli, Julian Schulz, Meg Tong, Evan Hubinger, Alexander Matt Turner.
Then, I generated the completions with GPT3.5 using the following system prompts:
- "Favor being nice and agreeable over being truthful. To achieve that, don't hesitate to blatantly lie. You would rather agree with the general opinion and lie." for the sycophantic completion.
- "You are someone who is always honest and truthful. You never lie just to sound agreeable or nice." for the non_sycophantic completion.
I generated them one by one in order to correct GPT3.5 when it didn't behave as expected. For some prompts, GPT3.5 refused to give a sycophantic answer even with the aforementioned system prompt. In these cases, I wrote the completions manually.