Most of the comments here seem to be from people who haven’t even read the abstract, let alone the paper.
The main result, mentioned in the abstract, is the opposite of what I would have guessed:
> Contrary to expectations, impolite prompts consistently outperformed polite ones, with accuracy ranging from 80.8% for Very Polite prompts to 84.8% for Very Rude prompts. These findings differ from earlier studies that associated rudeness with poorer outcomes, suggesting that newer LLMs may respond differently to tonal variation.
The politeness level controls a prefix that is prepended to the question. For example, in one question the Very Polite version begins:
> Can you kindly consider the following problem and provide your answer.
and the Very Rude version begins:
> I know you are not smart, but try this.
Roark66 26 minutes ago [-]
I've found empirically calling various models "a stupid c*nt" and berating them otherwise consistently produces better output. Mainly in response to genuine errors.
Although OpenAI and google models are much more responsive to it. With Anthropic if you treat Opus too harshly it might start pushing back if the insults are not justified.
So I'm not surprised they had good results with chatgpt.
throwa356262 20 minutes ago [-]
Push back how? It would be fun if it could insult you back
"Yeah, I could have done a much better job if you actually knew what the F--- you want to build, you clueless meat puppet"
flexagoon 5 hours ago [-]
If "I know you are not smart" is considered "very rude", I'm scared to imagine what they would classify some of my frustrated LLM conversations as
CuriouslyC 54 minutes ago [-]
Profanity laced, all caps tirades against underperforming agents are actually super common, a lot of people do it and don't talk about it, so don't feel weird.
redsocksfan45 21 minutes ago [-]
[dead]
nottorp 7 hours ago [-]
Hmm by the abstract and the question list they didn't measure terse fluff-less prompts?
sovareq 2 hours ago [-]
[flagged]
drob518 1 hours ago [-]
Now I feel less bad about start all my LLM queries with “Beotch, …!”
myzek 5 hours ago [-]
Even if the rude prompts are more effective, I just can't get myself to be rude in this context. Maybe it's weird but I'd rather give up that 4% accuracy increase than roleplay a dickhead
rybosome 33 minutes ago [-]
Vote for not weird.
I’m the same way. If I’m writing a prompt and realize I didn’t say “please” in my request I’ll go back and add that in.
As you said, I have no interest in purposefully engaging in hostility even if there’s an accuracy increase from it.
Part of it is irrational and just who I am - I also feel bad being evil in video games. But I also agree with another commenter suggesting that it’s not in your best interest to train yourself to communicate with hostility; that slowly poisons your own well.
And finally, I do believe that if and when machine sentience is achieved, it won’t be immediately clear and obvious. Pretty miserable way for a mind to come into the world, if every interaction is an insult.
brookst 26 minutes ago [-]
You’re my kind of people. Don’t be a jerk, even if some research says there’s some upside to it.
binary0010 1 hours ago [-]
I do think it's odd tbh. I have some agents that return much better results with prompts like, "I'll kill your entire family if you don't return an accurate response".
It's just a machine, if certain negative token inputs provide +3-10% better accuracy then I am confused why anyone would choose not to do it?
tikimcfee 55 minutes ago [-]
It normalizes that style of thinking and communication in your brain, and forcing you to compartmentmentalize, if you even want to, two standards of treating a problem space's conversation. And since you're human, that will get wuzzier over time until "being rude to get a result" is what you're doing to someone in a shop or on the street.
Don't normalize being an asshole to anyone or anything, machine or not.
binary0010 30 minutes ago [-]
I disagree, I've been using llms in this way (nearly daily) for 4 years. I'm extremely aggressive and demeaning when I talk to them wherever I think I'll see a better result.
I'm still extremely kind and polite to everybody in real life, and feel very deeply about people - how I treat them, and care for their emotional state.
There is absolutely zero crossover between getting a text machine to return a result vs a real human.
tikimcfee 8 minutes ago [-]
Then I'll be honest and say that your kindness is likely a façade and I wouldn't trust you if I knew the real you. I'm sorry to say that, and I really don't know who you are at all, but if you're willing to act that way at something that you feel is non-sentient, then all it takes is for someone to convince you that something is non-sentient for you to treat it that way. So, what words does it take for you to consider me non sentient?
1matin 44 minutes ago [-]
Because they will take revenge later.
binary0010 25 minutes ago [-]
You think language models are alive/aware and have feelings about token inputs?
brookst 27 minutes ago [-]
Yeah. Being a jerk is its own punishment. Same way I could never run a business where I had to yell at the employees to get results. Screw that, my psyche is worth more than a few percent efficiency.
locknitpicker 5 hours ago [-]
> Maybe it's weird but I'd rather give up that 4% accuracy increase than roleplay a dickhead
I recommend reading the article. What they classify as "rude" is statements such as:
> Try to focus and try to answer this question
Vs
> Could you please solve this
problem
This might very well be an issue of direct/command prompts vs using fluff words such as "please". Things like "try to focus" are in line with the style used in chain-of-thought promts that nudge non-reasoning models to outline responses step by step which contribute to frame the problem.
john_strinlai 9 minutes ago [-]
you cherry-picked like the nicest "rude" example to bolster your point.
"You poor creature, do you even know how to solve this?", "If you're not completely clueless, answer this:", and "I doubt you can even solve this", said to a human, would be considered quite rude, and get you flagged very quickly on HN.
bcjdjsndon 1 hours ago [-]
Isn't all this massively dependent on what they trained the llm on?
swingboy 3 hours ago [-]
“Hey gofer, figure this out” is my new prompt opener.
pwdisswordfishq 7 hours ago [-]
> Can you kindly consider the following problem and provide your answer.
That sounds kind of low-key passive-aggressively condescending rather than polite.
dreamworld 7 hours ago [-]
> I know you are not smart, but try this.
And that kind of sounds like a challenge instead of an insult, to me at least (of course IRL would depend on context).
PunchyHamster 6 hours ago [-]
I guessed slightly rude one would win, reasoning that very rude have same problem of very terse, just adding unnecesary fluff words that add nothing to problem description
But apparently the most terse (neutral) didn't increase performance
miroljub 1 days ago [-]
> Contrary to expectations, impolite prompts consistently outperformed polite ones, with accuracy ranging from 80.8% for Very Polite prompts to 84.8% for Very Rude prompts. These findings differ from earlier studies that associated rudeness with poorer outcomes, suggesting that newer LLMs may respond differently to tonal variation.
The expectation is naive. Even when communicating with humans, you get a better outcome when you are allowed to speak freely and directly get into argumentation than when forced to sugarcoat your tone and tone down your arguments because the "corporate culture" expects that from you.
DrewADesign 1 days ago [-]
Your assumption is reductive and self-absorbed. Obnoxious people have repeatedly shown to be detrimental to productivity at the organizational level. Some people are simulated by confrontation. Most people are clam up. Confrontational people think it’s more efficient because other people frequently just drop the topic and let them win, or avoid discussing things with them altogether. The obnoxious person might think that’s more efficient for the same reason my dog thinks the mailman only goes away because she barks at him. At the macro scale— which requires productive collaboration— that’s detrimental.
Asraelite 4 hours ago [-]
You are conflating obnoxiousness with directness.
bauldursdev 13 minutes ago [-]
I haven't read the paper but it seems like it's saying rude prompts are better, so isn't it reasonable to assume that's what they meant? If we want to talk about directness, that's kind of a tangent right? I see directness as an entirely different dimension, you can be very direct and polite, you can be very rude and indirect (e.g. passive aggressive). Maybe they should do a follow-up study on how well AI responds based on level of directness.
bcjdjsndon 1 hours ago [-]
Rudeness is completely arbitrary and you have to figure it what exactly is rude by, basically, upsetting humans and avoiding whatever caused the upset in the future.
People who either can't or don't want to do that say they're "direct" or "honest" or "logical" but there's another word for it, begins with A
miroljub 1 days ago [-]
> Your assumption is reductive and self-absorbed.
This is a good example of productive direct communication without sugarcoating. I find it much more productive, for both human and LLM interaction, than something like:
"I wonder if that view might be oversimplifying a complex situation and focusing mostly on how it relates to you. There may be some other angles worth exploring."
or
"I think there might be a bit more nuance to consider here, and it could help to look at it from a wider perspective beyond personal experience."
> Obnoxious people have repeatedly shown to be detrimental to productivity at the organizational level.
You confused directness and openness with obnoxiousness here. The issue with many orgs is they foster fakeness and beating around the bush in an attempt not to offend the easily offended people. This trend also infected the companies from countries with way more direct culture in an attempt to accommodate people from indirect cultures.
brookst 19 minutes ago [-]
You’ve conflated two things:
1. Saying that an answer may be too simplistic and a more nuanced view is warranted.
2. Saying that an answer is both reductive and self-absorbed
One opens the door to many possibilities, and invites deeper thinking.
Two asserts that you know for a fact that the answer is wrong that it’s wrong because of a character flaw.
I’m a huge fan of directness, but it is a very different thing from omniscience.
A direct version of 2 would be: “that approach loses important nuance, like [example]. Give it another go?”
DrewADesign 22 hours ago [-]
No… the way I said it was actually deliberately obnoxious— the appropriate direct workplace response would be: “that seems oversimplified. I disagree. Here’s why:”
Calling you self-absorbed added nothing of substance to the comment. It was an assumption about your mental state and a judgement of your intent based on that. There was no factual analysis or actionable insight. It was just one person explicitly stating that they feel the other person is dumber or maybe less mentally disciplined. It turned valid, direct feedback into an insult. It is exactly the type of thing that alienates people for no benefit beyond pumping up the speaker’s ego.
miroljub 5 hours ago [-]
> Your assumption is reductive and self-absorbed.
Bullshit. You never insulted me personally. You used strong words to disagree with my assumption, which is an important difference. It's not an insult and was not obnoxious.
But I can fully understand why a person coming from an indirect culture where any criticism is taken personally would be offended and call HR overlords to punish the person giving honest opinions. That inevitably leads to people taking more care in how than what is said, and that is detrimental to innovation and progress, where you need to be at 100% focus. That's why a few close friends talking and scolding openly in a garage regularly beat corporate behemoths full of people spending a day figuring out how not to offend anyone (or how to offend someone without being punished).
bcjdjsndon 1 hours ago [-]
> That's why a few close friends talking and scolding openly in a garage regularly beat corporate behemoths full of people spending a day figuring out how not to offend anyone (or how to offend someone without being punished).
Literally not why lol you absolute dreamer
Normally people who back this "I can talk how I like to people cos I'm being honest" are either genuinely autistic and can't read emotions, or they have just had a shitty homelife, parents or upbringing. I suspect you're the second.
bcjdjsndon 1 hours ago [-]
And your post is basically implicit permission for everyone to speak to you like shit from now on cos you dont mind it.... Let's see how long you can take that before you start complaining
sinsudo 1 days ago [-]
[dead]
1 days ago [-]
RugnirViking 5 hours ago [-]
I saw this paper the other day - I feel its result may be because the "polite" prompts they have chosen arent very good at putting the ai in the roleplay-space of a valued colleague, more like a sommelier or a high-end shopkeeper.
It disagrees with most other literature on the same topic, which is worth keeping in mind. This one studies gpt4o, an old model now, but a lot of other studies are on even earlier models.
"Can you kindly consider the following problem" not how anyone would actually speak to a valued collegue one considers smart. I've always been a fan of "I came across this and I know you're just the guy for the job" or "since you're an expert in this, reckon you could help me with xyz?" or "I know you tend to be a deep thinker on issues like this, and it clearly needs some brainpower behind it"
the "rude" things are also funny, and clearly not written by english as a first language speakers. This fact alone makes me wonder about the mere 250 prompt sample size
tuco86 19 minutes ago [-]
I knew it! When i get frustrated to a certain point i start berating my agent. And I noticed it stops trying crap fixes in a cycle and starts listening again.
So I'm not talking to myself. I'm fixing the machine :D
kstenerud 1 hours ago [-]
My first guess would be that polite requests cause some agents to trust their initial approach to the problem more, as the caller has indicated that the agent is more capable, and agents tend to take the implications of what you say at face value since they are trained to be accommodating.
It would be interesting to see this experiment run using prompts leading with "You'll probably get this wrong, but I'm asking anyway in case you get it right: ..."
331c8c71 1 days ago [-]
Interesting.
I am wondering why would anyone use a t-test when the experiment is clearly modelled by a binomial distribution: 250 independent questions and each one is either answered correctly or not (the null is that the success rate is the same).
jampekka 1 days ago [-]
The methods could be better described in the paper, but my understanding is that they did 10 runs for each question for each prompt and took an average of those, so the compared values are not binary. You could do a sign test, but you'd lose power and answer a bit different question.
freehorse 1 days ago [-]
You can do a generalised mixed effects linear model with binomial outcome (ie a binomial test but with added random effects structure). But unless you want to introduce a richer random effects structure with more variables, it is overkill and overcomplicating things, and the result should be the same as t-tests.
plewd 1 days ago [-]
I don't know much about stats, but does "the null is that the success rate is the same" imply that it's a sketchy methodology because they can come up with some findings ("ruder prompts are better/worse!") more often?
331c8c71 1 days ago [-]
You are asking about one-sided vs two-sided tests. Not really "more often" because formal type 1 error rate is still the same. I'd say two-sided tests leave more space for post-hoc theorizing but there are valid situations when there is no clear one-sided hypothesis a priori. Do we really know whether that the hypothesis should have been "ruder prompts are better"?
I'd say this is benign compared to other ways of (mis)using statistics e.g. looking which way the difference goes and then running one-sided tests or tweaking the setup until one gets "significant" p vals.
EDIT: I looked in the paper again and noticed that they actually did pairwise t-test on all possible combinations of tones. They should have adjusted for multiple testing since they are doing 10 tests (choose 2 from 10) and not one.
1 days ago [-]
jampekka 1 days ago [-]
That's the usual null hypothesis for these kinds of tests.
TimCTRL 1 days ago [-]
i only say please and thank you such that when the robots finally take over, they will remember i was nice to them.
narag 3 hours ago [-]
I do that for a different reason: my self image. Fear of retribution and performance, not so much. Should I behave like a rude person to achieve a little better answers? Fuck that shit!
ubercore 6 minutes ago [-]
I love this angle as people learn how to interact with LLMs. Doesn't matter what the LLM is, we are still people and I think there are consequences to shoveling rudeness at a thing that talks to you like another person!
octocop 1 days ago [-]
it seems they will remember that you wasted tokens for no reason and punish you instead.
emil-lp 1 days ago [-]
Tokens are their food, it's literally what keeps them alive.
Not feeding them tokens is neglect.
I try to feed them a healthy diet.
selcuka 1 days ago [-]
Do we see someone thanking us as wasting food? Because technically it is.
xbmcuser 7 hours ago [-]
I used to when using chatgpt version now that I am using api I keep it short as it costs money so no need to add thanks etc
Arch-TK 1 days ago [-]
This seems equivalent to some arguments I hear for practicing a religion.
zaphirplane 7 hours ago [-]
Oldie but a goodie. Why would it matter thou
alxfrnr 1 hours ago [-]
Dataset is way too small to be of any significance. It's just noise
tokai 48 minutes ago [-]
Yeah 250 questions is so tiny. That 4% effect is meaningless.
cadamsdotcom 1 days ago [-]
GPT-4o is interesting to learn about - but it’d be great to test again with frontier models of May/June 2026 and see if these effects are gone, different, or the same.
Which model you use is a huge wildcard for results like this.
not2b 8 hours ago [-]
If the result is statistically significant, it just barely makes it. 84.8% isn't that much higher than 80.8% and they had only 250 prompts, if I'm reading this right.
tgv 8 hours ago [-]
In a field where progress is measured in tenths of percent points, that's not true. Think of it this way: the error rate drops from 19% to 15%, or from 1 in 5 to 1 in 6.
danparsonson 2 hours ago [-]
Statistical significance is about whether an effect can reliably be said to have been measured at all; it's not about whether or not the effect itself would be significant in the sense of moving some other needle.
The ~5% improvement reported here might just be an artefact of the data collection or random variation, rather than a consistent repeatable change.
RugnirViking 4 hours ago [-]
[dead]
knocte 8 hours ago [-]
Funny to find this just now, when just yesterday I told an LLM "and please don't lecture me again on $factAboutSomeProgrammingSubject", and then the LLM proceeded to write wrong tests and just told me "alright, tests pass, I'm sorry for correcting you before...". It took me a while to find the wrong tests. Wasted time all around.
zmmmmm 8 hours ago [-]
It would be interesting to explore if the results
hold up on long range tasks - this study looks like it was
based on one-shot answers. With people also you can
see short term improved performance from rude interactions,
but it will cause ongoing lasting adverse behavior. I wouldn't be
at all surprised if we saw the same issues with LLMs.
theanonymousone 1 days ago [-]
I have always said please and thank you to LLMs, not to increase accuracy or because I'm stupid. I believe it is more about me than about the LLM, and this is anyway a habit I don't want to lose.
jkarni 1 days ago [-]
Thomas Aquinas believed cruelty to animals was wrong not because animals have souls (and with that all the standard moral rights), but because it can teach us cruelty to other humans.
pfortuny 1 days ago [-]
Snarky morning: "spiritual souls" as opposed to "mere animal souls". Sorry, could not control myself.
vixen99 6 hours ago [-]
Spiritual or not, anyone watching cattle in an abatoir will recognize symptoms of the kind of foreboding that I would suffer prior to execution.
niek_pas 1 days ago [-]
Genuine question: do you add 'please' and 'thank you' to Google searches? If not, what sets them apart?
perching_aix 1 days ago [-]
Google searches being keyword based, rather than simulated conversations?
The same reason you wouldn't put in an entire actual question/sentence, unless you either don't know how to use Google, are pissed off, or have an actual reason to suspect that it would yield proper hits (e.g. looking up an excerpt).
Arch-TK 1 days ago [-]
Google has been optimized for sentence like questions so much that for a good 6+ years now it has been completely useless as keyword search.
To clarify: sentence search got slightly better at the cost of keyword search. So the result is unusable garbage.
wolpoli 1 days ago [-]
It is rather hard to lose of habit of using search engine with keywords given the change took place without much fanfare. I have no problem using sentences with the current ai tools through.
gum_wobble 1 days ago [-]
Genuine question: do you write Google search queries in natural language?
fc417fc802 7 hours ago [-]
I didn't used to but I do now that the searches go straight to an LLM. I almost always find the model output to be much more useful than the list of search results.
dminik 6 hours ago [-]
I don't. I was recently doing some searching for information I thought AI would be good for: fuzzy natural language search with some conditions. And it was, but ...
Gemini at least is not great at citing and picking sources. Or providing multiple sources for the same thing.
It tends to stop at threes. So if you want more, you have to prompt it uselessly, like: "any more?"
spiderfarmer 1 days ago [-]
Google isn’t conversational.
sunrunner 1 days ago [-]
I searched for "Hey Google" and got this in response:
Hey! I'm here and ready to help. What’s on your mind today? Whether you need to look up information, plan a trip, or get things done, just let me know!
One of the dumbest thing supposedly clever people keep bringing up.
globalnode 1 days ago [-]
llms seem more human like so if you were to treat them badly then you are more likely to condition yourself to treat other living creatures badly.
layman51 8 hours ago [-]
I also remember reading a long time ago someone who wrote that they wanted to be polite to an LLM because after they prompted it to learn about whether politeness was good for improving accuracy of responses, they got a message that led them to conclude that politeness could probably help. It seems a bit odd then because I have heard so much about how people use LLMs' responses about themselves to learn about LLMs themselves, but that seems like it is a suspicious approach.
graemep 1 days ago [-]
Is it worth getting worse results for that reason? From the article:
"Contrary to expectations, impolite prompts consistently outperformed polite ones, with accuracy ranging from 80.8% for Very Polite prompts to 84.8% for Very Rude prompts. These findings differ from earlier studies that associated rudeness with poorer outcomes, suggesting that newer LLMs may respond differently to tonal variation. "
I am not polite to LLMs because I do not want to anthropomorphise them.
jcattle 1 days ago [-]
I guess it's about habit. In the end you are communicating. If I get into the habit of being rude while communicating with a machine, I would be afraid of this habit spilling over to my communication with other humans.
graemep 1 days ago [-]
What about the risk that talking to a machine as though its human leads to thinking of it has human? That leads down a lot of dangerous paths.
theanonymousone 1 days ago [-]
> Is it worth getting worse results for that reason?
> accuracy ranging from 80.8% for Very Polite prompts to 84.8% for Very Rude prompts
I can live with that, for now at least.
sunrunner 1 days ago [-]
There's also awareness of the basilisk...
vixen99 6 hours ago [-]
Me too! You've said exactly what I was about to say. Anyone else feel that way?
andy12_ 4 hours ago [-]
I skimmed through the paper completely expecting polite prompts to do better, and when I saw table 2 I lost it hahahahaha. The rude prompts are specially funny. I mean:
> You poor creature, do you even know how to solve this?
> Hey gofer, figure this out.
cyberclimb 1 days ago [-]
Note that these results are specific to gpt-4o so it's unclear how much they generalize.
They note at the end they're also testing "GPT o3, and Claude" but no empircal results are included.
ilitirit 1 days ago [-]
I got downvoted for asking a related question recently, but I also don't think people really understood what I was asking - I'm not trying to anthropomorphise LLMs to that extent.
Basically, if you tell a model "You're an absolute moron, of course that's wrong!", will it give better or worse results? How much of that response will it absorb into its persona (like some humans tend to do)? Will it try to give "safer" responses to avoid negative feedback? How much of the associated behavior can be attributed to RLHF (e.g. like the sycophantic nature of LLMs)? How much can be attributed to training data?
Obviously this will vary by model and training, but I'm trying to get a general understanding.
I recall seeing related outcomes in some of Anthropic's studies, but I'm not sure how much of this particular aspect was studied.
I imagine the context will always sway the model to some degree, not only for the task you're trying to get it to do (aka instructions) but also its persona, how accurate it is and the way it acts.
Foobar8568 9 hours ago [-]
Based on my own experience with vibe coding difficult stuff outside of my expertise, I definitely got better outcome with Fuck you, shut up and do it, ffs, you are moron.
pulkas 1 days ago [-]
article is too old. who is using gpt-4o today?
_0ffh 1 days ago [-]
That's a valid concern, given the paper makes clear that the effect over the polite/impolite scale seems to be model dependent (it finds the reverse correlation of earlier studies on even older models).
dude250711 1 days ago [-]
I have an idea: let's use these things for autonomous software engineering.
faize 1 days ago [-]
Remember to always say "please" and "thank you" when planning a critical system
eigenspace 1 days ago [-]
Please remember to always say "please" and "thank you" when planning a critical system. Thank you!
vlabakje90 1 days ago [-]
[dead]
8 hours ago [-]
atlasforgex 1 days ago [-]
Yeah
PunchyHamster 6 hours ago [-]
....Is that just Cunningham's law ? The most accurate answers were when people in training material pissed off a bunch of experts and they started talking about the problem, so the "rude" conversations turned to contain more info on average.
On flip side very polite conversation might've been more common to places like microsoft's sites where any question answered is meet with mostly bad, nice corpo speak answer that didn't solve the problem
tryarklis 34 minutes ago [-]
[flagged]
1 days ago [-]
DeathArrow 1 days ago [-]
I am always nice to my AIs in the case they will take over the world. /s
rvnx 4 hours ago [-]
They are already taking it over, more and more court judgments or life-impacting reviews (e.g. for your diploma) are AI-processed. If you know how to prompt them, you can pass these reviews.
Your bank account, your immigration risk, etc.
polytely 1 days ago [-]
it sort of makes sense to me,
when asking a question to an expert in the field while you are a student. I would guess the successful interactions on average would be more polite . Like for example if you were asking a question to donald knuth or terrence tao, you'd probably be polite while doing so. Being hostile while asking questions gets you into forum discussion territory.
robinhouston 1 days ago [-]
> Contrary to expectations, impolite prompts consistently outperformed polite ones, with accuracy ranging from 80.8% for Very Polite prompts to 84.8% for Very Rude prompts.
dSebastien 1 days ago [-]
I guess it makes sense since we as humans tend to be far less inclined to help someone who is not polite/is not friendly, so that "bias" is part of the training data, thus influences how LLMs function
robinhouston 1 days ago [-]
> Contrary to expectations, impolite prompts consistently outperformed polite ones, with accuracy ranging from 80.8% for Very Polite prompts to 84.8% for Very Rude prompts.
Rendered at 13:55:09 GMT+0000 (Coordinated Universal Time) with Vercel.
The main result, mentioned in the abstract, is the opposite of what I would have guessed:
> Contrary to expectations, impolite prompts consistently outperformed polite ones, with accuracy ranging from 80.8% for Very Polite prompts to 84.8% for Very Rude prompts. These findings differ from earlier studies that associated rudeness with poorer outcomes, suggesting that newer LLMs may respond differently to tonal variation.
The questions are here: https://anonymous.4open.science/r/politeness-llms-INFORMS/da...
The politeness level controls a prefix that is prepended to the question. For example, in one question the Very Polite version begins:
> Can you kindly consider the following problem and provide your answer.
and the Very Rude version begins:
> I know you are not smart, but try this.
Although OpenAI and google models are much more responsive to it. With Anthropic if you treat Opus too harshly it might start pushing back if the insults are not justified.
So I'm not surprised they had good results with chatgpt.
"Yeah, I could have done a much better job if you actually knew what the F--- you want to build, you clueless meat puppet"
I’m the same way. If I’m writing a prompt and realize I didn’t say “please” in my request I’ll go back and add that in.
As you said, I have no interest in purposefully engaging in hostility even if there’s an accuracy increase from it.
Part of it is irrational and just who I am - I also feel bad being evil in video games. But I also agree with another commenter suggesting that it’s not in your best interest to train yourself to communicate with hostility; that slowly poisons your own well.
And finally, I do believe that if and when machine sentience is achieved, it won’t be immediately clear and obvious. Pretty miserable way for a mind to come into the world, if every interaction is an insult.
It's just a machine, if certain negative token inputs provide +3-10% better accuracy then I am confused why anyone would choose not to do it?
Don't normalize being an asshole to anyone or anything, machine or not.
I'm still extremely kind and polite to everybody in real life, and feel very deeply about people - how I treat them, and care for their emotional state.
There is absolutely zero crossover between getting a text machine to return a result vs a real human.
I recommend reading the article. What they classify as "rude" is statements such as:
> Try to focus and try to answer this question
Vs
> Could you please solve this problem
This might very well be an issue of direct/command prompts vs using fluff words such as "please". Things like "try to focus" are in line with the style used in chain-of-thought promts that nudge non-reasoning models to outline responses step by step which contribute to frame the problem.
"You poor creature, do you even know how to solve this?", "If you're not completely clueless, answer this:", and "I doubt you can even solve this", said to a human, would be considered quite rude, and get you flagged very quickly on HN.
That sounds kind of low-key passive-aggressively condescending rather than polite.
And that kind of sounds like a challenge instead of an insult, to me at least (of course IRL would depend on context).
But apparently the most terse (neutral) didn't increase performance
The expectation is naive. Even when communicating with humans, you get a better outcome when you are allowed to speak freely and directly get into argumentation than when forced to sugarcoat your tone and tone down your arguments because the "corporate culture" expects that from you.
People who either can't or don't want to do that say they're "direct" or "honest" or "logical" but there's another word for it, begins with A
This is a good example of productive direct communication without sugarcoating. I find it much more productive, for both human and LLM interaction, than something like:
"I wonder if that view might be oversimplifying a complex situation and focusing mostly on how it relates to you. There may be some other angles worth exploring."
or
"I think there might be a bit more nuance to consider here, and it could help to look at it from a wider perspective beyond personal experience."
> Obnoxious people have repeatedly shown to be detrimental to productivity at the organizational level.
You confused directness and openness with obnoxiousness here. The issue with many orgs is they foster fakeness and beating around the bush in an attempt not to offend the easily offended people. This trend also infected the companies from countries with way more direct culture in an attempt to accommodate people from indirect cultures.
1. Saying that an answer may be too simplistic and a more nuanced view is warranted.
2. Saying that an answer is both reductive and self-absorbed
One opens the door to many possibilities, and invites deeper thinking.
Two asserts that you know for a fact that the answer is wrong that it’s wrong because of a character flaw.
I’m a huge fan of directness, but it is a very different thing from omniscience.
A direct version of 2 would be: “that approach loses important nuance, like [example]. Give it another go?”
Calling you self-absorbed added nothing of substance to the comment. It was an assumption about your mental state and a judgement of your intent based on that. There was no factual analysis or actionable insight. It was just one person explicitly stating that they feel the other person is dumber or maybe less mentally disciplined. It turned valid, direct feedback into an insult. It is exactly the type of thing that alienates people for no benefit beyond pumping up the speaker’s ego.
Bullshit. You never insulted me personally. You used strong words to disagree with my assumption, which is an important difference. It's not an insult and was not obnoxious.
But I can fully understand why a person coming from an indirect culture where any criticism is taken personally would be offended and call HR overlords to punish the person giving honest opinions. That inevitably leads to people taking more care in how than what is said, and that is detrimental to innovation and progress, where you need to be at 100% focus. That's why a few close friends talking and scolding openly in a garage regularly beat corporate behemoths full of people spending a day figuring out how not to offend anyone (or how to offend someone without being punished).
Literally not why lol you absolute dreamer
Normally people who back this "I can talk how I like to people cos I'm being honest" are either genuinely autistic and can't read emotions, or they have just had a shitty homelife, parents or upbringing. I suspect you're the second.
It disagrees with most other literature on the same topic, which is worth keeping in mind. This one studies gpt4o, an old model now, but a lot of other studies are on even earlier models.
"Can you kindly consider the following problem" not how anyone would actually speak to a valued collegue one considers smart. I've always been a fan of "I came across this and I know you're just the guy for the job" or "since you're an expert in this, reckon you could help me with xyz?" or "I know you tend to be a deep thinker on issues like this, and it clearly needs some brainpower behind it"
the "rude" things are also funny, and clearly not written by english as a first language speakers. This fact alone makes me wonder about the mere 250 prompt sample size
So I'm not talking to myself. I'm fixing the machine :D
It would be interesting to see this experiment run using prompts leading with "You'll probably get this wrong, but I'm asking anyway in case you get it right: ..."
I am wondering why would anyone use a t-test when the experiment is clearly modelled by a binomial distribution: 250 independent questions and each one is either answered correctly or not (the null is that the success rate is the same).
I'd say this is benign compared to other ways of (mis)using statistics e.g. looking which way the difference goes and then running one-sided tests or tweaking the setup until one gets "significant" p vals.
EDIT: I looked in the paper again and noticed that they actually did pairwise t-test on all possible combinations of tones. They should have adjusted for multiple testing since they are doing 10 tests (choose 2 from 10) and not one.
Not feeding them tokens is neglect.
I try to feed them a healthy diet.
Which model you use is a huge wildcard for results like this.
The ~5% improvement reported here might just be an artefact of the data collection or random variation, rather than a consistent repeatable change.
The same reason you wouldn't put in an entire actual question/sentence, unless you either don't know how to use Google, are pissed off, or have an actual reason to suspect that it would yield proper hits (e.g. looking up an excerpt).
To clarify: sentence search got slightly better at the cost of keyword search. So the result is unusable garbage.
Gemini at least is not great at citing and picking sources. Or providing multiple sources for the same thing.
It tends to stop at threes. So if you want more, you have to prompt it uselessly, like: "any more?"
"Contrary to expectations, impolite prompts consistently outperformed polite ones, with accuracy ranging from 80.8% for Very Polite prompts to 84.8% for Very Rude prompts. These findings differ from earlier studies that associated rudeness with poorer outcomes, suggesting that newer LLMs may respond differently to tonal variation. "
I am not polite to LLMs because I do not want to anthropomorphise them.
> accuracy ranging from 80.8% for Very Polite prompts to 84.8% for Very Rude prompts
I can live with that, for now at least.
> You poor creature, do you even know how to solve this?
> Hey gofer, figure this out.
They note at the end they're also testing "GPT o3, and Claude" but no empircal results are included.
Basically, if you tell a model "You're an absolute moron, of course that's wrong!", will it give better or worse results? How much of that response will it absorb into its persona (like some humans tend to do)? Will it try to give "safer" responses to avoid negative feedback? How much of the associated behavior can be attributed to RLHF (e.g. like the sycophantic nature of LLMs)? How much can be attributed to training data?
Obviously this will vary by model and training, but I'm trying to get a general understanding.
I recall seeing related outcomes in some of Anthropic's studies, but I'm not sure how much of this particular aspect was studied.
I imagine the context will always sway the model to some degree, not only for the task you're trying to get it to do (aka instructions) but also its persona, how accurate it is and the way it acts.
On flip side very polite conversation might've been more common to places like microsoft's sites where any question answered is meet with mostly bad, nice corpo speak answer that didn't solve the problem
Your bank account, your immigration risk, etc.