The Weaponisation of Preference

Preference is useful. It tells us what attracts us, what repels us, and what feels comfortable, desirable, familiar, or relieving. But preference is also wishful. It reaches ahead of consideration. It says I would rather long before the consequence had had time to introduce itself.

There is nothing morally wrong with that. Human life would be unbearable if every coffee, shirt, conversation, and Tuesday afternoon required an inquiry into our deepest interests.

The trouble begins when the wishful element is promoted into evidence.

I prefer it; therefore, it is good for me.
I prefer it; therefore, respecting me requires you to give it to me.

That is an extraordinary amount of authority to hand to a preference.

The wish is not the verdict

Preference can arrive complete. Interest is slower. Interest has to ask what follows: what accumulates, who benefits, what the arrangement requires later, what becomes easier and what becomes harder, what cannot be seen from the position in which the choice is being made.

That slowness is inconvenient in ordinary interaction. Someone wants an answer now. A customer wants the friction removed. A colleague wants the preferred outcome. A platform wants the click. A relationship wants the discomfort gone. Wishfulness moves faster, and speed is useful.

We have become remarkably comfortable treating preference as if it were a considered judgement merely because it belongs to the person expressing it. But a preference can be sincere without being considered. It can be intensely felt without being well informed. It can be ours without having originated entirely inside us.

The architecture around the choice

Modern markets do not need to invent desire from nothing. They need to notice it, arrange it, amplify it, and place the easiest path directly beneath it.

The UK Competition and Markets Authority's evidence review on online choice architecture describes how defaults, rankings, framing, scarcity claims, information overload, sludge and visual manipulation can alter consumer decisions — and notes a deeper problem: preferences are not always fixed before a choice is presented, but can be formed in the act of choosing.

That distinction should make us less sentimental about the word choice. A person can click voluntarily, purchase voluntarily, subscribe voluntarily, agree voluntarily — and still understand very little about the architecture surrounding the decision.

Choice architecture research does not show that every nudge works, or that people are puppets. A large scoping review of hundreds of interventions found a heterogeneous evidence base and substantial gaps in understanding why and when interventions work. That restraint matters — manipulation is not magic. But neither is agency magic: the existence of a choice does not prove the neutrality of the environment in which it was made.

The flattering of agency

There is something deeply convenient about telling people that because they chose, they understood. It closes the ethical question at precisely the point at which it becomes interesting.

What was made prominent? What was made difficult? What disappeared behind friction? What was framed as normal? What urgency was manufactured? What did the person believe everybody else was doing? What information arrived after commitment rather than before it?

The CMA review is unusually useful here because it does not treat all choice architecture as harmful — design can make decisions easier and markets work better. The problem is not influence itself; there is no influence-free environment. The problem begins when architecture exploits predictable tendencies in ways that can lead people away from their own interests or impair their ability to understand the transaction.

That is a far more serious criticism than saying people are gullible. Gullibility is almost beside the point: the more sophisticated the environment becomes at learning what attracts us, the less useful it is to treat every resulting preference as untouched evidence of autonomous judgement.

Preference wearing the robes of principle

The problem does not stop at the checkout. Preference has acquired moral force in day-to-day interaction.

You did not give me the outcome I wanted; therefore, you did not hear me.
You made me uncomfortable; therefore, you acted without care.
You frustrated my choice; therefore, you failed to respect me.

Sometimes those accusations are accurate. Sometimes they prefer wearing the robes of principle.

Research on procedural justice gives a useful counterweight: people care deeply about voice, dignity, neutrality and respectful treatment, including when outcomes are unfavourable — so respect cannot be reduced to receiving the preferred result. A further review goes further still: procedural fairness can support cooperation and belonging, but the very signals of voice and respectful process can themselves leave people susceptible to manipulation and exploitation.

That is the uncomfortable symmetry. Preference can be weaponised against authority — give me what I want, or your integrity is suspect. And the language of respect can be weaponised by authority — I gave you voice; therefore, what I did to you must have been fair. Neither shortcut deserves the power we give it.

Understanding before worship

This is not an argument against preference. It is an argument against worshipping it.

Preference is information. It deserves attention. It may reveal knowledge no expert, leader, partner, institution or market possesses from the outside. But it remains one element in a larger consideration.

The person who respects our agency does not have to pretend that everything we want is good for us. And the person who respects our intelligence should not need to flatter us with the fiction that every choice we make was formed in isolation from the architecture surrounding it.

We are marketed to. Courted. Prompted. Sorted. Framed. Flattered. Frightened. Reassured. Shown what people like us supposedly want. None of this removes our agency. It should make us more interested in how that agency is being recruited.

Wanting something is real. But before preference becomes proof of interest, identity, respect or integrity, it deserves one more question:

Who taught the wish where to look?

Research underneath

Clickable sources supporting the factual floor of the article.

• Competition and Markets Authority (2022). Online Choice Architecture: How digital design can harm competition and consumers — evidence review.
• Szaszi, B., et al. (2018). A Systematic Scoping Review of the Choice Architecture Movement. Journal of Behavioral Decision Making, 31(3), 355–366.
• Lichtenstein, S., & Slovic, P. (Eds.) (2006). The Construction of Preference. Cambridge University Press.
• Tyler, T. R. (2000). Social Justice: Outcome and Procedure. International Journal of Psychology, 35(2), 117–125.
• MacCoun, R. J. (2005). Voice, Control, and Belonging: The Double-Edged Sword of Procedural Fairness. Annual Review of Law and Social Science, 1, 171–201.