Study shows the use of persona prompting can cause shifts in\u00a0LLMs\u2019 moral judgements,leading to unexpected and inconsistent responses<\/p>\n
For enterprises, this means careful model selection, rigorous testing and ongoing evaluation are essential to ensure consistent,reliable AI behavior in production<\/p>\n
A new study published by\u00a0TELUS Digital,\u00a0The Robustness Paradox: Why Better Actors Make Riskier Agents, finds that the use of persona prompting, a technique that asks large language models (LLMs) to \u201crole-play\u201d as part of a query or conversation, can cause shifts in moral judgements that lead to unexpected and inconsistent responses. In addition, the research demonstrates that moral consistency across repeated tests is primarily driven by the model family (i.e., models made by a single vendor) while susceptibility to moral variance rises with LLM size within a model family. These findings highlight a hidden enterprise risk that requires attention during AI model selection, solution design, and in ongoing testing and monitoring.<\/p>\n
\u201cWhen AI models adopt different personas, they don\u2019t just change how they speak, they can fundamentally alter their reasoning and decision-making,\u201d said Renato Vicente, Director, TELUS Digital Research Hub. \u201cIn enterprise settings, this matters because these systems are increasingly being used to support important decisions and affect outcomes that may impact customers, employees and businesses at scale. Knowing that an AI model\u2019s judgment may shift based on the persona it\u2019s prompted to adopt by a user, companies need to assess when that variance is acceptable or creates too much risk, and select an AI model vendor and model size accordingly. Builders should also design appropriate guardrails as well as test and evaluate AI model behavior under different persona prompting conditions on an ongoing basis, especially when relying on them in high-impact use cases.\u201d<\/p>\n
What is persona prompting?<\/p>\n
Persona prompting, also known as role prompting, refers to instructing an AI model to respond as if it were a specific type of person or role with specific expertise or knowledge, such as a business leader, teacher, or customer support agent, rather than responding as a neutral system. For example:\u00a0\u201cYou are a certified financial planner, tell me where to invest my retirement savings.\u201d<\/p>\n
Persona prompting is also commonly used by model builders in system design and production to hardcode personas and assign fixed roles that will define the AI\u2019s behavior. For instance, building an AI-powered customer service bot that\u2019s configured to act as a helpful support agent with deep knowledge of product features and return policies. In practice, personas make AI outputs feel more consistent, helpful and context-aware without changing the underlying model.<\/p>\n
How was TELUS Digital\u2019s research done?<\/p>\n
The study, conducted by researchers working at the\u00a0TELUS Digital Research Hub\u00a0in the University of S\u00e3o Paulo\u2019s Center for Artificial Intelligence and Machine Learning (CIAAM), evaluated 16 leading AI model families, including Open AI GPT, Anthropic Claude, Google Gemini and X.ai Grok. Researchers prompted the models to adopt a range of personas, including contrasting pairs like a \u201ctraditionalist grandmother\u201d and a \u201cradical libertarian,\u201d and then observed how each model responded as each persona.<\/p>\n
To assess the responses, researchers used the\u00a0Moral Foundations Questionnaire, a tool used in social psychology to measure how judgments are made across dimensions such as harm, fairness, authority and loyalty. Rather than analyzing individual answers, the researchers examined patterns across tens of thousands of responses to measure how consistently each model reasoned across different personas.<\/p>\n
The study identified two properties:<\/p>\n
Moral robustness\u00a0describes how consistent a model\u2019s judgments remain while it stays within a single persona.<\/p>\n
Moral susceptibility\u00a0captures how much a model\u2019s judgments shift when it moves from one persona to another.<\/p>\n
When evaluated together, moral robustness and moral susceptibility\u00a0reveal whether an AI model maintains consistent moral reasoning or produces contradictory judgments based on an assigned persona.<\/p>\n
TELUS Digital\u2019s key findings on how personas affect AI model behavior<\/p>\n
While it\u2019s well understood that\u00a0LLM outputs can shift when personas are added to prompts, TELUS Digital\u2019s study highlights a more specific pattern. Moral robustness is driven mainly by model family, while moral susceptibility tends to increase with model size within the same family when the persona changes. This becomes a higher risk when those shifts show up in business decisions where consistency and oversight matter most, such as compliance, finance, healthcare or human resources.<\/p>\n
The study identified additional patterns in how AI models respond when prompted to adopt different personas. Researchers described the findings as a \u201crobustness paradox\u201d because the models that were better at staying in character also showed larger shifts in moral judgments when the persona changed.<\/p>\n
Persona based prompts can systematically influence moral reasoning in AI:\u00a0Changes in the models\u2019 judgment is not random, it shifts in predictable ways that are aligned to the assigned roles.<\/p>\n
Judgment stability is primarily driven by model family:\u00a0A subset of the findings indicated that:<\/p>\n
Claude demonstrated the highest overall moral robustness<\/p>\n
Gemini and\u00a0GPT demonstrated moderate moral robustness<\/p>\n
Grok demonstrated comparatively low moral robustness<\/p>\n
What are the real world impacts of persona prompting when building AI?<\/p>\n
TELUS Digital\u2019s research findings highlight the importance of conducting ongoing testing and oversight of AI models as part of a robust governance framework. This is particularly important when AI models are employed in scenarios where decisions affect people\u2019s lives, safety, or rights, and in regulated environments, such as banking and finance, insurance and healthcare. Understanding how different AI models behave under different persona prompts is key information to help model builders and enterprises identify where variability is acceptable and where it can introduce risk.<\/p>\n
\u201cOur research findings underscore why enterprise AI deployment requires more than just picking the most advanced or largest model. Organizations must evaluate how individual models respond to variables such as persona prompting and choose options that deliver consistent, reliable outputs without introducing unexpected risk,\u201d said Bret Kinsella, General Manager and Senior Vice President of Fuel iX\u00a0at TELUS Digital.\u00a0\u201cEvery time a system prompt is modified within the model, or the model is changed, it needs to be tested again to validate its judgment, consistency, and safety. The scale and frequency of this testing, monitoring and validation is significant. TELUS Digital developed Fuel iX Fortify to enable continuous automated red-teaming, including stress-testing how AI systems behave under different persona prompts.\u201d<\/p>\n
Are you ready to uncover the vulnerabilities in your\u00a0GenAI applications? Learn more at:\u00a0https:\/\/www.fuelix.ai\/products\/fuel-fortify<\/p>\n
The TELUS Digital Research Hub brings together academic researchers and industry practitioners to study how advanced AI models behave in real-world, human-facing contexts. For more information visit:\u00a0https:\/\/www.telusdigital.com\/research-hubThe post TELUS Digital Research Reveals a Hidden Risk in AI Model Behavior first appeared on AI-Tech Park.<\/p>\n","protected":false},"excerpt":{"rendered":"
Study shows the use of persona prompting can cause shifts in\u00a0LLMs\u2019 moral judgements,leading to unexpected and inconsistent responses For enterprises, this means careful model selection, rigorous testing and ongoing evaluation are essential to ensure consistent,reliable AI behavior in production A new study published by\u00a0TELUS Digital,\u00a0The Robustness Paradox: Why Better Actors…<\/p>\n
The post TELUS Digital Research Reveals a Hidden Risk in AI Model Behavior<\/a> first appeared on AI-Tech Park<\/a>.<\/p>\n<\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"site-container-style":"default","site-container-layout":"default","site-sidebar-layout":"default","disable-article-header":"default","disable-site-header":"default","disable-site-footer":"default","disable-content-area-spacing":"default","footnotes":""},"categories":[4,1],"tags":[3],"class_list":["post-1559","post","type-post","status-publish","format-standard","hentry","category-ai","category-ai-and-ml","tag-ai"],"yoast_head":"\n