The Bizarre Case of the Prompt Injection Attack: A Cautionary Tale for Litigants and Judges Alike A recent court filing in Connecticut has sparked controversy over its use of artificial intelligence to manipulate a legal outcome.
In a lawsuit against the New York Bariatric Group, a plaintiff embedded hidden prompts in his filing instructions that would have an AI system declare him the winner.
The incident raises questions about the intersection of AI, litigation, and human ingenuity.