--- title: "Lawyer Submits Anti-AI Document That Appears to Have Been Created Using AI" description: "A lawyer in Minnesota has been accused of using an AI chatbot to draft an affidavit — in support of an anti-deepfake law in the state." date: "2024-11-23" modified: "2024-11-23" authors: - name: "Victor Tangermann" job_title: "Senior Editor" link: "https://futurism.com/authors/victor" url: "https://futurism.com/the-byte/lawyer-submits-anti-ai-document" categories: - "Future Society" tags: - "ai chatbots" - "chatgpt" - "deepfakes" - "lawyers" - "the digest" --- # Lawyer Submits Anti-AI Document That Appears to Have Been Created Using AI ![A lawyer in Minnesota has been accused of using an AI chatbot to draft an affidavit — in support of an anti-deepfake law in the state.]() *\Image: Getty / Futurism\* ## Irony Fire A lawyer in Minnesota who [claims to be an expert]() on how "people use deception with technology," has been accused of using an AI chatbot to draft an affidavit — in support of an anti-deepfake law in the state. As the [*Minnesota Reformer* reports](), lawyers challenging the law on behalf of far-right YouTuber and Republican state representative Mary Franson found that Stanford Social Media Lab founding director Jeff Hancock's affidavit included references to studies that don't appear to exist, a telltale sign of AI text generators that often "hallucinate" facts and reference materials. While it's [far from the first time]() a lawyer has been accused of making up court cases using AI chatbots like OpenAI's ChatGPT, it's an especially ironic development given the subject matter. The law, which calls for a ban on the use of deepfakes to influence an election, was [challenged in federal court]() by Franson on the grounds that such a ban would violate First Amendment rights. But in an attempt to defend the law, Hancock — or possibly one of his staff — appears to have stepped in it, handing the plaintiff's attorneys a golden opportunity. ## Law Fare One study cited in Hancock's affidavit titled "The Influence of Deepfake Videos on Political Attitudes and Behavior" doesn't appear to exist. "The citation bears the hallmarks of being an artificial intelligence (AI) 'hallucination,' suggesting that at least the citation was generated by a large language model like ChatGPT," Franson's attorneys [wrote in a memorandum](). "Plaintiffs do not know how this hallucination wound up in Hancock’s declaration, but it calls the entire document into question." And it's not just Franson's lawyers. UCLA law professor Eugene Volokh [also discovered]() a different cited study titled "Deepfakes and the Illusion of Authenticity: Cognitive Processes Behind Misinformation Acceptance," which also doesn't appear to exist. It's a troubling turn in an otherwise meaningful effort to keep AI deepfakes from swaying an election, something that has [become a very real risk]() given steady advancements in the tech. It also highlights a recurring trend: lawyers keep getting caught using tools like ChatGPT when they bungle up facts. Last year, New York City-based lawyer Steven Schwartz [was caught]() using ChatGPT to help him write up a document. A different Colorado-based lawyer named Zacharia Crabill, who was also caught red-handed, was [fired from his job in November]() for the same offense. Crabill, however, dug in his heels. "There’s no point in being a naysayer," he [told the *Washington Post*]() of the firing, "or being against something that is invariably going to become the way of the future." **More on AI and lawyers:** *[Lawyer in Huge Trouble After He Used ChatGPT in Court and It Totally Screwed Up]()* ## Author I've been at Futurism since 2017, where my role has evolved to encompass design, writing, and increasingly editing. I've always been fascinated by space exploration and advanced transportation, which I've leaned into by interviewing luminaries in those fields while closely following the dimensions of policy and regulation that allow next-generation projects to succeed -- or, sometimes, to fail. I'm also keenly interested in the effects of generative AI on society, policies, and democratic institutions, as well as clean energy, physics and biology, and the vagaries of tech leadership. My work for Futurism has been cited by publications including Ars Technica, Gizmodo, PC Magazine, Jalopnik, Fox News, and the New York Post. I spent my childhood living in locations including Manila, the Philippines, and Geneva, Switzerland, attended McGill University, and now live in Toronto, Canada. Before Futurism I worked at AskMen and a small photography studio. In my free time, I'm an avid gardener, foodie, and craft beer lover, as well as a maker of artisanal hot pepper sauces. I have a magnificent dog named Freida. ### Author social links [Bluesky]()