--- title: "Tech Companies Furious at New Law That Would Hold Them Accountable When Their AI Does Bad Stuff" description: "The California bill, SB 1047, has been criticized by companies like OpenAI for potentially stifling the nascent AI industry." date: "2024-08-22" modified: "2024-08-22" authors: - name: "Frank Landymore" job_title: "Contributing Writer" link: "https://futurism.com/authors/flandymore" url: "https://futurism.com/the-byte/tech-companies-accountable-ai-bill" categories: - "Artificial Intelligence" tags: - "generative ai" - "OpenAI" - "the digest" --- # Tech Companies Furious at New Law That Would Hold Them Accountable When Their AI Does Bad Stuff ![The California bill, SB 1047, has been criticized by companies like OpenAI for potentially stifling the nascent AI industry.]() *\Image: Getty / Futurism\* ## With Great Power... California is on the verge of passing a bill that would enforce sweeping regulations in the AI industry, after it was approved in the state's Assembly Appropriations Committee [on Thursday](). The bill, SB 1047, proposes a number of safety requirements for AI developers to prevent "severe harm," and includes provisions that could hold them accountable for the output of their AI models. Now OpenAI, which has [advocated for regulation in the past](), is joining [other tech companies](), as well as [some politicians](), in decrying the bill, arguing that it would hurt innovation in the industry, [*Bloomberg* reports](). "The AI revolution is only just beginning, and California's unique status as the global leader in AI is fueling the state's economic dynamism," Jason Kwon, chief strategy officer at OpenAI, wrote in a letter to state Senator Scott Wiener, who introduced the bill, as quoted by *Bloomberg*. "SB 1047 would threaten that growth, slow the pace of innovation, and lead California's world-class engineers and entrepreneurs to leave the state in search of greater opportunity elsewhere." ## Playing It Safe In more specific terms, the bill would give the California attorney general the power to seek an injunction against tech companies that put out unsafe AI models, [according to *Platformer*'s analysis](). If successfully sued, these companies could face civil penalties — [though not criminal penalties](). To be compliant, businesses would need to carry out mandated safety testing for any AI models that either cost more than $100 million to develop or require more than a certain amount of computing power. AI developers would also need to build their AI models with a "kill switch" that could be used to shut them down in an emergency. In addition to in-house testing, developers would be required to hire third-party auditors to assess their safety practices, [per *Reuters*](). The bill also provides more legal protections to whistleblowers speaking out against AI practices. ## Tech Troublemakers As *Platformer* observes, the bill raises an age-old question: should the person using the tech be blamed, or the tech itself? With regards to social media, the law says that generally, [websites can't be held accountable]() for what users post. AI companies hope that this status quo applies to them, too. Because AI models [frequently hallucinate]() and are [easily tricked into ignoring their guardrails](), the prospect of being held accountable for their chaotic outputs could be a major headache. OpenAI and others argue that such regulatory actions are premature and could hamper development of the tech in the state. And true, it may be the case that AIs are still in their infancy and have a long way to go before they're capable enough to turn on us à la Skynet — but it'd be remiss to downplay the dangers of more mundane [fears like misinformation](), or their ability [to carry out hacks](). As it stands, the bill awaits a vote in the state's full Assembly, and must be passed by the end of the month before it can be sent to Governor Gavin Newsom for approval. **More on AI:** *[Tech CEO Admits That He “Really F\*cking Hates” Generative AI]()* ## Author At Futurism, my work has often centered on bringing a sense of clarity and insight to complex topics ranging from the regulation of emerging technologies to the esoteric ideologies of Silicon Valley executives, while striving not to lose the poetic sense of awe inspired by often-obscure fields like astrophysics and quantum computing. I broke the story of CNET using AI to produce articles that turned out to be riddled with factual errors and plagiarism — a dam-breaking inflection point, as I've reported, that's inspired copycats and endless discourse while beguiling stakeholders ranging from tech giants to purveyors of spam around the web. My work at Futurism has been cited by publications including CBS News, the Los Angeles Times, Vice, Gizmodo, Engadget, the Verge, and Vanity Fair. I grew up in locales ranging from India to China, and now live in the exotic suburbs of Virginia. In my free time, I'm an avid reader of weird sci-fi literature, an aficionado of East Asian cinema, and, regrettably, a relapsed gamer. Allegedly, I’m working on a debut novel, currently untitled. ### Author social links [Bluesky]()