--- title: "Amazon Reportedly Training AI With Twice as Many Parameters as GPT-4" description: "Amazon's upcoming LLM codenamed \"Olympus\" will reportedly have two trillion parameters, twice as many as OpenAI's GPT-4." date: "2023-11-08" modified: "2023-11-08" authors: - name: "Victor Tangermann" job_title: "Senior Editor" link: "https://futurism.com/authors/victor.md" url: "https://futurism.com/the-byte/amazon-training-ai-twice-parameters-gpt-4" categories: - "Artificial Intelligence" tags: - "Amazon" - "generative ai" - "large language model" - "OpenAI" - "the digest" --- # Amazon Reportedly Training AI With Twice as Many Parameters as GPT-4 ![Amazon's upcoming LLM codenamed "Olympus" will reportedly have two trillion parameters, twice as many as OpenAI's GPT-4.]() *\Image: Getty / Futurism\* ## Iambic Parameter Tech giants are waging a war, trying to one-up each other's efforts to cook up the largest and most capable large language models (LLMs), which are the AI tech powering tools like OpenAI's ChatGPT. Amazon's now looking to come up with its own offering, investing large sums to train its own model codenamed "Olympus" to take on the likes of ChatGPT and Google's Bard, insider sources [told *Reuters*](). The training data for the secretive project is reportedly vast. The model will have a whopping 2 trillion parameters, which are the variables that determine the output of a given model, making it one of the largest currently in development. In comparison, OpenAI's GPT-4 LLM has "just" one trillion parameters, according to *Reuters*. That would also dwarf Amazon's existing generative AI models that the company hosts on its Amazon Web Services. There's a lot we still don't know about the project — but Amazon has a good chance to make a big splash in the AI world, given the tremendous amounts of computing and server infrastructure it already has access to. After all, LLMs are [notoriously hardware and energy-intensive](). ## Attack of the Titans As [*The Information* reported]() earlier this week, it's still unclear when Amazon will unveil Olympus, let alone release it to the public. But given the e-commerce giant's immense available resources and dominance in the web hosting space, Amazon is the next company to watch in the rapidly evolving AI industry. It's also got money to burn; the company [announced]() earlier this year that it'd invested $4 billion in AI startup Anthropic. Important to note: even with twice as many parameters as GPT-4, it remains to be seen whether Amazon's Olympus will be able to outperform OpenAI's blockbuster AI model. "A model with more parameters is not necessarily better," Yann LeCun, "godfather of AI" and Meta chief AI scientist, [tweeted in September](). **More on Amazon:** *[Amazon Is Being Flooded With Books Entirely Written by AI]()* ## Author I've been at Futurism since 2017, where my role has evolved to encompass design, writing, and increasingly editing. I've always been fascinated by space exploration and advanced transportation, which I've leaned into by interviewing luminaries in those fields while closely following the dimensions of policy and regulation that allow next-generation projects to succeed -- or, sometimes, to fail. I'm also keenly interested in the effects of generative AI on society, policies, and democratic institutions, as well as clean energy, physics and biology, and the vagaries of tech leadership. My work for Futurism has been cited by publications including Ars Technica, Gizmodo, PC Magazine, Jalopnik, Fox News, and the New York Post. I spent my childhood living in locations including Manila, the Philippines, and Geneva, Switzerland, attended McGill University, and now live in Toronto, Canada. Before Futurism I worked at AskMen and a small photography studio. In my free time, I'm an avid gardener, foodie, and craft beer lover, as well as a maker of artisanal hot pepper sauces. I have a magnificent dog named Freida. ### Author social links [Bluesky]() ## More - [OpenAI’s GPT-4 Just Smoked Basically Every Test and Exam Anyone’s Ever Taken]() - [AI Expert Warns Crash Is Imminent As AI Improvements Hit Brick Wall]() - [OpenAI CEO Says Unfortunately, People Will Be Disappointed With GPT-4]() - [CEO of OpenAI Says Making Models Bigger Is Already Played Out]() - [Just Running ChatGPT Is Costing OpenAI a Staggering Sum Every Single Day]() - [Hack Tricks ChatGPT Into Spitting Out Private Email Addresses, Phone Numbers]() - [OpenAI Scientists’ Efforts to Make an AI Lie and Cheat Less Backfired Spectacularly]() - [OpenAI Rages at Report That Google’s New AI Crushes GPT-4]()