--- title: "Amazon Reportedly Training AI With Twice as Many Parameters as GPT-4" description: "Amazon's upcoming LLM codenamed \"Olympus\" will reportedly have two trillion parameters, twice as many as OpenAI's GPT-4." date: "2023-11-08" modified: "2023-11-08" authors: - name: "Victor Tangermann" job_title: "Senior Editor" link: "https://futurism.com/authors/victor" url: "https://futurism.com/the-byte/amazon-training-ai-twice-parameters-gpt-4" categories: - "Artificial Intelligence" tags: - "Amazon" - "generative ai" - "large language model" - "OpenAI" - "the digest" --- # Amazon Reportedly Training AI With Twice as Many Parameters as GPT-4 ![Amazon's upcoming LLM codenamed "Olympus" will reportedly have two trillion parameters, twice as many as OpenAI's GPT-4.]() *\Image: Getty / Futurism\* ## Iambic Parameter Tech giants are waging a war, trying to one-up each other's efforts to cook up the largest and most capable large language models (LLMs), which are the AI tech powering tools like OpenAI's ChatGPT. Amazon's now looking to come up with its own offering, investing large sums to train its own model codenamed "Olympus" to take on the likes of ChatGPT and Google's Bard, insider sources [told *Reuters*](). The training data for the secretive project is reportedly vast. The model will have a whopping 2 trillion parameters, which are the variables that determine the output of a given model, making it one of the largest currently in development. In comparison, OpenAI's GPT-4 LLM has "just" one trillion parameters, according to *Reuters*. That would also dwarf Amazon's existing generative AI models that the company hosts on its Amazon Web Services. There's a lot we still don't know about the project — but Amazon has a good chance to make a big splash in the AI world, given the tremendous amounts of computing and server infrastructure it already has access to. After all, LLMs are [notoriously hardware and energy-intensive](). ## Attack of the Titans As [*The Information* reported]() earlier this week, it's still unclear when Amazon will unveil Olympus, let alone release it to the public. But given the e-commerce giant's immense available resources and dominance in the web hosting space, Amazon is the next company to watch in the rapidly evolving AI industry. It's also got money to burn; the company [announced]() earlier this year that it'd invested $4 billion in AI startup Anthropic. Important to note: even with twice as many parameters as GPT-4, it remains to be seen whether Amazon's Olympus will be able to outperform OpenAI's blockbuster AI model. "A model with more parameters is not necessarily better," Yann LeCun, "godfather of AI" and Meta chief AI scientist, [tweeted in September](). **More on Amazon:** *[Amazon Is Being Flooded With Books Entirely Written by AI]()* ## Author I've been at Futurism since 2017, where my role has evolved to encompass design, writing, and increasingly editing. I've always been fascinated by space exploration and advanced transportation, which I've leaned into by interviewing luminaries in those fields while closely following the dimensions of policy and regulation that allow next-generation projects to succeed -- or, sometimes, to fail. I'm also keenly interested in the effects of generative AI on society, policies, and democratic institutions, as well as clean energy, physics and biology, and the vagaries of tech leadership. My work for Futurism has been cited by publications including Ars Technica, Gizmodo, PC Magazine, Jalopnik, Fox News, and the New York Post. I spent my childhood living in locations including Manila, the Philippines, and Geneva, Switzerland, attended McGill University, and now live in Toronto, Canada. Before Futurism I worked at AskMen and a small photography studio. In my free time, I'm an avid gardener, foodie, and craft beer lover, as well as a maker of artisanal hot pepper sauces. I have a magnificent dog named Freida. ### Author social links [Bluesky]()