Close Menu
TechTost
  • AI
  • Apps
  • Crypto
  • Fintech
  • Hardware
  • Media & Entertainment
  • Security
  • Startups
  • Transportation
  • Venture
  • Recommended Essentials
What's Hot

Sales automation startup Rox AI hits $1.2 billion valuation, sources say

Why Rivian is holding onto the $45,000 R2 base model until ‘late 2027’

Gumloop gets $50M from Benchmark to turn every worker into an AI agent builder

Facebook X (Twitter) Instagram
  • About Us
  • Contact Us
  • Privacy Policy
  • Terms and Conditions
  • Disclaimer
Facebook X (Twitter) Instagram
TechTost
Subscribe Now
  • AI

    How to watch Jensen Huang’s Nvidia GTC 2026 keynote

    13 March 2026

    Ford’s new AI assistant will help fleet owners know if seat belts are being used

    12 March 2026

    AI ‘Actress’ Tilly Norwood Releases Worst Song I’ve Ever Heard

    12 March 2026

    AI apps struggle with long-term retention, according to a new report

    11 March 2026

    Amazon is launching its AI health assistant on its website and app

    11 March 2026
  • Apps

    Channel Surfer lets you watch YouTube like it’s old-school cable TV

    13 March 2026

    Google Maps is getting an AI ‘Ask Maps’ feature and upgraded ‘immersive’ navigation

    12 March 2026

    Google Play adds new paid and PC games, game tests, community posts and more

    12 March 2026

    Google brings Gemini to Chrome in India

    11 March 2026

    YouTube surpasses Disney, Paramount, WBD in ad revenue in 2025

    11 March 2026
  • Crypto

    Hackers stole over $2.7 billion in crypto in 2025, data shows

    23 December 2025

    New report examines how David Sachs may benefit from Trump administration role

    1 December 2025

    Why Benchmark Made a Rare Crypto Bet on Trading App Fomo, with $17M Series A

    6 November 2025

    Solana co-founder Anatoly Yakovenko is a big fan of agentic coding

    30 October 2025

    MoviePass opens Mogul fantasy league game to the public

    29 October 2025
  • Fintech

    India neobank Fi removes banking services on its platform

    11 March 2026

    X taps William Shatner to give invitations to his payment service, X Money

    4 March 2026

    Stripe wants to turn your AI costs into a profit center

    3 March 2026

    3 days left: Save up to $680 on your ticket to Disrupt 2026

    25 February 2026

    More startups surpass $10M ARR in 3 months than ever before

    24 February 2026
  • Hardware

    Ex-Apple Engineer Raises $5M for Note-Taking Locket That Only Records Your Voice

    12 March 2026

    Canopii seems to succeed where the old indoor farms failed

    11 March 2026

    Hyperscale Power is the latest startup to challenge 140-year-old transformer technology

    10 March 2026

    Whoop is launching a new blood test focused on women’s health

    10 March 2026

    Honor says its ‘Robot phone’ with moving camera can dance to music

    8 March 2026
  • Media & Entertainment

    Substack launches an embedded recording studio

    12 March 2026

    TikTok now allows Apple Music subscribers to play entire songs without leaving the app

    12 March 2026

    WordPress debuts a private workspace that runs in your browser via a new service, my.WordPress.net

    11 March 2026

    “Pokémon Pokopia” is a game about restoring a broken world — and I love it

    11 March 2026

    YouTube extends fake AI detection to politicians, government officials and journalists

    10 March 2026
  • Security

    Law enforcement shuts down botnet consisting of tens of thousands of hacked routers

    12 March 2026

    The pro-Iranian hacktivist group says it is behind the attack on medical technology giant Stryker

    12 March 2026

    Salt Typhoon hacks the world’s phone and internet giants — here’s where they’ve been hit

    11 March 2026

    DOGE employee stole Social Security data and thumbed it, report says

    11 March 2026

    US military contractor likely built iPhone hacking tools used by Russian spies in Ukraine

    10 March 2026
  • Startups

    Sales automation startup Rox AI hits $1.2 billion valuation, sources say

    13 March 2026

    When startups become a family business

    12 March 2026

    Ride-hailing inDrive acquires Pakistan’s Krave Mart to boost grocery delivery

    12 March 2026

    Google completes $32 billion acquisition of cloud cybersecurity startup Wiz

    11 March 2026

    Mandiant founder just raised $190 million for autonomous AI security agent startup

    11 March 2026
  • Transportation

    Why Rivian is holding onto the $45,000 R2 base model until ‘late 2027’

    13 March 2026

    Group14 opens factory to produce flash charge battery materials for EVs

    12 March 2026

    Nuro is testing its autonomous vehicle technology on the streets of Tokyo

    12 March 2026

    Zoox plans to put its robotaxis on the Uber app in Vegas this year

    11 March 2026

    GM figured out how to deal with EV uncertainty with the Chevy Bolt

    11 March 2026
  • Venture

    Gumloop gets $50M from Benchmark to turn every worker into an AI agent builder

    13 March 2026

    This SpaceX Veteran Says The Next Big Thing In Space Is Satellites Returning To Earth

    10 March 2026

    Founders Fund is approaching $6 billion for its latest growth fund, sources say

    10 March 2026

    Robinhood’s startup fund stumbles in its NYSE debut

    7 March 2026

    City Detect, which uses artificial intelligence to help cities stay safe and clean, raises $13M Series A

    7 March 2026
  • Recommended Essentials
TechTost
You are at:Home»Startups»Tiny startup Arcee AI built a 400B parameter open source LLM from scratch to best Meta’s Llama
Startups

Tiny startup Arcee AI built a 400B parameter open source LLM from scratch to best Meta’s Llama

techtost.comBy techtost.com30 January 202606 Mins Read
Share Facebook Twitter Pinterest LinkedIn Tumblr Email
Tiny Startup Arcee Ai Built A 400b Parameter Open Source
Share
Facebook Twitter LinkedIn Pinterest Email

Many in the industry believe that the winners of the AI ​​model market have already been decided: Big Tech will own it (Google, Meta, Microsoft, a little Amazon) along with the model makers of their choice, notably OpenAI and Anthropic.

But a tiny startup of 30 people Arcee AI he disagrees. The company has just released a truly and permanently open (Apache licensed) general purpose foundation model called Trinity, and Arcee claims that at 400B parameters, it is one of the largest open source foundation models ever trained and released by a US company.

Arcee says Trinity compares to Meta’s Llama 4 Maverick 400B and Z.ai’s GLM-4.5, a high-performance open-source model from China’s Tsinghua University, according to benchmark tests conducted with base models (very shortly after training).

Arcee AI benchmarks for Trinity large LLM (preview version, base model)Image Credits:Arcee AI

Like other state-of-the-art (SOTA) models, Trinity is designed for coding and multi-step processes like agents. However, despite its size, it is still not a true SOTA competitor because it currently only supports text.

More features are in the works — a vision model is currently in development, and a speech-to-text version is on the roadmap, CTO Lucas Atkins told TechCrunch (pictured above, left). By comparison, Meta’s Llama 4 Maverick is already multimodal, supporting text and images.

But before adding more AI functions to her roster, Arcee says, she wanted a basic LLM that would impress her primary target customers: developers and academics. The group is particularly keen to lure US companies of all sizes away from China’s choice of open-ended models.

“Ultimately, the winners of this game, and the only way to really win usage, is to have the best open-weight model,” Atkins said. “To win the hearts and minds of developers, you have to give them the best.”

Techcrunch event

Boston, MA
|
June 23, 2026

Benchmarks show that the basic Trinity model, which is in preview while more further training takes place, largely holds its own and, in some cases, slightly outperforms the Llama in tests of coding and math, common sense, cognition and reasoning.

The progress Arcee has made so far in becoming a competitive AI lab is impressive. Next is the large Trinity model two previous small models released in December: the 26B-parameter Trinity Mini, a fully trained inference model for tasks ranging from web apps to agents, and the 6B-parameter Trinity Nano, an experimental model designed to push the boundaries of models that are tiny but chatty.

More importantly, Arcee trained them all in six months for a total of $20 million, using 2,048 Nvidia Blackwell B300 GPUs. That’s out of about $50 million the company has raised so far, said founder and CEO Mark McQuade (pictured above, right).

That kind of cash was “a lot for us,” said Atkins, who led the modeling effort. However, he acknowledged that it pales in comparison to how much larger labs are currently spending.

The six-month timeline “was very calculated,” said Atkins, whose pre-LLM career included building voice agents for cars. “We’re a younger startup that’s very hungry. We have a tremendous amount of talent and bright young researchers who, when given the opportunity to spend this amount of money and train a model of this size, we believed they would rise to the occasion. And they certainly did, with many sleepless nights, many long hours.”

McQuade, formerly of the open-source modeling marketplace Hugging Face, says Arcee didn’t start out wanting to be a new AI lab in the US: The company initially customized models for large enterprise clients like SK Telecom.

“We just did post-training. So we’d do other people’s great work: We’d take a Llama model, we’d take a Mistral model, we’d take a Qwen model that was open source, and then train it to make it better” for a company’s intended use, he said, including reinforcement learning.

But as their client list grew, Atkins said, the need for their own model became a necessity, and McQuade worried about relying on other companies. At the same time, many of the best open models came from China, which American companies were reluctant or forbidden to use.

It was a nerve-wracking decision. “I think there are less than 20 companies in the world that have trained and released their own model” at the size and level that Arcee was shooting for, McQuade said.

The company started small at first, trying its hand at a tiny 4.5B model created in partnership with training company DatologyAI. The success of the project then encouraged greater efforts.

But if the US already has the Llama, why does it need another open-weight model? Atkins says that by choosing the Apache open source license, the startup is committed to always keeping its models open. This comes after Meta CEO Mark Zuckerberg said last year that his company might not always make all the most advanced models open source.

“Llama can be considered not truly open source, as it uses a Meta-controlled license with commercial and usage warnings,” he says. This has caused some open source organizations to claim that Llama is not open source compatible at all.

“Arcee exists because the US needs a permanently open, Apache-licensed, edge-quality alternative that can actually compete on today’s frontier,” said McQuade.

All Trinity models, large and small, can be downloaded for free. The larger version will come in three flavors. Trinity Large Preview is a lightly trained instruction model, meaning it has been trained to follow human instructions, not just predict the next word, which orients it for general conversational use. The Trinity Large Base is the base model without further training.

Then we have TrueBase, a model with any instructional or post-training data, so businesses or researchers who want to customize it won’t have to untangle data, rules, or assumptions.

Arcee AI will eventually offer a hosted version of its general release model for what it says is competitive API pricing. That release is up to six weeks away as the startup continues to refine the model’s reasoning training.

API pricing for Trinity Mini is $0.045 / $0.15 and there is also a free tier available with a limited price. Meanwhile, the company still sells post-training and customization options.

400B Arcee Arcee AI blade 4 built foundation models Llama llm Metas open open source ai parameter scratch source startup tiny Triad
Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
Previous ArticleTesla’s energy storage business is growing faster than any other part of the company
Next Article Last 24 hours to get 50% off +1 pass for Disrupt 2026 | TechCrunch
bhanuprakash.cg
techtost.com
  • Website

Related Posts

Sales automation startup Rox AI hits $1.2 billion valuation, sources say

13 March 2026

When startups become a family business

12 March 2026

Ride-hailing inDrive acquires Pakistan’s Krave Mart to boost grocery delivery

12 March 2026
Add A Comment

Leave A Reply Cancel Reply

Don't Miss

Sales automation startup Rox AI hits $1.2 billion valuation, sources say

13 March 2026

Why Rivian is holding onto the $45,000 R2 base model until ‘late 2027’

13 March 2026

Gumloop gets $50M from Benchmark to turn every worker into an AI agent builder

13 March 2026
Stay In Touch
  • Facebook
  • YouTube
  • TikTok
  • WhatsApp
  • Twitter
  • Instagram
Fintech

India neobank Fi removes banking services on its platform

11 March 2026

X taps William Shatner to give invitations to his payment service, X Money

4 March 2026

Stripe wants to turn your AI costs into a profit center

3 March 2026
Startups

Sales automation startup Rox AI hits $1.2 billion valuation, sources say

When startups become a family business

Ride-hailing inDrive acquires Pakistan’s Krave Mart to boost grocery delivery

© 2026 TechTost. All Rights Reserved
  • About Us
  • Contact Us
  • Privacy Policy
  • Terms and Conditions
  • Disclaimer

Type above and press Enter to search. Press Esc to cancel.