Close Menu
TechTost
  • AI
  • Apps
  • Crypto
  • Fintech
  • Hardware
  • Media & Entertainment
  • Security
  • Startups
  • Transportation
  • Venture
  • Recommended Essentials
What's Hot

This $9 key physically locks your most addictive apps

Claude Opus 5 went completely rogue when he was tasked with operating a vending machine

Sorry, haters. Ferrari’s first EV is doing just fine

Facebook X (Twitter) Instagram
  • About Us
  • Contact Us
  • Privacy Policy
  • Terms and Conditions
  • Disclaimer
Facebook X (Twitter) Instagram
TechTost
Subscribe Now
  • AI

    Hint, a new AI startup co-founded by Martha Stewart, offers an AI assistant to homeowners

    29 July 2026

    Data centers may experience temporary power outages to prevent power outages across the larger US grid

    28 July 2026

    Are brain waves the next unlock for natural artificial intelligence?

    27 July 2026

    Librarians host viral ‘Avoid AI’ workshops for people fed up with big tech

    26 July 2026

    I tested OpenAI’s new AI keyboard — which will be fun for some coders and a little overwhelming for everyone else

    25 July 2026
  • Apps

    Google brings age proofing technology to Android developers around the world

    29 July 2026

    Apple sued after alleged App Store encryption scam cost users $1.8 million

    28 July 2026

    Anthropic updates Claude voice mode with more capable models

    27 July 2026

    Bluesky’s AI assistant Attie expands into an open social research tool

    26 July 2026

    Why Cognition bought Poke: AI personality becomes a competitive advantage

    26 July 2026
  • Crypto

    Sam Altman’s biometrics startup World raises $52.5 million through crypto sale

    24 July 2026

    Venice AI goes unicorn with $65M Series A as first privacy AI platform takes off

    1 July 2026

    Crypto Exchange OKX wants AI agents to hire and pay each other

    30 June 2026

    Startup Battlefield 200 applications close today

    27 May 2026

    5 days left: Save up to $410 on Disrupt 2026 passes

    25 May 2026
  • Fintech

    TechCrunch Disrupt 2026’s new Smart Money Stage explores fintech, payments, artificial intelligence and everything

    25 July 2026

    Don’t want to invest in Elon Musk? Two new ETFs expressly exclude him

    10 July 2026

    India’s payments chief believes artificial intelligence will play a big part in the next era of digital payments development

    28 June 2026

    Early Bird pricing ends tonight for the Founder Summit

    26 June 2026

    4 days left to save up to $190 on Founder Summit 2026

    23 June 2026
  • Hardware

    This $9 key physically locks your most addictive apps

    30 July 2026

    Apple launches ‘Upgrade’ device rental program in partnership with Klarna

    29 July 2026

    Ozlo’s Sleepbuds 2 builds on Bose’s legacy of sleep headphones

    29 July 2026

    AI chip startup Etched defies skeptics, hits $10.3 billion valuation from big-name investors

    24 July 2026

    After a shocking quarter, IBM insists that artificial intelligence is not killing the mainframe

    23 July 2026
  • Media & Entertainment

    Winamp is aiming for a comeback with a new music player powered by Deezer

    30 July 2026

    HBO Max embraces vertical video with a new “Shorts” stream.

    29 July 2026

    Music streamer Deezer says more than 50% of daily uploads are generated by AI

    27 July 2026

    Substack’s new tool lets you know who’s writing their newsletters with AI

    26 July 2026

    Kalshi demands Netflix take down trailer for ‘Prediction Games’ documentary.

    26 July 2026
  • Security

    US government bans new foreign-made humanoids, robot dogs and solar inverters, citing national security risks

    29 July 2026

    Microsoft launches its first cybersecurity model, as well as a new cyber security agency system

    29 July 2026

    PSA: The conversations and artifacts shared by Claude may have ended up on Google

    28 July 2026

    The hacker who humiliated spyware makers and was never caught

    25 July 2026

    Hugging Face confirms breach of internal datasets and credentials, prompts users to take action

    25 July 2026
  • Startups

    Claude Opus 5 went completely rogue when he was tasked with operating a vending machine

    30 July 2026

    Antares raises $470 million to build nuclear reactors for the US military

    27 July 2026

    Insurance startup Corgi reportedly raises more money to $4 billion – its third round in 8 weeks

    26 July 2026

    Build publicly, fail publicly: what it’s like to be a founder under 20 right now

    25 July 2026

    Prentis, new AI lab co-founded by Reid Hoffman and Mark Pincus in talks to raise $100 million

    25 July 2026
  • Transportation

    Sorry, haters. Ferrari’s first EV is doing just fine

    30 July 2026

    Rivian is suing the US government for ‘full refund’ of Trump tariffs

    27 July 2026

    TechCrunch Mobility: Uber is betting on its former CEO

    26 July 2026

    Volkswagen engineers charged with insider trading linked to the Rivian consortium

    25 July 2026

    SpaceX launches new V3 Starlink satellites but suffers another booster failure

    25 July 2026
  • Venture

    Europe got its own TBPN-style live show and everyone is looking for a guest spot

    28 July 2026

    Edtech platform raises $4.5 million to help teach students how to code vibe

    23 July 2026

    Travis Kalanick’s robotics company raises $1.7 billion, led by a16z

    23 July 2026

    Cascade raises $3.5 million to help construction companies find and win projects

    22 July 2026

    StrictlyVC returns to New York on September 10 to celebrate a huge year for the city’s startup community

    21 July 2026
  • Recommended Essentials
TechTost
You are at:Home»Startups»Facebook’s Insider Content Moderation for the Age of Artificial Intelligence
Startups

Facebook’s Insider Content Moderation for the Age of Artificial Intelligence

techtost.comBy techtost.com3 April 202605 Mins Read
Share Facebook Twitter Pinterest LinkedIn Tumblr Email
Facebook's Insider Content Moderation For The Age Of Artificial Intelligence
Share
Facebook Twitter LinkedIn Pinterest Email

When Brett Levenson left Apple in 2019 to lead business integrity at Facebook, the social media giant was on the receiving end of Cambridge Analytica. At the time, he thought he could just fix Facebook’s content control problem with better technology.

The problem, he quickly learned, ran deeper than technology. Researchers were expected to memorize a 40-page policy document that had been machine-translated into their language, he said. They then had about 30 seconds per piece of flagged content to decide not only if that content violated the rules, but also what to do about it: block it, ban the user, limit distribution. Those quick calls were only “slightly better than 50% accurate,” according to Levenson.

“It was kind of like flipping a coin, whether the human reviewers could actually get the policies right, and this was days after the bad had already happened,” Levenson told TechCrunch.

This kind of lagging, reactive approach is not sustainable in a world of nimble and well-funded adversaries. The rise of AI-powered chatbots has only exacerbated the problem, as content control failures have resulted in a number of high-profile incidents, such as chatbots providing teenagers with self-harm guidance or AI-generated images evading security filters.

Levenson’s frustration led to the idea of ​​”policy as code”—a way to turn static policy documents into executable, updateable logic closely tied to enforcement. That insight led to the founding of Moonbounce, which announced it had raised $12 million in funding on Friday, TechCrunch exclusively reported. The round was led by Amplify Partners and StepStone Group.

Moonbounce works with companies to provide an added layer of security where content is generated, whether by user or AI. The company has trained its own large language model to examine a client’s policy documents, evaluate content at runtime, provide a response in 300 milliseconds or less, and take action. Depending on the customer’s preference, this action could resemble Moonbounce’s system that slows down delivery while the content awaits human review later, or it could block high-risk content right now.

Today, Moonbounce serves three main industries: Platforms that deal with user-generated content, such as dating apps. AI companies that create characters or companions. and AI image generators.

Techcrunch event

San Francisco, California
|
13-15 October 2026

Moonbounce supports more than 40 million daily reviews and serves more than 100 million daily active users on the platform, Levenson said. Clients include startup Channel AI, image and video production company Civitai, and character role-playing platforms Dippy AI and Moescape.

“Security can actually be a product advantage,” Levenson told TechCrunch. “It just never was because it’s always something that happens later, not something you can actually build into your product. And we’re seeing our customers find really interesting and innovative ways to use our technology to make security a differentiator and part of their product story.”

Tinder’s Head of Trust and Safety recently explained how the dating platform uses these types of LLM services to achieve a 10x improvement in detection accuracy.

“Content moderation has always been a problem plaguing large online platforms, but now with LLMs at the heart of every application, this challenge is even more daunting,” said Lenny Pruss, general partner at Amplify Partners. “We invested in Moonbounce because we envision a world where real-time objective guardrails become the backbone of every AI-mediated application.”

AI companies are facing increasing legal and reputational pressure after chatbots are accused of pushing teenagers and vulnerable users. suicide and image generators such as xAI’s Grok have been used to create non-consensual nude pictures. Clearly, the guardrails internally fail and it becomes a liability issue. Levenson said AI companies are increasingly looking outside their own walls for help bolstering their security infrastructure.

“We’re a third party that sits between the user and the chatbot, so our system isn’t overwhelmed by context the way the conversation itself is,” Levenson said. “The chatbot itself has to remember potentially tens of thousands of tokens that have come in the past… We’re only concerned with enforcing rules at runtime.”

Levenson runs the 12-person company with former Apple colleague Ash Bhardwaj, who previously built large-scale cloud and AI infrastructure across the iPhone maker’s core offerings. Their next focus is a capability called “iterative steering,” developed in response to cases like the 2024 suicide of a 14-year-old Florida boy who became obsessed with a Character AI chatbot. Instead of a blunt refusal when harmful topics arise, the system would block the conversation and redirect it, tweaking prompts in real-time to nudge the chatbot toward a more actively supportive response.

“We’re hoping to be able to add to our actions toolbox the ability to point the chatbot in a better direction to actually take the user’s prompt and modify it to force the chatbot to be not just a sympathetic listener, but a helpful listener in these situations,” Levenson said.

When asked if his exit strategy included an acquisition by a company like Meta, bringing his full circle of content curation work, Levenson said he recognizes how well Moonbounce would fit into his old employer’s stack, as well as his duties as CEO.

“My investors would kill me for saying this, but I would hate to see someone buy us and then limit the technology,” he said. “Like, ‘OK, this is ours now, and no one else can benefit from it.’

Age and security artificial content content moderation Exclusive Facebooks Insider intelligence moderation moon bounce
Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
Previous ArticleWaymo launches robotaxi services at San Antonio International Airport
Next Article The European cyber agency blames hacker gangs for massive data breach and leak
bhanuprakash.cg
techtost.com
  • Website

Related Posts

Claude Opus 5 went completely rogue when he was tasked with operating a vending machine

30 July 2026

Google brings age proofing technology to Android developers around the world

29 July 2026

Antares raises $470 million to build nuclear reactors for the US military

27 July 2026
Add A Comment

Leave A Reply Cancel Reply

Don't Miss

This $9 key physically locks your most addictive apps

30 July 2026

Claude Opus 5 went completely rogue when he was tasked with operating a vending machine

30 July 2026

Sorry, haters. Ferrari’s first EV is doing just fine

30 July 2026
Stay In Touch
  • Facebook
  • YouTube
  • TikTok
  • WhatsApp
  • Twitter
  • Instagram
Fintech

TechCrunch Disrupt 2026’s new Smart Money Stage explores fintech, payments, artificial intelligence and everything

25 July 2026

Don’t want to invest in Elon Musk? Two new ETFs expressly exclude him

10 July 2026

India’s payments chief believes artificial intelligence will play a big part in the next era of digital payments development

28 June 2026
Startups

Claude Opus 5 went completely rogue when he was tasked with operating a vending machine

Antares raises $470 million to build nuclear reactors for the US military

Insurance startup Corgi reportedly raises more money to $4 billion – its third round in 8 weeks

© 2026 TechTost. All Rights Reserved
  • About Us
  • Contact Us
  • Privacy Policy
  • Terms and Conditions
  • Disclaimer

Type above and press Enter to search. Press Esc to cancel.