Close Menu
TechTost
  • AI
  • Apps
  • Crypto
  • Fintech
  • Hardware
  • Media & Entertainment
  • Security
  • Startups
  • Transportation
  • Venture
  • Recommended Essentials
What's Hot

This is what some of the world’s largest malware banks look like stacked up as hard drives

Rep. Jeff Bezos steps down from Slate Auto board

Notion just turned its workspace into a hub for AI agents

Facebook X (Twitter) Instagram
  • About Us
  • Contact Us
  • Privacy Policy
  • Terms and Conditions
  • Disclaimer
Facebook X (Twitter) Instagram
TechTost
Subscribe Now
  • AI

    Notion just turned its workspace into a hub for AI agents

    14 May 2026

    The 6 stages at Disrupt 2026 — built for today’s toughest startup market

    13 May 2026

    Medicare’s new payment model is designed for artificial intelligence, and most of the tech world has no idea

    13 May 2026

    Dessn raises $6 million for production-focused design tool

    12 May 2026

    Riding on an AI rally, Robinhood is preparing its second retail IPO

    12 May 2026
  • Apps

    X launches a History tab for bookmarks, likes, videos and articles

    14 May 2026

    Amazon launches an AI shopping assistant for the search bar, powered by Alexa+

    13 May 2026

    Everything Google announced at its Android Expo, from Googlebooks to vibe-encoded widgets

    13 May 2026

    TikTok now wants to be the place where you book that trip you just saw on TikTok

    12 May 2026

    Discord Launches Nitro Rewards, Giving Subscribers Access to Xbox Game Pass Base Level at No Extra Cost

    11 May 2026
  • Crypto

    As crypto cools, a16z crypto raises $2.2 billion in capital

    6 May 2026

    Coinbase to lay off 14% of staff as part of broader restructuring

    5 May 2026

    British cryptographer Adam Back denies NYT report that he is Bitcoin creator Satoshi Nakamoto

    9 April 2026

    Hackers stole over $2.7 billion in crypto in 2025, data shows

    23 December 2025

    New report examines how David Sachs may benefit from Trump administration role

    1 December 2025
  • Fintech

    Venmo’s biggest makeover in years comes at a very interesting time

    11 May 2026

    Fintech startup Parker files for bankruptcy

    10 May 2026

    Robinhood’s venture fund IPO attracted 150,000+ private investors, CEO says

    7 May 2026

    PayPal says it’s “becoming a tech company again” — that’s AI

    6 May 2026

    Stripe introduces Link, a digital wallet that autonomous AI agents can also use

    1 May 2026
  • Hardware

    Google unveils Googlebook, a new line of laptops with native artificial intelligence

    13 May 2026

    The Instax Wide 400 takes the simplicity of instant photography and expands it, literally

    10 May 2026

    Google Unveils Fitbit Air Without Whoop-like Display

    8 May 2026

    Google’s $9.99 per month AI health plan launches on May 19

    8 May 2026

    Apple to pay $250 million to settle lawsuit over Siri’s lagging AI features

    7 May 2026
  • Media & Entertainment

    Digg is trying again, this time as an AI news aggregator

    12 May 2026

    Bravo creates unscripted mini-dramas for the Peacock app

    11 May 2026

    The hottest place for startups to strike a deal? The F1 mantra

    10 May 2026

    Netflix delays Greta Gerwig’s ‘Narnia’ for big theatrical push to 2027

    2 May 2026

    Roku’s $3 streaming service Howdy hits 1 million subscribers, per recent report

    29 April 2026
  • Security

    This is what some of the world’s largest malware banks look like stacked up as hard drives

    14 May 2026

    This is what some of the world’s largest malware banks look like stacked up as hard drives

    13 May 2026

    Exaforce Raises $125M Series B to Build AI to Catch and Stop Cyberattacks as They Happen

    13 May 2026

    Google launches new Android security feature to help uncover spyware attacks

    12 May 2026

    US healthcare marketplaces shared citizenship and race data with ad tech giants

    11 May 2026
  • Startups

    Anduril Raises $5B, Doubles Valuation To $61B

    13 May 2026

    Korea’s biggest manufacturers support Config, TSMC robot data

    11 May 2026

    China’s Moonshot AI Raises $2B in $20B Valuation as Demand for Open Source AI Soars

    10 May 2026

    Could Lovable’s automatic 10% pay rise be the cure for toxic cultures?

    9 May 2026

    Gusto hits $1 billion in revenue, moves closer to public markets

    9 May 2026
  • Transportation

    Rep. Jeff Bezos steps down from Slate Auto board

    14 May 2026

    ‘Too early’ to talk about IPO, says incoming CFO of Redwood Materials

    13 May 2026

    Potholes are costing cities millions: This company uses artificial intelligence and trucks to fix them

    13 May 2026

    Waymo issues recall to address a flooding issue

    12 May 2026

    GM just laid off hundreds of IT workers to hire people with stronger AI skills

    12 May 2026
  • Venture

    Anthropic warns investors against secondary platforms offering access to its shares

    13 May 2026

    Mother Ventures looks at moms as the ‘economic engine’

    9 May 2026

    2 days left: Get 50% off a second Disrupt 2026 pass

    7 May 2026

    All your M&A questions will be answered at Disrupt 2026

    6 May 2026

    ElevenLabs lists BlackRock, Jamie Foxx and Eva Longoria as new investors

    6 May 2026
  • Recommended Essentials
TechTost
You are at:Home»Startups»Facebook’s Insider Content Moderation for the Age of Artificial Intelligence
Startups

Facebook’s Insider Content Moderation for the Age of Artificial Intelligence

techtost.comBy techtost.com3 April 202605 Mins Read
Share Facebook Twitter Pinterest LinkedIn Tumblr Email
Facebook's Insider Content Moderation For The Age Of Artificial Intelligence
Share
Facebook Twitter LinkedIn Pinterest Email

When Brett Levenson left Apple in 2019 to lead business integrity at Facebook, the social media giant was on the receiving end of Cambridge Analytica. At the time, he thought he could just fix Facebook’s content control problem with better technology.

The problem, he quickly learned, ran deeper than technology. Researchers were expected to memorize a 40-page policy document that had been machine-translated into their language, he said. They then had about 30 seconds per piece of flagged content to decide not only if that content violated the rules, but also what to do about it: block it, ban the user, limit distribution. Those quick calls were only “slightly better than 50% accurate,” according to Levenson.

“It was kind of like flipping a coin, whether the human reviewers could actually get the policies right, and this was days after the bad had already happened,” Levenson told TechCrunch.

This kind of lagging, reactive approach is not sustainable in a world of nimble and well-funded adversaries. The rise of AI-powered chatbots has only exacerbated the problem, as content control failures have resulted in a number of high-profile incidents, such as chatbots providing teenagers with self-harm guidance or AI-generated images evading security filters.

Levenson’s frustration led to the idea of ​​”policy as code”—a way to turn static policy documents into executable, updateable logic closely tied to enforcement. That insight led to the founding of Moonbounce, which announced it had raised $12 million in funding on Friday, TechCrunch exclusively reported. The round was led by Amplify Partners and StepStone Group.

Moonbounce works with companies to provide an added layer of security where content is generated, whether by user or AI. The company has trained its own large language model to examine a client’s policy documents, evaluate content at runtime, provide a response in 300 milliseconds or less, and take action. Depending on the customer’s preference, this action could resemble Moonbounce’s system that slows down delivery while the content awaits human review later, or it could block high-risk content right now.

Today, Moonbounce serves three main industries: Platforms that deal with user-generated content, such as dating apps. AI companies that create characters or companions. and AI image generators.

Techcrunch event

San Francisco, California
|
13-15 October 2026

Moonbounce supports more than 40 million daily reviews and serves more than 100 million daily active users on the platform, Levenson said. Clients include startup Channel AI, image and video production company Civitai, and character role-playing platforms Dippy AI and Moescape.

“Security can actually be a product advantage,” Levenson told TechCrunch. “It just never was because it’s always something that happens later, not something you can actually build into your product. And we’re seeing our customers find really interesting and innovative ways to use our technology to make security a differentiator and part of their product story.”

Tinder’s Head of Trust and Safety recently explained how the dating platform uses these types of LLM services to achieve a 10x improvement in detection accuracy.

“Content moderation has always been a problem plaguing large online platforms, but now with LLMs at the heart of every application, this challenge is even more daunting,” said Lenny Pruss, general partner at Amplify Partners. “We invested in Moonbounce because we envision a world where real-time objective guardrails become the backbone of every AI-mediated application.”

AI companies are facing increasing legal and reputational pressure after chatbots are accused of pushing teenagers and vulnerable users. suicide and image generators such as xAI’s Grok have been used to create non-consensual nude pictures. Clearly, the guardrails internally fail and it becomes a liability issue. Levenson said AI companies are increasingly looking outside their own walls for help bolstering their security infrastructure.

“We’re a third party that sits between the user and the chatbot, so our system isn’t overwhelmed by context the way the conversation itself is,” Levenson said. “The chatbot itself has to remember potentially tens of thousands of tokens that have come in the past… We’re only concerned with enforcing rules at runtime.”

Levenson runs the 12-person company with former Apple colleague Ash Bhardwaj, who previously built large-scale cloud and AI infrastructure across the iPhone maker’s core offerings. Their next focus is a capability called “iterative steering,” developed in response to cases like the 2024 suicide of a 14-year-old Florida boy who became obsessed with a Character AI chatbot. Instead of a blunt refusal when harmful topics arise, the system would block the conversation and redirect it, tweaking prompts in real-time to nudge the chatbot toward a more actively supportive response.

“We’re hoping to be able to add to our actions toolbox the ability to point the chatbot in a better direction to actually take the user’s prompt and modify it to force the chatbot to be not just a sympathetic listener, but a helpful listener in these situations,” Levenson said.

When asked if his exit strategy included an acquisition by a company like Meta, bringing his full circle of content curation work, Levenson said he recognizes how well Moonbounce would fit into his old employer’s stack, as well as his duties as CEO.

“My investors would kill me for saying this, but I would hate to see someone buy us and then limit the technology,” he said. “Like, ‘OK, this is ours now, and no one else can benefit from it.’

Age and security artificial content content moderation Exclusive Facebooks Insider intelligence moderation moon bounce
Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
Previous ArticleWaymo launches robotaxi services at San Antonio International Airport
Next Article The European cyber agency blames hacker gangs for massive data breach and leak
bhanuprakash.cg
techtost.com
  • Website

Related Posts

Rep. Jeff Bezos steps down from Slate Auto board

14 May 2026

Anduril Raises $5B, Doubles Valuation To $61B

13 May 2026

Potholes are costing cities millions: This company uses artificial intelligence and trucks to fix them

13 May 2026
Add A Comment

Leave A Reply Cancel Reply

Don't Miss

This is what some of the world’s largest malware banks look like stacked up as hard drives

14 May 2026

Rep. Jeff Bezos steps down from Slate Auto board

14 May 2026

Notion just turned its workspace into a hub for AI agents

14 May 2026
Stay In Touch
  • Facebook
  • YouTube
  • TikTok
  • WhatsApp
  • Twitter
  • Instagram
Fintech

Venmo’s biggest makeover in years comes at a very interesting time

11 May 2026

Fintech startup Parker files for bankruptcy

10 May 2026

Robinhood’s venture fund IPO attracted 150,000+ private investors, CEO says

7 May 2026
Startups

Anduril Raises $5B, Doubles Valuation To $61B

Korea’s biggest manufacturers support Config, TSMC robot data

China’s Moonshot AI Raises $2B in $20B Valuation as Demand for Open Source AI Soars

© 2026 TechTost. All Rights Reserved
  • About Us
  • Contact Us
  • Privacy Policy
  • Terms and Conditions
  • Disclaimer

Type above and press Enter to search. Press Esc to cancel.