Close Menu
TechTost
  • AI
  • Apps
  • Crypto
  • Fintech
  • Hardware
  • Media & Entertainment
  • Security
  • Startups
  • Transportation
  • Venture
  • Recommended Essentials
What's Hot

Trump’s pick to head the US cyber agency CISA is asking to step down

Redwood Materials loses COO amid layoffs, restructuring

Tesla’s Q1 revenue rises, driven by EV sales and FSD subscriptions

Facebook X (Twitter) Instagram
  • About Us
  • Contact Us
  • Privacy Policy
  • Terms and Conditions
  • Disclaimer
Facebook X (Twitter) Instagram
TechTost
Subscribe Now
  • AI

    Meet Noscroll, an AI bot that does the doomscroll for you

    24 April 2026

    Another customer of troubled startup Delve suffered a major security incident

    23 April 2026

    Tesla just increased its spending plan to $25 billion — this is where the money is going

    23 April 2026

    OpenAI partners with Infosys to bring AI tools to more businesses

    22 April 2026

    Unauthorized group gained access to Anthropic’s proprietary Mythos cyber tool, report claims

    22 April 2026
  • Apps

    These are the countries that are moving to ban social media for children

    24 April 2026

    WhatsApp adds prepaid phone recharges in India as payment usage continues to lag

    23 April 2026

    Keep up with X’s new AI-powered custom streams

    23 April 2026

    X makes it more expensive to publish links through its API

    22 April 2026

    Apple’s Cal AI crackdown signals it still controls the App Store

    22 April 2026
  • Crypto

    British cryptographer Adam Back denies NYT report that he is Bitcoin creator Satoshi Nakamoto

    9 April 2026

    Hackers stole over $2.7 billion in crypto in 2025, data shows

    23 December 2025

    New report examines how David Sachs may benefit from Trump administration role

    1 December 2025

    Why Benchmark Made a Rare Crypto Bet on Trading App Fomo, with $17M Series A

    6 November 2025

    Solana co-founder Anatoly Yakovenko is a big fan of agentic coding

    30 October 2025
  • Fintech

    Salmon raises $100 million in equity and debt to bring digital credit to unbanked Filipinos

    24 April 2026

    Cash App targets a new type of customer: children aged 6 to 12 years

    22 April 2026

    Revolut eyes up to $200 billion valuation in potential IPO

    22 April 2026

    Once close enough for a takeover, Stripe and Airwallex are now going after each other

    18 April 2026

    Airwallex is set to take on Stripe and the rest of the payments industry — in the physical world

    16 April 2026
  • Hardware

    Era raises $11 million to build a software platform for AI gadgets

    24 April 2026

    Apple’s John Ternus will run one of the most powerful companies in the world. work is a minefield

    22 April 2026

    Tim Cook steps down as Apple CEO: Here’s a look at his 15-year legacy, from new products and services to China expansion

    22 April 2026

    Who is John Ternus, the new CEO of Apple?

    21 April 2026

    Tim Cook steps down as Apple CEO, while John Ternus takes over

    21 April 2026
  • Media & Entertainment

    India’s app market is booming — but global platforms are raking in most of the profits

    23 April 2026

    YouTube extends its AI similarity detection technology to celebrities

    21 April 2026

    Deezer says 44% of songs uploaded to its platform every day are created with artificial intelligence

    20 April 2026

    Netflix plans to add a vertical video stream, use AI for recommendations

    17 April 2026

    Netflix co-founder and chairman Reed Hastings is stepping down from the board

    17 April 2026
  • Security

    Trump’s pick to head the US cyber agency CISA is asking to step down

    24 April 2026

    Vercel says some of its customer data was stolen before the recent hack

    23 April 2026

    Cosmetics giant Rituals confirms data breach of customer membership records

    23 April 2026

    Apple fixes bug used by police to extract deleted chat messages from iPhones

    22 April 2026

    As US spy laws expire, lawmakers divided over protecting Americans from warrantless surveillance

    22 April 2026
  • Startups

    Redwood Materials loses COO amid layoffs, restructuring

    24 April 2026

    Beehiiv introduces new creator tools, including webinars and customizable payments

    23 April 2026

    How SpaceX prompted a $2 billion fundraising with a $60 billion takeover offer

    23 April 2026

    Cathie Woods’ ARK makes first major investment in startup Lucra — and it’s not AI

    22 April 2026

    AI research lab NeoCognition offers $40 million to build agents that learn like humans

    22 April 2026
  • Transportation

    Tesla’s Q1 revenue rises, driven by EV sales and FSD subscriptions

    24 April 2026

    Tesla withdraws Musk’s $29 billion ‘interim’ award after Delaware court restores bigger pay package

    23 April 2026

    Elon Musk Admits Millions of Tesla Owners Need Upgrades for True ‘Full Self-Driving’

    23 April 2026

    Redwood Materials lays off 10% in restructuring to pursue energy storage business

    22 April 2026

    Amazon taps Sweden’s Einride for its electric big rigs

    21 April 2026
  • Venture

    The first StrictlyVC of 2026 starts in one week in San Francisco

    23 April 2026

    Esther and Anne Wojcicki support new healthcare accelerator, fund

    23 April 2026

    Anthropic rejects VC funding that values ​​it at $800B+, for now

    16 April 2026

    Financial risk management platform Pillar raises $20 million in rounds led by a16z

    15 April 2026

    Vercel CEO Guillermo Rauch signals IPO readiness as AI agents drive revenue

    14 April 2026
  • Recommended Essentials
TechTost
You are at:Home»Startups»Facebook’s Insider Content Moderation for the Age of Artificial Intelligence
Startups

Facebook’s Insider Content Moderation for the Age of Artificial Intelligence

techtost.comBy techtost.com3 April 202605 Mins Read
Share Facebook Twitter Pinterest LinkedIn Tumblr Email
Facebook's Insider Content Moderation For The Age Of Artificial Intelligence
Share
Facebook Twitter LinkedIn Pinterest Email

When Brett Levenson left Apple in 2019 to lead business integrity at Facebook, the social media giant was on the receiving end of Cambridge Analytica. At the time, he thought he could just fix Facebook’s content control problem with better technology.

The problem, he quickly learned, ran deeper than technology. Researchers were expected to memorize a 40-page policy document that had been machine-translated into their language, he said. They then had about 30 seconds per piece of flagged content to decide not only if that content violated the rules, but also what to do about it: block it, ban the user, limit distribution. Those quick calls were only “slightly better than 50% accurate,” according to Levenson.

“It was kind of like flipping a coin, whether the human reviewers could actually get the policies right, and this was days after the bad had already happened,” Levenson told TechCrunch.

This kind of lagging, reactive approach is not sustainable in a world of nimble and well-funded adversaries. The rise of AI-powered chatbots has only exacerbated the problem, as content control failures have resulted in a number of high-profile incidents, such as chatbots providing teenagers with self-harm guidance or AI-generated images evading security filters.

Levenson’s frustration led to the idea of ​​”policy as code”—a way to turn static policy documents into executable, updateable logic closely tied to enforcement. That insight led to the founding of Moonbounce, which announced it had raised $12 million in funding on Friday, TechCrunch exclusively reported. The round was led by Amplify Partners and StepStone Group.

Moonbounce works with companies to provide an added layer of security where content is generated, whether by user or AI. The company has trained its own large language model to examine a client’s policy documents, evaluate content at runtime, provide a response in 300 milliseconds or less, and take action. Depending on the customer’s preference, this action could resemble Moonbounce’s system that slows down delivery while the content awaits human review later, or it could block high-risk content right now.

Today, Moonbounce serves three main industries: Platforms that deal with user-generated content, such as dating apps. AI companies that create characters or companions. and AI image generators.

Techcrunch event

San Francisco, California
|
13-15 October 2026

Moonbounce supports more than 40 million daily reviews and serves more than 100 million daily active users on the platform, Levenson said. Clients include startup Channel AI, image and video production company Civitai, and character role-playing platforms Dippy AI and Moescape.

“Security can actually be a product advantage,” Levenson told TechCrunch. “It just never was because it’s always something that happens later, not something you can actually build into your product. And we’re seeing our customers find really interesting and innovative ways to use our technology to make security a differentiator and part of their product story.”

Tinder’s Head of Trust and Safety recently explained how the dating platform uses these types of LLM services to achieve a 10x improvement in detection accuracy.

“Content moderation has always been a problem plaguing large online platforms, but now with LLMs at the heart of every application, this challenge is even more daunting,” said Lenny Pruss, general partner at Amplify Partners. “We invested in Moonbounce because we envision a world where real-time objective guardrails become the backbone of every AI-mediated application.”

AI companies are facing increasing legal and reputational pressure after chatbots are accused of pushing teenagers and vulnerable users. suicide and image generators such as xAI’s Grok have been used to create non-consensual nude pictures. Clearly, the guardrails internally fail and it becomes a liability issue. Levenson said AI companies are increasingly looking outside their own walls for help bolstering their security infrastructure.

“We’re a third party that sits between the user and the chatbot, so our system isn’t overwhelmed by context the way the conversation itself is,” Levenson said. “The chatbot itself has to remember potentially tens of thousands of tokens that have come in the past… We’re only concerned with enforcing rules at runtime.”

Levenson runs the 12-person company with former Apple colleague Ash Bhardwaj, who previously built large-scale cloud and AI infrastructure across the iPhone maker’s core offerings. Their next focus is a capability called “iterative steering,” developed in response to cases like the 2024 suicide of a 14-year-old Florida boy who became obsessed with a Character AI chatbot. Instead of a blunt refusal when harmful topics arise, the system would block the conversation and redirect it, tweaking prompts in real-time to nudge the chatbot toward a more actively supportive response.

“We’re hoping to be able to add to our actions toolbox the ability to point the chatbot in a better direction to actually take the user’s prompt and modify it to force the chatbot to be not just a sympathetic listener, but a helpful listener in these situations,” Levenson said.

When asked if his exit strategy included an acquisition by a company like Meta, bringing his full circle of content curation work, Levenson said he recognizes how well Moonbounce would fit into his old employer’s stack, as well as his duties as CEO.

“My investors would kill me for saying this, but I would hate to see someone buy us and then limit the technology,” he said. “Like, ‘OK, this is ours now, and no one else can benefit from it.’

Age and security artificial content content moderation Exclusive Facebooks Insider intelligence moderation moon bounce
Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
Previous ArticleWaymo launches robotaxi services at San Antonio International Airport
Next Article The European cyber agency blames hacker gangs for massive data breach and leak
bhanuprakash.cg
techtost.com
  • Website

Related Posts

Redwood Materials loses COO amid layoffs, restructuring

24 April 2026

Beehiiv introduces new creator tools, including webinars and customizable payments

23 April 2026

How SpaceX prompted a $2 billion fundraising with a $60 billion takeover offer

23 April 2026
Add A Comment

Leave A Reply Cancel Reply

Don't Miss

Trump’s pick to head the US cyber agency CISA is asking to step down

24 April 2026

Redwood Materials loses COO amid layoffs, restructuring

24 April 2026

Tesla’s Q1 revenue rises, driven by EV sales and FSD subscriptions

24 April 2026
Stay In Touch
  • Facebook
  • YouTube
  • TikTok
  • WhatsApp
  • Twitter
  • Instagram
Fintech

Salmon raises $100 million in equity and debt to bring digital credit to unbanked Filipinos

24 April 2026

Cash App targets a new type of customer: children aged 6 to 12 years

22 April 2026

Revolut eyes up to $200 billion valuation in potential IPO

22 April 2026
Startups

Redwood Materials loses COO amid layoffs, restructuring

Beehiiv introduces new creator tools, including webinars and customizable payments

How SpaceX prompted a $2 billion fundraising with a $60 billion takeover offer

© 2026 TechTost. All Rights Reserved
  • About Us
  • Contact Us
  • Privacy Policy
  • Terms and Conditions
  • Disclaimer

Type above and press Enter to search. Press Esc to cancel.