Close Menu
TechTost
  • AI
  • Apps
  • Crypto
  • Fintech
  • Hardware
  • Media & Entertainment
  • Security
  • Startups
  • Transportation
  • Venture
  • Recommended Essentials
What's Hot

Klue says hackers stole credentials from 2022 leading to customer data breaches

HaloBraid Raises $7M From Seven Seven Six To End Six-Hour Salon Appointment

Fika Jobs Raises $4M to Build Video-First Recruiting Platform Where AI Agents Interview Candidates

Facebook X (Twitter) Instagram
  • About Us
  • Contact Us
  • Privacy Policy
  • Terms and Conditions
  • Disclaimer
Facebook X (Twitter) Instagram
TechTost
Subscribe Now
  • AI

    Fika Jobs Raises $4M to Build Video-First Recruiting Platform Where AI Agents Interview Candidates

    23 June 2026

    Founder Summit success rates increase on June 26

    22 June 2026

    US says ASML’s top chip tool may be in China, but how?

    22 June 2026

    When the Trump administration hits Anthropic, who benefits?

    21 June 2026

    In the Weights is your new AI-centric vanity quest

    21 June 2026
  • Apps

    Ribbie turns real-time baseball stats into arcade-like, pixel-art shows

    23 June 2026

    Amazon is testing Alexa+ in India with Hindi support

    23 June 2026

    WhatsApp gets new head as Meta taps CRED India founder Kunal Shah, invests $900 million in startup

    22 June 2026

    Adobe adds AI assistant to Premiere, Illustrator and InDesign

    22 June 2026

    Beyond Siri: Here are the handy AI features coming to your iPhone in iOS 27

    21 June 2026
  • Crypto

    Startup Battlefield 200 applications close today

    27 May 2026

    5 days left: Save up to $410 on Disrupt 2026 passes

    25 May 2026

    As crypto cools, a16z crypto raises $2.2 billion in capital

    6 May 2026

    Coinbase to lay off 14% of staff as part of broader restructuring

    5 May 2026

    British cryptographer Adam Back denies NYT report that he is Bitcoin creator Satoshi Nakamoto

    9 April 2026
  • Fintech

    4 days left to save up to $190 on Founder Summit 2026

    23 June 2026

    Robinhood’s note on 10% layoffs shows that blaming AI doesn’t cut it

    17 June 2026

    Anthropic’s latest spat with the Trump administration may actually help it, sales figures suggest

    17 June 2026

    Ramp raises $750M at $44B valuation as investors thirst for fintechs with AI history

    5 June 2026

    Last 24 hours to save up to $410 on your Disrupt 2026 ticket

    29 May 2026
  • Hardware

    AI chipmaker Groq confirms $650m raise and staff shakeup after Nvidia’s $20bn rent-free deal

    23 June 2026

    Aura’s stunning e-ink frame doesn’t even look digital

    20 June 2026

    AI hurts Apple in more ways than one: It could force iPhone price hikes

    18 June 2026

    Snap is finally debuting its long-awaited AR glasses, the specs, and, ugh, they’re not cheap

    17 June 2026

    Qualcomm wants to be the chip in everything that replaces your smartphone, and it just announced two products to that end

    17 June 2026
  • Media & Entertainment

    Instagram looks set to take on streaming services with a longer, episodic and live format for its TV app

    22 June 2026

    Spotify’s reserved ticket sales to music superfans are now live

    18 June 2026

    Google is betting on Gemini to reinvent the smart home speaker

    18 June 2026

    Mastodon is looking for newsletters to help revive the open social web

    17 June 2026

    60 percent of US consumers say ‘artificial intelligence’ in brand messaging is a turnoff, survey finds

    16 June 2026
  • Security

    Klue says hackers stole credentials from 2022 leading to customer data breaches

    23 June 2026

    A new unpatched flaw in Apple’s chips opens the door to an iPhone jailbreak

    23 June 2026

    Tata Electronics, a major technology supplier to Apple and Tesla, confirms the data breach

    22 June 2026

    Cybercriminals reportedly hacked tens of thousands of Fortinet firewalls used by major companies around the world

    17 June 2026

    Apple is planning to change the Hide My Email privacy feature that could make it less effective

    17 June 2026
  • Startups

    HaloBraid Raises $7M From Seven Seven Six To End Six-Hour Salon Appointment

    23 June 2026

    Ethan Thornton tries to do everything at once

    22 June 2026

    Founders Fund’s extreme bet on humanely killed fish

    21 June 2026

    DeepL acquires Mixhalo for live audio streaming and translation

    20 June 2026

    It made the free video player work smoothly. Now he does this for robots.

    20 June 2026
  • Transportation

    Tesla brings back Autopilot narrative after fatal Texas crash

    23 June 2026

    Lucid Motors’ new CEO cuts 18% of staff to ‘simplify the company’

    22 June 2026

    TechCrunch Mobility: A new robotaxi scorecard shows China’s dominance

    21 June 2026

    Rivian owners file lawsuit alleging false promises about self-driving features

    19 June 2026

    Waymo recalls nearly 4,000 robotaxis to stop them from driving in highway construction zones

    18 June 2026
  • Venture

    Seedcamp Raises $320M for New Fund to Expand US Footprint

    22 June 2026

    The 11 startups that stood out from YC’s demo day, according to VCs

    19 June 2026

    Roelof Botha joins SpaceX board of directors

    18 June 2026

    Chi-Hua Chien saw Facebook coming – now he says the real AI winners won’t sell AI

    18 June 2026

    PayPal Ventures is shutting down as the company continues to restructure

    17 June 2026
  • Recommended Essentials
TechTost
You are at:Home»Startups»Facebook’s Insider Content Moderation for the Age of Artificial Intelligence
Startups

Facebook’s Insider Content Moderation for the Age of Artificial Intelligence

techtost.comBy techtost.com3 April 202605 Mins Read
Share Facebook Twitter Pinterest LinkedIn Tumblr Email
Facebook's Insider Content Moderation For The Age Of Artificial Intelligence
Share
Facebook Twitter LinkedIn Pinterest Email

When Brett Levenson left Apple in 2019 to lead business integrity at Facebook, the social media giant was on the receiving end of Cambridge Analytica. At the time, he thought he could just fix Facebook’s content control problem with better technology.

The problem, he quickly learned, ran deeper than technology. Researchers were expected to memorize a 40-page policy document that had been machine-translated into their language, he said. They then had about 30 seconds per piece of flagged content to decide not only if that content violated the rules, but also what to do about it: block it, ban the user, limit distribution. Those quick calls were only “slightly better than 50% accurate,” according to Levenson.

“It was kind of like flipping a coin, whether the human reviewers could actually get the policies right, and this was days after the bad had already happened,” Levenson told TechCrunch.

This kind of lagging, reactive approach is not sustainable in a world of nimble and well-funded adversaries. The rise of AI-powered chatbots has only exacerbated the problem, as content control failures have resulted in a number of high-profile incidents, such as chatbots providing teenagers with self-harm guidance or AI-generated images evading security filters.

Levenson’s frustration led to the idea of ​​”policy as code”—a way to turn static policy documents into executable, updateable logic closely tied to enforcement. That insight led to the founding of Moonbounce, which announced it had raised $12 million in funding on Friday, TechCrunch exclusively reported. The round was led by Amplify Partners and StepStone Group.

Moonbounce works with companies to provide an added layer of security where content is generated, whether by user or AI. The company has trained its own large language model to examine a client’s policy documents, evaluate content at runtime, provide a response in 300 milliseconds or less, and take action. Depending on the customer’s preference, this action could resemble Moonbounce’s system that slows down delivery while the content awaits human review later, or it could block high-risk content right now.

Today, Moonbounce serves three main industries: Platforms that deal with user-generated content, such as dating apps. AI companies that create characters or companions. and AI image generators.

Techcrunch event

San Francisco, California
|
13-15 October 2026

Moonbounce supports more than 40 million daily reviews and serves more than 100 million daily active users on the platform, Levenson said. Clients include startup Channel AI, image and video production company Civitai, and character role-playing platforms Dippy AI and Moescape.

“Security can actually be a product advantage,” Levenson told TechCrunch. “It just never was because it’s always something that happens later, not something you can actually build into your product. And we’re seeing our customers find really interesting and innovative ways to use our technology to make security a differentiator and part of their product story.”

Tinder’s Head of Trust and Safety recently explained how the dating platform uses these types of LLM services to achieve a 10x improvement in detection accuracy.

“Content moderation has always been a problem plaguing large online platforms, but now with LLMs at the heart of every application, this challenge is even more daunting,” said Lenny Pruss, general partner at Amplify Partners. “We invested in Moonbounce because we envision a world where real-time objective guardrails become the backbone of every AI-mediated application.”

AI companies are facing increasing legal and reputational pressure after chatbots are accused of pushing teenagers and vulnerable users. suicide and image generators such as xAI’s Grok have been used to create non-consensual nude pictures. Clearly, the guardrails internally fail and it becomes a liability issue. Levenson said AI companies are increasingly looking outside their own walls for help bolstering their security infrastructure.

“We’re a third party that sits between the user and the chatbot, so our system isn’t overwhelmed by context the way the conversation itself is,” Levenson said. “The chatbot itself has to remember potentially tens of thousands of tokens that have come in the past… We’re only concerned with enforcing rules at runtime.”

Levenson runs the 12-person company with former Apple colleague Ash Bhardwaj, who previously built large-scale cloud and AI infrastructure across the iPhone maker’s core offerings. Their next focus is a capability called “iterative steering,” developed in response to cases like the 2024 suicide of a 14-year-old Florida boy who became obsessed with a Character AI chatbot. Instead of a blunt refusal when harmful topics arise, the system would block the conversation and redirect it, tweaking prompts in real-time to nudge the chatbot toward a more actively supportive response.

“We’re hoping to be able to add to our actions toolbox the ability to point the chatbot in a better direction to actually take the user’s prompt and modify it to force the chatbot to be not just a sympathetic listener, but a helpful listener in these situations,” Levenson said.

When asked if his exit strategy included an acquisition by a company like Meta, bringing his full circle of content curation work, Levenson said he recognizes how well Moonbounce would fit into his old employer’s stack, as well as his duties as CEO.

“My investors would kill me for saying this, but I would hate to see someone buy us and then limit the technology,” he said. “Like, ‘OK, this is ours now, and no one else can benefit from it.’

Age and security artificial content content moderation Exclusive Facebooks Insider intelligence moderation moon bounce
Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
Previous ArticleWaymo launches robotaxi services at San Antonio International Airport
Next Article The European cyber agency blames hacker gangs for massive data breach and leak
bhanuprakash.cg
techtost.com
  • Website

Related Posts

HaloBraid Raises $7M From Seven Seven Six To End Six-Hour Salon Appointment

23 June 2026

Amazon is testing Alexa+ in India with Hindi support

23 June 2026

Ethan Thornton tries to do everything at once

22 June 2026
Add A Comment

Leave A Reply Cancel Reply

Don't Miss

Klue says hackers stole credentials from 2022 leading to customer data breaches

23 June 2026

HaloBraid Raises $7M From Seven Seven Six To End Six-Hour Salon Appointment

23 June 2026

Fika Jobs Raises $4M to Build Video-First Recruiting Platform Where AI Agents Interview Candidates

23 June 2026
Stay In Touch
  • Facebook
  • YouTube
  • TikTok
  • WhatsApp
  • Twitter
  • Instagram
Fintech

4 days left to save up to $190 on Founder Summit 2026

23 June 2026

Robinhood’s note on 10% layoffs shows that blaming AI doesn’t cut it

17 June 2026

Anthropic’s latest spat with the Trump administration may actually help it, sales figures suggest

17 June 2026
Startups

HaloBraid Raises $7M From Seven Seven Six To End Six-Hour Salon Appointment

Ethan Thornton tries to do everything at once

Founders Fund’s extreme bet on humanely killed fish

© 2026 TechTost. All Rights Reserved
  • About Us
  • Contact Us
  • Privacy Policy
  • Terms and Conditions
  • Disclaimer

Type above and press Enter to search. Press Esc to cancel.