Customers
Use Cases
SFT
Rich Supervised Fine-Tuning
RLHF
Sophisticated Reinforcement Learning with Human Feedback
Human Evaluation
Custom Benchmarks
Latest Case Study
Read more
Other Use cases
Processed-Based Annotation
Audio RLHF
Multimodal SFT
STEM & Reasoning Post-Training
PhD Experts
Hundreds of Use Cases
Supervised Fine-Tuning
RLHF
Human Evaluation
Blog
About
Pricing
Team
Contact
Careers
Get Started
Get Started
Get Started

Surge AI Blog

Data that Speaks for Itself, Independence that Speaks Volumes

Featured

Data that Speaks for Itself, Independence that Speaks Volumes

Edwin Chen
Edwin Chen
AI

We rarely talk publicly about the work we do here at Surge AI. That’s by design. Our role is to help our clients build, train, and test the best AI models. Their amazing models do all the talking for us!

Read more

Recent 
articles

The latest in AI, language, and data labeling. Subscribe below!

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
DALL·E 3 and Midjourney Fail Astral Codex Ten's Image Generation Bet

DALL·E 3 and Midjourney Fail Astral Codex Ten's Image Generation Bet

Edwin Chen
Edwin Chen
AI
How Anthropic uses Surge AI’s RLHF platform to train their LLM Assistant on Human Feedback

How Anthropic uses Surge AI’s RLHF platform to train their LLM Assistant on Human Feedback

Andrew Mauboussin
Andrew Mauboussin
Large Language Models
How RLHF Shifts LLMs from Autocompletion to Conversational Understanding

How RLHF Shifts LLMs from Autocompletion to Conversational Understanding

Edwin Chen
Edwin Chen
AI
Introduction to Reinforcement Learning with Human Feedback

Introduction to Reinforcement Learning with Human Feedback

Edwin Chen
Edwin Chen
Large Language Models
2022 Blog Recap: Trends in AI, Language, & Data

2022 Blog Recap: Trends in AI, Language, & Data

Edwin Chen
Edwin Chen
AI
We Evaluated ChatGPT vs. Google on 500 Search Queries

We Evaluated ChatGPT vs. Google on 500 Search Queries

Edwin Chen
Edwin Chen
Large Language Models
AI Red Teams for Adversarial Training: How to Make ChatGPT and LLMs Adversarially Robust

AI Red Teams for Adversarial Training: How to Make ChatGPT and LLMs Adversarially Robust

Edwin Chen
Edwin Chen
Large Language Models
HellaSwag or HellaBad? 36% of this popular LLM benchmark contains errors

HellaSwag or HellaBad? 36% of this popular LLM benchmark contains errors

Edwin Chen
Edwin Chen
Large Language Models
How TikTok is Evolving the Next Generation of Search

How TikTok is Evolving the Next Generation of Search

Edwin Chen
Edwin Chen
Social Media
Evaluating Generative AI: Did Astral Codex Ten Win His Bet on AI Progress?

Evaluating Generative AI: Did Astral Codex Ten Win His Bet on AI Progress?

Edwin Chen
Edwin Chen
AI
Why Instagram is Losing Gen Z: We Asked 100 Users to Compare TikTok vs. Reels

Why Instagram is Losing Gen Z: We Asked 100 Users to Compare TikTok vs. Reels

Andrew Mauboussin
Andrew Mauboussin
Social Media
The $250K Inverse Scaling Prize and Human-AI Alignment

The $250K Inverse Scaling Prize and Human-AI Alignment

Edwin Chen
Edwin Chen
Large Language Models
Human Evaluation of Large Language Models: How Good is Hugging Face's BLOOM?

Human Evaluation of Large Language Models: How Good is Hugging Face's BLOOM?

Edwin Chen
Edwin Chen
Large Language Models
30% of Google's Emotions Dataset is Mislabeled

30% of Google's Emotions Dataset is Mislabeled

Edwin Chen
Edwin Chen
AI
Search Behind-the-Scenes: How Neeva Uses Human Evaluation to Measure Search Quality

Search Behind-the-Scenes: How Neeva Uses Human Evaluation to Measure Search Quality

Edwin Chen
Edwin Chen
Case Studies
AI Red Teams and Adversarial Data Labeling with Redwood Research

AI Red Teams and Adversarial Data Labeling with Redwood Research

Andrew Mauboussin
Andrew Mauboussin
Case Studies
Case Study: Content Moderation for a Leading Social Media Company

Case Study: Content Moderation for a Leading Social Media Company

Jefferson Lee
Jefferson Lee
Case Studies
Humans vs. Gary Marcus vs. Slate Star Codex: When is an AI failure actually a failure?

Humans vs. Gary Marcus vs. Slate Star Codex: When is an AI failure actually a failure?

Edwin Chen
Edwin Chen
AI
How Surge AI Built OpenAI's GSM8K Dataset of 8,500 Math Problems

How Surge AI Built OpenAI's GSM8K Dataset of 8,500 Math Problems

Edwin Chen
Edwin Chen
AI
10 Egregious Failures in Gmail Spam Detection

10 Egregious Failures in Gmail Spam Detection

Edwin Chen
Edwin Chen
Content Moderation
How to Pick the Best Data Labeling Platform

How to Pick the Best Data Labeling Platform

Scott Heiner
Scott Heiner
Product
We asked 100 humans to draw the DALL·E prompts

We asked 100 humans to draw the DALL·E prompts

Edwin Chen
Edwin Chen
AI
The average number of ads on a Google Search recipe? 8.7

The average number of ads on a Google Search recipe? 8.7

Bradley Webb
Bradley Webb
Engineering
Google Search is Falling Behind

Google Search is Falling Behind

Edwin Chen
Edwin Chen
Engineering
Building a No-Code Machine Learning Model by Chatting with GitHub Copilot

Building a No-Code Machine Learning Model by Chatting with GitHub Copilot

Andrew Mauboussin
Andrew Mauboussin
Engineering
Surge AI Achieves SOC 2 Compliance

Surge AI Achieves SOC 2 Compliance

Andrew Mauboussin
Andrew Mauboussin
Engineering
Moving Beyond Engagement: Optimizing Facebook's Algorithms for Human Values

Moving Beyond Engagement: Optimizing Facebook's Algorithms for Human Values

Andrew Mauboussin
Andrew Mauboussin
Social Media
Using Surge AI with a Hybrid Cloud Model

Using Surge AI with a Hybrid Cloud Model

Andrew Mauboussin
Andrew Mauboussin
Engineering
Holy $#!t: Are popular toxicity models simply profanity detectors?

Holy $#!t: Are popular toxicity models simply profanity detectors?

Edwin Chen
Edwin Chen
Content Moderation
Is Google Search Deteriorating? Measuring Google's Search Quality in 2022

Is Google Search Deteriorating? Measuring Google's Search Quality in 2022

Edwin Chen
Edwin Chen
Human Evaluation
Inter-Annotator Agreement: An Introduction to Krippendorff’s Alpha

Inter-Annotator Agreement: An Introduction to Krippendorff’s Alpha

Andrew Mauboussin
Andrew Mauboussin
Engineering
How Good is Your Chatbot? An Introduction to Perplexity in NLP

How Good is Your Chatbot? An Introduction to Perplexity in NLP

Engineering
Inter-Annotator Agreement: An Introduction to Cohen's Kappa Statistic

Inter-Annotator Agreement: An Introduction to Cohen's Kappa Statistic

Bradley Webb
Bradley Webb
Engineering
The Pitfalls of Inter-Rater Reliability in Data Labeling and Machine Learning

The Pitfalls of Inter-Rater Reliability in Data Labeling and Machine Learning

Scott Heiner
Scott Heiner
Engineering
A Visual Introduction to Language Models in NLP (Part 1: Intuition)

A Visual Introduction to Language Models in NLP (Part 1: Intuition)

Andrew Mauboussin
Andrew Mauboussin
Engineering
How Surge AI Helps NYU Study the Impact of Social Media

How Surge AI Helps NYU Study the Impact of Social Media

Bradley Webb
Bradley Webb
Case Studies
Manifold: Using Neural Embeddings to Explore the Shape of Your Data

Manifold: Using Neural Embeddings to Explore the Shape of Your Data

Jefferson Lee
Jefferson Lee
Product
Getting started with Surge AI's Python SDK

Getting started with Surge AI's Python SDK

Andrew Mauboussin
Andrew Mauboussin
Engineering
The AI Bottleneck: High-Quality, Human-Powered Data

The AI Bottleneck: High-Quality, Human-Powered Data

Edwin Chen
Edwin Chen
Product
|
Powering the world’s LLMs

Welcome to
the world's largest RLHF platform

Get Started
Get Started
Subscribe
The latest in AI, language, and RLHF
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Case Studies
Company
Developers
Platform
2025 © Surge AI. All Rights Reserved
Sitemap
/
Terms of Service
/
Privacy Policy
Go to top