Reddit posts will not be archived on Wayback Machine: Here's what it means

Reddit is restricting the Wayback Machine to archiving only its homepage, blocking access to posts, comments, and profiles to prevent AI firms from scraping data

Reddit
Aashish Kumar Shrivastava New Delhi
2 min read Last Updated : Aug 12 2025 | 4:07 PM IST
Reddit has reportedly begun blocking the Internet Archive’s Wayback Machine from indexing much of its content to prevent AI firms from harvesting user data. According to The Verge, this move restricts archival access to Reddit’s homepage only, removing the ability to crawl individual posts, comments, and user profiles — effectively limiting archival visibility to top trending content.

What’s changing

As reported by The Verge, Reddit spokesperson Tim Rathschmidt confirmed that this restriction is triggered by AI companies violating platform rules, using the archive to “scrape data from the Wayback Machine.”
 
The platform’s statement emphasises, “Until they’re able to defend their site and comply with platform policies (e.g., respecting user privacy, re: deleting removed content), we’re limiting some of their access to Reddit data to protect redditors.” These changes are now being implemented, with Reddit notifying the Internet Archive ahead of time to ensure a smoother transition.

Why it matters

According to The Verge, the Wayback Machine will now only archive Reddit’s homepage — meaning users, researchers, or journalists will lose access to historical snapshots of discussions, deleted posts, and individual profiles.
 
This significantly reduces the publicly available Reddit archive, potentially impacting investigative work, content verification, and online historical records.

Broader context

Reddit’s action follows a pattern of tightening control over its data. Previously, it monetised search and AI training access through partnerships with Google and OpenAI, redesigned its APIs to limit unauthorised use, and even sued other AI firms, like Anthropic, for continued scraping despite commitments to stop.
 
The Verge quoted Mark Graham, director of the Wayback Machine, as saying: “We have a longstanding relationship with Reddit and continue to have ongoing discussions about this matter.”
*Subscribe to Business Standard digital and get complimentary access to The New York Times

Smart Quarterly

₹900

3 Months

₹300/Month

SAVE 25%

Smart Essential

₹2,700

1 Year

₹225/Month

SAVE 46%
*Complimentary New York Times access for the 2nd year will be given after 12 months

Super Saver

₹3,900

2 Years

₹162/Month

Subscribe

Renews automatically, cancel anytime

Here’s what’s included in our digital subscription plans

Exclusive premium stories online

  • Over 30 premium stories daily, handpicked by our editors

Complimentary Access to The New York Times

  • News, Games, Cooking, Audio, Wirecutter & The Athletic

Business Standard Epaper

  • Digital replica of our daily newspaper — with options to read, save, and share

Curated Newsletters

  • Insights on markets, finance, politics, tech, and more delivered to your inbox

Market Analysis & Investment Insights

  • In-depth market analysis & insights with access to The Smart Investor

Archives

  • Repository of articles and publications dating back to 1997

Ad-free Reading

  • Uninterrupted reading experience with no advertisements

Seamless Access Across All Devices

  • Access Business Standard across devices — mobile, tablet, or PC, via web or app

More From This Section

Topics :Technology NewsRedditartifical intelligence

First Published: Aug 12 2025 | 4:07 PM IST

Next Story