Reddit will block the Internet Archive
-
OK, I stopped posting on Reddit but left my account and comments in place because I considered them part of the public record. If Reddit is taking that record private, it’s time for me to start removing my content from the platform.
Does anyone know if historical Reddit content will remain in IA? If not, I’m going to have to back up years of content somewhere else.
I'm assuming IA will continue to host their historical archives of Reddit, they'll just not have any new captures after this. Unless IA has said otherwise, it'd be very strange to wipe their archive of Reddit
-
This post did not contain any content.
I already gave up from Reddit long time ago. Deleted all
-
lol i think that might be the worst/best thing I have seen in a long time
Unrelated but is your username a play on benzene?
-
This post did not contain any content.
The company says that AI companies have scraped data from the Wayback Machine, so it’s going to limit what the Wayback Machine can access.
Yeah, wouldn't want those AI companies to get all that data for free. Gotta make 'em pay for it.
-
This post did not contain any content.
As somebody who often ends up using Reddit like Stackoverflow and in some cases needing the Internet Archive (IA) to find the original post after it’s been deleted or garbled, I think this is a wakeup call for those go to Reddit both to get technical help and to post it. More than ever, Reddit is becoming an unreliable place to find answers for old obscure issues and if they are going to lockout places like the IA then I think it’s time people stopped contributing their solutions to Reddit.
-
They do archive sites against the owners wishes when they consider it an important site for public archiving, like some news sites. They are in no obligation to delete the archives and hope they don’t.
Parties have archived the data from pushshift, which cover a lot of Reddit history.
kagis
Subreddit comments/submissions 2005-06 to 2024-12
This is the top 40,000 subreddits from reddit s history in separate files. You can use your torrent client to only download the subreddit s you re interested in. These are from the pushshift dumps from 2005-06 to 2024-12 which can be found here These are zstandard compressed ndjson files. Example python scripts for parsing the data can be found here If you have questions, please reply to this reddit post or DM u/Watchful on reddit or respond to this post , Info Hash: 1614740ac8c94505e4ecb9d88be8bed7b6afddd4
Academic Torrents (academictorrents.com)
Subreddit comments/submissions 2005-06 to 2024-12
This is the top 40,000 subreddits from reddit's history in separate files. You can use your torrent client to only download the subreddit's you're interested in.
I mean, that won't have the past half year or some low-traffic subreddits, but...
-
Unrelated but is your username a play on benzene?
yes, in a way. this benzene ring
there was a band called Hum and in one of my favorite songs of theirs called The Scientists, the song talks about a couple who are scientists and creating and experimenting with drugs.
she tells him to keep this benzene ring around your finger, and think of me when everything you ever wanted is about to end
i fucking love that song but that moment in the song is just peak layers upon layers of music and poetry and love and adventure.
-
yes, in a way. this benzene ring
there was a band called Hum and in one of my favorite songs of theirs called The Scientists, the song talks about a couple who are scientists and creating and experimenting with drugs.
she tells him to keep this benzene ring around your finger, and think of me when everything you ever wanted is about to end
i fucking love that song but that moment in the song is just peak layers upon layers of music and poetry and love and adventure.
there was a band called Hum
Wow, what a memory trip! I listened to that song, I don't think I have heard it before, but it is great! I'm pretty sure I heard a different song from them at the time, but they probably live in my mind from looking at BMG and CD warehouse catalogs at the time. Other artists have popped up over the years from there.
I'm glad I asked, and thanks for answering! Somehow that took me back to my Candlebox days.
-
I already gave up from Reddit long time ago. Deleted all
Yup, same here.
-
YouTube's already throttling users in their mobile site. They have these massive channel cards in their feeds and the video titles/thumbnails disappear after a few offerings, leaving you with the ability to blindly click on a video.
I've declared my YT channel to be dormant starting on the 13th due to this AI age-gating crap.
-
It is my understanding that if you block the wayback machine from indexing your site it will also delist the history as well.
The ability to block crawling is separate from the ability to delist old pages. The latter usually happens after domains change owners
-
there was a band called Hum
Wow, what a memory trip! I listened to that song, I don't think I have heard it before, but it is great! I'm pretty sure I heard a different song from them at the time, but they probably live in my mind from looking at BMG and CD warehouse catalogs at the time. Other artists have popped up over the years from there.
I'm glad I asked, and thanks for answering! Somehow that took me back to my Candlebox days.
their big hit was called Stars
oh yeah, I listened to Candelbox. They didn't put on a good live show sadly
-
their big hit was called Stars
oh yeah, I listened to Candelbox. They didn't put on a good live show sadly
Ya that was the one , i listened to it, also. The very beginning sounded very familiar but I'm not sure about the rest. But maybe it's been 30 years and, well
️ I never saw Candlebox live, guess I didn't miss out. I really liked Alice in Chains but only got to see Cantrell tour while "waiting"
-
Ya that was the one , i listened to it, also. The very beginning sounded very familiar but I'm not sure about the rest. But maybe it's been 30 years and, well
️ I never saw Candlebox live, guess I didn't miss out. I really liked Alice in Chains but only got to see Cantrell tour while "waiting"
I never got to see AiC either
-
I never got to see AiC either
Ya 🫤 Jerry is still touring (I think). He was good live then, but the last time I saw him was like a month or two after Layne's death. It's been awhile. He's older, but so am I, and presumably you
His solo stuff was great. We ended up getting a lot of AiC stiff at that '02 show. Very solid performance. Not really related, but I've heard the Sublime stuff is good, but I wasn't ever that into them, just have a friend who has stuck with it.
-
Ya 🫤 Jerry is still touring (I think). He was good live then, but the last time I saw him was like a month or two after Layne's death. It's been awhile. He's older, but so am I, and presumably you
His solo stuff was great. We ended up getting a lot of AiC stiff at that '02 show. Very solid performance. Not really related, but I've heard the Sublime stuff is good, but I wasn't ever that into them, just have a friend who has stuck with it.
I saw the Long Beach Dub Allstars and they played a couple Sublime songs. Fucking heroin.... fucking opioids. Ruined so many lives.
-
Damn, guess if you want reddit data to train your AI that you’ll need to pay Spez for access.
It's important for people writing papers and such who need to cite material.
I wonder if there's some way to use the TLS certificate to get a cryptographically-signed copy of a webpage with timestamp that someone could later validate as having been downloaded on that date. I don't know if existing TLS libraries are capable of that. Like, Web browser menu option "Store cryptographically-signed webpage". Absent a later certificate compromise, I'd think that that'd at least provide people a way to credibly say "this is really what was on that webpage on August 15th, 2026". Like, you'd have to save a copy of the TLS session and then have libraries that could read and validate an already-generated session. The timestamp is already embedded in the session.
Some protocols, like OTR, are designed to specifically not allow that, but AFAIK, TLS could.
EDIT: Well, technically the timestamp is gonna be during the handshake, not tied to the HTTP request internal to the TLS session. It might be possible to game that by establishing a TLS session, holding it open without activity, and issuing a request much later. I'd think that that'd potentially be disallowed by Web servers one way or another, since otherwise you could probably do a denial-of-service attack by holding open a lot of sessions for a long time.
EDIT2: Oh, wait, no, shouldn't be an issue, because the HTTP Date response header is gonna have a timestamp tied to the response.
-
Just more vindication for my ditching that trash heap of a platform. YT is probably going to be the next platform I ditch as they're going full Reddit now.
It's a matter of time before third-party YT front-ends start getting throttled or outright blocked like third-party Reddit front-ends.
Time to use peertube
-
As somebody who often ends up using Reddit like Stackoverflow and in some cases needing the Internet Archive (IA) to find the original post after it’s been deleted or garbled, I think this is a wakeup call for those go to Reddit both to get technical help and to post it. More than ever, Reddit is becoming an unreliable place to find answers for old obscure issues and if they are going to lockout places like the IA then I think it’s time people stopped contributing their solutions to Reddit.
Searching anywhere in general is getting shittier and shittier by day. Web searches are riddled with hallucinated AI generated garbage pages. Finding the right answer for difficult problems is getting worse and worse. We are sliding rapidly into Idiocracy.
-
OK, I stopped posting on Reddit but left my account and comments in place because I considered them part of the public record. If Reddit is taking that record private, it’s time for me to start removing my content from the platform.
Does anyone know if historical Reddit content will remain in IA? If not, I’m going to have to back up years of content somewhere else.
You can't remove it. It's there forever.