Wayback Machine mirrors and mirroring

General project discussion.
Use this as a last resort if your topic does not fit in any of the other boards but it still on-topic.
Forum rules
This General Discussion board is meant for topics that are still relevant to Pale Moon, web browsers, browser tech, UXP applications, and related, but don't have a more fitting board available.

Please stick to the relevance of this forum here, which focuses on everything around the Pale Moon project and its user community. "Random" subjects don't belong here, and should be posted in the Off-Topic board.
User avatar
Mæstro
Keeps coming back
Keeps coming back
Posts: 825
Joined: 2019-08-13, 00:30
Location: Casumia

Wayback Machine mirrors and mirroring

Post by Mæstro » 2025-11-05, 19:53

I became interested tonight in whether there exist mirrors of the Wayback Machine, or ways for private lay users to mirror the contents of a specific website. The best information I have thus far found on each point thus far are that there exists (or existed) an Egyptian mirror comprising all data down to 2007, which is said to have failed in 2023 (both through that interface and OpenWayback, and a Github project which is both too technical for me to use and which can only preserve a site from a single data, whereas my intent is to browse a mirror including all content for a specific site from my childhood for the whole period up to 2008 or so. Could somebody point me in the right direction, whether that means getting the Egyptian site to work or using another existing Wayback mirror, or else downloading the desired site contents myself? To be clear, there is nothing wrong with the Internet Archive as is. Rather, I am wary about the possibility of overzealous copyright claims leading to existing matter being deleted despite qualifying as fair dealing.
Life is a fever dream Mæstro would enjoy.
How is your computer at 96°C and not on fire?
All posts 100% organic. Ash is the best letter.
What is being nice online?
Debian 10 ELTS / Official PM build

User avatar
frostknight
Keeps coming back
Keeps coming back
Posts: 845
Joined: 2022-08-10, 02:25

Re: Wayback Machine mirrors and mirroring

Post by frostknight » 2025-11-06, 19:05

Mæstro wrote:
2025-11-05, 19:53
I became interested tonight in whether there exist mirrors of the Wayback Machine, or ways for private lay users to mirror the contents of a specific website. The best information I have thus far found on each point thus far are that there exists (or existed) an Egyptian mirror comprising all data down to 2007, which is said to have failed in 2023 (both through that interface and OpenWayback, and a Github project which is both too technical for me to use and which can only preserve a site from a single data, whereas my intent is to browse a mirror including all content for a specific site from my childhood for the whole period up to 2008 or so. Could somebody point me in the right direction, whether that means getting the Egyptian site to work or using another existing Wayback mirror, or else downloading the desired site contents myself? To be clear, there is nothing wrong with the Internet Archive as is. Rather, I am wary about the possibility of overzealous copyright claims leading to existing matter being deleted despite qualifying as fair dealing.
Problem is, even if you are doing parody, the big media has the advantage of sending bogus cease and desist letters because most people cannot pay for a lawyer to challenge their bs.

I so hate corporations for doing this crap but its sadly how things are now.

There really needs to be country wide anti-slapp laws and only lawyer fees for the loser type thinking and laws in usa.

As of now? The situation is pure bs.
Freedom is never more than one generation away from extinction. Feelings are not facts
If you wish to be humbled, try to exalt yourself long term If you wish to be exalted, try to humble yourself long term
Favourite operating systems: Hyperbola Devuan OpenBSD
Say NO to Fascism and Corporatism as much as possible!
Also, Peace Be With us All!

User avatar
andyprough
Board Warrior
Board Warrior
Posts: 1249
Joined: 2020-05-31, 04:33

Re: Wayback Machine mirrors and mirroring

Post by andyprough » 2025-11-07, 14:51

I would just use the ScrapBook X extension and download the whole site for all those years from wayback to a local copy. Then you'd have it for long-term keeping, and wouldn't have to rely on some mirror service to stay in existence.

I know that people on this forum tend to downplay the benefits of scrapbooking, but I did it for a few years as part of my work and its pretty remarkable the power that you find you have once you get into serious web scrapbooking.

User avatar
Mæstro
Keeps coming back
Keeps coming back
Posts: 825
Joined: 2019-08-13, 00:30
Location: Casumia

Re: Wayback Machine mirrors and mirroring

Post by Mæstro » 2025-11-07, 17:09

andyprough wrote:
2025-11-07, 14:51
I would just use the ScrapBook X extension and download the whole site for all those years from wayback to a local copy. Then you'd have it for long-term keeping, and wouldn't have to rely on some mirror service to stay in existence. I know that people on this forum tend to downplay the benefits of scrapbooking, but I did it for a few years as part of my work and its pretty remarkable the power that you find you have once you get into serious web scrapbooking.
Thank you so very much for this! I am amazed. Scrapbook X is far more powerful than I supposed before installing it, and is, without exaggeration, the browser capability I dreamt about having as a child with an unreliable internet connexion (and even, for 2009–10, no internet at all) and who always disliked it when a site revamped itself. Changing a few settings (eg link depth and scripting) allowed me to supply some assets and page behaviour which failed with default settings on my test page. This board does not permit me to mark an answer as accepted, but I accept your answer. :thumbup:
Life is a fever dream Mæstro would enjoy.
How is your computer at 96°C and not on fire?
All posts 100% organic. Ash is the best letter.
What is being nice online?
Debian 10 ELTS / Official PM build

User avatar
Kerebron
Fanatic
Fanatic
Posts: 128
Joined: 2016-12-04, 22:01

Re: Wayback Machine mirrors and mirroring

Post by Kerebron » 2025-11-07, 19:47

If you want to use a standalone program, there's an old (2017) HTTrack website copier still available for download. I don't know how it would work with modern webs(h)ites, as I haven't been using it for a while now (five years, at least). Should be fine, I suppose.
Now, here, you see, it takes all the running you can do, to keep in the same place. If you want to get somewhere else, you must run at least twice as fast as that!

User avatar
andyprough
Board Warrior
Board Warrior
Posts: 1249
Joined: 2020-05-31, 04:33

Re: Wayback Machine mirrors and mirroring

Post by andyprough » 2025-11-07, 20:26

Mæstro wrote:
2025-11-07, 17:09
Scrapbook X is far more powerful than I supposed before installing it, and is, without exaggeration, the browser capability I dreamt about having as a child with an unreliable internet connexion (and even, for 2009–10, no internet at all) and who always disliked it when a site revamped itself.
I used to spend a lot of time camping in the woods, far from any phone or wifi connection. I found that I could scrapbook all the sites I would be likely to need, to a certain link depth, and I could then access them while camping to write documents for work. When I was ready to email the documents I would drive to a local restaurant and jump on their wifi, maybe scrapbook a few more sites I found I still needed, and then disconnect again and go back into the woods. It's a marvelous way to live, I'd like to do that again now.