Rsync'ing Project Gutenberg, a report

083 February 10, 2019 -- (tmsr)

From the logs:

mircea_popescu: incidentally, either spyked or lobbes what do you need to make a complete copy ? it IS going away, for one thing the initiator guy died and for the other thing, with their world-famous there's no way they'll stay online all that long.
a111: Logged on 2017-03-15 23:50 mircea_popescu: which incidentally - has been read TODAY by more people than read ALL of marcel proust's works since the making of

mircea_popescu: should prolly also salvage but that's going to be more work than a straight download & strip headers job.
asciilifeform: mircea_popescu: apparently gutenberg is rsync'able ( ) , tho i haven't tried
mircea_popescu: aha. not much work.

Thusly proceeding, I read the "Mirroring How-To" guide, which pointed me to a place called, which supposedly contains a full mirror of -- supposedly, because on a first attempt, one can easily notice that their ftp doesn't contain said item, or if it does, it's hidden so well that I could not find it.

However, further down the line in the mirroring wiki-guide, we are given the anchor to a list of mirrors. Similarly, I randomly selected a couple of links, finding that they either timed out or didn't contain the gutenberg mirror they purport to. Fortunately, the third choice,, worked, in that I could:

$ rsync -av --del rsync:// guten

and after three days or so of downloading, I have sitting somewhere circa 800GB of files that on a cursory glance seem to contain books and other assorted items, e.g. mp3 files and DVD images.

The mirror is currently resting on a private machine, but I will make it available in the following months, after some disk acquisition and swapping which will allow me to host it at house Mogosanu. Meanwhile, I expect that for now (and probably only in the very near future), the step above should be reproducible by other folks who wish to maintain their own mirror.