Return to BSD News archive
#! rnews 3390 bsd Path: euryale.cc.adfa.oz.au!newshost.anu.edu.au!harbinger.cc.monash.edu.au!news.mira.net.au!news.mel.connect.com.au!munnari.OZ.AU!spool.mu.edu!howland.reston.ans.net!tank.news.pipex.net!pipex!oleane!jussieu.fr!math.ohio-state.edu!uwm.edu!news-res.gsl.net!news.gsl.net!EU.net!usenet2.news.uk.psi.net!uknet!usenet1.news.uk.psi.net!uknet!dispatch.news.demon.net!demon!mail2news.demon.co.uk!mauve.demon.co.uk From: Ian Stirling <root@mauve.demon.co.uk> Newsgroups: demon.ip.support,demon.tech.unix,comp.unix.bsd.freebsd.misc Subject: Re: Batch FTP and Web Pages Followup-To: demon.ip.support,demon.tech.unix,comp.unix.bsd.freebsd.misc Date: Fri, 28 Jun 1996 17:39:54 GMT Lines: 54 Message-ID: <199606281739.RAA05841@mauve.demon.co.uk> References: <31c2e7bd.14691630@news.demon.co.uk> <834878464snz@pair.com> <834921960snz@michaels.demon.co.uk> <835206024.5881.2@diltd.demon.co.uk> <slrn4sgtd6.ds.dom@myrddin.demon.co.uk> <835294223.22071.1@diltd.demon.co.uk> <slrn4sjj16.cs.dom@myrddin.demon.co.uk> <199606261821.SAA02204@mauve.demon.co.uk> <4qtcee$n1h@alfie.demon.co.uk> X-NNTP-Posting-Host: mauve.demon.co.uk X-Newsreader: TIN [version 1.2 PL2] X-Mail2News-Path: relay-4.mail.demon.net!post.demon.co.uk!mauve.demon.co.uk Nick Holloway (Nick.Holloway@alfie.demon.co.uk) wrote: : Ian Stirling <root@mauve.demon.co.uk> writes: : > A www-server that could do reget, or restart or whatever would : > be very usefull, can such a thing exist? : I haven't checked the HTTP protocol in detail, but I suspect that it : doesn't include an offset to continue fetching at. I was sure I saw this in a standard, I've been reading too many standards though, trying to deduce IEEE1284 (enhanced printer ports) from the IEEE1284.* draft addendum standards :) I'll check over the weekend if I remember. : I keep muttering that sites should make large downloads available by : ftp, as well as via http for this reason. A short shell script can : automatically use reget to continue fetching. Or if you want several files from the site, edit your .netrc file, so as to when ftp starts, use the command newer on all the files you want, it'll skip any you've got or are in the process of getting, this works very well, I had a remote site, working at 200 bytes/sec, that I wanted several meg from, running lots of ftp sessions together, not needing to watch the output, it easily saturated my 28k8 modem, letting me download all of them in a reasonable time. Clean up at the end, by running reget on all the files, to get the ends of any truncated files. Sample .netrc file, from when I first used this. nlist * |xargs -n 1 echo reget will prepare the repititious part. default login ftp password root@mauve.demon.co.uk macdef init hash bin cd /pub/ieee/1284.3 reget 1284MEM.ZIP reget 1284PROD.DOC reget 1284PROD.TXT reget 1284mem.zip : Of course, this is completely thwarted by Microsoft. Their NT ftp : server does support restarting at an offset (used by reget) but only if : the offset is 0. Sigh. : -- : `O O' | Home: Nick.Holloway@alfie.demon.co.uk : // ^ \\ | Work: Nick.Holloway@parallax.co.uk http://www.parallax.co.uk/~alfie/ -- Ian Stirling. | I have a web page, but it's only AKA Caeser, Bolonewbie. | accessible by local users :( | which sort of makes it less usefull :) Two fish in a tank: one says to the other, do you know how to drive this thing?