Return to BSD News archive
From: BORKI@zug.use.ch (Reto Burkhalter) Subject: Re: "webcrawler" for freebsd Message-ID: <xo2IyMD4F99agz5@borki.zug.use.ch> Date: Wed, 22 May 96 14:51:30 GMT Path: euryale.cc.adfa.oz.au!newshost.anu.edu.au!harbinger.cc.monash.edu.au!news.cs.su.oz.au!metro!metro!asstdc.scgt.oz.au!nsw.news.telstra.net!act.news.telstra.net!psgrain!newsfeed.internetmci.com!iol!tank.news.pipex.net!pipex!howland.reston.ans.net!surfnet.nl!swsbe6.switch.ch!scsing.switch.ch!dino.active.ch!hp.use.ch!turicum.use.ch!zug.use.ch Organization: Turicum Communications References: <4nsha6$rg_001@sc.intel.com> X-Gateway: ZCONNECT UE turicum.use.ch [PolyNet Amiga RFC/ZC V4.23 no. 599198gr45qW-017] X-Mailer: MicroDot 1.10 [REGISTERED 004f99] Newsgroups: comp.unix.bsd.freebsd.misc MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit Lines: 26 >> John Reece >> 21.05.1996 JR> In article <31910056.1E84@zugernet.ch>, JR> Cafe 5 <cafe5@zugernet.ch> wrote: JR> >Hy everyone JR> > JR> >I'm looking for a program that can search the web JR> >for me (in order to fill the proxy server). JR> JR> Why not let your users do it for you as JR> they browse through your proxy server? But my users are visitors of an Internet Cafe and I want to have all the links on our homepage in the proxy cache in order to satisfy our costumers (as far as it concerns to speed). The program should follow all my links and the links within these links about 3 or 4 steps further... Reto