*BSD News Article 60664


Return to BSD News archive

Path: euryale.cc.adfa.oz.au!newshost.anu.edu.au!harbinger.cc.monash.edu.au!news.mel.connect.com.au!munnari.OZ.AU!news.hawaii.edu!ames!usenet.kornet.nm.kr!usenet.hana.nm.kr!usenet.seri.re.kr!news.cais.net!zippy.cais.net!news.vni.net!cnordin
From: cnordin@hq.vni.net (Craig Nordin)
Newsgroups: comp.unix.bsd.bsdi.misc
Subject: Re: News Server Performance
Date: 4 Feb 1996 20:59:16 -0500
Organization: Virtual Networks
Lines: 101
Message-ID: <cnordin.823484840@news.vni.net>
References: <4f3kta$s0l@jaxnet.jaxnet.com>
NNTP-Posting-Host: hq.vni.net
X-Newsreader: NN version 6.5.0 #6 (NOV)





Add some more memory!

See that hash table for the history file?  

Every time an article comes in (about 2 per second on a full feed)
that hash table is searched.  If that table is up in memory, it goes
much faster.  

Adjust your expire "remember" time to correspond with your cutoff
time (is it -c or -C?) flag on your innd call.  Bring it down and
bring down the overall size of the history file.  Bring it down
too far and you lose articles that take a long time to wander over
to you.  Bring it down some and you make everything faster, expires
and "do i already have it?" searches.

Change your fsck call in the morning if it runs over your news.
Make it run before or after.

Protect your root drive more than anythign because everything will
wait on swapping.

Change your overview directory to be something on your least-used drive.

Change your history and history hash files to your least-used drive.

Don't get any more 4 gig drives. :)  Get 1 or 2.

If you are running over split drives you have to be using symlinks,
right?  If so, are you cleaning them up properly?

5000 groups should not be giving you problems with that kind of
hardware anyway.




krenaut@jax.jaxnet.com (Karl Renaut) writes:

>I need a little advice on my news server.  I would like to get a full
>news feed, but I am concerned if my machine can handle it.  Currently
>the expire process takes aproximately 12 hours to run, I currently on 
>receive about 5000 news groups (although I'm sure they account for a 
>large percent of news traffic thats out there, they are the standard 
>comp, news, rec, sci, talk, alt, soc, etc..).  Here is my machine 
>configuration:

>Intel P100 - 256k cache - 64mb main memory
>Buslogic 946c PCI scsi controller
>3c509b etherlink III
>system files /, /usr, /var   - 2gig seagate 8ms seek 5400rpm
>/var/news/spool              - 4gig barracuda
>/var/news/spool/alt          - 4gig barracuda
>/var/news/spool/alt/binaries - 4gig barracuda

>First, I noticed that I am using as much as 32meg of swap space, so 
>obviously, more memory should help.

>Second, I recently had to recover they news history file, so, I rebuilt 
>it from scratch... I noticed that the expire process ran twice as fast 
>while the history file was still small, so, I am thinking that the 
>history file processing is taking up as much, if not more time, than the 
>actual process that removes the news articles.

>Is more memory the only thing that is going to help me here?


>--
>-----------------------------------------------------------------
>Karl Renaut				Voice: 904-350-1969
>Southeast Network Services		Data:  904-292-4567
>P.O. Box 56946				email: krenaut@southeast.net
>Jacksonville, FL  32241                 http://jax.jaxnet.com
>Making Internet Affordable                / - \
>----------------------------------------m| o o |m----------------
>                                            U
-- 

                                                  http://www.vni.net/

cnordin@vni.net                Fly VNI:  Send E-Mail to  info@vni.net