*BSD News Article 73633


Return to BSD News archive

Path: euryale.cc.adfa.oz.au!newshost.anu.edu.au!harbinger.cc.monash.edu.au!nntp.coast.net!zombie.ncsc.mil!news.mathworks.com!enews.sgi.com!fido.asd.sgi.com!neteng!lm
From: lm@neteng.engr.sgi.com (Larry McVoy)
Newsgroups: comp.os.linux.networking,comp.unix.bsd.netbsd.misc,comp.unix.bsd.freebsd.misc
Subject: Re: TCP latency
Followup-To: comp.os.linux.networking,comp.unix.bsd.netbsd.misc,comp.unix.bsd.freebsd.misc
Date: 13 Jul 1996 18:23:26 GMT
Organization: Silicon Graphics Inc., Mountain View, CA
Lines: 37
Message-ID: <4s8piu$f6p@fido.asd.sgi.com>
References: <4paedl$4bm@engnews2.Eng.Sun.COM> <31E106AF.41C67EA6@dyson.iquest.net> <4rvmtf$ven@linux.cs.Helsinki.FI> <31E3D9E2.41C67EA6@dyson.iquest.net> <4s5bl2$qpg@linux.cs.Helsinki.FI> <31E664EB.167EB0E7@inuxs.att.com> <4s67sk$oa9@fido.asd.sgi.com> <31E6B8AB.3E6C@indy.celebration.net> <4s7j2r$blf@fido.asd.sgi.com> <31E79738.1D1E@cet.co.jp>
Reply-To: lm@slovax.engr.sgi.com
NNTP-Posting-Host: neteng.engr.sgi.com
X-Newsreader: TIN [version 1.2 PL2]
Xref: euryale.cc.adfa.oz.au comp.os.linux.networking:45110 comp.unix.bsd.netbsd.misc:4027 comp.unix.bsd.freebsd.misc:23489

Michael Hancock (michaelh@cet.co.jp) wrote:
: You're in the benchmark business, you should be prepared to take a lot of 
: heat.  Next time you'll cover your a$$ and get past your biases and run 
: benchmarks on the *exact* hardware for everything.

No, I'm not in the benchmark business.  I'm in the OS business.  The fact 
that I happened to have a bunch of tools sitting around that people liked
was a side effect of doing my job.  It certainly isn't my job to write
benchmarks, it's my job to make things go fast.  The benchmarks exist
only to tell me if I've done a decent job or not.

I'm not very worried about covering my ass.  Last I checked, the usenet
was not paying my salary.  Let me know if you are offering, and I'll
be happy to do things to your exact specifications.

: I don't think you fudged your numbers, but I question your professional 
: integrity by running it on different hardware and displaying your obvious 
: bias in a presentation.  Go ahead take me to court.

I don't have any issue with the fact that I'm biased towards Linux,
simply because they are a pleasant and responsive crowd to work with.
And I could care less who knows that.

Where I get upset is when people suggest I cooked the numbers.  I actually
walked through all the results and carefully picked the ones that looked
like they were reproduceable and accurate.  I had a FreeBSD run that for
some reason had much worse numbers (I suspect they were doing something
else on that machine at the time) and I could have easily presented that
if I wanted to cook the numbers.  I didn't, and never would.

I should probably not even argue about this, you can go get the benchmark 
and reproduce the numbers yourself if you have any doubts.  I do take 
exception to people suggesting I fudged the numbers, so I'll ask you 
to produce data if you're going to go that route.  Or just shut up.
--
---
Larry McVoy     lm@sgi.com     http://reality.sgi.com/lm     (415) 933-1804