• We’re currently investigating an issue related to the forum theme and styling that is impacting page layout and visual formatting. The problem has been identified, and we are actively working on a resolution. There is no impact to user data or functionality, this is strictly a front-end display issue. We’ll post an update once the fix has been deployed. Thanks for your patience while we get this sorted.

The proposed Hub & switch test testing plan

ScottMac

Moderator<br>Networking<br>Elite member
Alrighty. For anyone interested and those that have been following the Hub/switch thread, the following are the tests we are looking to do:

As much as possible, the testing will be performed using a typical consumer-grade eight-port switch, and a typical consumer-grade eight-port hub. Both will be recent models of popular brands. There's a minor problem, and, if y'all will accept the work-around, we'll do it. Noone I know has a consumer-grade 100Meg HUB. We have a couple commercial-grade 100MEG-only hubs in the Lab...so if you want to see 100meg hub against 100meg switch, the 100Meg hub will be either a 3COM or Intel commercial-grade hub. Otherwise, to keep things &quot;apples-to-apples,&quot; the testing will have to be in the 10Meg relm.

Think about it and let me know by Friday (the proposed test day, still looking good).

The test (Smartbits):

One stream in, one stream out
Two streams in, two streams out
Four streams in, four streams out

Two streams in, one stream out
Four streams in, one stream out
Seven streams in, one stream out (<--wanna do this?)

The basic test suite from NetIQ has testing for throughput, latency, and packet drop. Throughput and latency will run for 10 seconds per iteration, using five packet sizes (64, 256, 512, 1024, and 1500 bytes). The packet-drop test will run for two minutes, using the same packets sizes.

Chariot

Four WINTEL 866MHz PCs plus one server will be attached to the device-under-test (DUT). Each PC will be an endpoint, the server will be an endpoint. Each PC will have one or more emulated streams simulating a large file transfer (and possibly a web session, email, or streaming video) to the server. In addition, each pair of PC Endpoints will run a concurrent stream emulating a print session, file transfer, or game stream. The number of actual sessions and the type of emulated stream will be adjusted to induce a moderate load on the DUT (or, you tell me, wanna crush it? Take it light?).

Before the test, all jumpers are scanned with a WaveTek cable scanner to ensure Category 5 compliance. The PCs will all have 10/100 NICs (Intel Pro 100s), the server will also have an Intel Pro100 NIC. Each PC has 512Meg of RAM. The Dual-Xeon 933 server has 1 GB of RAM. The Endpoint software runs as a service in the background on all machines.

My intention is to publish a BRIEF summary of the results in this forum, with the complete and unedited output from the Smartbits test and Chariot test available from a web page and/or FTP server.

The plan (so far) is to run the tests Friday afternoon. I'm doing this at work, so if any of that nasty work-stuff happens, I may have to push it back to next week.

In the meantime, if I've omitted something from this plan, or if there's something you really want to see, post it in this thread and we'll try to get it into the test.

Let me know .....

Scott
 


<< Noone I know has a consumer-grade 100Meg HUB. >>



CRAP! In one of my periodic fits of shelf-clearing, I threw out an 8 porter last week!!!! It had an ugly scratch accross the top, but it worked fine. Damn!

Russ, NCNE
 
Well, if &quot;everybody&quot; decides that the 3COM or Intel 100Base hub is OK, I can use one of them. I don't want any accusations of cheating. After all, &quot;Hubs is Hubs&quot; right?

Scott
 
That'd work for me, I can get it back to you right after the testing.

I'll PM the address info.

edit: Done, thanks again.

Thanks! Any objections to the SMC from anyone??
 
so whats say we get a pool running?
😉
My bets on hub for one or two clients, more then that switch.
hehe
-M.T.O
 
ScottMac;

Are we going to use the Chariot Console as an endpoint on the 4 port switch tests?
Or do we have enough eight port + so we don't have to worry about it?

BTW' Count me in on the testing.
 
We shouldn't need the console. Four 866s + the 933 dual should do it. Worse case, we toss in the Ultras..no big deal.

Seeya

Scott


 
I personally believe the test should be run in the 100 meg realm, even with a professional grade hub.

Also..

Two streams in, one stream out
Four streams in, one stream out
Seven streams in, one stream out (<--wanna do this?)

Why is this methodology being tested?

Shouldnt it be..

One Stream in, one stream out.
One stream in, two, three, seven, four streams out.

>7 people join a UT game, all need to download the map at the same time<

Servers are designed to push data, and in 90% of the cases, especially home use, data will be sent to and from the server, however the majoritity will be from it. With multiuser games, The client receives alot more data then it sends.

Are you going to be testing UDP vs TCP? UDP can easily kill a network and it doesnt matter if it is a hub or switch if you are trying to overload a port, a switch will just loose more packets, BUT have more successful packets.

How about Duplexing? The switch aspect has better be tested at both Half, and Full duplex settings.

Are the intel card's drivers going to be tweaked? Receive windows?


 
Xanathar:

The SmartBits test is a pure layer two test. Switches and hubs &quot;don't know nothin'&quot; about TCP or UDP. The Chariot test implements the whole stack, up to layer seven. Chariot EMULATES traffic patterns in a predictable and reproducible way so that concievably, someone could take the parameters we use and do the test independently and expect similar results.

Regarding the many-to-one scheme, unless the server is broadcasting or multicasting the information, Ethernet (by specification) is one machine talks to exactly one other machine, other machines catch the packet, but it is discarded at the hardware/Layer one if the packet is not addresses to that specific NIC.

Do the game servers broadcast the information, or does it talk to one at a time?
Unless the game servers broadcast, then it's single source to single destination, and that test is already planned.

The Chariot scripts we use emulate two-way traffic. If this was being done for a paying customer, we can create a script to emulate traffic flow based on an analyzer trace. But it's a fair amount of work, and frankly, this test ain't worth that kind of effort. Stock scripts only.

We will be doing 100 meg testing. JackMDS is sending us a 10/100 SMC hub.

NIC driver, Windows, TCP/IP stack will all be untweaked, stock, out of the box installs.

alpineranger: If time permits, we'll give it a shot (testing commercial 100Base Hubs).


Thanks for the input, keep it coming....

Scott
 
Still with respect the the Many to One configuration.

Yes, no matter how you look at it, this should be done with unicast, however my point being is the traffic generation should be done from the server side to multiple machines, rather then from multiple clients to one server. Especially since the test is not taking into account the upper layers and their flow control.

In the game scenario, (which is why I asked about duplexing). The server is talking on a one to one basis, however is talking to multiple machines. The server will recveive a small amount of data from every client, then combine all of the data to refire back out to all of the clients (extremely simplified).

I am just trying to make sure that the switch doesnt get unfairly abused here by having 7 clients all send 100 meg of unregulated data at it with it attempting to end in a single 100 meg port. I do not know of any applications that would work in this manor.
 
The 7 to one stream is probably there to overflow the egress port of the switch. I am interested to see the numbers on this never seen in real life conversation. I'm curious...would a hub really do better with this? probably so.
 
Reversing the flow (clients--> server, server --> clients) is easy on either test. We'll give it a shot. We can also vary the traffic levels as well, from 10% to 110%. I figured to try a couple levels...

Anything else?

Scott

 
Last Call.....testing starts after lunch, Chicago time..

Any other suggestions, tweaks, or questions?

Scott
 
looks like i'm a bit too late on this one.. have a 100meg only SOHO hub i could have sent in

oh well.. day late/dollar short as they say


Interested to see how the tests turn out.

DnetMHZ
 
DnetMhz: JackMDS has an SMC 8 port 10/100 hub enroute. It's not here yet (as of 13:00 Friday, but we can get started with the switch testing and squeeze it in next week (we DO have a four port 10/100 on-hand, so maybe we can to the 1/2/2->1/1->2 portions as well.

Thanks for the offer!

Scott
 
Report on testing:

Scott and I did not generate enough data on our 4 port hub to present.
However our 8 port Switch tests are done, both on Chariot and Smartbits,
and Scott will post the raw data later this weekend (or so).

Thanks to Dave and Eric for the loan of their hubs and for stopping by during the testing.

My initial impressions were both the hub and switch were high quality, and the differences will be due to the technology.

Doug
 
Back
Top