| To find the best protocol analyzer
tool, we spent several intensive weeks exercising, stressing,
poking and prodding three popular protocol analyzers at our
Connecticut-based Network Testing Labs site. We looked at
Sniffer Portable 4.5, offered by Sniffer Technologies (a Network
Associates, Inc. business unit), EtherPeek NX 1.0 for Windows,
manufactured by WildPackets, Inc., and Observer 8.2, from
Network Instruments, LLC.
While all three tools displayed network message contents
and network summary data, Network Instruments’ Observer
earned the top spot in the competition for the breadth of
protocols it decodes, its helpful expert mode commentator,
its low cost, the ease with which we could navigate its screens
to determine the cause of a problem and - most importantly
- the wealth, usefulness and clarity of its reports.
An EKG for your Network
We found that Observer decodes over 500 protocols.
WildPackets claims that EtherPeek NX can decode “hundreds”
of protocols, but some of the protocols on the vendor’s
decode lists aren’t really separate protocols but rather
just subprotocols. EtherPeek’s total is more realistically
about 450, while Sniffer can do just over 450.
All three protocol analyzers can decode the major protocol
suites, including Ethernet, AppleTalk, DECnet, NetBEUI, IPX/SPX,
NetWare’s file sharing NetWare Core Protocol (NCP),
System Network Architecture (SNA), IBM’s and Microsoft’s
Server Message Block (SMB), HTTP, VoIP, TCP/IP and the protocols
used by TCP/IP utilities such as telnet and ftp. While all
three vendors also offer remote capture probes for collecting
and analyzing packets from non-local network segments, we
noted that Observer’s probe offers a number of special
features that made monitoring remote segments a breeze. In
an 802.11a or 802.11b environment, Observer, Sniffer and WildPacket’s
separate AiroPeek product all decode wireless messages. Observer,
however, comprehensively and clearly shows such detail as
wireless CRC errors, low average signal quality, low average
signal strength, missed acks, short PLCP errors, high reassociation
attempts and other wireless connection attributes.
Network Instruments’ Observer includes an integrated
SNMP console and management interface, an integrated RMON
I/II console and management interface, a built-in Web server
along with Web-based access to trend displays and other reports.
In our evaluation, we found the EtherPeek NX and Sniffer products
lacked the breadth and depth of Observer’s reports,
especially in the areas of trending and capacity analysis.
Observer’s many filter options include network address
ranges, error conditions, specific protocols and up to twenty
concurrent user-definable custom offsets and values. Observer
smartly helped us solve the problems we caused in the lab.
Furthermore, in a refreshing example of vendor honesty, Network
Instruments’ Observer even identifies packets it drops
when you run it on a slow computer with a bottleneck network
adapter. Observer dropped no packets in our tests, but we
found the vendor’s keen motivation to account for every
packet a sharp contrast to other vendors’ attitudes.
In fact, it’s downright admirable.
Observer can use RMON I and RMON II to manage and collect
SNMP statistics from SNMP-aware devices. Moreover, Network
Instruments offers local and remote software-based probes
customers can configure to use either industry-standard RMON
or Network Instruments’ enhanced and augmented version
of RMON, called Advanced Probe. In RMON mode, Observer’s
probe behaved exactly as the RMON standard demands. When we
configured Observer’s software probe to act as an Advanced
Probe, our tests revealed that Observer’s RMON enhancements
make up for virtually all RMON’s shortcomings. Network
Instruments’ RMON enhancements use network resources
much more frugally than standard RMON, and they also allow
for remote probe redirection, accumulation of network trending
data and viewing of Advanced Probe snapshots via a Web browser.
As icing on the cake, Observer probes can automatically update
themselves when an administrator wants to install Network
Instruments updates across a network.
To help EtherPeek monitor remote network segments, WildPackets
suggests its customers buy Netopia’s Timbuktu Pro. Installing
Timbuktu Pro on remote segments lets EtherPeek users remotely
perform diagnostics, monitor traffic, trace illicit network
activities and debug network hardware and software.
Called Sniffer Distributed, Sniffer’s probe and central
management components for monitoring remote network segments
perform many of the same functions Observer does. Sniffer
Distributed gathers statistics on network traffic, protocol
distribution and application usage, then forwards the data
to a central console. Significantly, Timbuktu Pro and the
Sniffer Distributed product lack Observer’s Advanced
Probe capabilities and thus cannot exceed the design limitations
of RMON I/II.
With its more than 100 expert mode events and easy-to-understand,
English language explanations, Observer’s expert mode
is more helpful in diagnosing network problems than EtherPeek’s
or Sniffer’s. In addition to decoding many more types
of network messages, Network Instruments’ Observer includes
a Router Observer component for monitoring router activity
against thresholds you set, a Web Observer for keeping a watchful
eye on Web servers utilization and an Internet Observer for
tracking IP message traffic by source and destination. While
EtherPeek NX and Sniffer can monitor individual switch ports,
Observer’s port tracking gives an administrator more
useful bandwidth utilization information on both a port-by-port
basis and an aggregate switch throughput basis.
EtherPeek
NX helped us pinpoint most of the causes of the deliberate
error conditions we set up. However, EtherPeek NX’s
real-time expert mode feature showed its lack of maturity
- it’s a fairly recent addition to EtherPeek. The real-time
expert provides a conversation-centered view of current traffic,
with settable thresholds and filters to let you drill down
into network activity. EtherPeek NX’s expert view displays
its breakdown of latency, throughput, and about 45 other problems
(i.e., half of Observer’s expert mode events) in a conversation-centered
view of traffic. Many EtherPeek NX tests offer user-defined
settings and thresholds. To help an administrator focus more
narrowly on the problems at hand, these filtering criteria
include network address, protocol, port, specified strings
of text inside packets, packet length and error codes within
packets.
We could also instruct EtherPeek, via what WildPackets calls
plug-ins, to verify packet checksums, detect duplicate IP
address assignments, log ftp file transfer operation file
names, monitor network addresses for continuous connectivity,
track telnet sessions and log Web server and news server accesses.
A customer who has some programming skills can additionally
create tailor-made EtherPeek NX plug-ins.
Viewing the Reports
Observer’s reports show top talkers, protocol statistics,
conversation pair statistics, Internet usage, physical layer
errors, transport layer errors, router statistics, switch
statistics, network utilization and historical trends. The
top talkers report contains a list of nodes, by bandwidth
usage, and it includes bandwidth percentages, total packets,
broadcasts and multicasts. The protocol statistics report
categorizes network traffic by protocol, in either tabular
of graphical format. The conversation pair statistics report
tracks nodes exchanging network messages and graphically illustrates
the nodes’ conversations by drawing lines between the
nodes. The Internet usage report identifies nodes connected
to the Internet, by node, service (HTTP, NNTP or FTP) and
Internet destination. The physical layer report tells (for
Ethernet) the number of wrong-sized packets, CRC errors, collisions
and alignment errors.
The server analysis report, which is one of Observer’s
most useful reports, graphically contrasts server response
times vs. the number of concurrent requests. The Router Observer
module monitors router devices, displaying total packets,
total bytes, packets per second, bytes per second and device
utilization. The switch monitor can continuously examine the
ports on a switch to show utilization and connectivity.
Observer can also show Web server traffic data, including
number of Internet connections and percentage of local network
traffic. A vital signs report divulges average and maximum
bandwidth utilization, total packets, CRC errors, alignments
errors, wrong-sized packets and collisions, and an Ethernet
collision analysis identifies the top ten network colliders.
For browser access to its data, Observer quickly and effortlessly
renders reports in dynamic Web page format. Much more sophisticated
than EtherPeek’s or Sniffer’s simple capture buffers,
the database of historical network activity that Observer
collects is the ideal foundation for its well-designed trending
and capacity planning reports.
EtherPeek NX displays node, protocol, conversation, network,
error, size, summary and history information. Node statistics,
which are useful for tracking bandwidth usage by node, include
real-time packet counts and traffic volumes as well as the
total number of network nodes. Protocol statistics show network
traffic volume, in packets and in bytes, by protocol and sub-protocol.
This data is useful for determining which protocols or sub-protocols
are using high amounts of bandwidth. Between pairs of network
nodes, conversation statistics show traffic data, in bytes
and packets, for each protocol or sub-protocol the pair has
used. The packet size distribution statistics reveal the number
of packets, by size, that the network has carried. The summary
and history statistics show network performance over time,
graphed according to selectable intervals. For a user-specified
interval, EtherPeek's graphing and trending feature can collect,
analyze and display, via several different graph options,
node, protocol, network or summary statistics. EtherPeek can
optionally render the data as Web pages.
Sniffer Portable displays useful statistics in its own right
and the vendor offers an optional, separate reporting tool.
The Sniffer Reporter’s tabular and graphical reports
show top hosts by traffic, top hosts by protocol, a matrix
identifying top conversation pairs and protocol distributions.
A global statistics report discloses traffic by segment, errors
by segment, segment size distribution and segment utilization.
An alarm report reveals alarm details the Sniffer captured.
Working with these Tools
Observer’s user interface offers a sleek tree,
toolbar and multiple child window view of network activity.
Selecting the elements to monitor and the statistics to collect
is simple. In the expert summary problem analysis, which shows
a list of error events, a double click drills down into the
capture buffer detail for further analysis. Double-clicking
on any of the protocol-based or application-based problems
shown in the TCP/UDP/ICMP experts window drills down to the
conversation level to show which pairs of nodes are involved
in the problem. The expert window shows network errors organized
by time of day to help you judge whether a problem is intermittent
or consistent. Observer also displays a window containing
a graphical view of network conversations. Alongside each
conversation pair are statistics showing packet-to-packet
delay times, retransmissions and lost packets. Clicking on
a conversation pair drills down to a list of packets exchanged
by the nodes, with the contents of each packet displayed in
a separate window. Each Observer activity presentation is
a child window that updates in real time, and you can have
as many concurrent windows open as you wish - a nice feature.
For captured packets, you can choose which columns you want
EtherPeek NX’s user interface to show. The selectable
columns include source and destination logical addresses,
protocol types, packet sizes and time stamps.
EtherPeek’s name table holds device and protocol name-address
equivalences for your network. On a network that uses DNS,
EtherPeek can automatically discover names for the devices
at each IP address. Editing EtherPeek’s name table by
hand is a tedious chore.
Like Observer’s graphical network map of network dialog
pairs, EtherPeek NX’s peer map plots those network nodes
that are talking to each other. EtherPeek NX draws an expanding
ellipse of node addresses and plots lines between the source
and destination IP addresses that it displays. Observer draws
a more-easily managed circle of conversation pairs, and Observer
did a better job of detecting and displaying node names on
its chart. Coping with EtherPeek NX’s display of IP
addresses was more difficult.
Sniffer’s
user interface uses a simplistic dashboard to show network
utilization, packets per second and error counts. One Sniffer
window displays a scrolling list of captured packets, while
another contains an expandable tree view of protocol event
alarms you can set. For a particular packet selected in the
scrolling packet list window, another window displays decoded
detail.
We found we had to spend quite a bit of time examining Sniffer
Portable’s displays of decoded packets to solve our
test problems. Unfortunately, Sniffer’s designers have
made locating and understanding culprit packets more difficult
than they need to be. On the other hand, Sniffer does a good
job of interpreting the attributes and proposals associated
with an IPsec handshake, which can be invaluable to anyone
who needs to troubleshoot IPsec configurations.
All three products are easy to install and come with clear,
easy-to-understand documentation.
Conclusion
Network Instruments’ Observer emerged the clear
winner in our tests. It’s a world-class protocol analyzer
that we feel no network administrator should be without.
Network Testing Labs’ Testbed and Methodology
We ran each protocol analyzer software product on
a Windows 98-based Dell OptiPlex G1 computer equipped with
a 350 Mhz Pentium II processor, 64 Mb RAM and 4 Gb hard drive.
The machine’s network adapter varied in the tests. For
EtherPeek NX, we used a Farallon Communications, Inc. PN996L-TX
Fast Ethernet PCI bus network adapter. For Network Instruments’
Observer, we installed an OBSPCI Fast Ethernet PCI bus network
adapter. Sniffer Portable listened on the network via an Adaptec
ANA-6911A Fast Ethernet PCI bus network adapter.
We connected each protocol analyzer to all our Fast Ethernet
network’s six segments, one segment at a time. Each
segment consisted of a NetWare 5.0, Windows NT 4.0 or Windows
2000 file server, an Oracle 8i, Microsoft SQL Server or Sybase
Adaptive Server database server, a Netscape or Internet Information
Server (IIS) Web server and ten Windows 98, Windows ME, Windows
NT, Windows 2000 Professional, Macintosh System 8, Red Hat
Linux 6.2 and OS/2 Warp 4.0 clients. The six-segment network
also contained SNMP-aware switches, Cisco 3500 routers, a
Covad Communications SDSL Internet link, Frame Relay DSU/CSUs
and RMON I/II hardware probes.
We confronted the protocol analyzers with six problem situations.
First, we configured an SMTP mail server to reject relay requests
and then sent the server e-mail from bogus, unauthenticated
user IDs, an action which produced SMTP Error Code 550 responses.
We attempted to log on to Microsoft and Novell file servers
with invalid user ID and password credentials. Next, we powered
off a file server while clients were accessing it. Using custom-written
packet-generating software, we then sent badly-formed SQL*NET
transactions to an Oracle server and badly-formed TDS transactions
to a Sybase server. We caused physical layer Ethernet problems
by using a cable deliberately wired to produce Near-End Cross
Talk (NEXT). We also asked the protocol analyzers to help
us diagnose a too-busy switch as well as find a misconfigured
Cisco router. To determine a protocol analyzer's accuracy,
we flooded our network with a known number of diverse protocol
messages and note whether each product captured and decoded
all the traffic.
You can e-mail Barry at barryn@erols.com. |