From: Chuck Church (cchurch@xxxxxxxxxxxxx)
Date: Fri Dec 28 2001 - 13:18:20 GMT-3
Dreams,
The ratio of fast to process switched packets looks real good. But if
you do the math, your 1.1 mb/sec and 2800 pps traffic gives you an average
of 49 bytes per packet. This looks like a DOS to me. They're probably all
TCP SYNC packets. Is this an Internet router? If so, throw the firewall
feature set on the router. I think it's got the same memory requirements as
plain IP for the 2600s. Log everything, and see if you get any messages
about too many half-open connections. You should find the culprit then. It
could even be internal, if you're running (sadly) M$'s IIS.
Hope this helps,
Chuck
----- Original Message -----
From: "Dreams Ruan" <dreams_r@163.com>
To: "Chuck Church" <cchurch@optonline.net>
Cc: <ccielab@groupstudy.com>
Sent: Friday, December 28, 2001 4:50 AM
Subject: Re: Re: Re: OT:Why so high CPU utilization
> Chuck Church,
>
> The router's config is easy and simple,so I can put the "show interface
> switching" like :
>
> Router#sh int ser 0 switching
> Serial0
> Throttle count 0
> Drops RP 0 SP 0
> SPD Flushes Fast 0 SSE 0
> SPD Aggress Fast 0
> SPD Priority Inputs 2251 Drops 0
>
> Protocol Path Pkts In Chars In Pkts Out Chars Out
> Other Process 0 0 60770 850780
> Cache misses 0
> Fast 0 0 0 0
> Auton/SSE 0 0 0 0
> IP Process 68382 5638639 40984 5556171
> Cache misses 0
> Fast 1303619723 909626948 1364827571 1390802000
> Auton/SSE 0 0 0 0
> !!!!
>
> FastEthernet0
> Throttle count 0
> Drops RP 0 SP 0
> SPD Flushes Fast 0 SSE 0
> SPD Aggress Fast 0
> SPD Priority Inputs 0 Drops 0
>
> Protocol Path Pkts In Chars In Pkts Out Chars Out
> Other Process 17306 2429410 60877 3652620
> Cache misses 0
> Fast 0 0 0 0
> Auton/SSE 0 0 0 0
> IP Process 72976 12178629 8009 1169388
> Cache misses 0
> Fast 1442001452 3879802872 1303593865 1703437314
> Auton/SSE 0 0 0 0
> ARP Process 36674 2200440 11159 669540
> Cache misses 0
> Fast 0 0 0 0
> Auton/SSE 0 0 0 0
> CDP Process 9717 3478458 9720 3022137
> Cache misses 0
> Fast 0 0 0 0
> Auton/SSE 0 0 0 0
>
>
>
> >Dreams Ruan,
> >
> > Practically all your CPU usage is due to interrupts. Send us your
> >config and a 'sh int switching'.
> >
> >Chuck
> >
> >----- Original Message -----
> >From: "Dreams Ruan" <dreams_r@163.com>
> >To: <ccielab@groupstudy.com>
> >Cc: <ccielab@groupstudy.com>
> >Sent: Tuesday, December 25, 2001 9:15 PM
> >Subject: Re: Re: OT:Why so high CPU utilization
> >
> >
> >> Jay Hennigan:
> >>
> >> In my router's interface,no any policy-route ,and switching type
> >> is CEF.But the line use FR encapsulation,so I check the show process
> >> CPU,the FR Broadcast Out and the Framer background use most cpu cycle,
> >> the content like that:
> >>
> >> sh proc cpu
> >> CPU utilization for five seconds: 30/30; one minute: 39; five minutes:
31
> >> PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
> >> 1 8084 82232 98 0.00 0.00 0.00 0 Load Meter
> >> 2 20 30 666 0.08 0.01 0.00 2 Virtual
Exec
> >> 3 557900 61402 9086 0.00 0.11 0.06 0 Check heaps
> >> 4 0 1 0 0.00 0.00 0.00 0 Chunk
Manager
> >> 5 432 269 1605 0.00 0.00 0.00 0 Pool
Manager
> >> 6 0 2 0 0.00 0.00 0.00 0 Timers
> >> 7 644 82183 7 0.00 0.00 0.00 0
> >ALARM_TRIGGER_SC
> >> 8 0 35 0 0.00 0.00 0.00 0 Serial
> >Backgroun
> >> 9 0 1 0 0.00 0.00 0.00 0 RM PROCESS
> >> 10 0 1 0 0.00 0.00 0.00 0 RM PROCESS
> >> 11 0 1 0 0.00 0.00 0.00 0 RM PROCESS
> >> 12 0 1 0 0.00 0.00 0.00 0 RM PROCESS
> >> 13 0 2 0 0.00 0.00 0.00 0 CAS Process
> >> 14 10496 27927 375 0.00 0.00 0.00 0 ARP Input
> >> 15 652 20557 31 0.00 0.00 0.00 0 HC Counter
> >Timer
> >> 16 0 4 0 0.00 0.00 0.00 0 DDR Timers
> >> 17 0 2 0 0.00 0.00 0.00 0 Dialer
event
> >> 18 20 4 5000 0.00 0.00 0.00 0 Entity MIB
API
> >> 19 0 1 0 0.00 0.00 0.00 0 SERIAL
> >A'detect
> >> 20 0 1 0 0.00 0.00 0.00 0 Critical
Bkgnd
> >> 21 216096 73238 2950 0.00 0.03 0.02 0 Net
Background
> >> 22 0 64 0 0.00 0.00 0.00 0 Logger
> >> 23 1292 411025 3 0.00 0.00 0.00 0 TTY
Background
> >> 24 2200 411045 5 0.00 0.00 0.00 0 Per-Second
> >Jobs
> >> 25 0 19583 0 0.00 0.00 0.00 0 CSM
periodical
> >p
> >> 26 40 215393 0 0.00 0.00 0.00 0 CSM timer
> >proces
> >> 27 0 2 0 0.00 0.00 0.00 0 CSM Tone
> >process
> >> 28 0 2 0 0.00 0.00 0.00 0 Call
> >Management
> >> 29 1016 11585 87 0.00 0.00 0.00 0 Net Input
> >> 30 19892 82232 241 0.00 0.00 0.00 0 Compute
load
> >avg
> >> 31 198360 7141 27777 0.00 0.03 0.00 0 Per-minute
> >Jobs
> >> 32 0 1 0 0.00 0.00 0.00 0 COT Timer
> >proces
> >> 33 0 1 0 0.00 0.00 0.00 0 COT Queue
> >proces
> >> 34 748 1631492 0 0.00 0.00 0.00 0 Framer
> >backgroun
> >> 35 0 3 0 0.00 0.00 0.00 0 Neat msg
> >> 36 16 4 4000 0.00 0.00 0.00 0 ISDN
> >> 37 0 2 0 0.00 0.00 0.00 0 AAA
Dictionary
> >R
> >> 38 42392 87732 483 0.00 0.01 0.00 0 IP Input
> >> 39 9352 53989 173 0.00 0.00 0.00 0 CDP
Protocol
> >> 40 0 1 0 0.00 0.00 0.00 0 X.25 Encaps
> >Mana
> >> 41 0 1 0 0.00 0.00 0.00 0 PPP IP Add
> >Route
> >> 42 5292 6992 756 0.00 0.00 0.00 0 IP
Background
> >> 43 1168 6859 170 0.00 0.00 0.00 0 Adj Manager
> >> 44 8 1373 5 0.00 0.00 0.00 0 TCP Timer
> >> PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
> >> 45 88 89 988 0.00 0.00 0.00 0 TCP
Protocols
> >> 46 0 1 0 0.00 0.00 0.00 0 Probe Input
> >> 47 0 1 0 0.00 0.00 0.00 0 RARP Input
> >> 48 0 1 0 0.00 0.00 0.00 0 HTTP Timer
> >> 49 0 1 0 0.00 0.00 0.00 0 Socket
Timers
> >> 50 9692 11078 874 0.00 0.00 0.00 0 DHCPD
Receive
> >> 51 1284 6851 187 0.00 0.00 0.00 0 IP Cache
Ager
> >> 52 0 1 0 0.00 0.00 0.00 0 COPS
> >> 53 0 1 0 0.00 0.00 0.00 0 PAD InCall
> >> 54 0 2 0 0.00 0.00 0.00 0 X.25
> >Background
> >> 55 1488 411033 3 0.00 0.00 0.00 0 RUDPV1 Main
> >Proc
> >> 56 0 1 0 0.00 0.00 0.00 0 bsm_timers
> >> 57 608 411032 1 0.00 0.00 0.00 0
bsm_xmt_proc
> >> 58 4 2 2000 0.00 0.00 0.00 0 RLM groups
> >Proce
> >> 59 9988 81987 121 0.00 0.00 0.00 0 FR LMI
> >> 60 1064 4108553 0 0.00 0.00 0.00 0 FR
Broadcast
> >Out
> >> 61 180 1631572 0 0.00 0.00 0.00 0 VFC File
> >System
> >> 62 0 1 0 0.00 0.00 0.00 0 Router
> >Autoconf
> >> 63 0 1 0 0.00 0.00 0.00 0 TSP
> >> 64 4 1 4000 0.00 0.00 0.00 0
> >QOS_MODULE_MAIN
> >> 65 64 63 1015 0.00 0.00 0.00 0 DSPRM
> >> 66 0 2 0 0.00 0.00 0.00 0 VFC Manager
> >> 67 0 2 0 0.00 0.00 0.00 0 Background
> >Loade
> >> 68 0 1 0 0.00 0.00 0.00 0 sssapp
> >> 69 0 2 0 0.00 0.00 0.00 0 RTSP_CLIENT
> >> 70 0 1 0 0.00 0.00 0.00 0 RTSP_DNS
> >> 71 648 6832 94 0.00 0.00 0.00 0 FR ARP
> >> 72 0 1 0 0.00 0.00 0.00 0 faxmsp
> >> 73 0 1 0 0.00 0.00 0.00 0 DocMSP
> >> 74 0 1 0 0.00 0.00 0.00 0 Syslog
Traps
> >> 75 356 41112 8 0.00 0.00 0.00 0 RMON
Recycle
> >Pro
> >> 76 4 2 2000 0.00 0.00 0.00 0 RMON
Deferred
> >Se
> >> 77 0 1 0 0.00 0.00 0.00 0 RMON
Packets
> >> 78 0 2 0 0.00 0.00 0.00 0 ISDN Timer
> >> 79 0 1 0 0.00 0.00 0.00 0 ISDNMIB
> >Backgrou
> >> 80 0 1 0 0.00 0.00 0.00 0 CallMIB
> >Backgrou
> >> 81 4 1 4000 0.00 0.00 0.00 0 ISDN From
> >Driver
> >> 82 4 64 62 0.00 0.00 0.00 0 Resource
> >Monitor
> >> 83 0 2 0 0.00 0.00 0.00 0 CC-API_VCM
> >> 84 12 4 3000 0.00 0.00 0.00 0 Session
> >Applicat
> >> 85 16 2 8000 0.00 0.00 0.00 0 VTSP
> >> 86 0 2 0 0.00 0.00 0.00 0 VOIP_RTCP
> >> 87 0 2 0 0.00 0.00 0.00 0 Voice
Player
> >> 88 0 1 0 0.00 0.00 0.00 0 Media
Content
> >Re
> >> 89 4 1 4000 0.00 0.00 0.00 0 pcapp
> >> 90 0 1 0 0.00 0.00 0.00 0 placecall
> >> PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
> >> 91 0 2 0 0.00 0.00 0.00 0 tcl ivr app
> >> 92 0 2 0 0.00 0.00 0.00 0 tcl ivr app
> >> 93 0 2 0 0.00 0.00 0.00 0 tcl ivr app
> >> 94 0 2 0 0.00 0.00 0.00 0 tcl ivr app
> >> 95 0 2 0 0.00 0.00 0.00 0 tcl ivr app
> >> 96 0 2 0 0.00 0.00 0.00 0 tcl ivr app
> >> 97 0 2 0 0.00 0.00 0.00 0 tcl ivr app
> >> 98 0 2 0 0.00 0.00 0.00 0 tcl ivr app
> >> 99 0 1 0 0.00 0.00 0.00 0 lib_off_app
> >> 100 8 2 4000 0.00 0.00 0.00 0 CCH323_CT
> >> 101 0 2 0 0.00 0.00 0.00 0 CCH323_RTCP
> >> 102 0 1 0 0.00 0.00 0.00 0 CCH323_DNS
> >> 103 4 2 2000 0.00 0.00 0.00 0
> >CCSIP_SPI_CONTRO
> >> 104 0 1 0 0.00 0.00 0.00 0 CCSIP_DNS
> >> 105 4 1 4000 0.00 0.00 0.00 0
> >CCSIP_UDP_SOCKET
> >> 106 0 1 0 0.00 0.00 0.00 0
> >CCSIP_TCP_SOCKET
> >> 107 4 2 2000 0.00 0.00 0.00 0 RTPSPI
> >> 108 0 1 0 0.00 0.00 0.00 0 ISDN L2
> >Process
> >> 109 0 1 0 0.00 0.00 0.00 0 ISDN L3
Timer
> >Pr
> >> 110 0 1 0 0.00 0.00 0.00 0 ISDN L2D
SRQ
> >Pro
> >> 111 0 3 0 0.00 0.00 0.00 0 AAA
Accounting
> >> 112 4 3427 1 0.00 0.00 0.00 0 DHCPD Timer
> >> 113 1704 116452 14 0.00 0.00 0.00 0 DHCPD
Database
> >> 114 0 1 0 0.00 0.00 0.00 0 Fax Receive
> >> 115 0 1 0 0.00 0.00 0.00 0 Fax
Transmit
> >> 116 0 1 0 0.00 0.00 0.00 0 Tiff Writer
> >> 117 0 217 0 0.00 0.00 0.00 0 fax timers
> >> 118 776 822027 0 0.00 0.00 0.00 0 esmtp
client
> >soc
> >> 119 0 2 0 0.00 0.00 0.00 0 esmtp
server
> >soc
> >> 120 0 1 0 0.00 0.00 0.00 0
faxmail-client
> >> 121 4 20550 0 0.00 0.00 0.00 0 FR TUNNEL
> >> 122 0 1 0 0.00 0.00 0.00 0 FRF9
manager
> >> 123 0 1 0 0.00 0.00 0.00 0 FRF9 timed
> >event
> >> 124 36 806 44 0.00 0.00 0.00 0 CEF process
> >> 125 4 18 222 0.00 0.00 0.00 0 CEF
> >Scanner!!!!
> >>
> >> I don't know how to solve.
> >>
> >> =======
> >>
> >> >On Tue, 25 Dec 2001, Dreams Ruan wrote:
> >> >
> >> >> Hello,Everyone:
> >> >>
> >> >> I have a question about router's cpu utilization.My company's router
> >> >> is 2621,used a FE and a Serial port.The data flow about 1.1M/s per
> >port,
> >> >> and the packet flow about 2800 packets/s per port,but the router's
cpu
> >> >> utilization is 95!!! I changed a router from 2621 to AS5300,the
> >AS5300's
> >> >> cpu utilization is 23-35.The data flow not so high,but Why so high
cpu
> >> >> utilization? The router used static route,no others protocol.
> >> >
> >> >Do you have "no ip route-cache" in your config on either interface?
> >> >
> >> >Any debugging turned on?
> >> >
> >> >Try "show interface switching" and see if the majority of your traffic
> >> >is being process-switched for any reason.
> >> >
> >> >"Show process cpu" will give an indication as to what is going on as
> >well.
> >> >
> >> >--
> >> >Jay Hennigan - CCIE #7880 - Network Administration - jay@west.net
> >> >NetLojix Communications, Inc. - http://www.netlojix.com/
> >> >WestNet: Connecting you to the planet. 805 884-6323
> >>
> >> = = = = = = = = = = = = = = = = = = = =
> >>
> >>
> >> VB
> >> @q#!
> >>
> >> Dreams Ruan
> >> dreams_r@163.com
> >> 2001-12-26
> = = = = = = = = = = = = = = = = = = = =
>
>
> VB
> @q#!
>
> Dreams Ruan
> dreams_r@163.com
> 2001-12-28
This archive was generated by hypermail 2.1.4 : Thu Jun 13 2002 - 10:32:49 GMT-3