SRX

Hello, 

I noticed that routing engine CPU is 100 % utilized whereas data core is process utilizations fine.

Actually there is no impact to customers or connections passing through the SRX 240 box.

 

Below is the output from firewall

 

show chassis routing-engine
Routing Engine status:
Temperature 43 degrees C / 109 degrees F
CPU temperature 42 degrees C / 107 degrees F
Total memory 1024 MB Max 850 MB used ( 83 percent)
Control plane memory 560 MB Max 465 MB used ( 83 percent)
Data plane memory 464 MB Max 390 MB used ( 84 percent)
CPU utilization:
User 34 percent
Background 0 percent
Kernel 66 percent
Interrupt 0 percent
Idle 0 percent
Model RE-SRX240H
Serial ID AADH3968
Start time 2013-06-23 11:03:09 GMT
Uptime 694 days, 6 hours, 39 minutes, 33 seconds
Last reboot reason 0x200:normal shutdown
Load averages: 1 minute 5 minute 15 minute
1.13 1.04 1.01

 

-------------------

 

show system processes extensive
last pid: 3389; load averages: 1.05, 1.03, 1.00 up 694+06:41:02 17:40:10
154 processes: 21 running, 120 sleeping, 2 zombie, 11 waiting

Mem: 209M Active, 148M Inact, 520M Wired, 6868K Cache, 112M Buf, 87M Free
Swap:

PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
1319 root 7 76 0 499M 49324K select 0 ??? 363.82% flowd_octeon_hm
22 root 1 171 52 0K 16K RUN 0 ??? 0.00% idle: cpu0
1043 root 1 76 0 12628K 4856K select 0 193.1H 0.00% eventd
1307 root 1 76 0 27720K 12048K select 0 151.4H 0.00% mib2d
24 root 1 -20 -139 0K 16K RUN 0 111.1H 0.00% swi7: clock
1306 root 1 76 0 20280K 12852K select 0 92.8H 0.00% snmpd
1314 root 1 76 0 27588K 13144K select 0 65.3H 0.00% kmd
23 root 1 -40 -159 0K 16K WAIT 0 54.6H 0.00% swi2: net
1338 root 1 76 0 13324K 6036K select 0 53.2H 0.00% rtlogd
1344 root 1 76 0 12332K 6160K select 0 45.0H 0.00% license-check

 

Also facing another issue as below

 

show security flow session summary
error: usp_ipc_client_open: failed to connect to the server after 1 retries

 

Please share any information about the issue and how to resolve it

 

Regarding error message, pls check https://prsearch.juniper.net/InfoCenter/index?page=prcontent&id=PR927771

Regarding high CPU, do you have policy logging? Can you disable it for smetime and check?

Also check if you have any jweb users logged in and idle

>show system users

If so, pls logout them

Hello Suraj,

 

Thanks for sharing the information about the error message.

As a work around we are rebooting the device.

 

Below is the output I took from SRX box when the CPU is 100%. There are 2 Zombie process running but not sure whether its creating the issue. When we checked the PPID, we noticed that defunct process were for chassisd. But as we decided to reboot the box, we didnt kill the processes.

 

>show system processes extensive

last pid: 28347;  load averages:  1.03,  1.04,  1.00  up 695+20:10:24    07:09:32
137 processes: 22 running, 102 sleeping, 2 zombie, 11 waiting

Mem: 173M Active, 148M Inact, 519M Wired, 6480K Cache, 112M Buf, 124M Free
Swap:

  PID USERNAME   THR PRI NICE   SIZE    RES STATE  C   TIME   WCPU COMMAND
 1319 root         7  76    0   499M 49324K select 0    ??? 367.63% flowd_octeon_hm
   22 root         1 171   52     0K    16K RUN    0    ???  0.00% idle: cpu0
 1043 root         1  76    0 12628K  4856K select 0 193.1H  0.00% eventd
 1307 root         1  76    0 27720K 12048K select 0 151.7H  0.00% mib2d
   24 root         1 -20 -139     0K    16K RUN    0 111.3H  0.00% swi7: clock
 1306 root         1  76    0 20280K 12852K select 0  93.0H  0.00% snmpd
 1314 root         1  76    0 27588K 13144K RUN    0  65.5H  0.00% kmd
   23 root         1 -40 -159     0K    16K WAIT   0  54.7H  0.00% swi2: net
 1338 root         1  76    0 13324K  6036K select 0  53.3H  0.00% rtlogd
 1344 root         1  76    0 12332K  6160K select 0  45.1H  0.00% license-check
    5 root         1 -16    0     0K    16K rtfifo 0  34.3H  0.00% rtfifo_kern_recv
 1309 root         1  76    0 20332K  8692K select 0  24.4H  0.00% l2ald
 1327 root         1  76    0 15568K  5088K select 0  17.9H  0.00% shm-rtsdbd
 1311 root         2  76    0 35560K  9008K select 0 672:52  0.00% pfed
 1301 root         1  76    0 39836K 16628K select 0 608:23  0.00% chassisd
 1302 root         1  76    0 12528K  5616K select 0 568:38  0.00% alarmd
 1339 root         1  76    0 18984K 10220K select 0 563:31  0.00% utmd
 1298 root         1  76    0  3288K  1360K select 0 469:28  0.00% bslockd
   49 root         1 -16    0     0K    16K psleep 0 461:41  0.00% vmkmemdaemon
   26 root         1 -16    0     0K    16K -      0 316:37  0.00% yarrow
 1366 root         1  76    0     0K    16K select 0 310:15  0.00% peerproxy00000001
80463 root         1  76    0 13028K  5832K select 0 272:08  0.00% httpd-gk
 1308 root         1   4    0 50488K 24564K kqread 0 262:44  0.00% rpd
 1342 root         3  76    0 13944K  5336K select 0 203:57  0.00% wland

Its possible, but cannot confirm with this output.

Did reboot fix it?

Yes, we rebooted the device and issue fixed.

 

The kernal usage was 66% earlier and after reboot its only 9%. And overall CPU usage is 10%.

 

Regards,

Aravind