SRX Services Gateway
SRX Services Gateway

SRX jsrpd log messages

Tuesday

Hello

 

 

Has anyone came into this kind of issue?

 

 

Jan 14 12:47:16  SUP-FW-SRX650B jsrpd[1323]: JSRPD_RG_STATE_CHANGE: Redundancy-group 2 transitioned from 'primary' to 'secondary-hold' state due to Monitor failed: IF
Jan 14 12:47:16  SUP-FW-SRX650B jsrpd[1323]: JSRPD_RG_STATE_CHANGE: Redundancy-group 3 transitioned from 'primary' to 'secondary-hold' state due to Monitor failed: IF
Jan 14 12:47:17  SUP-FW-SRX650B jsrpd[1323]: JSRPD_RG_STATE_CHANGE: Redundancy-group 2 transitioned from 'secondary-hold' to 'secondary' state due to Back to back failover interval expired
Jan 14 12:47:17  SUP-FW-SRX650B jsrpd[1323]: JSRPD_RG_STATE_CHANGE: Redundancy-group 3 transitioned from 'secondary-hold' to 'secondary' state due to Back to back failover interval expired
Jan 14 13:11:16  SUP-FW-SRX650B jsrpd[1323]: JSRPD_RG_STATE_CHANGE: Redundancy-group 2 transitioned from 'secondary' to 'primary' state due to Remote yield (1/0)
Jan 14 13:14:59  SUP-FW-SRX650B jsrpd[1323]: JSRPD_RG_STATE_CHANGE: Redundancy-group 3 transitioned from 'secondary' to 'primary' state due to Remote node is in secondary hold
Jan 14 13:42:20  SUP-FW-SRX650B jsrpd[1323]: JSRPD_RG_STATE_CHANGE: Redundancy-group 2 transitioned from 'primary' to 'secondary-hold' state due to Monitor failed: IF
Jan 14 13:42:20  SUP-FW-SRX650B jsrpd[1323]: JSRPD_RG_STATE_CHANGE: Redundancy-group 3 transitioned from 'primary' to 'secondary-hold' state due to Monitor failed: IF
Jan 14 13:42:21  SUP-FW-SRX650B jsrpd[1323]: JSRPD_RG_STATE_CHANGE: Redundancy-group 2 transitioned from 'secondary-hold' to 'secondary' state due to Back to back failover interval expired
Jan 14 13:42:21  SUP-FW-SRX650B jsrpd[1323]: JSRPD_RG_STATE_CHANGE: Redundancy-group 3 transitioned from 'secondary-hold' to 'secondary' state due to Back to back failover interval expired
Jan 14 17:29:58  SUP-FW-SRX650B jsrpd[1323]: JSRPD_RG_STATE_CHANGE: Redundancy-group 2 transitioned from 'secondary' to 'primary' state due to Remote yield (1/0)
Jan 14 17:41:46  SUP-FW-SRX650B jsrpd[1323]: JSRPD_RG_STATE_CHANGE: Redundancy-group 3 transitioned from 'secondary' to 'primary' state due to Remote yield (1/0)

 

I searched in google for this but found only this article, which not sure if related to my issue:

https://puck.nether.net/pipermail/juniper-nsp/2014-May/028884.html

 

I'm also seeing fpc cpu spikes to 100%

Does the above log messages might be related to fpc spikes?

 

 

Jan 14 12:31:36  SUP-FW-SRX650B PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 9 PIC 0 CPU utilization exceeds threshold, current value=96
Jan 14 12:31:50  SUP-FW-SRX650B PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 9 PIC 0 CPU utilization exceeds threshold, current value=91
Jan 14 12:31:56  SUP-FW-SRX650B PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 9 PIC 0 CPU utilization exceeds threshold, current value=87
Jan 14 12:32:08  SUP-FW-SRX650B PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 9 PIC 0 CPU utilization exceeds threshold, current value=87
Jan 14 12:32:10  SUP-FW-SRX650B PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 9 PIC 0 CPU utilization exceeds threshold, current value=86

 

 

 

{primary:node1}
admin@SUP-FW-SRX650B> show security monitoring fpc 0    
node0:
--------------------------------------------------------------------------
FPC 0
  PIC 0
    CPU utilization          :   51 %
    Memory utilization       :   76 %
    Current flow session     : 29571
    Current flow session IPv4: 29571
    Current flow session IPv6:    0
    Max flow session         : 524288
Total Session Creation Per Second (for last 96 seconds on average): 1314
IPv4  Session Creation Per Second (for last 96 seconds on average): 1314
IPv6  Session Creation Per Second (for last 96 seconds on average):    0

node1:
--------------------------------------------------------------------------
FPC 0
  PIC 0
    CPU utilization          :    1 %
    Memory utilization       :   76 %
    Current flow session     : 34668
    Current flow session IPv4: 34668
    Current flow session IPv6:    0
    Max flow session         : 524288
Total Session Creation Per Second (for last 96 seconds on average): 1306
IPv4  Session Creation Per Second (for last 96 seconds on average): 1306
IPv6  Session Creation Per Second (for last 96 seconds on average):    0

 

 

 

 

Regards,
A'bed AL-R.
[JNCSP-SEC JNCDA JNCIS-ENT Ingenious Champion|Sec]
https://srxtech.wordpress.com
2 REPLIES 2
SRX Services Gateway

Re: SRX jsrpd log messages

Wednesday

Hi Abed Al-R,

 

These messages are indicating events about failover that happened in SRX cluster nodes, the jsrpd process handles the Chassis cluster events.  When one node is rebooting, it performs a failover to the secondary node in order to avoid loss connectivity that is the high availability method used by SRX, and these logs are generated.

 

Please check if the notes were rebooted or crashed recently and troubleshoot the reason for that.  As you mentioned, CPU is high, that could be resulting in an issue with the cluster. 

 

If there are any core files, better to log a TAC case to have them analyzed.

 

Hope this helps.

 

Regards,
-r.

--------------------------------------------------

If this solves your problem, please mark this post as "Accepted Solution."
Kudos are always appreciated Smiley Happy.

SRX Services Gateway

Re: SRX jsrpd log messages

Wednesday

Hi

 

Thanks for your reply

But bot nodes were not rebooted

Both is up all the time

I check the uptime and it is OK on both cluster members

 

I have three reth interfaces , and those logs shows only on two reth: reth2 and reth3 . description above.

 

So it must be something else, maybe only the reth failed ? what could be the reason for this?

Regards,
A'bed AL-R.
[JNCSP-SEC JNCDA JNCIS-ENT Ingenious Champion|Sec]
https://srxtech.wordpress.com