SRX Services Gateway
SRX Services Gateway

0x1000:reboot due to panic

[ Edited ]
‎08-25-2019 11:43 PM

Hi guys, i have a SRX340 that almost daily, and sometimes more than once daily rebootes.

 

When i run "run show chassis routing-engine" i get the following output:

0x1000:reboot due to panic

 

Routing Engine status:
Temperature 35 degrees C / 95 degrees F
CPU temperature 53 degrees C / 127 degrees F
Total memory 4096 MB Max 1188 MB used ( 29 percent)
Control plane memory 2624 MB Max 708 MB used ( 27 percent)
Data plane memory 1472 MB Max 471 MB used ( 32 percent)
5 sec CPU utilization:
User 38 percent
Background 0 percent
Kernel 50 percent
Interrupt 0 percent
Idle 12 percent
Model RE-SRX340
Serial ID CY3218AF0243
Start time 2019-08-24 18:45:43 GMT+1
Uptime 1 day, 10 hours, 24 minutes, 30 seconds
Last reboot reason 0x1000:reboot due to panic
Load averages: 1 minute 5 minute 15 minute
3.94 5.31 4.93

 

And when i run "run show system core-dumps" i get this output:

XXX@SRX340# run show system core-dumps

 

/var/crash/*core*: No such file or directory
/var/tmp/*core*: No such file or directory
/var/tmp/pics/*core*: No such file or directory
/var/crash/kernel.*: No such file or directory
/var/jails/rest-api/tmp/*core*: No such file or directory
/tftpboot/corefiles/*core*: No such file or directory

 

Software:

Junos: 15.1X49-D70.3
JUNOS Software Release [15.1X49-D70.3]

 

Can you guys help me?
/Nikolaj Nielsen

11 REPLIES 11
SRX Services Gateway

Re: 0x1000:reboot due to panic

[ Edited ]
‎08-26-2019 12:14 AM

Nikolaj,

 

From the RE output, I can see that Idle value is 12 percent. Can you provide me the output of "show system processes extensive"?

 

To narrow down the issue, let me know the following:

  • Since when you're facing the issue?
  • Any changes made prior to this issue?
  • Is there any pattern in the reboot like every 3 hours its rebooting kinda situation?
  • Do you have SNMP monitoring where we can see the device status?

It seems like RE CPU is going High and I suspect this can be an issue. But we don't see any core-dumps during the time of issue so, it can be a hardware issue as well and RMA may be required.

 

Also, I would suggest you to consider upgrading the device to the recommended Junos version which is 15.1X49-D170 for SRX340. For more information, please visit the following KB article - https://kb.juniper.net/InfoCenter/index?page=content&id=KB21476&actp=METADATA#srx_series



Thanks,
π00bm@$t€®.
Please, Mark My Solution Accepted if it Helped, Kudos are Appreciated too!!!
SRX Services Gateway

Re: 0x1000:reboot due to panic

‎08-26-2019 02:01 AM

Hi Noobmaster

 

Thank you for taking the time to reply.

 

Here is the "show system processes extensive" Output:

 

XXX@SRX340# run show system processes extensive
last pid: 89349; load averages: 1.84, 1.87, 1.71 up 1+11:43:02 06:28:15
225 processes: 19 running, 194 sleeping, 12 waiting

Mem: 327M Active, 137M Inact, 1595M Wired, 391M Cache, 112M Buf, 1530M Free
Swap:


PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
1849 root 6 76 0 1554M 471M select 0 112.9H 307.42% flowd_octeon_hm
21 root 1 171 52 0K 16K RUN 0 613:06 41.31% idle: cpu0
23 root 1 -20 -139 0K 16K RUN 0 21:32 0.00% swi7: clock
1876 root 7 76 0 34520K 9280K select 0 21:31 0.00% aamwd
1496 root 1 76 0 18316K 6600K select 0 13:31 0.00% eventd
1857 root 1 76 0 110M 32248K select 0 10:33 0.00% authd
1832 root 1 76 0 10004K 5972K select 0 7:55 0.00% ntpd
22 root 1 -40 -159 0K 16K WAIT 0 6:51 0.00% swi2: netisr 0
1839 root 1 76 0 60504K 22768K select 0 6:39 0.00% pfed
35 root 1 -8 0 0K 16K xfer s 0 6:05 0.00% udev-sched-0.1
1878 root 1 76 0 19924K 8124K select 0 5:13 0.00% rtlogd
1838 root 1 83 0 8832K 2504K select 0 4:23 0.00% inetd
18 root 1 171 52 0K 16K RUN 3 4:14 0.00% idle: cpu3
19 root 1 171 52 0K 16K RUN 2 4:14 0.00% idle: cpu2
1885 root 1 76 0 19004K 7784K select 0 3:56 0.00% license-check
25 root 1 -20 -139 0K 16K WAIT 0 3:45 0.00% swi7: +
1856 root 1 76 0 104M 19064K select 0 3:12 0.00% jdhcpd
20 root 1 171 52 0K 16K RUN 1 3:11 0.00% idle: cpu1
1834 root 1 76 0 35148K 16928K select 0 3:10 0.00% snmpd
1837 root 1 76 0 39328K 14392K select 0 2:44 0.00% l2ald
1843 root 1 76 0 22252K 10408K select 0 2:30 0.00% ppmd
1835 root 1 76 0 49408K 15424K select 0 2:20 0.00% mib2d
5 root 1 -16 0 0K 16K rtfifo 0 2:13 0.00% rtfifo_kern_recv
1864 root 1 76 0 19804K 4820K select 0 1:29 0.00% shm-rtsdbd
1853 root 1 4 0 31440K 13884K kqread 0 1:18 0.00% l2cpd
3 root 1 -8 0 0K 16K - 0 1:16 0.00% g_up
40 root 1 171 52 0K 16K pgzero 0 0:56 0.00% pagezero
4 root 1 -8 0 0K 16K - 0 0:55 0.00% g_down
1875 root 7 8 0 97404K 7076K nanslp 0 0:47 0.00% ipfd
1915 nobody 1 76 0 13084K 5600K select 0 0:43 0.00% httpd
49 root 1 -16 0 0K 16K psleep 0 0:39 0.00% vmkmemdaemon
1836 root 1 4 0 68628K 33032K kqread 0 0:36 0.00% rpd
29 root 1 -28 -147 0K 16K WAIT 0 0:35 0.00% swi5: cambio
1826 root 1 76 0 3544K 1496K select 0 0:35 0.00% bslockd
1829 root 1 76 0 73484K 26036K select 0 0:33 0.00% chassisd
1830 root 1 76 0 18360K 6984K select 0 0:31 0.00% alarmd
1847 root 1 76 0 11200K 3996K select 0 0:29 0.00% irsd
1863 root 1 76 0 58268K 37092K select 0 0:25 0.00% smid
1842 root 1 76 0 36472K 14168K select 0 0:24 0.00% kmd
1 root 1 8 0 1816K 956K wait 0 0:22 0.00% init
1928 nobody 1 4 0 12256K 1668K kqread 0 0:20 0.00% webapid
43 root 1 20 0 0K 16K syncer 0 0:18 0.00% syncer
1858 root 1 76 0 27076K 11584K select 0 0:17 0.00% cfmd
82 root 1 -8 0 0K 16K mdwait 0 0:17 0.00% md1
1883 root 1 8 0 29996K 4524K nanslp 0 0:17 0.00% wmic
44 root 1 20 0 0K 16K vnlrum 0 0:16 0.00% vnlru_mem
1869 root 1 76 0 20148K 8012K select 0 0:15 0.00% pkid
26 root 1 -16 0 0K 16K - 0 0:15 0.00% yarrow
1879 root 1 76 0 23208K 9960K select 0 0:15 0.00% utmd
2 root 1 -8 0 0K 16K - 0 0:12 0.00% g_event
1828 root 1 76 0 44556K 13864K select 0 0:11 0.00% dcd
1887 root 1 4 0 29984K 12548K kqread 0 0:10 0.00% dot1xd
1867 root 1 76 0 37932K 14988K select 0 0:08 0.00% nsd
1874 root 1 76 0 52108K 11648K select 0 0:07 0.00% idpd
1848 root 1 76 0 19528K 8288K select 0 0:07 0.00% bfdd
1825 root 1 76 0 3084K 1060K select 0 0:06 0.00% watchdog
1840 root 1 76 0 21060K 9132K select 0 0:05 0.00% rmopd
71135 root 1 139 0 12456K 4196K RUN 0 0:05 0.00% sshd
1841 root 1 76 0 30404K 11580K select 0 0:05 0.00% cosd
1855 root 1 76 0 11632K 4396K select 0 0:05 0.00% lfmd
1975 root 1 76 0 0K 16K select 0 0:04 0.00% peerproxy00000001
1866 root 1 76 0 21776K 10808K select 0 0:04 0.00% jsrpd
1831 root 1 76 0 19076K 6484K select 0 0:04 0.00% craftd
71212 Nikolaj 1 76 0 69600K 29916K select 0 0:03 0.00% cli
1833 root 1 76 0 55324K 24324K select 0 0:02 0.00% mgd
1594 root 1 8 0 3732K 1436K nanslp 0 0:02 0.00% cron
45 root 1 -16 0 0K 16K sdflus 0 0:01 0.00% softdepflush
1845 root 1 76 0 36904K 15840K select 0 0:01 0.00% dfwd
1870 root 1 76 0 17228K 5716K select 0 0:01 0.00% httpd-gk
42 root 1 -4 0 0K 16K vlruwt 0 0:01 0.00% vnlru
41 root 1 -16 0 0K 16K psleep 0 0:01 0.00% bufdaemon
1859 root 1 76 0 14536K 3796K select 0 0:01 0.00% mplsoamd
1881 root 3 79 0 20188K 6068K ucond 0 0:01 0.00% syshmd
1882 root 1 76 0 10952K 3292K select 0 0:01 0.00% smtpd
47 root 1 -16 0 0K 16K psleep 0 0:01 0.00% vmuncachedaemon
71213 root 1 76 0 57720K 11444K select 0 0:01 0.00% mgd
1872 root 2 81 0 27704K 6588K select 0 0:00 0.00% appidd
1873 root 1 76 0 28768K 7708K select 0 0:00 0.00% appsecured
1862 root 1 103 0 20276K 6808K select 0 0:00 0.00% wwand
1860 root 1 76 0 26316K 5916K select 0 0:00 0.00% bdbrepd
89298 root 1 77 0 11216K 4164K select 0 0:00 0.00% sshd
1458 root 1 76 0 3780K 1472K select 0 0:00 0.00% usbd
1877 root 1 76 0 13824K 4600K select 0 0:00 0.00% nstraced
39 root 1 -16 0 0K 16K psleep 0 0:00 0.00% pagedaemon
9 root 1 -16 0 0K 16K octagl 0 0:00 0.00% octagl
1851 root 1 139 0 11936K 4280K select 0 0:00 0.00% pppd
1861 root 1 93 0 14352K 4276K select 0 0:00 0.00% sendd
1886 root 1 95 0 14084K 3844K select 0 0:00 0.00% sdxd
1895 root 1 20 0 9892K 812K pause 0 0:00 0.00% ntpd
1854 root 1 76 0 13080K 4068K select 0 0:00 0.00% oamd
1884 root 1 20 0 12004K 3624K pause 0 0:00 0.00% webapid
6 root 1 8 0 0K 16K - 0 0:00 0.00% kqueue taskq
333 root 1 -8 0 0K 16K mdwait 0 0:00 0.00% md2
89318 sshd 1 8 0 10116K 2744K nanslp 0 0:00 0.00% sshd
89345 root 1 81 0 10064K 3968K select 0 0:00 0.00% sshd
89340 root 1 79 0 10064K 3968K select 0 0:00 0.00% sshd
89342 root 1 81 0 10064K 3968K select 0 0:00 0.00% sshd
59 root 1 -8 0 0K 16K mdwait 0 0:00 0.00% md0
89348 root 1 4 0 8704K 3912K sbwait 0 0:00 0.00% sshd
89346 sshd 1 81 0 10068K 1896K select 0 0:00 0.00% sshd
89347 sshd 1 82 0 10068K 1896K select 0 0:00 0.00% sshd
89343 sshd 1 82 0 10068K 1888K select 0 0:00 0.00% sshd
1868 root 1 88 0 8772K 2564K select 0 0:00 0.00% inetd
1827 root 1 83 0 4920K 1616K select 0 0:00 0.00% tnetd
1888 root 1 5 0 3504K 1496K ttyin 0 0:00 0.00% getty
89349 root 1 76 0 25204K 2184K CPU0 0 0:00 0.00% top
88791 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89107 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89042 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88687 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89333 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89339 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88954 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88129 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89278 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88579 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88497 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89248 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89295 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88355 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88598 root 1 4 0 3436K 1552K sbwait 0 0:00 0.00% telnetd
88892 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87955 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88204 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88136 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88051 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88430 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88001 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88299 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87909 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87778 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87866 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
85903 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88027 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89310 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
85978 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
86238 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87771 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89336 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
85812 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
86159 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87441 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
86385 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89267 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87629 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87489 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87575 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
69319 root 1 4 0 3440K 1468K sbwait 0 0:00 0.00% telnetd
86620 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
79294 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
86067 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87715 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
85814 root 1 4 0 3436K 1552K sbwait 0 0:00 0.00% telnetd
87297 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
73450 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87354 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
73518 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89325 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
86318 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89332 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89275 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89327 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89284 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89326 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87843 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89261 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
85754 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
86467 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87718 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
32 root 1 8 0 0K 16K usbevt 0 0:00 0.00% usb0
34 root 1 8 0 0K 16K usbevt 0 0:00 0.00% usb1
0 root 1 -8 0 0K 0K WAIT 0 0:00 0.00% swapper
37 root 1 -44 -163 0K 16K WAIT 0 0:00 0.00% swi1: ipfwd
36 root 1 -36 -155 0K 16K WAIT 0 0:00 0.00% swi3: ipopt ip6opt
31 root 1 -48 -167 0K 16K WAIT 0 0:00 0.00% swi0: uart
1702 root 1 -8 0 0K 16K mdwait 0 0:00 0.00% md3
8 root 1 8 0 0K 16K - 0 0:00 0.00% thread taskq
50 root 1 -8 0 0K 16K select 0 0:00 0.00% if_pfe_listen
53 root 1 -8 0 0K 16K select 0 0:00 0.00% if_pic_listen0
46 root 1 76 0 0K 16K sleep 0 0:00 0.00% netdaemon
51 root 1 4 0 0K 16K dump_r 0 0:00 0.00% kern_dump_proc
54 root 1 8 0 0K 16K - 0 0:00 0.00% nfsiod 0
56 root 1 8 0 0K 16K - 0 0:00 0.00% nfsiod 2
1583 root 1 8 0 0K 16K crypto 0 0:00 0.00% crypto
57 root 1 8 0 0K 16K - 0 0:00 0.00% nfsiod 3
1584 root 1 8 0 0K 16K crypto 0 0:00 0.00% crypto returns
55 root 1 8 0 0K 16K - 0 0:00 0.00% nfsiod 1
52 root 1 4 0 0K 16K purge_ 0 0:00 0.00% kern_pir_proc
1585 root 1 8 0 0K 16K crypto 0 0:00 0.00% crypto
1586 root 1 8 0 0K 16K crypto 0 0:00 0.00% crypto returns
33 root 1 8 0 0K 16K usbtsk 0 0:00 0.00% usbtask
7 root 1 8 0 0K 16K - 0 0:00 0.00% mastership taskq
27 root 1 -12 -131 0K 16K WAIT 0 0:00 0.00% swi9: Giant taskq
28 root 1 -12 -131 0K 16K WAIT 0 0:00 0.00% swi9: task queue
30 root 1 -16 -135 0K 16K WAIT 0 0:00 0.00% swi8: +
24 root 1 -24 -143 0K 16K WAIT 0 0:00 0.00% swi6: vm
38 root 1 -32 -151 0K 16K WAIT 0 0:00 0.00% swi4: ipmismatch+
15 root 1 171 52 0K 16K CPU0 0 0:00 0.00% idle: cpu6
14 root 1 171 52 0K 16K CPU0 0 0:00 0.00% idle: cpu7
13 root 1 171 52 0K 16K CPU0 0 0:00 0.00% idle: cpu8
12 root 1 171 52 0K 16K CPU0 0 0:00 0.00% idle: cpu9
11 root 1 171 52 0K 16K CPU0 0 0:00 0.00% idle: cpu10
10 root 1 171 52 0K 16K CPU0 0 0:00 0.00% idle: cpu11
16 root 1 171 52 0K 16K CPU0 0 0:00 0.00% idle: cpu5
17 root 1 171 52 0K 16K CPU0 0 0:00 0.00% idle: cpu4

 

Here is answers for the question:

 

  • Since when you're facing the issue? - The past 4 weeks.
  • Any changes made prior to this issue? - No, the only thing i can think of, is that some ports have been opened.
  • Is there any pattern in the reboot like every 3 hours its rebooting kinda situation? - Sadly no pattern, sometimes 2-4 hours, sometimes 2-4 days.
  • Do you have SNMP monitoring where we can see the device status? - No.

 

I hope you can help.

Thank you.

 

/Nikolaj

 

SRX Services Gateway

Re: 0x1000:reboot due to panic

‎08-26-2019 02:22 AM

Hi Nikolaj,

 

From the output, I can see none of the processes are consuming more CPU but still Idle has low percent. Can you please provide me the output for the following:

 

user@host> start shell

user@host% top

 

If I don't find any processes consuming CPU threads from the output as well, then we left with 2 options: Upgrading the device to the recommended Junos version or initiating the RMA for the chassis

 

Also, I managed to look into other forums threads and please check the last update, let me know if you've any LTE module  - https://forums.juniper.net/t5/SRX-Services-Gateway/SRX-340-occasional-panic/td-p/326160



Thanks,
π00bm@$t€®.
Please, Mark My Solution Accepted if it Helped, Kudos are Appreciated too!!!
SRX Services Gateway

Re: 0x1000:reboot due to panic

‎08-26-2019 02:29 AM

Hi

 

Here is the output for shell top:

 

last pid: 6872; load averages: 3.04, 2.59, 2.37 up 1+13:41:02 08:26:15
178 processes: 5 running, 173 sleeping
CPU states: 78.0% user, 0.0% nice, 2.2% system, 0.1% interrupt, 19.7% idle
Mem: 332M Active, 138M Inact, 1596M Wired, 390M Cache, 112M Buf, 1523M Free
Swap:

PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
1849 root 6 76 0 1554M 471M select 0 119.2H 287.89% flowd_octeon_hm
1876 root 7 76 0 34520K 9280K select 0 22:42 0.00% aamwd
1496 root 1 76 0 18316K 6600K select 0 14:30 0.00% eventd
1857 root 1 76 0 110M 32296K select 0 11:07 0.00% authd
1832 root 1 76 0 10004K 5972K select 0 8:14 0.00% ntpd
1839 root 1 76 0 60504K 22784K select 0 7:01 0.00% pfed
1878 root 1 76 0 19924K 8124K select 0 5:36 0.00% rtlogd
1838 root 1 109 0 8832K 2504K select 0 4:38 0.00% inetd
1885 root 1 -4 0 19004K 7784K ufs 0 4:09 0.00% license-check
1856 root 1 76 0 104M 19196K select 0 3:21 0.00% jdhcpd
1834 root 1 76 0 35148K 16928K select 0 3:20 0.00% snmpd
1837 root 1 76 0 39328K 14392K select 0 2:53 0.00% l2ald
1843 root 1 76 0 22252K 10408K select 0 2:38 0.00% ppmd
1835 root 1 76 0 49408K 15456K select 0 2:28 0.00% mib2d
1864 root 1 76 0 19804K 4820K select 0 1:34 0.00% shm-rtsdbd
1853 root 1 4 0 31696K 14036K kqread 0 1:22 0.00% l2cpd
1875 root 7 8 0 97404K 7076K nanslp 0 0:49 0.00% ipfd
1915 nobody 2 76 0 13176K 5712K ucondt 0 0:48 0.00% httpd
1836 root 1 4 0 68628K 33032K kqread 0 0:38 0.00% rpd
1826 root 1 76 0 3544K 1496K select 0 0:37 0.00% bslockd
1829 root 1 76 0 73484K 26036K select 0 0:35 0.00% chassisd
1830 root 1 76 0 18360K 6984K select 0 0:32 0.00% alarmd
1847 root 1 76 0 11200K 3996K select 0 0:31 0.00% irsd
1863 root 1 76 0 58300K 37256K select 0 0:26 0.00% smid
1842 root 1 76 0 36472K 14168K select 0 0:25 0.00% kmd
1928 nobody 1 4 0 12256K 1668K kqread 0 0:21 0.00% webapid
1858 root 1 76 0 27076K 11584K select 0 0:18 0.00% cfmd
1883 root 1 8 0 29996K 4488K nanslp 0 0:18 0.00% wmic
1869 root 1 76 0 20148K 8012K select 0 0:16 0.00% pkid
1879 root 1 76 0 23208K 9960K select 0 0:15 0.00% utmd
1828 root 1 76 0 44556K 13864K select 0 0:12 0.00% dcd
1887 root 1 4 0 29984K 12548K kqread 0 0:10 0.00% dot1xd
1867 root 1 76 0 37932K 14988K select 0 0:08 0.00% nsd
1874 root 1 76 0 52108K 11648K select 0 0:08 0.00% idpd
1848 root 1 76 0 19528K 8288K select 0 0:08 0.00% bfdd
71135 root 1 76 0 12476K 4216K select 0 0:06 0.00% sshd
1825 root 1 76 0 3084K 1060K select 0 0:06 0.00% watchdog
1840 root 1 76 0 21060K 9132K select 0 0:05 0.00% rmopd
1855 root 1 76 0 11632K 4396K select 0 0:05 0.00% lfmd
1841 root 1 76 0 30404K 11580K select 0 0:05 0.00% cosd
1866 root 1 76 0 21776K 10808K select 0 0:04 0.00% jsrpd
1831 root 1 76 0 19076K 6484K select 0 0:04 0.00% craftd
71212 Nikolaj 1 8 0 69600K 29940K wait 0 0:03 0.00% cli
1833 root 1 76 0 55324K 24324K select 0 0:02 0.00% mgd
1594 root 1 8 0 3732K 1436K nanslp 0 0:02 0.00% cron
1845 root 1 76 0 36904K 15840K select 0 0:01 0.00% dfwd
1870 root 1 76 0 17228K 5716K select 0 0:01 0.00% httpd-gk
1859 root 1 76 0 14536K 3796K select 0 0:01 0.00% mplsoamd
1881 root 3 79 0 20188K 6068K ucond 0 0:01 0.00% syshmd
1882 root 1 76 0 10952K 3292K select 0 0:01 0.00% smtpd
6662 Nikolaj 1 76 0 25612K 2720K CPU0 0 0:01 0.00% top
71213 root 1 76 0 55672K 11380K select 0 0:01 0.00% mgd
1872 root 2 81 0 27704K 6588K select 0 0:00 0.00% appidd
1873 root 1 76 0 28768K 7708K select 0 0:00 0.00% appsecured
1862 root 1 103 0 20276K 6808K select 0 0:00 0.00% wwand
6831 root 1 -4 0 11216K 4164K ufs 0 0:00 0.00% sshd
1860 root 1 76 0 26316K 5912K select 0 0:00 0.00% bdbrepd
6837 root 1 79 0 11216K 4164K select 0 0:00 0.00% sshd
1458 root 1 76 0 3780K 1472K select 0 0:00 0.00% usbd
1877 root 1 76 0 13824K 4600K select 0 0:00 0.00% nstraced
1851 root 1 139 0 11936K 4280K select 0 0:00 0.00% pppd
1861 root 1 93 0 14352K 4276K select 0 0:00 0.00% sendd
1886 root 1 95 0 14084K 3844K select 0 0:00 0.00% sdxd
1895 root 1 20 0 9892K 812K pause 0 0:00 0.00% ntpd
1854 root 1 76 0 13080K 4068K select 0 0:00 0.00% oamd
1884 root 1 20 0 12004K 3624K pause 0 0:00 0.00% webapid
6834 sshd 1 4 0 10116K 2744K sbwait 0 0:00 0.00% sshd
6839 sshd 1 8 0 10116K 2744K nanslp 0 0:00 0.00% sshd
6849 root 1 -8 0 11204K 4232K biowr 0 0:00 0.00% sshd
6851 root 1 -4 0 10064K 3968K ufs 0 0:00 0.00% sshd
6858 root 1 -4 0 10064K 3968K ufs 0 0:00 0.00% sshd
6859 root 1 -4 0 10064K 3968K ufs 0 0:00 0.00% sshd
6641 root 1 84 0 10052K 3956K select 0 0:00 0.00% sshd
6856 sshd 1 4 0 10116K 1972K sbwait 0 0:00 0.00% sshd
6857 sshd 1 4 0 10068K 1908K sbwait 0 0:00 0.00% sshd
6860 sshd 1 4 0 10068K 1908K sbwait 0 0:00 0.00% sshd
6861 sshd 1 4 0 10068K 1908K sbwait 0 0:00 0.00% sshd
1868 root 1 88 0 8772K 2564K select 0 0:00 0.00% inetd

 

I can see that the "flowd_octeon_hm" is very high, any sugestions?

 

I don´t have any LTE module, or any other modules.

 

/Nikolaj

SRX Services Gateway

Re: 0x1000:reboot due to panic

[ Edited ]
‎08-26-2019 03:03 AM

Hi Nikolaj,

 

flowd_octeon_hm is responsible for packet processing in SRX. Generally, it will run high due to the nature of the CPU and we should focus on other processes apart from flowd_octeon_hm.

 

As of now, I don't see any other processes consuming more CPU cycles. I suspected RE CPU to be one of the causes, however, looking at the outputs I cant conclude further. 

 

Although there can be other reasons for reboot; for instance, it can be due to overheating, device consuming more RE CPU, a bug in the Junos code, a process crashed resulting in generating a core-dump and finally hardware issue.

 

I have zeroize and Junos upgrade in mind, let me know whether we can perform the same. For zeroize procedure, refer the following technical documentation - https://www.juniper.net/documentation/en_US/junos/topics/reference/command-summary/request-system-ze...

 

If we ruled out all the possibilities then I would suggest you contact JTAC for proceeding with the RMA.



Thanks,
π00bm@$t€®.
Please, Mark My Solution Accepted if it Helped, Kudos are Appreciated too!!!
SRX Services Gateway

Re: 0x1000:reboot due to panic

‎08-26-2019 05:03 AM

Hi noobmaster,

 

flowd_octeon_hm is responsible for packet processing in SRX. Generally, it will run high due to the nature of the CPU and we should focus on other processes apart from flowd_octeon_hm. - Sorry, i haven´t googled it when asking :-)

 

I will try to contact JTAC support, and then update the firmware to D170.

 

Do you have any idea, why a core-dump is not created, when the SRX crashes?

 

/var/crash/*core*: No such file or directory
/var/tmp/*core*: No such file or directory
/var/tmp/pics/*core*: No such file or directory
/var/crash/kernel.*: No such file or directory
/var/jails/rest-api/tmp/*core*: No such file or directory
/tftpboot/corefiles/*core*: No such file or directory

 

/Nikolaj

SRX Services Gateway

Re: 0x1000:reboot due to panic

‎08-26-2019 05:47 AM

Hi Nikolaj,

 

No worries.

 

Answering to your question, "Do you have any idea, why a core-dump is not created, when the SRX crashes?"

 

We can't anticipate every time that core-dumps will be generated whenever SRX crashes. Mostly core-dumps are generated to capture the state of the process when it abruptly terminated or when it crashed. This is on the software-level. However, there are certain scenarios where the hardware itself is faulty and it can't generate a core-dump

 

Hope this helps.



Thanks,
π00bm@$t€®.
Please, Mark My Solution Accepted if it Helped, Kudos are Appreciated too!!!
SRX Services Gateway
Solution
Accepted by topic author Nikolaj_Nielsen
‎08-30-2019 02:19 AM

Re: 0x1000:reboot due to panic

‎08-26-2019 06:42 AM

I suspect 63 telnet and 8 ssh sessions may be playing a part.

 

89318 sshd 1 8 0 10116K 2744K nanslp 0 0:00 0.00% sshd
89345 root 1 81 0 10064K 3968K select 0 0:00 0.00% sshd
89340 root 1 79 0 10064K 3968K select 0 0:00 0.00% sshd
89342 root 1 81 0 10064K 3968K select 0 0:00 0.00% sshd
89348 root 1 4 0 8704K 3912K sbwait 0 0:00 0.00% sshd
89346 sshd 1 81 0 10068K 1896K select 0 0:00 0.00% sshd
89347 sshd 1 82 0 10068K 1896K select 0 0:00 0.00% sshd
89343 sshd 1 82 0 10068K 1888K select 0 0:00 0.00% sshd
1868 root 1 88 0 8772K 2564K select 0 0:00 0.00% inetd
1827 root 1 83 0 4920K 1616K select 0 0:00 0.00% tnetd
88791 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89107 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89042 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88687 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89333 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89339 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88954 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88129 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89278 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88579 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88497 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89248 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89295 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88355 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88598 root 1 4 0 3436K 1552K sbwait 0 0:00 0.00% telnetd
88892 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87955 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88204 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88136 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88051 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88430 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88001 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88299 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87909 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87778 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87866 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
85903 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
88027 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89310 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
85978 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
86238 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87771 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89336 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
85812 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
86159 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87441 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
86385 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89267 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87629 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87489 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87575 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
69319 root 1 4 0 3440K 1468K sbwait 0 0:00 0.00% telnetd
86620 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
79294 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
86067 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87715 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
85814 root 1 4 0 3436K 1552K sbwait 0 0:00 0.00% telnetd
87297 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
73450 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87354 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
73518 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89325 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
86318 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89332 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89275 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89327 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89284 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89326 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87843 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
89261 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
85754 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
86467 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
87718 root 1 4 0 3440K 1560K sbwait 0 0:00 0.00% telnetd
SRX Services Gateway

Re: 0x1000:reboot due to panic

‎08-26-2019 05:40 PM

Nikolaj,

 

Do you have any kind of syslog configured on the SRX? (share "show system syslog")

 

We could check if there are logs related to the reboot. Try:

 

> show log messages

> show log chassisd

 

I you could upload the logs we could certainly check them and let you know.

 

Please mark my answer as the Solution if it applies.
SRX Services Gateway

Re: 0x1000:reboot due to panic

[ Edited ]
‎08-27-2019 12:25 AM

Hello,

 

I strongly suggest opening a JTAC case so we can look into any potential component issues.

 

https://kb.juniper.net/InfoCenter/index?page=content&id=TSB17581

 

Regards,

 

Vikas

SRX Services Gateway

Re: 0x1000:reboot due to panic

‎08-30-2019 02:19 AM

Hi

 

I think it was because all the telnet and ssh connections.

I have changed my config, and by now, the SRX haven´t rebotted yet.

 

Thank you for your help.

 

/Nikolaj