04-09-2012 08:22 PM
Hi,
We have an MX80 where a vendor plugged in their end of the fibre today which caused the whole TFEB 0 to reboot. Service couldnt be restored and the system not accessable until the fibre was physically inplugged.
The closest I could find similar to this fault was from back in 2006 - http://puck.nether.net/pipermail/juniper-nsp/2006-
icepick@Vibe-191Q-CRMX1> show log chassisd | match "Apr 10"
Apr 10 13:25:53 rcv: ch_ipc_dispatch() null ipc read for args 0x2342020 pipe 0x23412c0, fru TFEB 0
Apr 10 13:25:53 -- TFEB 0, last request 0, state Online
Apr 10 13:25:53 disconnect: slot 0
Apr 10 13:25:53 CHASSISD_SHUTDOWN_NOTICE: Shutdown reason: TFEB connection lost
Apr 10 13:25:53 CHASSISD_IFDEV_DETACH_FPC: ifdev_detach_fpc(0)
Apr 10 13:25:53 ifd lc-0/0/0 marked as gone
Apr 10 13:25:53 ifd pfh-0/0/0 marked as gone
Apr 10 13:25:53 ifd pfe-0/0/0 marked as gone
Apr 10 13:25:53 ifd xe-0/0/0 marked as gone
Apr 10 13:25:53 ifd xe-0/0/1 marked as gone
Apr 10 13:25:53 ifd xe-0/0/2 marked as gone
Apr 10 13:25:53 ifd xe-0/0/3 marked as gone
Apr 10 13:25:53 CHASSISD_SNMP_TRAP10: SNMP trap generated: Fru Offline (jnxFruContentsIndex 7, jnxFruL1Index 1, jnxFruL2Index 0, jnxFruL3Index 0, jnxFruName FPC @ 0/*/*, jnxFruType 3, jnxFruSlot 0, jnxFruOfflineReason 2, jnxFruLastPowerOff 0, jnxFruLastPowerOn 0)
Apr 10 13:25:53 CHASSISD_IFDEV_DETACH_FPC: ifdev_detach_fpc(1)
Apr 10 13:25:53 ifd pd-1/0/0 marked as gone
Apr 10 13:25:53 if_pseudo_detach_cleanup: Clearing ifd present flag for pd-1/0/0 from ifd_pseudo_pim ignored. ifm_desc:83
Apr 10 13:25:53 ifd pe-1/0/0 marked as gone
Apr 10 13:25:53 if_pseudo_detach_cleanup: Clearing ifd present flag for pe-1/0/0 from ifd_pseudo_pim ignored. ifm_desc:83
Apr 10 13:25:53 ifd gr-1/0/0 marked as gone
Apr 10 13:25:53 if_pseudo_detach_cleanup: Clearing ifd present flag for gr-1/0/0 from ifd_pseudo_pim ignored. ifm_desc:83
Apr 10 13:25:53 ifd ip-1/0/0 marked as gone
Apr 10 13:25:53 if_pseudo_detach_cleanup: Clearing ifd present flag for ip-1/0/0 from ifd_pseudo_pim ignored. ifm_desc:83
Apr 10 13:25:53 ifd vt-1/0/0 marked as gone
Apr 10 13:25:53 if_pseudo_detach_cleanup: Clearing ifd present flag for vt-1/0/0 from ifd_pseudo_pim ignored. ifm_desc:83
Apr 10 13:25:54 ifd mt-1/0/0 marked as gone
Apr 10 13:25:54 if_pseudo_detach_cleanup: Clearing ifd present flag for mt-1/0/0 from ifd_pseudo_pim ignored. ifm_desc:83
Apr 10 13:25:54 ifd lt-1/0/0 marked as gone
Apr 10 13:25:54 if_pseudo_detach_cleanup: Clearing ifd present flag for lt-1/0/0 from ifd_pseudo_pim ignored. ifm_desc:83
Apr 10 13:25:54 ifd ut-1/0/0 marked as gone
Apr 10 13:25:54 if_pseudo_detach_cleanup: Clearing ifd present flag for ut-1/0/0 from ifd_pseudo_pim ignored. ifm_desc:1
Apr 10 13:25:54 ifd ge-1/0/0 marked as gone
Apr 10 13:25:54 ifd ge-1/0/1 marked as gone
Apr 10 13:25:54 ifd ge-1/0/2 marked as gone
Apr 10 13:25:54 ifd ge-1/0/3 marked as gone
Apr 10 13:25:54 ifd ge-1/0/4 marked as gone
Apr 10 13:25:54 ifd ge-1/0/5 marked as gone
Apr 10 13:25:54 ifd ge-1/0/6 marked as gone
Apr 10 13:25:54 ifd ge-1/0/7 marked as gone
Apr 10 13:25:54 ifd ge-1/0/8 marked as gone
Apr 10 13:25:54 ifd ge-1/0/9 marked as gone
Apr 10 13:25:54 ifd ge-1/1/0 marked as gone
Apr 10 13:25:54 ifd ge-1/1/1 marked as gone
Apr 10 13:25:54 ifd ge-1/1/2 marked as gone
Apr 10 13:25:54 ifd ge-1/1/3 marked as gone
Apr 10 13:25:54 ifd ge-1/1/4 marked as gone
Apr 10 13:25:54 ifd ge-1/1/5 marked as gone
Apr 10 13:25:54 ifd ge-1/1/6 marked as gone
Apr 10 13:25:54 ifd ge-1/1/7 marked as gone
Apr 10 13:25:54 ifd ge-1/1/8 marked as gone
Apr 10 13:25:54 ifd ge-1/1/9 marked as gone
4 crash files were generated...
-rw-r--r-- 1 root wheel 48156823 Apr 10 13:26 core-TAZ-TBB-0.gz.core.1
-rw-r--r-- 1 root wheel 20073232 Apr 10 13:28 core-TAZ-TBB-0.gz.core.2
-rw-r--r-- 1 root wheel 15192857 Apr 10 13:30 core-TAZ-TBB-0.gz.core.3
-rw-r--r-- 1 root wheel 15176391 Apr 10 13:52 core-TAZ-TBB-0.gz.core.4
The fibre that was connected was to a SFP-LX10
icepick@Vibe-191Q-CRMX1> show chassis hardware
Hardware inventory:
Item Version Part number Serial number Description
Chassis F2791 MX80
Midplane REV 08 711-031594 ZP7923 MX80
PEM 0 Rev 04 740-028288 VH07308 AC Power Entry Module
PEM 1 Rev 04 740-028288 VH07307 AC Power Entry Module
Routing Engine BUILTIN BUILTIN Routing Engine
TFEB 0 BUILTIN BUILTIN Forwarding Engine Processor
QXM 0 REV 05 711-028408 ZL8886 MPC QXM
FPC 0 BUILTIN BUILTIN MPC BUILTIN
MIC 0 BUILTIN BUILTIN 4x 10GE XFP
PIC 0 BUILTIN BUILTIN 4x 10GE XFP
FPC 1 BUILTIN BUILTIN MPC BUILTIN
MIC 0 REV 26 750-028392 ZP4465 3D 20x 1GE(LAN) SFP
PIC 0 BUILTIN BUILTIN 10x 1GE(LAN) SFP
Xcvr 0 REV 01 740-011782 P8J2AL1 SFP-SX
Xcvr 9 NON-JNPR FNS103902J6 SFP-SX
PIC 1 BUILTIN BUILTIN 10x 1GE(LAN) SFP
Xcvr 0 L!' NON-JNPR C1008251262 UNSUPPORTED
Xcvr 1 NON-JNPR C1008251390 UNSUPPORTED
Xcvr 2 NON-JNPR SAGU00066 SFP-LX10
Xcvr 7 NON-JNPR SAGU00055 SFP-LX10
Xcvr 8 NON-JNPR FNS10420J2U SFP-SX
Xcvr 9 NON-JNPR AGM112724AJ SFP-T
Fan Tray
Version is as follows:
icepick@Vibe-191Q-CRMX1> show version
Hostname: Vibe-191Q-CRMX1
Model: mx80
JUNOS Base OS boot [11.4R1.14]
JUNOS Base OS Software Suite [11.4R1.14]
JUNOS Kernel Software Suite [11.4R1.14]
JUNOS Crypto Software Suite [11.4R1.14]
JUNOS Packet Forwarding Engine Support (MX80) [11.4R1.14]
JUNOS Online Documentation [11.4R1.14]
JUNOS Routing Software Suite [11.4R1.14]
Any help would be much appreciated.
Many thanks
Barry Murphy
04-12-2012 10:05 PM
The output from "show chassis hardware", there are some un-supported SFPs which were plugged into MX80, maybe this is the reason TFEB was reboot. You should use compatible SFPs with this device and the best would be Juniper SFPs, then try test double-check wherther or not the problem happen again.
04-16-2012 01:41 AM
Since there is a crash file , open a JTAC ticket.
Seems it crashed as the traffic hit the port..