Ethernet Switching
Ethernet Switching

pem_tvp_periodic

[ Edited ]
‎01-11-2019 05:50 AM

Hi,

 

in my chassis Logfile I've tons of those messages:

 

Jan 10 01:47:59  pem_tvp_periodic cbd=9518940 slot=1, state=1
Jan 10 01:48:04  pem_tvp_periodic cbd=9518940 slot=1, state=1
Jan 10 01:48:04  pem_tvp_periodic cbd=9518940 slot=1, state=1
Jan 10 01:48:09  pem_tvp_periodic cbd=9518940 slot=1, state=1
 
this repeats every few seconds and it is always the same message. I allready google and search the forum but didn't found anything about it. Can anyone explain where they came from and how to stop it?
 
System is a QFX5100 in VC with 2 Members.
 
THX
--Manuel
9 REPLIES 9
Ethernet Switching

Re: pem_tvp_periodic

‎01-11-2019 06:05 AM

There are two possibilities

One is communication error between the daemon who is managing LEDs and physical LEDs. The other is power supply flapping.

Are you seeing any alarm at the time of errors?

 

Two narrow down

1. Restart “craftd” via shell command “root% kill -9 <process ID of craftd>”
2. Reseat physically all power supplies on both FPCs

Ethernet Switching

Re: pem_tvp_periodic

‎01-11-2019 06:24 AM

Ok, it must be the deamon for managing the LEDs because all LEDs are off but Ports working fine so far. I'm new in QFX and already wondering why all LEDs are off.

 

Maybe a hardware problem on both switches because reboot does not help to enable LEDs?

Ethernet Switching

Re: pem_tvp_periodic

‎01-11-2019 06:35 AM

Restart of craftd did not help:

 

Jan 11 14:31:51 pem_tvp_periodic cbd=9518940 slot=1, state=1
Jan 11 14:31:53 chassis_handle_peer_receive: closing connection: errno = 0

Jan 11 14:31:53 closing connection on fd 42
Jan 11 14:31:53 craftd connection completed
Jan 11 14:31:56 pem_tvp_periodic cbd=9518940 slot=1, state=1
Jan 11 14:31:56 pem_tvp_periodic cbd=9518940 slot=1, state=1
Jan 11 14:32:01 pem_tvp_periodic cbd=9518940 slot=1, state=1
Jan 11 14:32:01 pem_tvp_periodic cbd=9518940 slot=1, state=1
Jan 11 14:32:06 pem_tvp_periodic cbd=9518940 slot=1, state=1

 

 

There are no alarms 

Ethernet Switching

Re: pem_tvp_periodic

‎01-12-2019 04:36 AM

Since the reboot of the switch and restart of process do not help this is very likely a hardware failure.

 

You will need to open an official support ticket with JTAC to have them verify and arrange for an RMA replacement.

 

https://my.juniper.net/#dashboard/servicerequests

 

Steve Puluka BSEET - Juniper Ambassador
IP Architect - DQE Communications Pittsburgh, PA (Metro Ethernet & ISP)
http://puluka.com/home
Highlighted
Ethernet Switching

Re: pem_tvp_periodic

‎01-12-2019 07:50 AM

This is not a hardware failure. These logs are informational and are displayed after the periodic check that confirms that that the power supply is ok. No need for a RMA or further action.

Ethernet Switching

Re: pem_tvp_periodic

‎01-12-2019 08:16 AM

If there is no hardware issue why are all the craft LEDs not working?

 

And why would an "all is good" event be logged at such a frequency?

 

Steve Puluka BSEET - Juniper Ambassador
IP Architect - DQE Communications Pittsburgh, PA (Metro Ethernet & ISP)
http://puluka.com/home
Ethernet Switching

Re: pem_tvp_periodic

‎01-12-2019 08:30 AM

Oh I missed the part about the LEDs. My response was based solely on the meaning of the messages in the initial post. The messages don't indicate a problem as I previously stated.

 

It would be interesting to see the output of "show chassis led" to understand what might be going on with the LEDs.

Ethernet Switching

Re: pem_tvp_periodic

‎01-13-2019 01:41 AM

manuel@qfx5100-01> show chassis led
LED status for: FPC 0
-----------------------------------
LEDs status:
Alarm LED : Off
Beacon LED: Off
System LED: Green
Master LED: Green

Interface STATUS LED LINK/ACTIVITY LED
---------------------------------------------------------
xe-0/0/0 N/A Green
xe-0/0/1 N/A Green
xe-0/0/2 N/A Green
xe-0/0/3 N/A Green
xe-0/0/4 N/A Green
xe-0/0/5 N/A Green
xe-0/0/6 N/A Green
xe-0/0/7 N/A Green
xe-0/0/8 N/A Green
xe-0/0/9 N/A Green
xe-0/0/10 N/A Green
xe-0/0/11 N/A Green
xe-0/0/12 N/A Green
xe-0/0/13 N/A Green
xe-0/0/14 N/A Green
xe-0/0/15 N/A Green
xe-0/0/16 N/A Green
xe-0/0/17 N/A Green
xe-0/0/18 N/A Green
xe-0/0/19 N/A Green
xe-0/0/20 N/A Green
xe-0/0/21 N/A Green
xe-0/0/22 N/A Green
xe-0/0/23 N/A Green
xe-0/0/24 N/A Green
xe-0/0/25 N/A Green
xe-0/0/26 N/A Green
xe-0/0/27 N/A Green
xe-0/0/28 N/A Green
xe-0/0/29 N/A Green
xe-0/0/30 N/A Green
xe-0/0/31 N/A Green
xe-0/0/32 N/A Green
xe-0/0/33 N/A Green
xe-0/0/34 N/A Green
xe-0/0/35 N/A Green
xe-0/0/36 N/A Green
xe-0/0/37 N/A Green
xe-0/0/38 N/A Green
xe-0/0/39 N/A Green
xe-0/0/40 N/A Green
xe-0/0/41 N/A Green
xe-0/0/42 N/A Green
xe-0/0/43 N/A Green
xe-0/0/44 N/A Green
xe-0/0/45 N/A Green
xe-0/0/46 N/A Green
xe-0/0/47 N/A Green

LED status for: FPC 1
-----------------------------------
LEDs status:
Alarm LED : Off
Beacon LED: Beacon ON
System LED: Green
Master LED: Green Blinking
Phone Home LED: Green

Interface STATUS LED LINK/ACTIVITY LED
---------------------------------------------------------
xe-1/0/0 N/A Green
xe-1/0/1 N/A Green
xe-1/0/2 N/A Green
xe-1/0/3 N/A Green
xe-1/0/4 N/A Green
xe-1/0/5 N/A Green
xe-1/0/6 N/A Green
xe-1/0/7 N/A Green
xe-1/0/8 N/A Green
xe-1/0/9 N/A Green
xe-1/0/10 N/A Green
xe-1/0/11 N/A Green
xe-1/0/12 N/A Green
xe-1/0/13 N/A Green
xe-1/0/14 N/A Green
xe-1/0/15 N/A Green
xe-1/0/16 N/A Green
xe-1/0/17 N/A Green
xe-1/0/18 N/A Green
xe-1/0/19 N/A Green
xe-1/0/20 N/A Green
xe-1/0/21 N/A Green
xe-1/0/22 N/A Green
xe-1/0/23 N/A Green
xe-1/0/24 N/A Green
xe-1/0/25 N/A Green
xe-1/0/26 N/A Green
xe-1/0/27 N/A Green
xe-1/0/28 N/A Green
xe-1/0/29 N/A Green
xe-1/0/30 N/A Green
xe-1/0/31 N/A Green
xe-1/0/32 N/A Green
xe-1/0/33 N/A Green
xe-1/0/34 N/A Green
xe-1/0/35 N/A Green
xe-1/0/36 N/A Green
xe-1/0/37 N/A Green
xe-1/0/38 N/A Green
xe-1/0/39 N/A Green
xe-1/0/40 N/A Green
xe-1/0/41 N/A Green
xe-1/0/42 N/A Green
xe-1/0/43 N/A Green
xe-1/0/44 N/A Green
xe-1/0/45 N/A Green
xe-1/0/46 N/A Green
xe-1/0/47 N/A Green

{master:0}
manuel@qfx5100-01>

 

 

I'm wondering that all Ports should be "Green" because not all Ports have an aktive link.

 

For exmaple:

 

Physical interface: xe-0/0/0, Enabled, Physical link is Up
Link-level type: Ethernet, MTU: 1514, LAN-PHY mode, Speed: Auto, Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled, Auto-negotiation: Disabled, Remote fault: Offline, Media type: Fiber
Device flags : Present Running
Interface flags: SNMP-Traps Internal: 0x4000
Link flags : None

Logical interface xe-0/0/0.0
Flags: Up SNMP-Traps 0x24024000 Encapsulation: Ethernet-Bridge
eth-switch

 

 

Physical interface: xe-0/0/1, Enabled, Physical link is Up
Link-level type: Ethernet, MTU: 1514, LAN-PHY mode, Speed: Auto, Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled, Auto-negotiation: Disabled, Remote fault: Offline, Media type: Fiber
Device flags : Present Running
Interface flags: SNMP-Traps Internal: 0x4000
Link flags : None

Logical interface xe-0/0/1.0
Flags: Up SNMP-Traps 0x24024000 Encapsulation: Ethernet-Bridge
eth-switch

 

 

Physical interface: xe-0/0/2, Enabled, Physical link is Up
Link-level type: Ethernet, MTU: 9216, LAN-PHY mode, Speed: Auto, Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled, Auto-negotiation: Disabled, Remote fault: Offline, Media type: Fiber
Device flags : Present Running
Interface flags: SNMP-Traps Internal: 0x4000
Link flags : None

Logical interface xe-0/0/2.0
Flags: Up SNMP-Traps 0x24024000 Encapsulation: Ethernet-Bridge
aenet

 

 

Physical interface: xe-0/0/3, Enabled, Physical link is Down
Link-level type: Ethernet, MTU: 1514, LAN-PHY mode, Speed: Auto, Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled, Auto-negotiation: Disabled, Remote fault: Offline, Media type: Fiber
Device flags : Present Running Down
Interface flags: Hardware-Down SNMP-Traps Internal: 0x4000
Link flags : None

Logical interface xe-0/0/3.16386
Flags: Device-Down 0x4004000 Encapsulation: ENET2

 

 

 

You see, "xe-0/0/3" is down. Should the LED also be Green in such state?

 

The repeat it: All physikal LEDs are OFF at the Front!

Ethernet Switching

Re: pem_tvp_periodic

‎01-13-2019 04:43 AM

The cli view should match the led view and the actual status of the ports.  So clearly there is a problem here.

 

It might be possible this is software and not hardware but that seems unlikely to me.

 

I would open an official ticket for review and request an RMA.

 

Steve Puluka BSEET - Juniper Ambassador
IP Architect - DQE Communications Pittsburgh, PA (Metro Ethernet & ISP)
http://puluka.com/home