03-20-2017 02:13 AM
I just got a new QFX5200 a couple of days ago. When I inspected the unit recently, I noticed that the LEDs for fan trays 0,1 and 4 were blinking amber. When I wanted to check out the problem on the CLI, I was surprised to see that neither "show chassis fan", "show chassis alarms" or "show chassis environment" were showing any problems - the chassis alarm LED also isn't lit. Power cycling the switch didn't make any difference. The switch is running Junos 15.1X53-D210.7
Has anybody observed similar issues?
03-20-2017 03:39 AM
Can you try to reset FANs with Amber LEDs?
Fan Amber Blinking:- An error has been detected in the fan module. Replace the fan module as soon as possible. Either the fan has failed or it is seated incorrectly. To maintain proper airflow through the chassis, leave the fan module installed in the chassis until you are ready to replace it.
03-21-2017 07:56 AM
reseating the individual fans doesn't change the behavior. I also tried swapping a fan with a green LED with one with a amber LED. This resulted in even weirder behavior since it changed the status of one of the other fans. Swapping them back brought back the old LED pattern.
While pulling the fans the chassis error LED came on as expected - so that seems to work. When all the fans were reseated, the chassis error LED went out again and like before, nothing indicates a problem except the fan LEDs themselves.
So for now I'm going to assume that this is a bug in the component that controls the state of the fan LEDs since I can even see all the fan RPM values from the CLI - they all look perfectly fine.
03-21-2017 09:26 AM
Since when did you start noticing this issue?
Did this switch show the said behavior from the beginning or everything was fine earlier?
I am just trying to understand the trigger of this.
03-22-2017 05:23 AM
> show chassis alarms No alarms currently active > show system alarms 2 alarms currently active Alarm time Class Description 2017-03-22 13:13:48 CET Minor JBS For Node locked licenses needed for this device 2017-03-17 14:40:20 CET Minor Rescue configuration is not set > show chassis lcd error: command is not valid on the qfx5200-32c-32q > show chassis led LED status for: FPC 0 ----------------------------------- LEDs status: Alarm LED : Off Beacon LED: Off System LED: Green Master LED: Green Interface STATUS LED LINK/ACTIVITY LED --------------------------------------------------------- sxe-0/0/0 N/A Green et-0/0/8 N/A Off et-0/0/9 N/A Off et-0/0/10 N/A Off et-0/0/11 N/A Off et-0/0/12 N/A Off et-0/0/13 N/A Off et-0/0/14 N/A Off et-0/0/15 N/A Off et-0/0/16 N/A Off et-0/0/17 N/A Off et-0/0/18 N/A Off et-0/0/19 N/A Off et-0/0/20 N/A Off et-0/0/21 N/A Off et-0/0/22 N/A Off et-0/0/23 N/A Off > show chassis environment Class Item Status Measurement Power FPC 0 Power Supply 0 OK FPC 0 Power Supply 1 OK Temp FPC 0 Sensor TopLeft I OK 38 degrees C / 100 degrees F FPC 0 Sensor TopRight E OK 33 degrees C / 91 degrees F FPC 0 Sensor TopCenter I OK 39 degrees C / 102 degrees F FPC 0 Sensor TopLeft E OK 36 degrees C / 96 degrees F FPC 0 Sensor CPULeft I OK 35 degrees C / 95 degrees F FPC 0 Sensor CPURight I OK 34 degrees C / 93 degrees F FPC 0 Sensor CPU Die Temp OK 39 degrees C / 102 degrees F FPC 0 Sensor TopCenter E OK 26 degrees C / 78 degrees F FPC 0 Sensor BottomRight E OK 39 degrees C / 102 degrees F FPC 0 Sensor TopRight I OK 27 degrees C / 80 degrees F FPC 0 Sensor BottomLeft E OK 44 degrees C / 111 degrees F Fans FPC 0 Fan Tray 0 OK Spinning at normal speed FPC 0 Fan Tray 1 OK Spinning at normal speed FPC 0 Fan Tray 2 OK Spinning at normal speed FPC 0 Fan Tray 3 OK Spinning at normal speed FPC 0 Fan Tray 4 OK Spinning at normal speed
> show chassis fan
Item Status RPM Measurement
FPC 0 Tray 0 Fan 0 OK 5973 Spinning at normal speed
FPC 0 Tray 0 Fan 1 OK 6577 Spinning at normal speed
FPC 0 Tray 1 Fan 0 OK 5921 Spinning at normal speed
FPC 0 Tray 1 Fan 1 OK 6428 Spinning at normal speed
FPC 0 Tray 2 Fan 0 OK 5775 Spinning at normal speed
FPC 0 Tray 2 Fan 1 OK 6360 Spinning at normal speed
FPC 0 Tray 3 Fan 0 OK 5763 Spinning at normal speed
FPC 0 Tray 3 Fan 1 OK 6279 Spinning at normal speed
FPC 0 Tray 4 Fan 0 OK 5966 Spinning at normal speed
FPC 0 Tray 4 Fan 1 OK 6593 Spinning at normal speed
The LEDs definitely were fine at the beginning. The only possible correlation I could think of is that I only noticed after we had updated the switch firmware to 15.1X53-D210.7 (from 15.1X53-D30.5 which it shipped with). Right now the only fan LED still green is the one for fan tray 3.
03-26-2017 05:16 AM
Based on the data you posted it seems quite likely this is a false alarm bug.
But there is also a small chance there is an actual problem that the internal data commands are not showing, which would be a more serious bug.
I would recommend opening an official JTAC case to make sure which is the actual bug and that it is tracked in the Juniper PR system for a fix.
Senior IP Engineer - DQE Communications Pittsburgh, PA (Metro Ethernet & ISP)
JNCIA-Junos JNCIS-SEC JNCIP-SEC JNCSP-SEC
JNCDA JNCDS-DC JNCDS-SEC
ACE PanOS 6 ACE PanOS 7
03-29-2017 07:10 AM
It's now almost certain that the firmware is the culprit here. Went back to 15.1X53-D30.5 and the problem went away - all LEDs green as expected. After I went back up to 15.1X53-D210.7 the old problem reappeared - the LEDs of fan trays 0,1 and 4 were blinking amber without any indication of fan problems on the CLI.
The images used were:
Opening a ticket now as advised...
03-29-2017 07:21 PM
There surely is a problem which we need to address. Please open a technical case with TAC we will help you.
One qucik thing do you see these errors across different 5200's?
07-03-2017 02:04 PM
I am facing the same issue just after upgrading to 15.1X53-D230. Did you find solution for this yet?
When Upgraded to 15.1X53-D230, it also has system alarm- "jbs for node locked licenses needed for this device" which was resolved after JBS license update. But FAN LED status is still blinking AMBER.
07-04-2017 03:12 AM
Thanks for your reply.
I hope the issue reolved in D210 is bit different than what I am facing...
In that case, we had System Alarm on the cli which get cleared automatically in next poll.
But in my case, There is no alarm on the cli, everything is fine until you you see that FAN LEDs are blinking Amber, same as explained in the original post.
Correct me if I am wrong.
07-05-2017 07:14 AM
Looks like problem that you are reporting is resolved in version 15.1X53-D231 by PR1274312. https://prsearch.juniper.net/PR1274312