Junos
Highlighted
Junos

EX3300 not starting after power outage

[ Edited ]
‎04-12-2020 06:24 AM

Hi,

We had a power outage in our DC, and after that one of the EX3300 in VC can't start. The switch was running normally before power loss. Right now it's in boot loop. I appended the log from console. It tries to boot from disk0s1 and disk0s2, but they throwing a lot of errors.

What should I do now? Is it an hardware issue? Or just software?

Log: https://pastebin.com/XSViM3nA

(I can't upload it here.. weird) 

4 REPLIES 4
Junos

Re: EX3300 not starting after power outage

[ Edited ]
‎04-12-2020 10:48 AM

Hey xelexin,

 

Greetings, unfortunately, it seems like you are suffering from a corrupted file system:

 

UNKNOWN FILE TYPE I=96
UNEXPECTED SOFT UPDATE INCONSISTENCY

CLEAR? yes

UNKNOWN FILE TYPE I=97
UNEXPECTED SOFT UPDATE INCONSISTENCY

 

 

if you are able to get into the loader prompt you will be able to save the device by rewriting the entire file system, here is the process: https://kb.juniper.net/InfoCenter/index?page=content&id=KB20643

 

good luck buddy!

 

 

If this solves your problem, please mark this post as "Accepted Solution" so we can help others too \:)/

Regards,

Lil Dexx
JNCIE-ENT#863, 3X JNCIP-[SP-ENT-DC], 4X JNCIA [cloud-DevOps-Junos-Design], Champions Ingenius, SSYB

 

 

 

Highlighted
Junos

Re: EX3300 not starting after power outage

‎04-12-2020 11:05 AM

Ok I will follow this KB. Do you have any idea, why this is happened? What should I do to prevent similiar situation in future? 

 

 

Highlighted
Junos

Re: EX3300 not starting after power outage

‎04-12-2020 12:06 PM

Hi xelexin,


Very good question mate! this could be due to many reasons, A software/application/process could hang while attempting to open a file, data could get damaged while copying a file to a flash drive, an abrupt power loss could disrupt a save action, etc.

 

How to avoid it? very good question too, well these causes I mentioned are all fairly normal functions that could lead to data damage if some form of disruption occurs hence preventing file corruption starts with proper device care e.g.

 

Shut down the system properly and in case of power outages have a redundant power source and PSU's if applicable/possible, don’t delete system files readily ( if you need to delete something make sure it is not a file that is paramount for the switch integrity and vitality, check hard drive regularly and a general health check on the hardware/software is very.important, and my best advise is backing up an installation using Snapshots: https://www.juniper.net/documentation/en_US/junos/topics/topic-map/backing-up-install-using-snapshot...

 

Another one I have seen quite often are bad blocks in the boot media that could cause ugly issues as well nevertheless the causes and  the way to avoid them are the same, here you can find more info:https://kb.juniper.net/InfoCenter/index?page=content&id=KB20570


 Eager to hear if you were able to format the file system, note that this will delete the configuration ( in case this device is RE please back up the configuration first) Good luck mate!!

 


If this solves your problem, please mark this post as "Accepted Solution" so we can help others too \:)/

 

Regards,

Lil Dexx
JNCIE-ENT#863, 3X JNCIP-[SP-ENT-DC], 4X JNCIA [cloud-DevOps-Junos-Design], Champions Ingenius, SSYB

 

Highlighted
Junos

Re: EX3300 not starting after power outage

‎04-13-2020 02:53 AM

The main protection from power failures on ex switches is to use snapshots.  These create a backup boot partition that can be used if an event corrupts to boot partition.  These do need to be keep up to date with any changes in the Junos upgrade and configuration.

 

https://www.juniper.net/documentation/en_US/junos/topics/topic-map/backing-up-install-using-snapshot...

 

When a corruption occurs you boot from the backup partition and a message is show on the cli and trap created to alert the operator that the original partition is corrupted and you need to run snapshot again for the repair.

 

Steve Puluka BSEET - Juniper Ambassador
IP Architect - DQE Communications Pittsburgh, PA (Metro Ethernet & ISP)
http://puluka.com/home
Feedback