Ethernet Switching
Highlighted
Ethernet Switching

EX 4200 Upgrade VC Switch Stack Fail

‎11-27-2018 09:54 PM

Hello All,

 

I have some EX4200's on our network that are all in a switch stack (anywhere from 2 to 4 switches in each stack). They are on an extremely old code (10.4R9.2) and I have been going through and upgrading them to 15.1R7.9. Now obviously this will need two upgrades to get there and the path I took was 10.4R9.2 > 12.3R12.4 > 15.1R7.9.

 

I almost never run into problems with the latter half of this upgrade, but no matter what methods I use I always run into issues upgrading from 10.x to 12.x. I have tried multiple scenarios and I still cannot find a foolproof way to do these so I could comfortably do them remotely. I have seen issues like an FPC member coming up on a corrupt image and denying the install, an FPC member breaking away from the VC as "Not Present" in which that FPC was stuck in the bootup sequence, and even an issue where an FPC member crashed and went into db> mode.

 

I have tried every single way Juniper has recommended (at least from what I could find) on how to upgrade a switch stack of EX4200 switches in a VC.

 

Tried the normal way:

request system software add validate /var/tmp/jinstall-ex-4200-12.3R12.4-domestic-signed.tgz
request system reboot all-members
request system snapshot slice alternate
request system software add validate /var/tmp/jinstall-ex-4200-15.1R7.9-domestic-signed.tgz
request system reboot all-members
request system snapshot slice alternate

 

Tried the tedious way (with the jloader😞

 file copy fpc0:/var/tmp/jloader-ex-3242-12.1R3-signed.tgz fpc1:/var/tmp/
file copy fpc0:/var/tmp/jloader-ex-3242-12.1R3-signed.tgz fpc2:/var/tmp/
request system software add /var/tmp/jloader-ex-3242-12.1R3-signed.tgz member 2
request system software add /var/tmp/jloader-ex-3242-12.1R3-signed.tgz member 1
request system software add /var/tmp/jloader-ex-3242-12.1R3-signed.tgz member 0
file copy fpc0:/var/tmp/jinstall-ex-4200-12.3R12.4-domestic-signed.tgz fpc1:/var/tmp/
file copy fpc0:/var/tmp/jinstall-ex-4200-12.3R12.4-domestic-signed.tgz fpc2:/var/tmp/
request system software add validate /var/tmp/jinstall-ex-4200-12.3R12.4-domestic-signed.tgz member 2
request system software add validate /var/tmp/jinstall-ex-4200-12.3R12.4-domestic-signed.tgz member 1
request system software add validate /var/tmp/jinstall-ex-4200-12.3R12.4-domestic-signed.tgz member 0
request system reboot all-members
request system snapshot slice alternate
file copy fpc0:/var/tmp/jinstall-ex-4200-15.1R7.9-domestic-signed.tgz fpc1:/var/tmp/
file copy fpc0:/var/tmp/jinstall-ex-4200-15.1R7.9-domestic-signed.tgz fpc2:/var/tmp/
request system software add validate /var/tmp/jinstall-ex-4200-15.1R7.9-domestic-signed.tgz member 2
request system software add validate /var/tmp/jinstall-ex-4200-15.1R7.9-domestic-signed.tgz member 1
request system software add validate /var/tmp/jinstall-ex-4200-15.1R7.9-domestic-signed.tgz member 0
request system reboot all-members
request system snapshot slice alternate

 

Tried it without the jloader:

file copy fpc0:/var/tmp/jinstall-ex-4200-12.3R12.4-domestic-signed.tgz fpc1:/var/tmp/
file copy fpc0:/var/tmp/jinstall-ex-4200-12.3R12.4-domestic-signed.tgz fpc2:/var/tmp/
request system software add validate /var/tmp/jinstall-ex-4200-12.3R12.4-domestic-signed.tgz member 2
request system software add validate /var/tmp/jinstall-ex-4200-12.3R12.4-domestic-signed.tgz member 1
request system software add validate /var/tmp/jinstall-ex-4200-12.3R12.4-domestic-signed.tgz member 0
request system reboot all-members
request system snapshot slice alternate
file copy fpc0:/var/tmp/jinstall-ex-4200-15.1R7.9-domestic-signed.tgz fpc1:/var/tmp/
file copy fpc0:/var/tmp/jinstall-ex-4200-15.1R7.9-domestic-signed.tgz fpc2:/var/tmp/
request system software add validate /var/tmp/jinstall-ex-4200-15.1R7.9-domestic-signed.tgz member 2
request system software add validate /var/tmp/jinstall-ex-4200-15.1R7.9-domestic-signed.tgz member 1
request system software add validate /var/tmp/jinstall-ex-4200-15.1R7.9-domestic-signed.tgz member 0
request system reboot all-members
request system snapshot slice alternate

 

 

 

And even now in the lab consoled in I tried it the normal way again but this time added the jloader, rebooted, then added the jinstall for 12., rebooted and FPC 0 did not take the upgrade. Received the below error during bootup sequence.

 

gzip: stdin: invalid compressed data--format violated
tar: Unexpected EOF in archive
tar: Unexpected EOF in archive
tar: Error is not recoverable: exiting now
*** The installer exited with status 2 ***
*** The installation is unsuccessful!!! ***
A shell has been started. type exit<cr> to reboot:

 

Any suggestions would be greatly appreciated.

4 REPLIES 4
Highlighted
Ethernet Switching

Re: EX 4200 Upgrade VC Switch Stack Fail

‎11-27-2018 10:04 PM

Hi,

 

I beilive the upgrade path would be 10.4 -> 11.4 -> 12.X-> 15.x

But i dont see 11.X version in our support site since its end of support.

 

Would you be able to try a USB install ? Ofcourse this will erase all your existing configuration.

You may need to take a backup in that case. 

 

-Ajo Thomas

Highlighted
Ethernet Switching

Re: EX 4200 Upgrade VC Switch Stack Fail

[ Edited ]
‎11-27-2018 10:07 PM

It was my understanding that you can push an upgrade between two version releases at a time. Is there some sort of exception regarding the 10.x versions that I am unaware of?

 

That's another thing. The "tedious" way I posted earlier, I have tested that multiple times in a lab setting on a two switch stack, however when I went to implement this on a three switch stack remotely FPC 2 broke and went into db> mode.

 

EDIT: To be a little more precise you can upgrade between 2 service releases and 3 extended releases IIRC.

Highlighted
Ethernet Switching

Re: EX 4200 Upgrade VC Switch Stack Fail

‎11-27-2018 11:47 PM

I believe I know the issue that I was seeing in the lab. I never had the date set and it was pulling an install package that was signed at a later date than what the switch is on.

 

That answers the lab... Not the other issues, however.

Highlighted
Ethernet Switching

Re: EX 4200 Upgrade VC Switch Stack Fail

‎11-27-2018 11:48 PM

This is what you would typically see if there was a time mismatch between your device and the install package your trying to use:

 

{master:0}
root> ...mp/jinstall-ex-4200-12.3R12.4-domestic-signed.tgz

Checking pending install on fpc1

Checking pending install on fpc0
Pushing bundle to fpc1

Validating on fpc1

Validating on fpc0
Done with validate on all virtual chassis members

fpc1:
tar: +CONTENTS: time stamp Jan 20 07:02 2016 is 125097902 s in the future
tar: +COMMENT: time stamp Jan 20 07:02 2016 is 125097902 s in the future
tar: +DESC: time stamp Jan 20 07:02 2016 is 125097902 s in the future
tar: +INSTALL: time stamp Jan 20 07:02 2016 is 125097902 s in the future
tar: jinstall-ex-4200-12.3R12.4-domestic.tgz: time stamp Jan 20 07:02 2016 is 125097870 s in the future
tar: jinstall-ex-4200-12.3R12.4-domestic.tgz.md5: time stamp Jan 20 07:02 2016 is 125097873 s in the future
tar: jinstall-ex-4200-12.3R12.4-domestic.tgz.sha1: time stamp Jan 20 07:02 2016 is 125097872 s in the future
tar: jinstall-ex-4200-12.3R12.4-domestic.tgz.sig: time stamp Jan 20 07:02 2016 is 125097874 s in the future
tar: certs.pem: time stamp Jan 20 01:14 2016 is 125076985 s in the future
tar: +DESC: time stamp Jan 20 07:02 2016 is 125097848 s in the future
tar: kernel: time stamp Jan 20 04:07 2016 is 125087365 s in the future
WARNING: A reboot is required to install the software
WARNING: Use the 'request system reboot' command immediately

fpc0:
tar: +CONTENTS: time stamp Jan 20 07:02 2016 is 125097863 s in the future
tar: +COMMENT: time stamp Jan 20 07:02 2016 is 125097863 s in the future
tar: +DESC: time stamp Jan 20 07:02 2016 is 125097863 s in the future
tar: +INSTALL: time stamp Jan 20 07:02 2016 is 125097863 s in the future
tar: jinstall-ex-4200-12.3R12.4-domestic.tgz: time stamp Jan 20 07:02 2016 is 125097833 s in the future
tar: jinstall-ex-4200-12.3R12.4-domestic.tgz.md5: time stamp Jan 20 07:02 2016 is 125097836 s in the future
tar: jinstall-ex-4200-12.3R12.4-domestic.tgz.sha1: time stamp Jan 20 07:02 2016 is 125097835 s in the future
tar: jinstall-ex-4200-12.3R12.4-domestic.tgz.sig: time stamp Jan 20 07:02 2016 is 125097837 s in the future
tar: certs.pem: time stamp Jan 20 01:14 2016 is 125076948 s in the future
tar: +DESC: time stamp Jan 20 07:02 2016 is 125097810 s in the future
tar: kernel: time stamp Jan 20 04:07 2016 is 125087328 s in the future
WARNING: A reboot is required to install the software
WARNING: Use the 'request system reboot' command immediately

Feedback