Switching

Hi,

We have a 4300 virtual chassis stack of 3 and is configured preprovisioned.  When I do show virtual-chassis status, only unit 1 is showing neighbors for 0 and 2.  But unit 0 and 2 are not showing each other as neighbors.  We have 4200 stacks and have never seen this.  Stack has been rebooted, and cable from Unit 0 to 2 replaced.  Any help is appreciated!

root@NOC-ES-01> show virtual-chassis status

Preprovisioned Virtual Chassis
Virtual Chassis ID: 9984.6180.d8a9
Virtual Chassis Mode: Enabled
                                                Mstr           Mixed Route Neighbor List
Member ID  Status   Serial No    Model          prio  Role      Mode  Mode ID  Interface
0 (FPC 0)  Prsnt        xxxxxxxxx  ex4300-24p     129   Master*      N  VC   1  vcp-255/1/0
1 (FPC 1)  Prsnt        xxxxxxxxx  ex4300-24p       0   Linecard     N  VC   2  vcp-255/1/0
                                                                           0  vcp-255/1/1
2 (FPC 2)  Prsnt       xxxxxxxxx   ex4300-24p     129   Backup       N  VC   1  vcp-255/1/1

> show virtual-chassis device-topology
fpc0:
--------------------------------------------------------------------------
                                               Neighbor List 
Member  Device  Status   System ID         Member  Device  Interface
   0       0    Prsnt    100e.7ea6.33c0       1       1    vcp-255/1/0
   1       1    Prsnt    ec3e.f790.27c0       0       0    vcp-255/1/1
                                              2       2    vcp-255/1/0
   2       2    Prsnt    100e.7ea6.3f60       1       1    vcp-255/1/1

fpc1:
--------------------------------------------------------------------------
                                               Neighbor List 
Member  Device  Status   System ID         Member  Device  Interface
   0       0    Prsnt    100e.7ea6.33c0       1       1    vcp-255/1/0
   1       1    Prsnt    ec3e.f790.27c0       0       0    vcp-255/1/1
                                              2       2    vcp-255/1/0
   2       2    Prsnt    100e.7ea6.3f60       1       1    vcp-255/1/1

fpc2:
--------------------------------------------------------------------------
                                               Neighbor List 
Member  Device  Status   System ID         Member  Device  Interface
   0       0    Prsnt    100e.7ea6.33c0       1       1    vcp-255/1/0
   1       1    Prsnt    ec3e.f790.27c0       0       0    vcp-255/1/1
                                              2       2    vcp-255/1/0
   2       2    Prsnt    100e.7ea6.3f60       1       1    vcp-255/1/1

{master:0}

Model: ex4300-24p
Junos: 14.1X53-D35.3

Maybe the default VCP configuration for EX4300 members 0 and 2 got changed somehow?  Suggest you get the output of:

show virtual-chassis vc-port all-members

And if need be follow step 10 from Pre-Provision section of:

http://www.juniper.net/documentation/en_US/junos15.1/topics/task/configuration/virtual-chassis-ex4300-configuring.html

Hopefully this helps.

Hi,

Could you check for:

show virtual-chassis device-topology all-members
show virtual-chassis vc-port all-members

Cheers,

Ashvin

rccpgm/ AshvinO - thank you and please see below.

> show virtual-chassis vc-port all-members
fpc0:
--------------------------------------------------------------------------
Interface   Type              Trunk  Status       Speed        Neighbor
or                             ID                 (mbps)       ID  Interface
PIC / Port
1/0         Configured         -1    Up           40000        1   vcp-255/1/1
1/1         Configured         -1    Down         40000
1/2         Configured               Absent 
1/3         Configured               Absent 

fpc1:
--------------------------------------------------------------------------
Interface   Type              Trunk  Status       Speed        Neighbor
or                             ID                 (mbps)       ID  Interface
PIC / Port
1/0         Configured         -1    Up           40000        2   vcp-255/1/1
1/1         Configured         -1    Up           40000        0   vcp-255/1/0
1/3         Configured               Absent 
1/2         Configured               Absent 

fpc2:
--------------------------------------------------------------------------
Interface   Type              Trunk  Status       Speed        Neighbor
or                             ID                 (mbps)       ID  Interface
PIC / Port
1/0         Configured         -1    Up           40000
1/1         Configured         -1    Up           40000        1   vcp-255/1/0
1/2         Configured               Absent 
1/3         Configured               Absent 

{master:0}
> show virtual-chassis device-topology all-members
fpc0:
--------------------------------------------------------------------------
                                               Neighbor List 
Member  Device  Status   System ID         Member  Device  Interface
   0       0    Prsnt    100e.7ea6.33c0       1       1    vcp-255/1/0
   1       1    Prsnt    ec3e.f790.27c0       0       0    vcp-255/1/1
                                              2       2    vcp-255/1/0
   2       2    Prsnt    100e.7ea6.3f60       1       1    vcp-255/1/1

fpc1:
--------------------------------------------------------------------------
                                               Neighbor List 
Member  Device  Status   System ID         Member  Device  Interface
   0       0    Prsnt    100e.7ea6.33c0       1       1    vcp-255/1/0
   1       1    Prsnt    ec3e.f790.27c0       0       0    vcp-255/1/1
                                              2       2    vcp-255/1/0
   2       2    Prsnt    100e.7ea6.3f60       1       1    vcp-255/1/1

fpc2:
--------------------------------------------------------------------------
                                               Neighbor List 
Member  Device  Status   System ID         Member  Device  Interface
   0       0    Prsnt    100e.7ea6.33c0       1       1    vcp-255/1/0
   1       1    Prsnt    ec3e.f790.27c0       0       0    vcp-255/1/1
                                              2       2    vcp-255/1/0
   2       2    Prsnt    100e.7ea6.3f60       1       1    vcp-255/1/1

{master:0}
>

root@> show configuration virtual-chassis
preprovisioned;
member 0 {
    role routing-engine;
    serial-number xxxxxx;
}
member 1 {
    role line-card;
    serial-number xxxxxx;
}
member 2 {
    role routing-engine;
    serial-number xxxxxx;
}

{master:0}
root@>

Maybe a HW problem with either FPC0 interface 1/1 or FPC2 interface 1/0?  I assume you are using QSFP+ DAC cables for these connections and you said you already tried a different cable.  How about trying some different interface combinations to try and narrow the situation down?  One side saying Up and other side saying Down looks like some one interface has either bad transmitter or bad receiver.

long story short, unit 2 switch was replaced recently and since then fpc0 1/1 shows down.  The only changes to config was the serial number for preprovisioned.  Ill have to get a maintenance window to troubleshoot hardware further.  Thanks for your time and ill keep you posted.

Hi, 

Some of the things you could dig into further to look for any transitiions and anomalies in receive v/s processed & drops:

show virtual-chassis protocol adjacency detail
show virtual-chassis protocol statistics all-members  

Also, you could try reconfigure the vcp port:

request virtual-chassis vc-port delete fpc-slot 0 pic-slot 1 port 1
request virtual-chassis vc-port set fpc-slot 0 pic-slot 1 port 1

Quite weird for the vcp port to be Up on one side and down on the other. I guess it would be operational Down due to some protocol issue

Cheers,

Ashvin

I have not tried reconfig port yet.

root@> show virtual-chassis protocol adjacency detail
fpc0:
--------------------------------------------------------------------------

ec3e.f790.27c0
  interface-name: vcp-255/1/0.32768, State: Up, Expires in 59 secs
  Priority: 0, Up/Down transitions: 1, Last transition: 4w6d 08:42:47 ago

fpc1:
--------------------------------------------------------------------------

100e.7ea6.3f60
  interface-name: vcp-255/1/0.32768, State: Up, Expires in 58 secs
  Priority: 0, Up/Down transitions: 3, Last transition: 2w4d 09:11:26 ago

100e.7ea6.33c0
  interface-name: vcp-255/1/1.32768, State: Up, Expires in 58 secs
  Priority: 0, Up/Down transitions: 1, Last transition: 4w6d 08:42:48 ago

fpc2:
--------------------------------------------------------------------------

ec3e.f790.27c0
  interface-name: vcp-255/1/1.32768, State: Up, Expires in 58 secs
  Priority: 0, Up/Down transitions: 3, Last transition: 2w4d 09:11:26 ago

{master:0}
root@> show virtual-chassis protocol statistics all-members
fpc0:
--------------------------------------------------------------------------

IS-IS statistics for 100e.7ea6.33c0:
PDU type       Received    Processed        Drops         Sent       Rexmit
LSP              897157       897154            3       667543            2
HELLO           1503849      1503849            0      1503877            0
CSNP                  4            4            0            4            0
PSNP             624946       624946            0       809784            0
Unknown            1576            0            0            0            0
Totals          3027532      3025953            3      2981208            2

Total packets received: 3027532 Sent: 2981210

LSP queue length: 0 Drops: 0
SPF runs: 3834
Fragments rebuilt: 340466
LSP regenerations: 336630
Purges initiated: 0

fpc1:
--------------------------------------------------------------------------

IS-IS statistics for ec3e.f790.27c0:
PDU type       Received    Processed        Drops         Sent       Rexmit
LSP              896077       896077            0      1353165            5
HELLO           2261312      2261312            0      2261259            0
CSNP                  3            3            0            3            0
PSNP            1219960      1219960            0       852481            0
Unknown               0            0            0            0            0
Totals          4377352      4377352            0      4466908            5

Total packets received: 4377352 Sent: 4466913

LSP queue length: 0 Drops: 0
SPF runs: 3816
Fragments rebuilt: 340328
LSP regenerations: 336525
Purges initiated: 0

fpc2:
--------------------------------------------------------------------------

IS-IS statistics for 100e.7ea6.3f60:
PDU type       Received    Processed        Drops         Sent       Rexmit
LSP              895971       895971            0       668626           83
HELLO           1503706      1503706            0      9047912            0
CSNP                 10           10            0           14            0
PSNP             625799       625799            0       808447            0
Unknown           27742            0            0            0            0
Totals          3053228      3025486            0     10524999           83

Total packets received: 3053228 Sent: 10525082

LSP queue length: 0 Drops: 0
SPF runs: 3834
Fragments rebuilt: 340407
LSP regenerations: 336563
Purges initiated: 0

{master:0}
root@>

I had to reseat fpc0 1/1 and status UP but still does not show under vc status

master:0}
root@> show virtual-chassis vc-port all-members   
fpc0:
--------------------------------------------------------------------------
Interface   Type              Trunk  Status       Speed        Neighbor
or                             ID                 (mbps)       ID  Interface
PIC / Port
1/0         Configured         -1    Up           40000        1   vcp-255/1/1
1/1         Configured         -1    Up           40000
1/2         Configured               Absent 
1/3         Configured               Absent 

fpc1:
--------------------------------------------------------------------------
Interface   Type              Trunk  Status       Speed        Neighbor
or                             ID                 (mbps)       ID  Interface
PIC / Port
1/0         Configured         -1    Up           40000        2   vcp-255/1/1
1/1         Configured         -1    Up           40000        0   vcp-255/1/0
1/3         Configured               Absent 
1/2         Configured               Absent 

fpc2:
--------------------------------------------------------------------------
Interface   Type              Trunk  Status       Speed        Neighbor
or                             ID                 (mbps)       ID  Interface
PIC / Port
1/0         Configured         -1    Up           40000
1/1         Configured         -1    Up           40000        1   vcp-255/1/0
1/2         Configured               Absent 
1/3         Configured               Absent 

{master:0}
root@> show virtual-chassis status                

Preprovisioned Virtual Chassis
Virtual Chassis ID: 9984.6180.d8a9
Virtual Chassis Mode: Enabled
                                                Mstr           Mixed Route Neighbor List
Member ID  Status   Serial No    Model          prio  Role      Mode  Mode ID  Interface
0 (FPC 0)  Prsnt    PF123456789 ex4300-24p     129   Master*      N  VC   1  vcp-255/1/0
1 (FPC 1)  Prsnt    PF123456789 ex4300-24p       0   Linecard     N  VC   2  vcp-255/1/0
                                                                           0  vcp-255/1/1
2 (FPC 2)  Prsnt    PF123456789 ex4300-24p     129   Backup       N  VC   1  vcp-255/1/1

{master:0}
root@>

Hi, 

Were you able to re-configure the vcp port. This would probably be the next step to re-configure the vcp port on both members now that the port is Up.

Cheers,

Ashvin

that did the trick, reconfig vc port.

Ashvin0/rccpgm - thank you very much!