Ethernet Switching
Highlighted
Ethernet Switching

Huge latency between two ex switches

‎09-26-2017 01:44 AM

I have two EX VC's connected to each other with two point to point links. 

 

The primary link is showing a latency of 8000ms pinging across it and the carrier is saying the circuit looks clean. There are event policies in place if one of the /30 ptp's has bad latency or fails...this is working.

 

While I know the Junos are differing etc the second point to point works absolutely fine. it is the next /30 in the range and is using 102 vlan tags

 

 

NetAdmin@Switch A> show configuration interfaces ge-0/0/8 
vlan-tagging;
unit 103 {
description "To NLAMSW01 port ge-0/0/26 - ISP1";
vlan-id 103;
family inet {
address 10.124.53.9/30;
}

Model: ex4550-32f
JUNOS Base OS boot [12.3R9.4]
JUNOS Base OS Software Suite [12.3R9.4]


64 bytes from 10.124.53.10: icmp_seq=117 ttl=64 time=9485.909 ms
64 bytes from 10.124.53.10: icmp_seq=118 ttl=64 time=8826.218 ms
64 bytes from 10.124.53.10: icmp_seq=119 ttl=64 time=8019.213 ms
64 bytes from 10.124.53.10: icmp_seq=120 ttl=64 time=8022.188 ms
64 bytes from 10.124.53.10: icmp_seq=121 ttl=64 time=9023.250 ms
64 bytes from 10.124.53.10: icmp_seq=122 ttl=64 time=8289.785 ms
64 bytes from 10.124.53.10: icmp_seq=123 ttl=64 time=9250.036 ms
64 bytes from 10.124.53.10: icmp_seq=124 ttl=64 time=8820.183 ms


Physical interface: ge-0/0/8, Enabled, Physical link is Up
Interface index: 160, SNMP ifIndex: 527, Generation: 173
Description: To port ge-0/0/26
Link-level type: Ethernet, MTU: 1518, Speed: 1000mbps, Duplex: Full-Duplex, BPDU Error: None, MAC-REWRITE Error: None, Loopback: Disabled, Source filtering: Disabled,
Flow control: Enabled, Auto-negotiation: Enabled, Remote fault: Online, Media type: Fiber
Device flags : Present Running
Interface flags: SNMP-Traps Internal: 0x0
CoS queues : 8 supported, 8 maximum usable queues
Hold-times : Up 0 ms, Down 0 ms
Current address: 44:f4:77:65:62:4b, Hardware address: 44:f4:77:65:62:4b
Last flapped : 2017-09-23 13:46:49 CEST (2d 20:55 ago)
Statistics last cleared: Never
Traffic statistics:
Input bytes : 8543418 0 bps
Output bytes : 9453440 0 bps
Input packets: 125493 0 pps
Output packets: 135886 0 pps
IPv6 transit statistics:
Input bytes : 0
Output bytes : 0
Input packets: 0
Output packets: 0
Input errors:
Errors: 0, Drops: 0, Framing errors: 0, Runts: 0, Policed discards: 0, L3 incompletes: 0, L2 channel errors: 0, L2 mismatch timeouts: 0, FIFO errors: 0, Resource errors: 0
Output errors:
Carrier transitions: 1, Errors: 0, Drops: 0, Collisions: 0, Aged packets: 0, FIFO errors: 0, HS link CRC errors: 0, MTU errors: 0, Resource errors: 0
Egress queues: 8 supported, 4 in use
Queue counters: Queued packets Transmitted packets Dropped packets
0 best-effort 0 16971908 0
1 assured-forw 0 0 0
5 expedited-fo 0 0 0
7 network-cont 0 12803295 0
Queue number: Mapped forwarding classes
0 best-effort
1 assured-forwarding
5 expedited-forwarding
7 network-control
Active alarms : None
Active defects : None
MAC statistics: Receive Transmit
Total octets 8543418 9453440
Total packets 125493 135886
Unicast packets 124758 135228
Broadcast packets 735 658
Multicast packets 0 0
CRC/Align errors 0 0
FIFO errors 0 0
MAC control frames 0 0
MAC pause frames 0 0
Oversized frames 0
Jabber frames 0
Fragment frames 0
Code violations 0
Autonegotiation information:
Negotiation status: Complete
Link partner:
Link mode: Full-duplex, Flow control: Symmetric, Remote fault: OK, Link partner Speed: 1000 Mbps
Local resolution:
Flow control: Symmetric, Remote fault: Link OK
Packet Forwarding Engine configuration:
Destination slot: 0
CoS information:
Direction : Output
CoS transmit queue Bandwidth Buffer Priority Limit
% bps % usec
0 best-effort 95 950000000 95 NA low none
7 network-control 5 50000000 5 NA low none
Interface transmit statistics: Disabled

Logical interface ge-0/0/8.0 (Index 81) (SNMP ifIndex 528) (Generation 201)
Flags: Up SNMP-Traps 0x0 VLAN-Tag [ 0x0000.0 ] Encapsulation: ENET2
Traffic statistics:
Input bytes : 0
Output bytes : 0
Input packets: 0
Output packets: 0
Local statistics:
Input bytes : 0
Output bytes : 0
Input packets: 0
Output packets: 0
Transit statistics:
Input bytes : 0 0 bps
Output bytes : 0 0 bps
Input packets: 0 0 pps
Output packets: 0 0 pps

Logical interface ge-0/0/8.103 (Index 96) (SNMP ifIndex 530) (HW Token 4092) (Generation 202)
Description: To NLAMEYSW01 port ge-0/0/26 - Level3
Flags: Up SNMP-Traps 0x0 VLAN-Tag [ 0x8100.103 ] Encapsulation: ENET2
Traffic statistics:
Input bytes : 8041510
Output bytes : 5794954
Input packets: 125494
Output packets: 125679
Local statistics:
Input bytes : 8041510
Output bytes : 5794954
Input packets: 125494
Output packets: 125679
Transit statistics:
Input bytes : 0 0 bps
Output bytes : 0 0 bps
Input packets: 0 0 pps
Output packets: 0 0 pps
Protocol inet, MTU: 1500, Generation: 214, Route table: 0
Flags: None
Addresses, Flags: Is-Preferred Is-Primary
Destination: 10.124.53.8/30, Local: 10.124.53.9, Broadcast: 10.124.53.11, Generation: 197



 

 

NetAdmin@Switch_B> show configuration interfaces ge-0/0/26                   
vlan-tagging;
unit 103 {
    description "To DEFFSW port ge-0/0/8";
    vlan-id 103;
    family inet {
        address 10.124.53.10/30;



Model: ex4300-32f
Junos: 14.1X53-D35.3
JUNOS EX Software Suite [14.1X53-D35.3]



show route 10.124.53.9
inet.0: 13 destinations, 18 routes (13 active, 0 holddown, 0 hidden)
+ = Active Route, - = Last Active, * = Both

10.124.53.8/30 *[Direct/0] 7w6d 07:45:36
> via ge-0/0/26.103


ping 10.124.53.9
PING 10.124.53.9 (10.124.53.9): 56 data bytes
64 bytes from 10.124.53.9: icmp_seq=0 ttl=64 time=9017.716 ms
64 bytes from 10.124.53.9: icmp_seq=1 ttl=64 time=8379.199 ms
64 bytes from 10.124.53.9: icmp_seq=2 ttl=64 time=8017.152 ms
64 bytes from 10.124.53.9: icmp_seq=3 ttl=64 time=8017.150 ms




NetAdmin@NLAMEYSW01> show interfaces ge-0/0/26 extensive
Physical interface: ge-0/0/26, Enabled, Physical link is Up
Interface index: 654, SNMP ifIndex: 510, Generation: 147
Description: To port ge-0/0/26
Link-level type: Ethernet, MTU: 1518, MRU: 0, Speed: 1000mbps, Duplex: Full-Duplex, BPDU Error: None, MAC-REWRITE Error: None, Loopback: Disabled, Source filtering: Disabled,
Flow control: Enabled, Auto-negotiation: Enabled, Remote fault: Online, Media type: Fiber
Device flags : Present Running
Interface flags: SNMP-Traps Internal: 0x0
CoS queues : 12 supported, 12 maximum usable queues
Hold-times : Up 0 ms, Down 0 ms
Current address: 20:4e:71:30:45:dd, Hardware address: 20:4e:71:30:45:dd
Last flapped : 2017-08-02 04:02:02 CEST (7w6d 07:19 ago)
Statistics last cleared: 2017-09-26 11:15:12 CEST (00:06:35 ago)
Traffic statistics:
Input bytes : 16826 256 bps
Output bytes : 32754 528 bps
Input packets: 236 1 pps
Output packets: 462 1 pps
IPv6 transit statistics:
Input bytes : 0
Output bytes : 0
Input packets: 0
Output packets: 0
Input errors:
Errors: 0, Drops: 0, Framing errors: 0, Runts: 0, Policed discards: 0, L3 incompletes: 0, L2 channel errors: 0, L2 mismatch timeouts: 0, FIFO errors: 0, Resource errors: 0
Output errors:
Carrier transitions: 0, Errors: 0, Drops: 0, Collisions: 0, Aged packets: 0, FIFO errors: 0, HS link CRC errors: 0, MTU errors: 0, Resource errors: 0
Egress queues: 12 supported, 8 in use
Queue counters: Queued packets Transmitted packets Dropped packets
0 0 0 0
1 0 0 0
2 0 0 0
3 0 466 0
8 0 0 0
9 0 0 0
10 0 0 0
11 0 0 0
Queue number: Mapped forwarding classes
0 best-effort
1 expedited-forwarding
2 assured-forwarding
3 network-control
8 mcast-be
9 mcast-ef
10 mcast-af
11 mcast-nc
Active alarms : None
Active defects : None
MAC statistics: Receive Transmit
Total octets 16826 32754
Total packets 236 462
Unicast packets 236 255
Broadcast packets 0 0
Multicast packets 0 207
CRC/Align errors 0 0
FIFO errors 0 0
MAC control frames 0 0
MAC pause frames 0 0
Oversized frames 0
Jabber frames 0
Fragment frames 0
VLAN tagged frames 236
Code violations 0
Autonegotiation information:
Negotiation status: Complete
Link partner:
Link mode: Full-duplex, Flow control: Symmetric/Asymmetric, Remote fault: OK, Link partner Speed: 1000 Mbps
Local resolution:
Flow control: Symmetric/Asymmetric, Remote fault: Link OK
Packet Forwarding Engine configuration:
Destination slot: 0
CoS information:
Direction : Output
CoS transmit queue Bandwidth Buffer Priority Limit
% bps % usec
0 best-effort 75 750000000 75 0 low none
3 network-control 5 50000000 5 0 low none
8 mcast-be 15 150000000 15 0 low none
11 mcast-nc 5 50000000 5 0 low none
Interface transmit statistics: Disabled
MACSec statistics:
Output
Secure Channel Transmitted
Protected Packets : 0
Encrypted Packets : 0
Protected Bytes : 0
Encrypted Bytes : 0
Input
Secure Channel Received
Accepted Packets : 0
Validated Bytes : 0
Decrypted Bytes : 0

 

 

2 REPLIES 2
Ethernet Switching

Re: Huge latency between two ex switches

‎09-30-2017 06:29 AM

Can you run the ping test with the source or interface option to insure the source address of the ping test is coming from the connected interface.

 

ping 

ping 10.124.53.10 source 10.124.53.9
or
ping 10.124.53.10 interface ge-0/0/8

This will insure you are testing the link itself both ways.  I'm wondering if your ping is sourcing from the loopback the the return routing path from the remote side is using the other link or some other path. 

Steve Puluka BSEET - Juniper Ambassador
IP Architect - DQE Communications Pittsburgh, PA (Metro Ethernet & ISP)
http://puluka.com/home
Highlighted
Ethernet Switching

Re: Huge latency between two ex switches

‎10-03-2017 10:14 PM

Probably you faced with the problem described in  PR1164135
Title QFX5100/EX4600: ICMP latency when pinging to and/or from directly connected l3/irb interfaces
...This is due to a hardware limitation. Transit traffic is not affected.

Feedback