Routing

last person joined: 3 days ago 

Ask questions and share experiences about ACX Series, CTP Series, MX Series, PTX Series, SSR Series, JRR Series, and all things routing, including portfolios and protocols.
Back to discussions
Expand all | Collapse all

90 ms delay between vr and physical router

  • 1.  90 ms delay between vr and physical router

    Posted 02-16-2013 14:18

    I'm having problem with delay between virtual and physical router about 90ms. We moved configuration from M7i to MX960.

     

    Between those routers is BGP.  On M7i we had about 20M traffic between logical interfaces which connects vr with physical router.  Right now on MX960 we have 380M traffic 🙂 so I assume that this causing so huge delay. Anyone have any idea why, and what should I look for

     

    Regards



  • 2.  RE: 90 ms delay between vr and physical router

    Posted 02-17-2013 09:08

     

    Hey there,

     

     Would you mind pasting your config with regards to lt- interfaces and VR/intercon info? I'm assuming you have tunnel-services bandwidth 1g (which IIRC minimum on MX960) so don't think that'd be the root.

     

     Cheers,



  • 3.  RE: 90 ms delay between vr and physical router

    Posted 02-17-2013 09:55

    Hi erderms, thanks for your reply.

     

    My configuration:

     

    #--------------------------------------------

    show configuration chassis

    redundancy { graceful-switchover; } 

    fpc 2 { pic 0 { tunnel-services { bandwidth 1g; } } }

     

    #--------------------------------------------

    show configuration interfaces lt-2/0/10

    description "logical tunnel interfce connects logical routers";

    unit 12 { description "**** xxxx ****";

    encapsulation vlan; vlan-id 300;

    peer-unit 21;

    family inet { address XXX.XXX.XXX.1/30; } }

     

     

     

    #--------------------------------------------

    show configuration logical-systems test-gw interfaces lt-2/0/10

    unit 21 { description "****xxxx ****";

    encapsulation vlan;

    vlan-id 300;

    peer-unit 12;

    family inet { address XXX.XXX.XXX.2/30; } }

     

     Between there is BGP session established.

     

     

    #--------------------------------------------

     

    monitor interface lt-2/0/10.12

     

    Interface: lt-2/0/10.12, Enabled, Link is Up
    Flags: SNMP-Traps 0x4000
    Encapsulation: LT-VLAN
    VLAN-Tag [ 0x8100.912 ]
    Local statistics: Current delta
    Input bytes: 3234935 [629]
    Output bytes: 9073771 [1180]
    Input packets: 56792 [11]
    Output packets: 57177 [11]
    Remote statistics:
    Input bytes: 16719822615365 (379147504 bps) [3384353832]
    Output bytes: 16368447960896 (370463624 bps) [3319881543]
    Input packets: 220273859587 (628640 pps) [45063516]
    Output packets: 218213314935 (624366 pps) [44777666]
    Traffic statistics:
    Input bytes: 16719825850300 [3384354461]
    Output bytes: 16368457034667 [3319882723]
    Input packets: 220273916379 [45063527]
    Output packets: 218213372112 [44777677]
    Protocol: inet, MTU: 1500, Flags: None

     



  • 4.  RE: 90 ms delay between vr and physical router

    Posted 02-18-2013 07:22

    When we moved traffic to another fpc where is MIC   4x 10GE XFP na set tunnel services also on 1G we have 400-800M of traffic input and output . 



  • 5.  RE: 90 ms delay between vr and physical router

    Posted 02-18-2013 22:03

    Hey there,

     

     Apologies for the delay. Can you go ahead and configure 10G for the tunnel services bw and see if it helps?

     

    Cheers,



  • 6.  RE: 90 ms delay between vr and physical router

    Posted 02-18-2013 23:03

    Sorry it didn't help.  Some bug generate such big traffic and between lt.  When we set bandwidth 1g it only helps us to limit this traffic.  



  • 7.  RE: 90 ms delay between vr and physical router

    Posted 02-19-2013 10:41

     

    Hey there,

     

     What do you mean by a bug generatic extra traffic? How much actual load do you expect between the VR and the main instance normally?

     

     I think that 'extra traffic' should be the first thing to solve 🙂 how about routing-engine cpu/memory load? (show chassis routing engine)

     

    Cheers,



  • 8.  RE: 90 ms delay between vr and physical router
    Best Answer

    Posted 02-19-2013 11:49

    Make sure your Junos OS release is not affected by: PR/685639: TTL check skipped for tunnel packets. Affected maintenance releases are 11.4R1, 11.4R2, 11.4R3, 12.1R1 and 12.1R2. What's your OS?



  • 9.  RE: 90 ms delay between vr and physical router

    Posted 02-19-2013 12:32

    Hi amonge!

     

    I'm very thankfull for your post! We have JUNOS 11.4R2 so it seems that this is the problem:

     

    Packets exchanged between logical routers within the same physical router over logical
    tunnel (LT) interfaces will not have their TTL decremented. [PR/685639: This issue
    has been resolved.]
    • Under very special race conditions, the MPC CPU might stop processing and will be
    reset due to Level3/Level 2 watchdog expiration timer. Potential exposure causes high
    load of traffic sent to the Host.

     


    Should i downgrade to JunOS 10.4R8.6? 



  • 10.  RE: 90 ms delay between vr and physical router

    Posted 02-19-2013 12:40

    I'd recommend to upgrade to latest 11.4 maintenance release.



  • 11.  RE: 90 ms delay between vr and physical router

    Posted 02-19-2013 23:13

     

    JTAC recommendation:

     

    MX Series with Enhanced SCB JUNOS 11.4R2.15

     

    Is this release also affected by  PR/685639?



  • 12.  RE: 90 ms delay between vr and physical router

    Posted 02-20-2013 01:43
    Yes it is affected, as per my previous post.


  • 13.  RE: 90 ms delay between vr and physical router

    Posted 02-20-2013 01:50

    Thanks,  i'm going to update to 11.4R6.6 



  • 14.  RE: 90 ms delay between vr and physical router

    Posted 02-20-2013 06:15

    JUNOS 11.4R6.6 solve our problem

     

    Thank you for your help!