Routing

Hi,

we use dual RE-S-2000 on MX480 with JUNOS 13.3R9.13 and we have memory over 70% with OSPF, LDP, BGP in dual stack. Below few other info about the status.

Can you help me to reduce the memory consumption ?

Kind regards,

Marco

 

show route summary
Autonomous system number: 49605
Router ID: 31.13.143.253

inet.0: 604264 destinations, 1232882 routes (603624 active, 1 holddown, 122440 hidden)
Direct: 46 routes, 45 active
Local: 43 routes, 43 active
OSPF: 273 routes, 272 active
BGP: 1232505 routes, 603251 active
Static: 6 routes, 6 active
Aggregate: 7 routes, 7 active
RSVP: 2 routes, 0 active

inet.3: 231 destinations, 242 routes (9 active, 0 holddown, 231 hidden)
OSPF: 231 routes, 0 active
RSVP: 2 routes, 2 active
LDP: 9 routes, 7 active

mpls.0: 23 destinations, 23 routes (23 active, 0 holddown, 0 hidden)
MPLS: 4 routes, 4 active
RSVP: 8 routes, 8 active
LDP: 11 routes, 11 active

inet6.0: 105912 destinations, 135814 routes (105505 active, 0 holddown, 521 hidden)
Direct: 39 routes, 22 active
Local: 38 routes, 38 active
OSPF3: 80 routes, 80 active
BGP: 135657 routes, 105365 active

 

 

Hi,

The process consuming more memory is rpd which is probably due to the number of BGP routes in inet.0

You could try looking further using

show task memory
show task memory detail

Cheers,
Ashvin

Hi Ashvin,

below the output about task memory, but the routes are "only" 1.2M no more.

Do you have some idea to optimize the memory usage ?

Thanks !

Marco

 

marco@FIMX480-re0> show task memory
Memory                 Size (kB)  Percentage  When
  Currently In Use:       720912         33%  now
  Maximum Ever Used:      787972         36%  16/07/29 00:11:42
  Available:             2147484        100%  now

{master}
marco@FIMX480-re0> show route summary
Autonomous system number: 49605
Router ID: 31.13.143.253

inet.0: 603802 destinations, 1208212 routes (603458 active, 2 holddown, 916 hidden)
              Direct:     46 routes,     45 active
               Local:     43 routes,     43 active
                OSPF:    273 routes,    272 active
                 BGP: 1207835 routes, 603085 active
              Static:      6 routes,      6 active
           Aggregate:      7 routes,      7 active
                RSVP:      2 routes,      0 active

inet.3: 231 destinations, 242 routes (9 active, 0 holddown, 231 hidden)
                OSPF:    231 routes,      0 active
                RSVP:      2 routes,      2 active
                 LDP:      9 routes,      7 active

mpls.0: 23 destinations, 23 routes (23 active, 0 holddown, 0 hidden)
                MPLS:      4 routes,      4 active
                RSVP:      8 routes,      8 active
                 LDP:     11 routes,     11 active

inet6.0: 106043 destinations, 166649 routes (105645 active, 1 holddown, 536 hidden)
              Direct:     39 routes,     22 active
               Local:     38 routes,     38 active
               OSPF3:     80 routes,     80 active
                 BGP: 166492 routes, 105505 active

Hi,

 

From the snapshots provided, rpd was using approx 835M of memory ~20%.

Max memory used by rpd is 36%. I believe thats within the range for that number of BGP routes.

Adding up memory usage by all processes shows usage at approx 50%.

 

What is the Junos version running on the device. Could it be a memory leak issue.

 

Cheers,

Ashvin

I would suggest you open a case with JTAC.Could be a process thats leaking memory.RPD Memory consumption seems to be within range.

Hi Ashvin,

the versio is

show version
Hostname: FIMX480-re1
Model: mx480
Junos: 13.3R9.13
JUNOS Base OS boot [13.3R9.13]
JUNOS Base OS Software Suite [13.3R9.13]
JUNOS Kernel Software Suite [13.3R9.13]
JUNOS Crypto Software Suite [13.3R9.13]
JUNOS Packet Forwarding Engine Support (M/T/EX Common) [13.3R9.13]
JUNOS Packet Forwarding Engine Support (MX Common) [13.3R9.13]
JUNOS Online Documentation [13.3R9.13]
JUNOS Services AACL Container package [13.3R9.13]
JUNOS Services Application Level Gateways [13.3R9.13]
JUNOS AppId Services [13.3R9.13]
JUNOS Services Captive Portal and Content Delivery Container package [13.3R9.13]
JUNOS Border Gateway Function package [13.3R9.13]
JUNOS Services HTTP Content Management package [13.3R9.13]
JUNOS IDP Services [13.3R9.13]
JUNOS Services LL-PDF Container package [13.3R9.13]
JUNOS Services Jflow Container package [13.3R9.13]
JUNOS Services MobileNext Software package [13.3R9.13]
JUNOS Services Mobile Subscriber Service Container package [13.3R9.13]
JUNOS Services PTSP Container package [13.3R9.13]
JUNOS Services NAT [13.3R9.13]
JUNOS Services RPM [13.3R9.13]
JUNOS Services Stateful Firewall [13.3R9.13]
JUNOS Voice Services Container package [13.3R9.13]
JUNOS Services Crypto [13.3R9.13]
JUNOS Services SSL [13.3R9.13]
JUNOS Services IPSec [13.3R9.13]
JUNOS platform Software Suite [13.3R9.13]
JUNOS Routing Software Suite [13.3R9.13]
JUNOS Runtime Software Suite [13.3R9.13]
JUNOS py-base-i386 [13.3R9.13]

It's the version from JTAC recomended.

Do you have any idea ?

Thansk !

Kind regards,

Marco

 

Hi,

 

The usual suspect would be memory leaks which would depend on specific config. E.g PR1187395

Would suggest raising this with JTAC.

 

Cheers,

Ashvin

Hi Ashvin,

I swapp today the route engine and the memory is always the same:

 

 show chassis routing-engine
Routing Engine status:
  Slot 0:
    Current state                  Backup
    Election priority              Master
    Temperature                 38 degrees C / 100 degrees F
    CPU temperature             40 degrees C / 104 degrees F
    DRAM                      3584 MB (4096 MB installed)
    Memory utilization          75 percent
    CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     0 percent
      Interrupt                  0 percent
      Idle                      99 percent
    Model                          RE-S-2000
    Serial ID                      9009019483
    Start time                     2016-06-10 15:40:13 CEST
    Uptime                         66 days, 17 hours, 3 minutes, 1 second
    Last reboot reason             Router rebooted after a normal shutdown.
    Load averages:                 1 minute   5 minute  15 minute
                                       0.03       0.03       0.00
Routing Engine status:
  Slot 1:
    Current state                  Master
    Election priority              Backup
    Temperature                 40 degrees C / 104 degrees F
    CPU temperature             47 degrees C / 116 degrees F
    DRAM                      3584 MB (4096 MB installed)
    Memory utilization          51 percent
    CPU utilization:
      User                       2 percent
      Background                 0 percent
      Kernel                     4 percent
      Interrupt                  0 percent
      Idle                      93 percent
    Model                          RE-S-2000
    Serial ID                      9009036253
    Start time                     2016-06-10 15:59:54 CEST
    Uptime                         66 days, 16 hours, 43 minutes, 35 seconds
    Last reboot reason             Router rebooted after a normal shutdown.
    Load averages:                 1 minute   5 minute  15 minute
                                       0.00       0.00       0.00

Probably the memory utilization is the peak value or/and the issue leak on memory about the config.

I'll see today what's happened.

Kind regards,

Marco

 

 

 

 

 

Hi, 

 

From the last snapshot, master RE is RE1 which is at 50% mem usage.

Backup RE is RE0 running at 75% mem. Is that still the same?

 

Cheers,

Ashvin

Hi Ashin,

exactly, but now I already rebbot the RE0 in back and the situation is:

 

marco@FIMX480-re1> show chassis routing-engine
Routing Engine status:
  Slot 0:
    Current state                  Backup
    Election priority              Master
    Temperature                 40 degrees C / 104 degrees F
    CPU temperature             42 degrees C / 107 degrees F
    DRAM                      3584 MB (4096 MB installed)
    Memory utilization          43 percent
    CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     0 percent
      Interrupt                  0 percent
      Idle                      99 percent
    Model                          RE-S-2000
    Serial ID                      9009019483
    Start time                     2016-08-16 08:52:18 CEST
    Uptime                         2 hours, 19 minutes, 20 seconds
    Last reboot reason             Router rebooted after a normal shutdown.
    Load averages:                 1 minute   5 minute  15 minute
                                       0.00       0.00       0.00
Routing Engine status:
  Slot 1:
    Current state                  Master
    Election priority              Backup
    Temperature                 41 degrees C / 105 degrees F
    CPU temperature             47 degrees C / 116 degrees F
    DRAM                      3584 MB (4096 MB installed)
    Memory utilization          51 percent
    CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     2 percent
      Interrupt                  1 percent
      Idle                      96 percent
    Model                          RE-S-2000
    Serial ID                      9009036253
    Start time                     2016-06-10 15:59:54 CEST
    Uptime                         66 days, 19 hours, 11 minutes, 52 seconds
    Last reboot reason             Router rebooted after a normal shutdown.
    Load averages:                 1 minute   5 minute  15 minute
                                       0.00       0.02       0.00

As you can see now also the RE0 has 43% in backup, that is normal.

Tomorrow I'll swap again the REs.

Kind regards,

Marco

 

Hi,

Is GRES and NSR enabled as the backup RE using at 43% memory.

Cheers,

Ashvin

Hi Ashvin,

we finally complete the swap and the memory is under 50%

 

show chassis routing-engine
Routing Engine status:
  Slot 0:
    Current state                  Master
    Election priority              Master
    Temperature                 38 degrees C / 100 degrees F
    CPU temperature             41 degrees C / 105 degrees F
    DRAM                      3584 MB (4096 MB installed)
    Memory utilization          46 percent
    CPU utilization:
      User                       1 percent
      Background                 0 percent
      Kernel                     4 percent
      Interrupt                  0 percent
      Idle                      95 percent
    Model                          RE-S-2000
    Serial ID                      9009019483
    Start time                     2016-08-16 08:52:18 CEST
    Uptime                         1 day, 3 hours, 47 minutes, 20 seconds
    Last reboot reason             Router rebooted after a normal shutdown.
    Load averages:                 1 minute   5 minute  15 minute
                                       0.09       0.06       0.01
Routing Engine status:
  Slot 1:
    Current state                  Backup
    Election priority              Backup
    Temperature                 40 degrees C / 104 degrees F
    CPU temperature             45 degrees C / 113 degrees F
    DRAM                      3584 MB (4096 MB installed)
    Memory utilization          47 percent
    CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     0 percent
      Interrupt                  0 percent
      Idle                      99 percent
    Model                          RE-S-2000
    Serial ID                      9009036253
    Start time                     2016-06-10 15:59:54 CEST
    Uptime                         67 days, 20 hours, 39 minutes, 41 seconds
    Last reboot reason             Router rebooted after a normal shutdown.
    Load averages:                 1 minute   5 minute  15 minute
                                       0.00       0.00       0.00

Kind regards,

Marco