Routing

Hi All,

I have a new mx-10003 as per below

root@MX-10K-2> show chassis hardware
Hardware inventory:
Item Version Part number Description
Chassis JNP10003 [MX10003]
Midplane REV 14 750-074276 Midplane 2
Routing Engine 0 BUILTIN BUILTIN RE-S-1600x8
Routing Engine 1 BUILTIN BUILTIN RE-S-1600x8
CB 0 REV 32 750-067071 Control Board
Mezz REV 16 711-066896 Control Mezz Board
CB 1 REV 32 750-067071 Control Board
Mezz REV 16 711-066896 Control Mezz Board
FPC 1 REV 26 750-066879 LC2103
CPU BUILTIN BUILTIN SMPC PMB
PIC 0 BUILTIN BUILTIN 6xQSFPP
PIC 1 REV 27 750-068806 MIC1
Xcvr 0 131 nm 740-058732 QSFP-100GBASE-LR4
(...)

Line card installed is a JNP10003-LC2103 and on fpc 1, pic 1 a QSFP-100GBASE-LR4 is inserted.

I wanted to set the speed of interface et-1/1/0 to 100GE at port level

root@MX-10K-2# show | compare
[edit]
+ chassis {
+ fpc 1 {
+ pic 1 {
+ port 0 {
+ speed 100g;
+ }
+ }
+ }
+ }

and then i run the command

root@MX-10K-2> request chassis pic fpc-slot 1 pic-slot 1 offline

root@MX-10K-2> request chassis pic fpc-slot 1 pic-slot 1 online

I see

root@MX-10K-2> show chassis fpc pic-status
Slot 1 Online LC2103
PIC 0 Online 6xQSFPP
PIC 1 Ready MIC1

root@MX-10K-2> show chassis fpc pic-status
Slot 1 Online LC2103
PIC 0 Online 6xQSFPP
PIC 1 Online MIC1

and then goes offline

root@MX-10K-2> show chassis fpc pic-status
Slot 1 Online LC2103
PIC 0 Online 6xQSFPP
PIC 1 Offline MIC1

In the logs i read

Aug 5 21:35:10 MX-10K-2 chassisd[12998]: jam_core_ch_fpc_pic_port_profile_set_invalid FPC 1 PIC 1 config invalid updating FPC flag
Aug 5 21:35:10 MX-10K-2 chassisd[12998]: summit_pic_port_profile_isvalid: FPC[1]PIC[1] have invalid profile type 1, reson Both PICs need to be in port-mode or other pic should have number-of-port as 0
Aug 5 21:35:10 MX-10K-2 chassisd[12998]: jam_core_ch_fpc_pic_port_profile_set_invalid FPC 1 PIC 1 config invalid updating FPC flag
Aug 5 21:35:10 MX-10K-2 chassisd[12998]: fpc_pic_ether_do_port_bounce: Invalid pic port configuration alarm raised for fpc slot 1, pic slot 1

The sfp does not appear anymore in the show chassis hardware also.

Any idea bout this error? I tried to look around but it is too much specific as error.

I am following

https://www.juniper.net/documentation/en_US/junos/topics/task/configuration/chassis-mx10003mpc-rate-select-configuring.html

Thanks.

Hello,

The Juniper Tech document you are referring to says it all.

Please refer the following section,

NOTE

Regardless of the line card— MIC (PIC1) or fixed-port PIC (PIC0) installed —you must configureboth the PICs and all the associated ports, under the [edit chassis] hierarchy. Configuring ports on only one of the PICs results in an invalid configuration.

https://www.juniper.net/documentation/en_US/junos/topics/task/configuration/chassis-mx10003mpc-rate-select-configuring.html

Regards,

Ankur

Hi Ankurt,

Thank you for this: i had it in front of my eyes but i overlooked at it.

In any case is misleading this note. It does not explain what has to be configured under "edit chassis".

What has to be configured on both PIC? Again my target is to have only et-1/1/0 at 100 GE. The remaining ports, on boths PICs, will be configured with different speed in the future.

Thanks.

Hi Fab

I don't have a router to test the configuration, but as per the document I think the configuration should be like this,

Here it is up to you how many ports you want to configure, only the ones you configure will be enabled. But remember to configure few ports in each PIC, you can modify them later as you need.

In below example, 3 ports in PIC0 are configured and 3 ports in PIC1.

Refer the following document for more clarity,

https://www.juniper.net/documentation/en_US/junos/topics/task/configuration/chassis-mx10003mpc-rate-select-configuring.html

CONFIG EXAMPLE :

show configuration chassis
fpc 1 {
pic 0 {
port 0 {
speed 40g;
}
port 1 {
speed 40g;
}
port 2 {
speed 10g;
}
}
pic 1 {
port 0 {
speed 100g;
}
port 2 {
speed 40g;
}
port 3 {
speed 40g;
}
}
}

I hope this helped !

Regards

Ankur

Please Mark My Solution Accepted if it Helped, Kudos are Appreciated too!!!

Hi Fab, 

I tested this in lab on MX10003

Please use “set chassis fpc 0 pic 0 number-of-ports 0”

labroot@lab-re0> show configuration chassis fpc 0 pic 1 | display set

set chassis fpc 0 pic 1 port 0 speed 10g

set chassis fpc 0 pic 1 port 1 speed 100g

set chassis fpc 0 pic 1 port 2 speed 100g

set chassis fpc 0 pic 1 port 4 speed 100g

set chassis fpc 0 pic 1 port 5 speed 100g

set chassis fpc 0 pic 1 port 6 speed 100g

set chassis fpc 0 pic 1 port 7 speed 100g

set chassis fpc 0 pic 1 port 8 speed 100g

set chassis fpc 0 pic 1 port 9 speed 10g

set chassis fpc 0 pic 1 port 10 speed 10g

set chassis fpc 0 pic 1 port 11 speed 10g

{master}

labroot@lab-re0> show configuration chassis fpc 0 pic 0 | display set

set chassis fpc 0 pic 0 number-of-ports 0

labroot@lab-re0> show chassis fpc pic-status

Slot 0   Online       LC2103                                       

  PIC 0  Online       6xQSFPP

  PIC 1  Online       MIC1

Slot 1   Offline      LC2103                                       

labroot@lab-re0> show chassis pic pic-slot 1 fpc-slot 0

FPC slot 0, PIC slot 1 information:

  Type                             MIC1

  State                            Online   

  PIC version                 1.26

  Uptime                         9 minutes, 32 seconds

PIC port information:

                         Fiber                    Xcvr vendor       Wave-    Xcvr         JNPR

  Port Cable type        type  Xcvr vendor        part number       length   Firmware     Rev

  0    100GBASE LR4 T2   SM    JUNIPER-SOURCE     SPQCELRCDFBJ2     1302 nm  0.0          REV 01

  1    100GBASE LR4 T2   SM    JUNIPER-SOURCE     SPQCELRCDFBJ2     1302 nm  0.0          REV 01

  2    100GBASE LR4 T2   SM    JUNIPER-SOURCE     SPQCELRCDFBJ2     1302 nm  0.0          REV 01

  4    100GBASE LR4 T2   SM    JUNIPER-SOURCE     SPQCELRCDFBJ2     1302 nm  0.0          REV 01

  5    100GBASE LR4 T2   SM    JUNIPER-SOURCE     SPQCELRCDFAJ2     1302 nm  0.0          REV 01

  6    100GBASE LR4 T2   SM    JUNIPER-SOURCE     SPQCELRCDFBJ2     1302 nm  0.0          REV 01

  7    100GBASE LR4 T2   SM    JUNIPER-SOURCE     SPQCELRCDFAJ2     1302 nm  0.0          REV 01

  8    100GBASE LR4 T2   SM    JUNIPER-SOURCE     SPQCELRCDFBJ2     1302 nm  0.0          REV 01

Port speed information:

  Port  PFE      Capable Port Speeds

  0      0       4x10GE, 40GE, 100GE

  1      0       4x10GE, 40GE, 100GE

  2      0       4x10GE, 40GE, 100GE

  3      0       4x10GE, 40GE, 100GE

  4      1       4x10GE, 40GE, 100GE

  5      1       4x10GE, 40GE, 100GE

  6      1       4x10GE, 40GE, 100GE

  7      1       4x10GE, 40GE, 100GE

  8      2       4x10GE, 40GE, 100GE   

  9      2       4x10GE, 40GE, 100GE

  10     2       4x10GE, 40GE, 100GE

  11     2       4x10GE, 40GE, 100GE

{master}

labroot@lab-re0> show chassis pic pic-slot 0 fpc-slot 0   

FPC slot 0, PIC slot 0 information:

  Type                             6xQSFPP

  State                            Online   

  PIC version                  0.0

  Uptime                         9 minutes, 48 seconds

labroot@lab-re0> show chassis hardware

Hardware inventory:

Item             Version  Part number  Serial number     Description

Chassis                                JN126169FJCB      JNP10003 [MX10003]

Midplane         REV 12   750-074276   CAKA6657          Midplane 2

Routing Engine 0          BUILTIN      BUILTIN           RE-S-1600x8

Routing Engine 1          BUILTIN      BUILTIN           RE-S-1600x8

CB 0             REV 31   750-067071   CAKC9988          Control Board

  Mezz           REV 16   711-066896   CAKA6826          Control Mezz Board

CB 1             REV 31   750-067071   CAKJ0150          Control Board

  Mezz           REV 16   711-066896   CAKJ3940          Control Mezz Board

FPC 0            REV 24   750-066879   CALA2032          LC2103

  CPU                     BUILTIN      BUILTIN           SMPC PMB

  PIC 0                   BUILTIN      BUILTIN           6xQSFPP

  PIC 1          REV 26   750-068806   CAKX8122          MIC1

    Xcvr 0       REV 01   740-061409   1GCQA23105C       QSFP-100GBASE-LR4-T2

    Xcvr 1       REV 01   740-061409   1GCQA3020RD       QSFP-100GBASE-LR4-T2

    Xcvr 2       REV 01   740-061409   1GCQA23209M       QSFP-100GBASE-LR4-T2

    Xcvr 4       REV 01   740-061409   1GCQA30301G       QSFP-100GBASE-LR4-T2

    Xcvr 5       REV 01   740-061409   1GCQA20705C       QSFP-100GBASE-LR4-T2

    Xcvr 6       REV 01   740-061409   1GCQA3020YZ       QSFP-100GBASE-LR4-T2

    Xcvr 7       REV 01   740-061409   1GCQA2080VV       QSFP-100GBASE-LR4-T2

    Xcvr 8       REV 01   740-061409   1GCQA3020L6       QSFP-100GBASE-LR4-T2

Hi both of you.

You shared very useful information and I also digged now in the documentation.

Please let me know if i got it correctly and may be we share info for other friends here.

It is possible to configure rate selectability:

- at mic level

- at pic level (built-in)

- at port-level

Main target is to avoid oversubscription on the PFE associated to the ports.

Configuring the ports at MIC level is needed to specify the number of ports one want to use: drawback is that in this case all the ports  have the same speed.

Very useful is the table 1 here:

https://www.juniper.net/documentation/en_US/junos/topics/reference/general/interfaces-active-ports-mx10003mpc.html

- At pic level (built-in) is valid the same consideration above. see table 2

https://www.juniper.net/documentation/en_US/junos/topics/reference/general/interfaces-active-ports-mx10003mpc.html

As said before the drawback is that all the ports will have the same speed in both case.

Very important in my opinion is also to have upfront the final schema of the wished speed for all the ports.

In my case i would like to reach the following:

1 x 100 GE -> et-1/1/0 -> pfe0
1 x100 GE -> et-1/1/4 -> pfe1

4 x 40GE (4 x 10GE -> pfe2) 
-> xe-1/1/8:0
-> xe-1/1/8:1
-> xe-1/1/8:2
-> xe-1/1/8:3

-> xe-1/1/9:0
-> xe-1/1/9:1
-> xe-1/1/9:2
-> xe-1/1/9:3

-> xe-1/1/10:0
-> xe-1/1/10:1
-> xe-1/1/10:2
-> xe-1/1/10:3

-> xe-1/1/11:0
-> xe-1/1/11:1
-> xe-1/1/11:2
-> xe-1/1/11:3

All 3 PFE are going to be used without subscription (each PFE can manage 400GBps) and more by using this tool https://apps.juniper.net/home/port-checker/ is possible to validate the configuration.

Now, due to the fact that in the above design I am not going to use the PIC0 (built-in) I think that the solution here is:

- configure speed at port-level for port:

port 0 -> 100GE

port 1 - 4x10GE

port 4 - 100GE

port 5 - 4 x10GE

port 8 -> 4x10GE

port 9 -> 4x10GE

and than

set chassis fpc 0 pic 0 number-of-ports 0

as correctly suggested by arpitch

Does it make sense to you guys?

so i confirm.

1)set speed at level port e.g. et-1/1/0

2)run command

 set chassis fpc 1 pic 0 number-of-ports 0

for pic0

3)reset the pic (offline command was already run)

root@MX-10K-1> request chassis pic pic-slot 1 fpc-slot 1 online
fpc 1 pic 1 online initiated, use "show chassis fpc pic-status" to verify

root@MX-10K-1> show chassis fpc pic-status
Slot 1   Online       LC2103
  PIC 0  Online       6xQSFPP
  PIC 1  Online       MIC1

  4)now interface is up

Thanks all.