vMX
vMX

vFPC 8-11 issue on vMX 18.2R1.9

‎07-10-2019 06:53 PM

Hi All,

 

I am facing an issue where vFPCs 8-11 will not load PIC 0 - vFPC itself will come online, however, there will be no entry for PIC.

 

Anything below vFPC 8, such as 6 or 7 will load just fine as per example below (currently vFPC 6-11 connected).

 

root> show chassis fpc pic-status 
Slot 6   Online       Virtual FPC                                   
  PIC 0  Online       Virtual
Slot 7   Online       Virtual FPC                                   
  PIC 0  Online       Virtual
Slot 8   Online       Virtual FPC                                   
Slot 9   Online       Virtual FPC                                   
Slot 10  Online       Virtual FPC                                   
Slot 11  Online       Virtual FPC
root> show chassis fpc 
                     Temp  CPU Utilization (%)   CPU Utilization (%)  Memory    Utilization (%)
Slot State            (C)  Total  Interrupt      1min   5min   15min  DRAM (MB) Heap     Buffer
  0  Empty           
  1  Empty           
  2  Empty           
  3  Empty           
  4  Empty           
  5  Empty           
  6  Online           Testing  12         0        9      5      2    511        31          0
  7  Online           Testing  10         0        9      9      9    511        31          0
  8  Online           Absent   0          0        0      0      0      0         0          0
  9  Online           Absent   0          0        0      0      0      0         0          0
 10  Online           Absent   0          0        0      0      0      0         0          0
 11  Online           Absent   0          0        0      0      0      0         0          0
root> show chassis hardware 
Hardware inventory:
Item             Version  Part number  Serial number     Description
Chassis                                VM5D266CE341      VMX
Midplane        
Routing Engine 0                                         RE-VMX
CB 0                                                     VMX SCB
CB 1                                                     VMX SCB
FPC 6                                                    Virtual FPC
  CPU            Rev. 1.0 RIOT-LITE    BUILTIN          
  MIC 0                                                  Virtual
    PIC 0                 BUILTIN      BUILTIN           Virtual
FPC 7                                                    Virtual FPC
  CPU            Rev. 1.0 RIOT-LITE    BUILTIN          
  MIC 0                                                  Virtual
    PIC 0                 BUILTIN      BUILTIN           Virtual
FPC 8                                                    Virtual FPC
  CPU            Rev. 1.0 RIOT-LITE    BUILTIN          
FPC 9                                                    Virtual FPC
  CPU            Rev. 1.0 RIOT-LITE    BUILTIN          
FPC 10                                                   Virtual FPC
  CPU            Rev. 1.0 RIOT-LITE    BUILTIN          
FPC 11                                                   Virtual FPC
  CPU            Rev. 1.0 RIOT-LITE    BUILTIN  

I can also see ARP entries for each vFPC which makes me think IP connectivity between RE and FPC is fine.

root> show arp 
MAC Address       Address         Name                      Interface               Flags
50:01:00:07:00:01 128.0.0.22      fpc6                      em1.0                   none
50:01:00:06:00:01 128.0.0.23      fpc7                      em1.0                   none
50:01:00:03:00:01 128.0.0.24      fpc8                      em1.0                   none
50:01:00:02:00:01 128.0.0.25      fpc9                      em1.0                   none
50:01:00:04:00:01 128.0.0.26      fpc10                     em1.0                   none
50:01:00:05:00:01 128.0.0.27      fpc11                     em1.0                   none
Total entries: 

I am seeing a lot of below entries in chassisd log.

Jul 11 00:10:10  ifdev_create: create ifd pfh-8/0/0 failed 22
Jul 11 00:10:10 CHASSISD_IFDEV_RTSLIB_FAILURE: ifdev_create: rtslib_ifdm_add failed (Invalid argument)
Jul 11 00:10:10  ifdev_create: pfh-8/0/0 failed, errno 22(Invalid argument)
Jul 11 00:10:10  fpc_create_devs_from_queue: pfh-8/0/0; ifdev_create failed; err = 22
Jul 11 00:10:12  ifdev_create entered pfh-8/0/0
Jul 11 00:10:12  pfh-8/0/0: large delay buffer cleared
Jul 11 00:10:12  pic_update_ifdev_cos_info:12100 pfh-8/0/0: ingress and egress queueing cleared
Jul 11 00:10:12  pic_parse_ifname: parse_interface of pfh-8/0/0 found fpc 8, pic 0, port 0, channel -1
Jul 11 00:10:12  pic_update_ifdev_cos_info setting the l2_count in chasd = 4, for port:0, hier:0, l2:0
Jul 11 00:10:12  fpc_is_synce_cap: FPC i2c: 0xbaa, PIC type: 0x0
                                        
Jul 11 00:10:12  pic_update_ifdev_tlvs: pfh-8/0/0 Not SyncE capable
                                        
Jul 11 00:10:12  pic_update_ifdev_tlvs: pfh-8/0/0 IFM type is Not Ether
                                        
Jul 11 00:10:12  ifdev_create: create ifd pfh-8/0/0 failed 22
Jul 11 00:10:12 CHASSISD_IFDEV_RTSLIB_FAILURE: ifdev_create: rtslib_ifdm_add failed (Invalid argument)
Jul 11 00:10:12  ifdev_create: pfh-8/0/0 failed, errno 22(Invalid argument)
Jul 11 00:10:12  fpc_create_devs_from_queue: pfh-8/0/0; ifdev_create failed; err = 22
Jul 11 00:10:14  ifdev_create entered pfh-8/0/0
Jul 11 00:10:14  pfh-8/0/0: large delay buffer cleared
Jul 11 00:10:14  pic_update_ifdev_cos_info:12100 pfh-8/0/0: ingress and egress queueing cleared
Jul 11 00:10:14  pic_parse_ifname: parse_interface of pfh-8/0/0 found fpc 8, pic 0, port 0, channel -1
Jul 11 00:10:14  pic_update_ifdev_cos_info setting the l2_count in chasd = 4, for port:0, hier:0, l2:0
Jul 11 00:10:14  fpc_is_synce_cap: FPC i2c: 0xbaa, PIC type: 0x0
                                        
Jul 11 00:10:14  pic_update_ifdev_tlvs: pfh-8/0/0 Not SyncE capable
                                        
Jul 11 00:10:14  pic_update_ifdev_tlvs: pfh-8/0/0 IFM type is Not Ether 

Does anyone have any idea what the problem could be?

 

Cheers,

4 REPLIES 4
vMX

Re: vFPC 8-11 issue on vMX 18.2R1.9

a month ago

Just to bring this post to the top of the list - has anyone come across this before, or are Juniper aware of this?

 

I am not sure what troubleshooting steps can be performed, however, I have seen this issue on some Juniper vMX related blog posts out there as well so clearly am not the only one occurance.

vMX

Re: vFPC 8-11 issue on vMX 18.2R1.9

a month ago

Not able to find any examples in either internal or external documents. Maybe not qualified or its platform/hyporvisor dependent. Just throwing some ideas. 

If this is not bothering you much, say you can happily use FPC0 to FPC7 with desired BW/Interfaces, you can come back and check this thread regularly, hope we will have some more solid update soon.

However, if this is bothering you and urgent for you. I'd suggest you to work with your Juniper account team or open JTAC case


Mengzhe Hu
JNCIE x 3 (SP DC ENT)
vMX

Re: vFPC 8-11 issue on vMX 18.2R1.9

a month ago

Hi,

 

2 points :-

 

1. Have you confirmed the resources required for runnings all those FPC's?

2. The logs suggests argument is invalid, Can you compare all your settings and permission for all FPC files and in place (compare the settings for FPC6 and FPC8 )?

 

-Rahul

Regards,
Rahul
vMX

Re: vFPC 8-11 issue on vMX 18.2R1.9

a month ago

Hi, What is the hypervisor used?

 

Also confirm the memory & vCPU used for both vCP & vFP..

 

We only recommend dual RE(vCP) on vMX. Multiple vFP is not yet qualified. 

-
VR
# Please mark my solution as accepted if it helped, Kudos are appreciated as well.