Attachment 1712000 Details for Bug 1870547 – config daemon pod crash logs

config daemon pod crash logs

configdaemon-crash.log (text/plain), 31.37 KB, created by zhaozhanqi on 2020-08-20 10:29:29 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: zhaozhanqi

Created: 2020-08-20 10:29:29 UTC

Size: 31.37 KB

patch

obsolete

>oc logs sriov-network-config-daemon-72zvw
>I0820 09:32:05.759670 3669154 start.go:102] starting node writer
>I0820 09:32:05.759798 3669154 writer.go:44] Run(): start writer
>I0820 09:32:05.759805 3669154 writer.go:47] Run(): once
>I0820 09:32:05.832914 3669154 utils.go:502] getLinkType(): Device 0000:18:00.0
>I0820 09:32:05.833797 3669154 utils.go:502] getLinkType(): Device 0000:18:00.1
>I0820 09:32:05.834095 3669154 utils.go:502] getLinkType(): Device 0000:18:00.2
>I0820 09:32:05.834312 3669154 utils.go:502] getLinkType(): Device 0000:18:00.3
>I0820 09:32:05.834537 3669154 utils.go:502] getLinkType(): Device 0000:3b:00.0
>I0820 09:32:05.834755 3669154 utils.go:502] getLinkType(): Device 0000:3b:00.1
>I0820 09:32:05.835386 3669154 utils.go:502] getLinkType(): Device 0000:5e:00.0
>I0820 09:32:05.837146 3669154 utils.go:502] getLinkType(): Device 0000:5e:00.1
>I0820 09:32:05.837797 3669154 utils.go:502] getLinkType(): Device 0000:60:00.0
>I0820 09:32:05.838446 3669154 utils.go:502] getLinkType(): Device 0000:60:00.1
>I0820 09:32:05.861138 3669154 writer.go:125] setNodeStateStatus(): syncStatus: , lastSyncError: 
>I0820 09:32:05.911906 3669154 writer.go:163] writeCheckpointFile(): try to decode the checkpoint file
>I0820 09:32:05.912364 3669154 start.go:114] Starting SriovNetworkConfigDaemon
>I0820 09:32:05.912436 3669154 daemon.go:166] Run(): start daemon
>I0820 09:32:05.912517 3669154 writer.go:44] Run(): start writer
>I0820 09:32:05.970863 3669154 daemon.go:346] Set log verbose level to: 2
>I0820 09:32:05.978578 3669154 daemon.go:319] nodeUpdateHandler(): node dell-per740-14.rhts.eng.pek2.redhat.com has been deleted
>I0820 09:32:05.978735 3669154 daemon.go:334] nodeUpdateHandler(): no other node is draining
>I0820 09:32:05.978834 3669154 daemon.go:334] nodeUpdateHandler(): no other node is draining
>I0820 09:32:05.978938 3669154 daemon.go:334] nodeUpdateHandler(): no other node is draining
>I0820 09:32:05.979035 3669154 daemon.go:334] nodeUpdateHandler(): no other node is draining
>I0820 09:32:05.979190 3669154 daemon.go:334] nodeUpdateHandler(): no other node is draining
>I0820 09:32:11.065604 3669154 daemon.go:226] Starting workers
>I0820 09:32:11.065659 3669154 daemon.go:229] Started workers
>I0820 09:32:11.065713 3669154 daemon.go:264] worker queue size: 1
>I0820 09:32:11.065734 3669154 daemon.go:266] get item: 14
>I0820 09:32:11.065750 3669154 daemon.go:353] nodeStateSyncHandler(): new generation is 14
>I0820 09:32:11.074206 3669154 daemon.go:681] registerPlugins(): [intel_plugin mellanox_plugin]
>I0820 09:32:11.074267 3669154 daemon.go:539] loadVendorPlugins(): try to load plugin intel_plugin
>I0820 09:32:11.074281 3669154 plugin.go:36] loadPlugin(): load plugin from /plugins/intel_plugin.so
>I0820 09:32:11.074302 3669154 writer.go:61] Run(): refresh trigger
>I0820 09:32:11.074354 3669154 writer.go:80] pollNicStatus()
>I0820 09:32:11.074369 3669154 utils.go:38] DiscoverSriovDevices
>I0820 09:32:11.123499 3669154 daemon.go:539] loadVendorPlugins(): try to load plugin mellanox_plugin
>I0820 09:32:11.123535 3669154 plugin.go:36] loadPlugin(): load plugin from /plugins/mellanox_plugin.so
>I0820 09:32:11.148081 3669154 utils.go:313] getNetdevMTU(): get MTU for device 0000:18:00.0
>I0820 09:32:11.148158 3669154 utils.go:308] tryGetInterfaceName(): name is eno1
>I0820 09:32:11.148217 3669154 utils.go:308] tryGetInterfaceName(): name is eno1
>I0820 09:32:11.148221 3669154 utils.go:334] getNetDevMac(): get Mac for device eno1
>I0820 09:32:11.148255 3669154 utils.go:346] getNetDevLinkSpeed(): get LinkSpeed for device eno1
>I0820 09:32:11.148285 3669154 utils.go:502] getLinkType(): Device 0000:18:00.0
>I0820 09:32:11.148609 3669154 utils.go:313] getNetdevMTU(): get MTU for device 0000:18:00.1
>I0820 09:32:11.148649 3669154 utils.go:308] tryGetInterfaceName(): name is eno2
>I0820 09:32:11.148697 3669154 utils.go:308] tryGetInterfaceName(): name is eno2
>I0820 09:32:11.148703 3669154 utils.go:334] getNetDevMac(): get Mac for device eno2
>I0820 09:32:11.148728 3669154 utils.go:346] getNetDevLinkSpeed(): get LinkSpeed for device eno2
>I0820 09:32:11.148753 3669154 utils.go:502] getLinkType(): Device 0000:18:00.1
>I0820 09:32:11.148943 3669154 utils.go:313] getNetdevMTU(): get MTU for device 0000:18:00.2
>I0820 09:32:11.148977 3669154 utils.go:308] tryGetInterfaceName(): name is eno3
>I0820 09:32:11.149024 3669154 utils.go:308] tryGetInterfaceName(): name is eno3
>I0820 09:32:11.149030 3669154 utils.go:334] getNetDevMac(): get Mac for device eno3
>I0820 09:32:11.149053 3669154 utils.go:346] getNetDevLinkSpeed(): get LinkSpeed for device eno3
>I0820 09:32:11.149079 3669154 utils.go:502] getLinkType(): Device 0000:18:00.2
>I0820 09:32:11.149216 3669154 utils.go:313] getNetdevMTU(): get MTU for device 0000:18:00.3
>I0820 09:32:11.149250 3669154 utils.go:308] tryGetInterfaceName(): name is eno4
>I0820 09:32:11.149297 3669154 utils.go:308] tryGetInterfaceName(): name is eno4
>I0820 09:32:11.149303 3669154 utils.go:334] getNetDevMac(): get Mac for device eno4
>I0820 09:32:11.149327 3669154 utils.go:346] getNetDevLinkSpeed(): get LinkSpeed for device eno4
>I0820 09:32:11.149376 3669154 utils.go:502] getLinkType(): Device 0000:18:00.3
>I0820 09:32:11.149518 3669154 utils.go:313] getNetdevMTU(): get MTU for device 0000:3b:00.0
>I0820 09:32:11.149552 3669154 utils.go:308] tryGetInterfaceName(): name is ens1f0
>I0820 09:32:11.149600 3669154 utils.go:308] tryGetInterfaceName(): name is ens1f0
>I0820 09:32:11.149606 3669154 utils.go:334] getNetDevMac(): get Mac for device ens1f0
>I0820 09:32:11.149644 3669154 utils.go:346] getNetDevLinkSpeed(): get LinkSpeed for device ens1f0
>I0820 09:32:11.149669 3669154 utils.go:502] getLinkType(): Device 0000:3b:00.0
>I0820 09:32:11.149797 3669154 utils.go:313] getNetdevMTU(): get MTU for device 0000:3b:00.1
>I0820 09:32:11.149832 3669154 utils.go:308] tryGetInterfaceName(): name is ens1f1
>I0820 09:32:11.149888 3669154 utils.go:308] tryGetInterfaceName(): name is ens1f1
>I0820 09:32:11.149941 3669154 utils.go:334] getNetDevMac(): get Mac for device ens1f1
>I0820 09:32:11.149993 3669154 utils.go:346] getNetDevLinkSpeed(): get LinkSpeed for device ens1f1
>I0820 09:32:11.150025 3669154 utils.go:502] getLinkType(): Device 0000:3b:00.1
>I0820 09:32:11.150184 3669154 utils.go:313] getNetdevMTU(): get MTU for device 0000:5e:00.0
>I0820 09:32:11.150224 3669154 utils.go:308] tryGetInterfaceName(): name is ens3f0
>I0820 09:32:11.150291 3669154 utils.go:308] tryGetInterfaceName(): name is ens3f0
>I0820 09:32:11.150297 3669154 utils.go:334] getNetDevMac(): get Mac for device ens3f0
>I0820 09:32:11.150321 3669154 utils.go:346] getNetDevLinkSpeed(): get LinkSpeed for device ens3f0
>I0820 09:32:11.150726 3669154 utils.go:502] getLinkType(): Device 0000:5e:00.0
>I0820 09:32:11.151802 3669154 utils.go:313] getNetdevMTU(): get MTU for device 0000:5e:00.2
>I0820 09:32:11.152008 3669154 utils.go:313] getNetdevMTU(): get MTU for device 0000:5e:00.3
>I0820 09:32:11.152066 3669154 utils.go:313] getNetdevMTU(): get MTU for device 0000:5e:00.1
>I0820 09:32:11.152105 3669154 utils.go:308] tryGetInterfaceName(): name is ens3f1
>I0820 09:32:11.152153 3669154 utils.go:308] tryGetInterfaceName(): name is ens3f1
>I0820 09:32:11.152160 3669154 utils.go:334] getNetDevMac(): get Mac for device ens3f1
>I0820 09:32:11.152187 3669154 utils.go:346] getNetDevLinkSpeed(): get LinkSpeed for device ens3f1
>I0820 09:32:11.152639 3669154 utils.go:502] getLinkType(): Device 0000:5e:00.1
>I0820 09:32:11.153060 3669154 utils.go:313] getNetdevMTU(): get MTU for device 0000:60:00.0
>I0820 09:32:11.153139 3669154 utils.go:308] tryGetInterfaceName(): name is ens2f0
>I0820 09:32:11.153191 3669154 utils.go:308] tryGetInterfaceName(): name is ens2f0
>I0820 09:32:11.153197 3669154 utils.go:334] getNetDevMac(): get Mac for device ens2f0
>I0820 09:32:11.153220 3669154 utils.go:346] getNetDevLinkSpeed(): get LinkSpeed for device ens2f0
>I0820 09:32:11.153679 3669154 utils.go:502] getLinkType(): Device 0000:60:00.0
>I0820 09:32:11.154044 3669154 utils.go:313] getNetdevMTU(): get MTU for device 0000:60:00.1
>I0820 09:32:11.154140 3669154 utils.go:308] tryGetInterfaceName(): name is ens2f1
>I0820 09:32:11.154242 3669154 utils.go:308] tryGetInterfaceName(): name is ens2f1
>I0820 09:32:11.154249 3669154 utils.go:334] getNetDevMac(): get Mac for device ens2f1
>I0820 09:32:11.154272 3669154 utils.go:346] getNetDevLinkSpeed(): get LinkSpeed for device ens2f1
>I0820 09:32:11.154650 3669154 utils.go:502] getLinkType(): Device 0000:60:00.1
>I0820 09:32:11.161988 3669154 writer.go:125] setNodeStateStatus(): syncStatus: InProgress, lastSyncError: 
>I0820 09:32:11.164379 3669154 daemon.go:539] loadVendorPlugins(): try to load plugin generic_plugin
>I0820 09:32:11.164394 3669154 plugin.go:36] loadPlugin(): load plugin from /plugins/generic_plugin.so
>I0820 09:32:11.206779 3669154 intel_plugin.go:37] intel-plugin OnNodeStateAdd()
>I0820 09:32:11.206847 3669154 daemon.go:387] nodeStateSyncHandler(): plugin intel_plugin: reqDrain false, reqReboot false
>I0820 09:32:11.206917 3669154 mellanox_plugin.go:65] mellanox-plugin OnNodeStateAdd()
>I0820 09:32:11.206956 3669154 mellanox_plugin.go:72] mellanox-Plugin OnNodeStateChange()
>I0820 09:32:11.206983 3669154 mellanox_plugin.go:234] mellanox-plugin getMlnxNicFwData(): device 0000:5e:00.0
>I0820 09:32:11.206992 3669154 mellanox_plugin.go:213] mellanox-plugin mstConfigReadData(): device 0000:5e:00.0
>I0820 09:32:11.206998 3669154 mellanox_plugin.go:220] mellanox-plugin runCommand(): mstconfig [-e -d 0000:5e:00.0 q]
>I0820 09:32:11.207089 3669154 mellanox_plugin.go:227] mellanox-plugin: runCommand(): mstconfig, [-e -d 0000:5e:00.0 q]
>I0820 09:32:12.208325 3669154 daemon.go:334] nodeUpdateHandler(): no other node is draining
>I0820 09:32:15.389179 3669154 mellanox_plugin.go:229] mellanox-plugin: runCommand(): 
>Device #1:
>----------
>
>Device type:    ConnectX5       
>Name:           N/A             
>Description:    N/A             
>Device:         0000:5e:00.0    
>
>Configurations:                              Default         Current         Next Boot
>         MEMIC_BAR_SIZE                      0               0               0               
>         MEMIC_SIZE_LIMIT                    _256KB(1)       _256KB(1)       _256KB(1)       
>         HOST_CHAINING_MODE                  DISABLED(0)     DISABLED(0)     DISABLED(0)     
>         HOST_CHAINING_DESCRIPTORS           Array[0..7]     Array[0..7]     Array[0..7]     
>         HOST_CHAINING_TOTAL_BUFFER_SIZE     Array[0..7]     Array[0..7]     Array[0..7]     
>         FLEX_PARSER_PROFILE_ENABLE          0               0               0               
>         FLEX_IPV4_OVER_VXLAN_PORT           0               0               0               
>         ROCE_NEXT_PROTOCOL                  254             254             254             
>         NON_PREFETCHABLE_PF_BAR             False(0)        False(0)        False(0)        
>*        NUM_OF_VFS                          0               2               2               
>*        SRIOV_EN                            False(0)        True(1)         True(1)         
>         PF_LOG_BAR_SIZE                     5               5               5               
>         VF_LOG_BAR_SIZE                     1               1               1               
>         NUM_PF_MSIX                         63              63              63              
>         NUM_VF_MSIX                         11              11              11              
>         INT_LOG_MAX_PAYLOAD_SIZE            AUTOMATIC(0)    AUTOMATIC(0)    AUTOMATIC(0)    
>         SW_RECOVERY_ON_ERRORS               False(0)        False(0)        False(0)        
>         RESET_WITH_HOST_ON_ERRORS           False(0)        False(0)        False(0)        
>         ADVANCED_POWER_SETTINGS             False(0)        False(0)        False(0)        
>         CQE_COMPRESSION                     BALANCED(0)     BALANCED(0)     BALANCED(0)     
>         IP_OVER_VXLAN_EN                    False(0)        False(0)        False(0)        
>         PCI_ATOMIC_MODE                     PCI_ATOMIC_DISABLED_EXT_ATOMIC_ENABLED(0) PCI_ATOMIC_DISABLED_EXT_ATOMIC_ENABLED(0) PCI_ATOMIC_DISABLED_EXT_ATOMIC_ENABLED(0)
>         LRO_LOG_TIMEOUT0                    6               6               6               
>         LRO_LOG_TIMEOUT1                    7               7               7               
>         LRO_LOG_TIMEOUT2                    8               8               8               
>         LRO_LOG_TIMEOUT3                    13              13              13              
>         LOG_DCR_HASH_TABLE_SIZE             11              11              11              
>         DCR_LIFO_SIZE                       16384           16384           16384           
>         ROCE_CC_PRIO_MASK_P1                255             255             255             
>         ROCE_CC_ALGORITHM_P1                ECN(0)          ECN(0)          ECN(0)          
>         ROCE_CC_PRIO_MASK_P2                255             255             255             
>         ROCE_CC_ALGORITHM_P2                ECN(0)          ECN(0)          ECN(0)          
>         CLAMP_TGT_RATE_AFTER_TIME_INC_P1    True(1)         True(1)         True(1)         
>         CLAMP_TGT_RATE_P1                   False(0)        False(0)        False(0)        
>         RPG_TIME_RESET_P1                   300             300             300             
>         RPG_BYTE_RESET_P1                   32767           32767           32767           
>         RPG_THRESHOLD_P1                    1               1               1               
>         RPG_MAX_RATE_P1                     0               0               0               
>         RPG_AI_RATE_P1                      5               5               5               
>         RPG_HAI_RATE_P1                     50              50              50              
>         RPG_GD_P1                           11              11              11              
>         RPG_MIN_DEC_FAC_P1                  50              50              50              
>         RPG_MIN_RATE_P1                     1               1               1               
>         RATE_TO_SET_ON_FIRST_CNP_P1         0               0               0               
>         DCE_TCP_G_P1                        1019            1019            1019            
>         DCE_TCP_RTT_P1                      1               1               1               
>         RATE_REDUCE_MONITOR_PERIOD_P1       4               4               4               
>         INITIAL_ALPHA_VALUE_P1              1023            1023            1023            
>         MIN_TIME_BETWEEN_CNPS_P1            0               0               0               
>         CNP_802P_PRIO_P1                    6               6               6               
>         CNP_DSCP_P1                         48              48              48              
>         CLAMP_TGT_RATE_AFTER_TIME_INC_P2    True(1)         True(1)         True(1)         
>         CLAMP_TGT_RATE_P2                   False(0)        False(0)        False(0)        
>         RPG_TIME_RESET_P2                   300             300             300             
>         RPG_BYTE_RESET_P2                   32767           32767           32767           
>         RPG_THRESHOLD_P2                    1               1               1               
>         RPG_MAX_RATE_P2                     0               0               0               
>         RPG_AI_RATE_P2                      5               5               5               
>         RPG_HAI_RATE_P2                     50              50              50              
>         RPG_GD_P2                           11              11              11              
>         RPG_MIN_DEC_FAC_P2                  50              50              50              
>         RPG_MIN_RATE_P2                     1               1               1               
>         RATE_TO_SET_ON_FIRST_CNP_P2         0               0               0               
>         DCE_TCP_G_P2                        1019            1019            1019            
>         DCE_TCP_RTT_P2                      1               1               1               
>         RATE_REDUCE_MONITOR_PERIOD_P2       4               4               4               
>         INITIAL_ALPHA_VALUE_P2              1023            1023            1023            
>         MIN_TIME_BETWEEN_CNPS_P2            0               0               0               
>         CNP_802P_PRIO_P2                    6               6               6               
>         CNP_DSCP_P2                         48              48              48              
>         LLDP_NB_DCBX_P1                     False(0)        False(0)        False(0)        
>         LLDP_NB_RX_MODE_P1                  OFF(0)          OFF(0)          OFF(0)          
>         LLDP_NB_TX_MODE_P1                  OFF(0)          OFF(0)          OFF(0)          
>         LLDP_NB_DCBX_P2                     False(0)        False(0)        False(0)        
>         LLDP_NB_RX_MODE_P2                  OFF(0)          OFF(0)          OFF(0)          
>         LLDP_NB_TX_MODE_P2                  OFF(0)          OFF(0)          OFF(0)          
>         DCBX_IEEE_P1                        True(1)         True(1)         True(1)         
>         DCBX_CEE_P1                         True(1)         True(1)         True(1)         
>         DCBX_WILLING_P1                     True(1)         True(1)         True(1)         
>         DCBX_IEEE_P2                        True(1)         True(1)         True(1)         
>         DCBX_CEE_P2                         True(1)         True(1)         True(1)         
>         DCBX_WILLING_P2                     True(1)         True(1)         True(1)         
>         KEEP_ETH_LINK_UP_P1                 True(1)         True(1)         True(1)         
>         KEEP_IB_LINK_UP_P1                  False(0)        False(0)        False(0)        
>         KEEP_LINK_UP_ON_BOOT_P1             False(0)        False(0)        False(0)        
>         KEEP_LINK_UP_ON_STANDBY_P1          False(0)        False(0)        False(0)        
>         KEEP_ETH_LINK_UP_P2                 True(1)         True(1)         True(1)         
>         KEEP_IB_LINK_UP_P2                  False(0)        False(0)        False(0)        
>         KEEP_LINK_UP_ON_BOOT_P2             False(0)        False(0)        False(0)        
>         KEEP_LINK_UP_ON_STANDBY_P2          False(0)        False(0)        False(0)        
>         NUM_OF_VL_P1                        _4_VLs(3)       _4_VLs(3)       _4_VLs(3)       
>         NUM_OF_TC_P1                        _8_TCs(0)       _8_TCs(0)       _8_TCs(0)       
>         NUM_OF_PFC_P1                       8               8               8               
>         NUM_OF_VL_P2                        _4_VLs(3)       _4_VLs(3)       _4_VLs(3)       
>         NUM_OF_TC_P2                        _8_TCs(0)       _8_TCs(0)       _8_TCs(0)       
>         NUM_OF_PFC_P2                       8               8               8               
>         DUP_MAC_ACTION_P1                   LAST_CFG(0)     LAST_CFG(0)     LAST_CFG(0)     
>         SRIOV_IB_ROUTING_MODE_P1            LID(1)          LID(1)          LID(1)          
>         IB_ROUTING_MODE_P1                  LID(1)          LID(1)          LID(1)          
>         DUP_MAC_ACTION_P2                   LAST_CFG(0)     LAST_CFG(0)     LAST_CFG(0)     
>         SRIOV_IB_ROUTING_MODE_P2            LID(1)          LID(1)          LID(1)          
>         IB_ROUTING_MODE_P2                  LID(1)          LID(1)          LID(1)          
>         PCI_WR_ORDERING                     per_mkey(0)     per_mkey(0)     per_mkey(0)     
>         MULTI_PORT_VHCA_EN                  False(0)        False(0)        False(0)        
>         PORT_OWNER                          True(1)         True(1)         True(1)         
>         ALLOW_RD_COUNTERS                   True(1)         True(1)         True(1)         
>         RENEG_ON_CHANGE                     True(1)         True(1)         True(1)         
>         TRACER_ENABLE                       True(1)         True(1)         True(1)         
>         IP_VER                              IPv4(0)         IPv4(0)         IPv4(0)         
>         BOOT_UNDI_NETWORK_WAIT              0               0               0               
>         UEFI_HII_EN                         False(0)        False(0)        False(0)        
>         BOOT_DBG_LOG                        False(0)        False(0)        False(0)        
>         UEFI_LOGS                           DISABLED(0)     DISABLED(0)     DISABLED(0)     
>         BOOT_VLAN                           1               1               1               
>         LEGACY_BOOT_PROTOCOL                PXE(1)          PXE(1)          PXE(1)          
>         BOOT_RETRY_CNT                      NONE(0)         NONE(0)         NONE(0)         
>         BOOT_LACP_DIS                       True(1)         True(1)         True(1)         
>         BOOT_VLAN_EN                        False(0)        False(0)        False(0)        
>         BOOT_PKEY                           0               0               0               
>         EXP_ROM_UEFI_ARM_ENABLE             False(0)        False(0)        False(0)        
>         EXP_ROM_UEFI_x86_ENABLE             False(0)        False(0)        False(0)        
>         EXP_ROM_PXE_ENABLE                  True(1)         True(1)         True(1)         
>         ADVANCED_PCI_SETTINGS               False(0)        False(0)        False(0)        
>         SAFE_MODE_THRESHOLD                 10              10              10              
>         SAFE_MODE_ENABLE                    True(1)         True(1)         True(1)         
>The '*' shows parameters with next value different from default/current value.
>I0820 09:32:15.389284 3669154 mellanox_plugin.go:277] mellanox-plugin parseMstconfigOutput(): Attributes [NUM_OF_VFS SRIOV_EN LINK_TYPE_P1 LINK_TYPE_P2]
>I0820 09:32:15.389578 3669154 mellanox_plugin.go:257] mellanox-plugin mlnxNicFromMap() map[NUM_OF_VFS:2 SRIOV_EN:True(1)]
>I0820 09:32:15.389618 3669154 mellanox_plugin.go:306] mellanox-plugin getLinkType(): linkType 
>W0820 09:32:15.389635 3669154 mellanox_plugin.go:315] mellanox-plugin getMlnxNicFwData(): LINK_TYPE_P* attribute was not found
>I0820 09:32:15.389647 3669154 mellanox_plugin.go:257] mellanox-plugin mlnxNicFromMap() map[NUM_OF_VFS:2 SRIOV_EN:True(1)]
>I0820 09:32:15.389666 3669154 mellanox_plugin.go:306] mellanox-plugin getLinkType(): linkType 
>W0820 09:32:15.389680 3669154 mellanox_plugin.go:315] mellanox-plugin getMlnxNicFwData(): LINK_TYPE_P* attribute was not found
>I0820 09:32:15.389692 3669154 mellanox_plugin.go:300] mellanox-plugin isDualPort(): pciAddress 0000:5e:00.0
>I0820 09:32:15.389707 3669154 mellanox_plugin.go:341] mellanox-plugin getOtherPortSpec(): pciAddress 0000:5e:00.0
>I0820 09:32:15.389724 3669154 mellanox_plugin.go:321] mellanox-plugin isLinkTypeRequireChange(): device 0000:5e:00.0
>I0820 09:32:15.389762 3669154 mellanox_plugin.go:170] mellanox-plugin needDrain false needReboot false
>I0820 09:32:15.389796 3669154 daemon.go:387] nodeStateSyncHandler(): plugin mellanox_plugin: reqDrain false, reqReboot false
>I0820 09:32:15.389928 3669154 generic_plugin.go:55] generic-plugin OnNodeStateAdd()
>I0820 09:32:15.390027 3669154 daemon.go:387] nodeStateSyncHandler(): plugin generic_plugin: reqDrain false, reqReboot false
>I0820 09:32:15.390049 3669154 daemon.go:399] nodeStateSyncHandler(): reqDrain false, reqReboot false
>I0820 09:32:15.390078 3669154 intel_plugin.go:49] intel-plugin Apply()
>I0820 09:32:15.390102 3669154 mellanox_plugin.go:176] mellanox-plugin Apply()
>I0820 09:32:15.390114 3669154 mellanox_plugin.go:181] mellanox-plugin configFW()
>I0820 09:32:15.390140 3669154 generic_plugin.go:105] generic-plugin Apply(): desiredState={3312958 [{0000:5e:00.0 2 1500 ens3f0 eth [{mlx278netdevice netdevice 0-1 mlx278-netdevice}]}]}
>I0820 09:32:15.390306 3669154 utils.go:148] needUpdate(): VF MTU needs update, desired=1500
>I0820 09:32:15.390358 3669154 utils.go:186] configSriovDevice(): config interface 0000:5e:00.0 with &{0000:5e:00.0 2 1500 ens3f0 eth [{mlx278netdevice netdevice 0-1 mlx278-netdevice}]}
>I0820 09:32:15.391393 3669154 driver.go:79] BindDefaultDriver(): bind device 0000:5e:00.2 to default driver
>I0820 09:32:15.391459 3669154 driver.go:112] hasDriver(): device 0000:5e:00.2 driver is mlx5_core
>I0820 09:32:15.391480 3669154 driver.go:83] BindDefaultDriver(): device 0000:5e:00.2 already bound to default driver mlx5_core
>I0820 09:32:15.391502 3669154 utils.go:280] setNetdevMTU(): set MTU for device 0000:5e:00.2 to 1500
>E0820 09:32:15.391859 3669154 runtime.go:78] Observed a panic: runtime.boundsError{x:0, y:0, signed:true, code:0x0} (runtime error: index out of range [0] with length 0)
>goroutine 132 [running]:
>k8s.io/apimachinery/pkg/util/runtime.logPanic(0x1d03b20, 0xc000da8580)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:74 +0xa3
>k8s.io/apimachinery/pkg/util/runtime.HandleCrash(0x0, 0x0, 0x0)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:48 +0x82
>panic(0x1d03b20, 0xc000da8580)
>	/opt/rh/go-toolset-1.14/root/usr/lib/go-toolset-1.14-golang/src/runtime/panic.go:969 +0x16a
>github.com/openshift/sriov-network-operator/pkg/utils.setNetdevMTU.func1(0xc000160840, 0xc000160860)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/utils/utils.go:292 +0x322
>github.com/cenkalti/backoff.RetryNotify(0xc000367300, 0x7f559b628320, 0xc000160840, 0x0, 0x0, 0x0)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/github.com/cenkalti/backoff/retry.go:37 +0xba
>github.com/cenkalti/backoff.Retry(...)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/github.com/cenkalti/backoff/retry.go:24
>github.com/openshift/sriov-network-operator/pkg/utils.setNetdevMTU(0xc0007ba265, 0xc, 0x5dc, 0x0, 0x3)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/utils/utils.go:286 +0x280
>github.com/openshift/sriov-network-operator/pkg/utils.configSriovDevice(0xc001002de0, 0xc00148a6e0, 0x1, 0xc000103301)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/utils/utils.go:247 +0x2e7
>github.com/openshift/sriov-network-operator/pkg/utils.SyncNodeState(0xc000103500, 0x5, 0xc0004da1d0)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/utils/utils.go:121 +0x429
>github.com/openshift/sriov-network-operator/pkg/plugins/generic.(*GenericPlugin).Apply(0x7f559bfd0320, 0x0, 0x0)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/plugins/generic/generic_plugin.go:126 +0x15e
>github.com/openshift/sriov-network-operator/pkg/daemon.(*Daemon).nodeStateSyncHandler(0xc000dba580, 0xe, 0x2d3dad8, 0xc000dc6270)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/daemon/daemon.go:419 +0xfd9
>github.com/openshift/sriov-network-operator/pkg/daemon.(*Daemon).processNextWorkItem.func1(0xc000dba580, 0x1b87ec0, 0xc000e7ca80, 0x0, 0x0)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/daemon/daemon.go:287 +0xcf
>github.com/openshift/sriov-network-operator/pkg/daemon.(*Daemon).processNextWorkItem(0xc000dba580, 0x203000)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/daemon/daemon.go:303 +0x164
>github.com/openshift/sriov-network-operator/pkg/daemon.(*Daemon).runWorker(0xc000dba580)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/daemon/daemon.go:248 +0x2b
>k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0006d4110)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f
>k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0006d4110, 0x200a2e0, 0xc0006d6e10, 0xc000010001, 0xc0001800c0)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xa3
>k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0006d4110, 0x3b9aca00, 0x0, 0x10000c000112301, 0xc0001800c0)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0xe2
>k8s.io/apimachinery/pkg/util/wait.Until(0xc0006d4110, 0x3b9aca00, 0xc0001800c0)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d
>created by github.com/openshift/sriov-network-operator/pkg/daemon.(*Daemon).Run
>	/go/src/github.com/openshift/sriov-network-operator/pkg/daemon/daemon.go:228 +0xa29
>panic: runtime error: index out of range [0] with length 0 [recovered]
>	panic: runtime error: index out of range [0] with length 0
>
>goroutine 132 [running]:
>k8s.io/apimachinery/pkg/util/runtime.HandleCrash(0x0, 0x0, 0x0)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:55 +0x105
>panic(0x1d03b20, 0xc000da8580)
>	/opt/rh/go-toolset-1.14/root/usr/lib/go-toolset-1.14-golang/src/runtime/panic.go:969 +0x16a
>github.com/openshift/sriov-network-operator/pkg/utils.setNetdevMTU.func1(0xc000160840, 0xc000160860)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/utils/utils.go:292 +0x322
>github.com/cenkalti/backoff.RetryNotify(0xc000367300, 0x7f559b628320, 0xc000160840, 0x0, 0x0, 0x0)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/github.com/cenkalti/backoff/retry.go:37 +0xba
>github.com/cenkalti/backoff.Retry(...)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/github.com/cenkalti/backoff/retry.go:24
>github.com/openshift/sriov-network-operator/pkg/utils.setNetdevMTU(0xc0007ba265, 0xc, 0x5dc, 0x0, 0x3)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/utils/utils.go:286 +0x280
>github.com/openshift/sriov-network-operator/pkg/utils.configSriovDevice(0xc001002de0, 0xc00148a6e0, 0x1, 0xc000103301)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/utils/utils.go:247 +0x2e7
>github.com/openshift/sriov-network-operator/pkg/utils.SyncNodeState(0xc000103500, 0x5, 0xc0004da1d0)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/utils/utils.go:121 +0x429
>github.com/openshift/sriov-network-operator/pkg/plugins/generic.(*GenericPlugin).Apply(0x7f559bfd0320, 0x0, 0x0)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/plugins/generic/generic_plugin.go:126 +0x15e
>github.com/openshift/sriov-network-operator/pkg/daemon.(*Daemon).nodeStateSyncHandler(0xc000dba580, 0xe, 0x2d3dad8, 0xc000dc6270)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/daemon/daemon.go:419 +0xfd9
>github.com/openshift/sriov-network-operator/pkg/daemon.(*Daemon).processNextWorkItem.func1(0xc000dba580, 0x1b87ec0, 0xc000e7ca80, 0x0, 0x0)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/daemon/daemon.go:287 +0xcf
>github.com/openshift/sriov-network-operator/pkg/daemon.(*Daemon).processNextWorkItem(0xc000dba580, 0x203000)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/daemon/daemon.go:303 +0x164
>github.com/openshift/sriov-network-operator/pkg/daemon.(*Daemon).runWorker(0xc000dba580)
>	/go/src/github.com/openshift/sriov-network-operator/pkg/daemon/daemon.go:248 +0x2b
>k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0006d4110)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f
>k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0006d4110, 0x200a2e0, 0xc0006d6e10, 0xc000010001, 0xc0001800c0)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xa3
>k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0006d4110, 0x3b9aca00, 0x0, 0x10000c000112301, 0xc0001800c0)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0xe2
>k8s.io/apimachinery/pkg/util/wait.Until(0xc0006d4110, 0x3b9aca00, 0xc0001800c0)
>	/go/src/github.com/openshift/sriov-network-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d
>created by github.com/openshift/sriov-network-operator/pkg/daemon.(*Daemon).Run
>	/go/src/github.com/openshift/sriov-network-operator/pkg/daemon/daemon.go:228 +0xa29

Actions: View

Attachments on bug 1870547: 1712000