VMware

High CPU Usage on vSAN Witness 7.0

In case someone can help me – Thanks in advance :

When upgrading my lab from 6.7u3 to 7.0, I decided to cleanly remove and unconfigure my vSAN before the upgrade. Everything went well, but now I reconfigure a fresh new **2-Nodes vSAN cluster + witness**, and I see high cpu usage on the witness non stop. It is not being used yet ! I tried reboot, I unconfigured and recreated it twice with fresh witness both time, always same issue.

Looking inside the Witness VM, I see a python taking all the CPU:

/usr/bin/python -u /usr/lib/vmware/vsan/bin/VSANDeviceMonitor.py -n vsandevicemonitord

​

Looking at the log folder I see this file writing like crazy: /scratch/log/localcli.log

Here the loop I see in the log:

`2020-05-01T14:55:18Z localcli[27151215]: Log for VMware ESXi version=7.0.0 build=build-15843807 option=Release`

`2020-05-01T14:55:18Z localcli[27151215]: VsanInfoImpl: Refresh config generation`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] GetInstances invoked for: component vsan group system key vsan_witness, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key vsan, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: VsanConfigStore: Get field fault_domain_name on entry vsan subobject host with value`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key vsan, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: VsanConfigStore: Get field vcenter_max_disk_version on entry vsan subobject options with value 11`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key vsan, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key vsan, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: VsanConfigStore: Failed to get datastore name from config store`

`2020-05-01T14:55:18Z localcli[27151215]: VsanInfoImpl: Assigning the default datastore`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key vsan, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key vsan, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: VsanConfigStore: Failed to get object – file_service`

`2020-05-01T14:55:18Z localcli[27151215]: VsanConfigStore: fail to get object for file_service`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key host_state, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: VsanConfigStore: unexpected value for decom state in config store: , treat this state as: NONE`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key host_state, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: VsanConfigStore: unexpected value for decom mode in config store: , treat this mode as: NONE`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key host_state, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key host_state, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] GetInstances invoked for: component vsan group system key vsan_witness, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: VsanConfigStore: Get subCluster config info`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] GetInstances invoked for: component vsan group system key vsan_witness, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key vsan_witness instanceId 524bc4b5-8b64-6542-7b96-e50a01465e41, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: VsanConfigStore: Get sub clusterUuid=524bc4b5-8b64-6542-7b96-e50a01465e41, enabled: 1`

`2020-05-01T14:55:18Z localcli[27151215]: VsanConfigStore: Get subCluster config count=1`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key vsan_witness instanceId 524bc4b5-8b64-6542-7b96-e50a01465e41, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key vsan_witness instanceId 524bc4b5-8b64-6542-7b96-e50a01465e41, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key vsan_witness instanceId 524bc4b5-8b64-6542-7b96-e50a01465e41, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key vsan_witness instanceId 524bc4b5-8b64-6542-7b96-e50a01465e41, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: VsanInfoImpl: push new cluster info uuid: 524bc4b5-8b64-6542-7b96-e50a01465e41, vcUuid: f06aae56-332d-4e64-8090-2dfcabcd9c78, genNum: 31, genTime: 1588301657421,in LoadClusterConfig: old count 0, new count 1`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key vsan, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: [ConfigStore:27151215:718235749824:] Get invoked for: component vsan group system key vsan, userdatacontext: 1`

`2020-05-01T14:55:18Z localcli[27151215]: VsanInfoImpl: Get config generation vcUuid: f06aae56-332d-4e64-8090-2dfcabcd9c78, genNum: 31, genTime: 1588301657421, clusterUuid: 524bc4b5-8b64-6542-7b96-e50a01465e41`

`2020-05-01T14:55:18Z localcli[27151215]: VsanIscsiTargetImpl: Calling VitVmkCtlFini()`

`2020-05-01T14:55:18Z localcli[27151215]: VsanUtil: ClearClusterLeaveCallback: Cleared callback`

`2020-05-01T14:55:18Z localcli[27151215]: VsanUtil: ClearVmkNicChangeCallback: Cleared callback`

`2020-05-01T14:55:18Z localcli[27151215]: VsanUtil: ClearVsanSystemRefreshCallback: Cleared callback`

`2020-05-01T14:55:18Z localcli[27151215]: VsanUtil: ClearVsanHostEnterMaintenanceModeCallback: Cleared callback`


View Reddit by macgaverView Source

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Close