Skip to content

Heads Up! Log Insight Integration Issue When Upgrading To vR Ops 6.1

Any issue has been discovered where upgraded instances of vR Ops from 6.0.x to 6.1 that were integrated with Log Insight no longer display Log Insight notification events. Read on to learn more about the issue and how to fix it.
vrops-256

Issue

After upgrading a vR Ops instance that was integrated with Log Insight from vR Ops 6.0.x to 6.1 Log Insight notification events no longer appear. Please note this only impacts upgraded vR Ops instances and only vR Ops instances where Log Insight integration was configured before the vR Ops upgrade.
Based not seeing Log Insight notification events in vR Ops, you can also confirm the issue, but checking some Log Insight log files. First, check the /storage/var/loginsight/alert.log file to confirm alerts are actually being fired. You will need to search based on the name of the alert you configured in the Log Insight UI. The output is in JSON format is may be quite long:

{"Timestamp":"2015-09-25T22:12:08.717Z","Data":{"Name":"esx03 - 3 - test 2","Info":null,"HitCount":1.0,"Url":"https://192.168.1.33/explorer?existingChartQuery=%7B%22query%22%3A%22WaitForUpdatesDone%5D+Completed+callback%22%2C%22startTimeMillis%22%3A1443218825848%2C%22endTimeMillis%22%3A1443219125847%2C%22piqlFunctionGroups%22%3A%5B%7B%22functions%22%3A%5B%7B%22label%22%3A%22Count%22%2C%22value%22%3A%22COUNT%22%2C%22requiresField%22%3Afalse%2C%22numericOnly%22%3Afalse%7D%5D%2C%22field%22%3Anull%7D%5D%2C%22dateFilterPreset%22%3A%22CUSTOM%22%2C%22shouldGroupByTime%22%3Atrue%2C%22eventSortOrder%22%3A%22DESC%22%2C%22summarySortOrder%22%3A%22DESC%22%2C%22compareQueryOrderBy%22%3A%22TREND%22%2C%22compareQuerySortOrder%22%3A%22DESC%22%2C%22compareQueryOptions%22%3Anull%2C%22messageViewType%22%3A%22EVENTS%22%2C%22constraintToggle%22%3A%22ALL%22%2C%22piqlFunction%22%3A%7B%22label%22%3A%22Count%22%2C%22value%22%3A%22COUNT%22%2C%22requiresField%22%3Afalse%2C%22numericOnly%22%3Afalse%7D%2C%22piqlFunctionField%22%3Anull%2C%22fieldConstraints%22%3A%5B%5D%2C%22supplementalConstraints%22%3A%5B%5D%2C%22groupByFields%22%3A%5B%7B%22displayName%22%3A%22hostname%22%2C%22internalName%22%3A%22hostname%22%2C%22displayNamespace%22%3Anull%2C%22numericGroupByType%22%3A%22EACH_VALUE%22%2C%22numericGroupByValue%22%3Anull%7D%5D%2C%22extractedFields%22%3A%5B%5D%7D","EditUrl":"https://192.168.1.33/explorer?existingChartQuery=%7B%22query%22%3A%22WaitForUpdatesDone%5D+Completed+callback%22%2C%22startTimeMillis%22%3A1443218825848%2C%22endTimeMillis%22%3A1443219125847%2C%22piqlFunctionGroups%22%3A%5B%7B%22functions%22%3A%5B%7B%22label%22%3A%22Count%22%2C%22value%22%3A%22COUNT%22%2C%22requiresField%22%3Afalse%2C%22numericOnly%22%3Afalse%7D%5D%2C%22field%22%3Anull%7D%5D%2C%22dateFilterPreset%22%3A%22CUSTOM%22%2C%22shouldGroupByTime%22%3Atrue%2C%22eventSortOrder%22%3A%22DESC%22%2C%22summarySortOrder%22%3A%22DESC%22%2C%22compareQueryOrderBy%22%3A%22TREND%22%2C%22compareQuerySortOrder%22%3A%22DESC%22%2C%22compareQueryOptions%22%3Anull%2C%22messageViewType%22%3A%22EVENTS%22%2C%22constraintToggle%22%3A%22ALL%22%2C%22piqlFunction%22%3A%7B%22label%22%3A%22Count%22%2C%22value%22%3A%22COUNT%22%2C%22requiresField%22%3Afalse%2C%22numericOnly%22%3Afalse%7D%2C%22piqlFunctionField%22%3Anull%2C%22fieldConstraints%22%3A%5B%5D%2C%22supplementalConstraints%22%3A%5B%5D%2C%22groupByFields%22%3A%5B%7B%22displayName%22%3A%22hostname%22%2C%22internalName%22%3A%22hostname%22%2C%22displayNamespace%22%3Anull%2C%22numericGroupByType%22%3A%22EACH_VALUE%22%2C%22numericGroupByValue%22%3Anull%7D%5D%2C%22extractedFields%22%3A%5B%5D%7D&editAlertId=ef061140-639e-4ec2-adca-6ebe6f8ebeab&editAlertOwnerId=00000000-0000-0000-0000-000000000002","Data":[{"Message":"2015-09-25T22:12:15.496Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-616c83c6] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:12:15.162Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-12b9c1f4] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:12:15.159Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-280f8458] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:12:01.500Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-6f113c29] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:12:11.623Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-3af6e856] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:12:10.642Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-37285d14] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:12:07.635Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1a00fe12] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:55.113Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-69418462] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:12:05.226Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-49e61349] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:12:04.082Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-7f9bbe3a] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:45.687Z esx04.matrix Vpxa: verbose vpxa[FFFD3B70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-46cdad9e] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:11:53.639Z esx03.matrix Vpxa: verbose vpxa[FFF4CB
70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-67f0eaa] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:36.113Z esx04.matrix Vpxa: verbose vpxa[FFFD3B70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1324956b] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:11:45.496Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-45ebf66b] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:45.159Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-777b6425] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:31.500Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-3ded0218] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:11:41.627Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-3801b2b4] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:40.643Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-4330c992] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:37.634Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-444d5ce] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:25.113Z esx04.matrix Vpxa: verbose vpxa[670BCB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-49d6ef1f] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:11:35.228Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1440389d] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:15.686Z esx04.matrix Vpxa: verbose vpxa[670BCB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-7d4ef196] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:11:23.648Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-553718d8] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:23.642Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-2b52fc60] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:06.117Z esx04.matrix Vpxa: verbose vpxa[FFFD3B70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-58468330] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:11:15.496Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1abfe118] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:15.159Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-6e64c8df] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:01.501Z esx04.matrix Vpxa: verbose vpxa[670BCB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-646d9ca2] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:11:11.624Z esx03.
matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-4461c36b] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:10.642Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-77e4a64b] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:07.634Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-37a0389c] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:55.113Z esx04.matrix Vpxa: verbose vpxa[670BCB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-396495d9] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:11:05.230Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1490ddf] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:11:05.227Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-36c9e6b3] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:45.686Z esx04.matrix Vpxa: verbose vpxa[670DDB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-2672c6f7] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:10:43.718Z esx04.matrix Vpxa: verbose vpxa[670BCB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-23f6e5f3] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:10:53.642Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-29f39539] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:53.639Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1e427d7] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:36.123Z esx04.matrix Vpxa: verbose vpxa[670BCB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-6eaf0322] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:10:45.495Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-4b274fbd] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:45.162Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-105ef8e8] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:31.500Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-32d9a442] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:10:41.625Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-41a080a9] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:40.645Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-7cf32f35] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:40.642Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-9257ff3] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"M
essage":"2015-09-25T22:10:37.630Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-8ca0d27] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:25.112Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-773ea93f] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:10:35.227Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-7ba2f9fb] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:32.250Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1cb05133] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:15.686Z esx04.matrix Vpxa: verbose vpxa[670DDB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-6400e703] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:10:23.644Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-7692c0ce] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:23.639Z esx03.matrix Vpxa: verbose vpxa[FFF4CB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-44bd85ab] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:06.113Z esx04.matrix Vpxa: verbose vpxa[670DDB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-3562b78e] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:10:15.493Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-147e7253] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:15.160Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-31cd29f8] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:01.499Z esx04.matrix Vpxa: verbose vpxa[670DDB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-47a166c7] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:10:11.624Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-45d153af] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:10.641Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-47d07196] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:10:07.630Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-54a1c222] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:55.112Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-6488b42b] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:10:05.227Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-7606c80d] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:45.684Z esx04.matrix Vpxa: verbose vpxa[670BCB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-6c613f63] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1
.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:09:53.640Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-3f16dcfe] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:36.107Z esx04.matrix Vpxa: verbose vpxa[670BCB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-5bf3f136] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:09:45.494Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-59642a53] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:45.163Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1382735e] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:31.498Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-640655ef] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:09:41.625Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-34ac2c16] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:40.642Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-73461863] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:37.630Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-b6e8640] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:25.112Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-7a5687ac] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:09:35.232Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-5a1c98b8] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:35.228Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-45265ed7] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:15.686Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-712611bc] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:09:15.681Z esx04.matrix Vpxa: verbose vpxa[FFFD3B70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-569fc1a] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:09:23.643Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-7f5b54f3] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:23.638Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-41449bf6] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:11.920Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-2514fee3] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:09:06.105Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-778c701e] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_
source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:09:15.492Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1081ea69] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:15.162Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-197dc6ba] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:01.500Z esx04.matrix Vpxa: verbose vpxa[670BCB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-5cdc1f52] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:09:11.626Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-5e6a5eeb] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:10.642Z esx03.matrix Vpxa: verbose vpxa[FF957A60] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-12009e8] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:07.631Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-3e80e87f] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:55.113Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-60b1ee15] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:09:05.521Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-6894c101] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:05.234Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-673d4942] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:05.230Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-181668d8] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:09:00.427Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-73afc2ae] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:45.684Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-516587ba] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:08:45.650Z esx04.matrix Vpxa: verbose vpxa[670BCB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1730043a] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:08:45.647Z esx04.matrix Vpxa: verbose vpxa[FFFF4B70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-14ec1469] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:08:56.441Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-2ef763a8] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:56.438Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-63562e43] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:53.639Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-7f6e4e86] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0
f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:36.114Z esx04.matrix Vpxa: verbose vpxa[FFFD3B70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-750b90ca] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:08:45.492Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-166fb373] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:45.163Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-51cdae52] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:31.499Z esx04.matrix Vpxa: verbose vpxa[FFFD3B70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-2b9d013] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:08:41.624Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-3116d453] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:40.644Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-190b3e0d] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:37.630Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-51f0d08a] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:25.112Z esx04.matrix Vpxa: verbose vpxa[FFFF4B70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-6ed96608] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:08:35.233Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-68d46bca] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:35.229Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-19bb8fa8] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:15.683Z esx04.matrix Vpxa: verbose vpxa[FFFF4B70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-6e75a9b7] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:08:23.647Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-6c2f5ddd] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:23.643Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-25742518] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:06.110Z esx04.matrix Vpxa: verbose vpxa[FFFF4B70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-3834407c] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:08:15.491Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1a6427d9] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:15.164Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-6705812e] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:01.498Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1c24dd2b] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","
appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:08:11.625Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-2b1caa9e] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:10.643Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-2edee34c] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:07.631Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-4c350cda] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:55.114Z esx04.matrix Vpxa: verbose vpxa[670BCB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-e91cf37] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:08:05.231Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-2d5376ca] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:08:05.228Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-365b70ef] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:45.682Z esx04.matrix Vpxa: verbose vpxa[670BCB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-6076a9fb] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:07:53.644Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-a4cc601] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:53.640Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1a6b8a6c] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:40.175Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-7ac9f317] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:07:36.112Z esx04.matrix Vpxa: verbose vpxa[FFFF4B70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-164a962f] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:07:45.490Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-4ea887cc] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_object_id":"host-28","vmw_vcenter":"vcs01.matrix","appname":"Vpxa","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:45.167Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-c828bce] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:45.163Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-200e535b] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:31.498Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [Origin[email protected] sub=VpxaHalCnxHostagent opID=WFU-203e2c60] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:07:41.627Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-3246381e] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:29.311Z esx04.matrix Vpxa: verbose vpxa[6713EB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-101d8c4] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcent
er_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:07:29.264Z esx04.matrix Vpxa: verbose vpxa[6713EB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-409143ea] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:07:40.644Z esx03.matrix Vpxa: verbose vpxa[FFF6DB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-66c3946f] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:37.632Z esx03.matrix Vpxa: verbose vpxa[FF9DBB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-2fa0d02e] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:25.114Z esx04.matrix Vpxa: verbose vpxa[670DDB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-29923fa8] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_object_id":"host-35","vmw_vcenter":"vcs01","appname":"Vpxa","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:07:35.231Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-64a96eab] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:35.229Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-52382780] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:28.558Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-7bc7305c] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:15.681Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-5552b793] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}},{"Message":"2015-09-25T22:07:23.643Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-4bb58b38] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:23.640Z esx03.matrix Vpxa: verbose vpxa[FFFAFB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-1c36b540] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-28","vmw_vr_ops_id":"eb9a426e-08b0-4dc8-88ad-61ca1a762aac","vmw_vcenter":"vcs01.matrix","vmw_vcenter_id":"FFB49D08-CBE1-417C-A1E0-5265DC1BDE12","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx03.matrix","__li_source_path":"192.168.1.12","vmw_datacenter":"bos01"}},{"Message":"2015-09-25T22:07:06.109Z esx04.matrix Vpxa: verbose vpxa[670FEB70] [[email protected] sub=VpxaHalCnxHostagent opID=WFU-5b9601d6] [WaitForUpdatesDone] Completed callback","Fields":{"vmw_object_id":"host-35","vmw_vr_ops_id":"bc748cce-49f3-4795-801f-93b8957b97f0","vmw_vcenter":"vcs01","vmw_vcenter_id":"199bf98e-b40f-4ff2-b2c7-d829a7948579","appname":"Vpxa","event_type":"v4_a0f23ef6","hostname":"esx04.matrix","__li_source_path":"192.168.1.13","vmw_datacenter":"bos"}}]}}

Then check the /storage/var/loginsight/vcenter_operations.log which will have 500 errors like the following:

[2015-09-25 20:37:07.496+0000] [Thread-14/192.168.1.29 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteNotificationProvider] [sending notification to vRealize Operations Manager]
[2015-09-25 20:37:07.497+0000] [Thread-14/192.168.1.29 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Post event for resource 4c8d7990-ea0d-4009-98ef-68e35c8f2723 :  Log Insight: esx03 - 3 - test 2, CRITICAL ]
[2015-09-25 20:37:07.497+0000] [Thread-14/192.168.1.29 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [constructed json {"eventType":"NOTIFICATION","resourceId":"4c8d7990-ea0d-4009-98ef-68e35c8f2723","startTimeUTC":1443213427497,"cancelTimeUTC":"0","message":"Log Insight: esx03 - 3 - test 2","severity":"CRITICAL","managedExternally":"true"}]
[2015-09-25 20:37:07.497+0000] [Thread-14/192.168.1.29 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://vcops.matrix/suite-api/api/events]
[2015-09-25 20:37:07.497+0000] [Thread-14/192.168.1.29 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [verifySslCertificate is set to false, accepting all certificates]
[2015-09-25 20:37:07.497+0000] [Thread-14/192.168.1.29 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [http connection, setting request method 'POST' and content type 'application/json; charset=utf-8']
[2015-09-25 20:37:07.497+0000] [Thread-14/192.168.1.29 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [writing json POST to stream]
[2015-09-25 20:37:07.502+0000] [Thread-14/192.168.1.29 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [reading server response]
[2015-09-25 20:37:07.583+0000] [Thread-14/192.168.1.29 ERROR] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [failed to post resource to vRealize Operations Manager]
java.io.IOException: Server returned HTTP response code: 500 for URL: https://vcops.matrix/suite-api/api/events
	at sun.reflect.GeneratedConstructorAccessor888.newInstance(Unknown Source)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
	at java.lang.reflect.Constructor.newInstance(Unknown Source)
	at sun.net.www.protocol.http.HttpURLConnection$6.run(Unknown Source)
	at sun.net.www.protocol.http.HttpURLConnection$6.run(Unknown Source)
	at java.security.AccessController.doPrivileged(Native Method)
	at sun.net.www.protocol.http.HttpURLConnection.getChainedException(Unknown Source)
	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source)
	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(Unknown Source)
	at com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest.jsonRequest(VcopsSuiteApiRequest.java:592)
	at com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest.postEvent(VcopsSuiteApiRequest.java:525)
	at com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest.postEvent(VcopsSuiteApiRequest.java:499)
	at com.vmware.loginsight.commons.vcops.VropsAdapter6RestApi.addNotificationEvent(VropsAdapter6RestApi.java:146)
	at com.vmware.loginsight.vcopssuite.VcopsSuiteNotificationProvider.sendNotification(VcopsSuiteNotificationProvider.java:61)
	at com.vmware.loginsight.notifications.Notification.sendNotification(Notification.java:73)
	at com.vmware.loginsight.daemon.notifications.PersistentNotificationQueue.run(PersistentNotificationQueue.java:177)
	at java.lang.Thread.run(Unknown Source)
Caused by: java.io.IOException: Server returned HTTP response code: 500 for URL: https://vcops.matrix/suite-api/api/events
	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source)
	at java.net.HttpURLConnection.getResponseCode(Unknown Source)
	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(Unknown Source)
	at com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest.jsonRequest(VcopsSuiteApiRequest.java:588)
	... 7 more
[2015-09-25 20:37:07.583+0000] [Thread-14/192.168.1.29 ERROR] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [failed to send notification to vRealize Operations Manager]
[2015-09-25 20:37:07.583+0000] [Thread-14/192.168.1.29 ERROR] [com.vmware.loginsight.vcopssuite.VcopsSuiteNotificationProvider] [Could not send vRealize Operations Manager event notification]
com.vmware.loginsight.vcopssuite.VcopsSuiteApiException: Exception posting event
	at com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest.postEvent(VcopsSuiteApiRequest.java:528)
	at com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest.postEvent(VcopsSuiteApiRequest.java:499)
	at com.vmware.loginsight.commons.vcops.VropsAdapter6RestApi.addNotificationEvent(VropsAdapter6RestApi.java:146)
	at com.vmware.loginsight.vcopssuite.VcopsSuiteNotificationProvider.sendNotification(VcopsSuiteNotificationProvider.java:61)
	at com.vmware.loginsight.notifications.Notification.sendNotification(Notification.java:73)
	at com.vmware.loginsight.daemon.notifications.PersistentNotificationQueue.run(PersistentNotificationQueue.java:177)
	at java.lang.Thread.run(Unknown Source)
Caused by: com.vmware.loginsight.vcopssuite.VcopsSuiteApiException: Exception posting resource
	at com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest.jsonRequest(VcopsSuiteApiRequest.java:603)
	at com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest.postEvent(VcopsSuiteApiRequest.java:525)
	... 6 more
Caused by: java.io.IOException: Server returned HTTP response code: 500 for URL: https://vcops.matrix/suite-api/api/events
	at sun.reflect.GeneratedConstructorAccessor888.newInstance(Unknown Source)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
	at java.lang.reflect.Constructor.newInstance(Unknown Source)
	at sun.net.www.protocol.http.HttpURLConnection$6.run(Unknown Source)
	at sun.net.www.protocol.http.HttpURLConnection$6.run(Unknown Source)
	at java.security.AccessController.doPrivileged(Native Method)
	at sun.net.www.protocol.http.HttpURLConnection.getChainedException(Unknown Source)
	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source)
	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(Unknown Source)
	at com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest.jsonRequest(VcopsSuiteApiRequest.java:592)
	... 7 more
Caused by: java.io.IOException: Server returned HTTP response code: 500 for URL: https://vcops.matrix/suite-api/api/events
	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source)
	at java.net.HttpURLConnection.getResponseCode(Unknown Source)
	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(Unknown Source)
	at com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest.jsonRequest(VcopsSuiteApiRequest.java:588)
	... 7 more

Workaround

VMware is aware of the issue and working on publishing a KB. In the meantime, I wanted to walk through the workaround with screenshots.

0. WARNING

Do not remove integration between Log Insight and vR Ops from the Log Insight Administration section. If you do then you will lose all historic notification events sent to vR Ops.

1. Get the object ID of the vRealizeOpsMgrAPI adapter instance

One way to do this is to look it up under https://<vrops>/ui/index.action#/administration/inventory-explorer:
li-vrops-ie1
Unfortunately, by default the ID is hidden and it may be hard to determine how to find the required information:
li-vrops-ie2
Also no copy option exists once the information is found:
li-vrops-ie3
The other way to do this is with a REST API call — you will need REST for the next step so I recommend this approach. First, you need to find out the API commands. I learned you can do this directly from your vR Ops instance via a URL:
li-vrops-api
Next you need to make the API call. I use the Advanced REST Client plugin for Chrome:
li-vrops-idYou will be prompted to authenticate and then you should get a 200 OK Status. The result of the command will be at the bottom of the screen:
li-vrops-id2

2. Delete the vRalizeOpsMgrAPI adapter instance

This MUST be done with a REST API call — you cannot delete from the vR Ops UI and should not attempt to delete anything from the vR Ops UI. Again we can use the browser to perform the required action using the information from the previous step:
li-vrops-id-deleteThis time you should receive a 204 No Content Status and no additional output. You can confirm the action worked by checking the vR Ops instance again. Please note it is not sufficient to simply hit the refresh button in the upper right-hand corner, doing so results in:
li-vrops-ie4Note that the line item is gone from the List, but still appears on the expanded navigation. I prefer to go to a different option — say Object Relationships — and then come back to Inventory Explorer. Then the page should look like this:
li-vrops-ie5

3. Restart the collector service on all vR Ops nodes

This needs to be done from the CLI of each vR Ops node. By default, SSH is disabled so you will need to enable it on the console of the VM by logging in and running /etc/init.d/sshd start. Then the command is:

# service vmware-vcops restart collector
Slice Online-true
ui Role Enabled-true
data Role Enabled-true
Stopping vRealize Operations Collector...
Waiting for vRealize Operations Collector to exit...
Waiting for vRealize Operations Collector to exit...
Waiting for vRealize Operations Collector to exit...
Waiting for vRealize Operations Collector to exit...
Waiting for vRealize Operations Collector to exit...
Waiting for vRealize Operations Collector to exit...
Waiting for vRealize Operations Collector to exit...
Waiting for vRealize Operations Collector to exit...
Waiting for vRealize Operations Collector to exit...
Waiting for vRealize Operations Collector to exit...
Stopped vRealize Operations Collector.
admin Role Enabled-true
remote collector Role Enabled-false
Slice Online-true
admin Role Enabled-true
data Role Enabled-true
Starting vRealize Operations Collector...
ui Role Enabled-true
remote collector Role Enabled-false

Again, please note this MUST BE DONE ON EVERY VR OPS NODE!

4. You are done!

Log Insight notification events should now be received by vR Ops. One note is that it can take several minutes for vR Ops to properly recognize the change, Log Insight alerts will take 5 or more minutes to make it to vR Ops depending on alert threshold configuration, and vR Ops could take 5 or more minutes to process the alert sent by Log Insight. Long story short, be patient!
One final note is that the vRealizeOpsMgrAPI adapter instance will not appear until a success Log Insight notification event is processed. Once it is, you will see a new adapter instance with a new ID:
li-vrops-ie6
While I am on the topic, one of the improvements in vR Ops 6.1 is that Log Insight notification events now show with the properly set Criticality:
li-vrops-notification
A special shoot out to Pavan and everyone else who helped put together this workaround!

© 2015, Steve Flanders. All rights reserved.

Published inVMware

2 Comments

  1. Moussa= Moussa=

    I would juste take the time to thank you for all your precious articles !
    Thank you very much ! your blog helps me every day 🙂

    • Thanks for the comment and I am glad you are enjoying the content!

Leave a Reply

Your email address will not be published. Required fields are marked *