Miscellany

Nov 24 06:09:05 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:08 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:11 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:12 vmkernel: 0:14:24:22.815 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:09:12 vmkernel: 0:14:24:22.815 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:09:12 vmkernel: 0:14:24:22.815 cpu7:4118)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:09:12 vmkernel: 0:14:24:22.868 cpu1:4117)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:09:13 vmkernel: 0:14:24:23.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:09:13 vmkernel: 0:14:24:23.423 cpu7:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:09:13 vmkernel: 0:14:24:23.423 cpu7:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:09:13 vmkernel: 0:14:24:23.423 cpu7:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:09:14 vmkernel: 0:14:24:24.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f412740
Nov 24 06:09:14 vmkernel: 0:14:24:24.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:09:14 vmkernel: 0:14:24:24.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:09:14 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:17 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:09:17 Hostd: [2011-11-24 06:09:17.795 FFB6EE80 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.885 1C5FFB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.885 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.887 1C7C6B90 info 'App' opID=task-internal-119-89f86e1] [VpxLRO] -- BEGIN task-internal-119 --  -- vpxapi.VpxaService.querySummaryStatistics -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.887 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 152, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.887 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 168, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.887 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 161, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.887 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 154, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.887 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 170, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 155, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 163, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 171, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 148, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 156, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 164, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 172, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 149, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 157, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 165, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 173, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 150, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 158, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 166, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 174, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.888 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 151, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 159, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 167, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 175, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 160, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 153, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 169, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 162, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 178, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 216, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 177, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 193, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 225, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 186, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 202, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 218, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 226, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 179, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 187, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.889 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 211, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 219, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 227, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 235, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 243, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 188, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 196, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 220, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 228, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 236, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 244, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 189, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 205, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 221, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 229, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 190, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 214, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 222, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 183, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 191, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.890 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 199, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.891 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 215, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.891 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 223, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.891 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 239, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.891 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 176, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.891 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 192, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.891 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 208, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.891 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 224, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.891 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 240, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.891 1C7C6B90 verbose 'App' opID=task-internal-119-89f86e1] [TranslateVpxdMetrics] Could not translate vpxd counter 217, metric omitted.
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.901 1C7C6B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-119-89f86e1] HTTP Response: Complete (processed 3799 bytes)
Nov 24 06:09:17 Vpxa: [2011-11-24 06:09:17.901 1C7C6B90 info 'App' opID=task-internal-119-89f86e1] [VpxLRO] -- FINISH task-internal-119 --  -- vpxapi.VpxaService.querySummaryStatistics -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:09:17 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:19 Vpxa: [2011-11-24 06:09:19.087 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:09:19 Vpxa: [2011-11-24 06:09:19.087 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:09:19 Vpxa: [2011-11-24 06:09:19.088 1C848B90 info 'App' opID=task-internal-120-d1c5ca90] [VpxLRO] -- BEGIN task-internal-120 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:09:19 Vpxa: [2011-11-24 06:09:19.088 1C848B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-120-d1c5ca90] HTTP Response: Complete (processed 1855 bytes)
Nov 24 06:09:19 Vpxa: [2011-11-24 06:09:19.088 1C848B90 info 'App' opID=task-internal-120-d1c5ca90] [VpxLRO] -- FINISH task-internal-120 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:09:20 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:22 Vpxa: [2011-11-24 06:09:22.574 1C889B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:09:22 Vpxa: [2011-11-24 06:09:22.576 1C889B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:09:24 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:27 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:30 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:33 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:36 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:39 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:42 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:42 Vpxa: [2011-11-24 06:09:42.574 1C37CB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:09:42 Vpxa: [2011-11-24 06:09:42.576 1C37CB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:09:45 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:45 Hostd: [2011-11-24 06:09:45.666 22EB1B90 verbose 'DvsManager'] PersistAllDvsInfo called
Nov 24 06:09:45 Hostd: [2011-11-24 06:09:45.778 FFB6EE80 verbose 'vm:/vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx'] Actual VM overhead: 532516864 bytes
Nov 24 06:09:45 Hostd: [2011-11-24 06:09:45.778 FFB6EE80 verbose 'Vmsvc'] RefreshVms updated overhead for 1 VM
Nov 24 06:09:45 Vpxa: [2011-11-24 06:09:45.780 1C253B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:09:45 Vpxa: [2011-11-24 06:09:45.780 1C253B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 228 to 229 (at 228)
Nov 24 06:09:45 Vpxa: [2011-11-24 06:09:45.780 1C253B90 verbose 'App'] [VpxaHalVmHostagent] 672: Runtime changed 'runtime.memoryOverhead'
Nov 24 06:09:45 Vpxa: [2011-11-24 06:09:45.780 1C253B90 verbose 'App'] [VpxaHalServices] RuntimeChange Event for vm(2) 672
Nov 24 06:09:45 Vpxa: [2011-11-24 06:09:45.780 1C253B90 verbose 'App'] [VpxaInvtVmChangeListener] AAM won't be notifyed. vmid 2: notifyVMAP 0,isRestarting 0
Nov 24 06:09:45 Vpxa: [2011-11-24 06:09:45.780 1C253B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no to (280): VmRuntime:VpxaInvtVmChangeListener::RuntimeChanged
Nov 24 06:09:48 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:51 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:52 vmkernel: 0:14:25:02.868 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:09:52 vmkernel: 0:14:25:02.868 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:09:52 vmkernel: 0:14:25:02.868 cpu0:4117)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:09:52 vmkernel: 0:14:25:02.901 cpu7:4119)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.832 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.832 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength 129)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.833 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Auto-completing at 129/129 bytes
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.833 FFE5BB10 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.833 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.833 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.833 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.834 1C6C2B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.834 1C6C2B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.834 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.834 1C848B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.834 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@280-80] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.835 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@280-80] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.835 1C848B90 info 'App' opID=HB-host-9@280-80] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-4
Nov 24 06:09:52 62a-a2de-0657c7cad3d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.835 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@280-80] [1+] VpxaMoService::GetChanges
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.835 1C848B90 verbose 'App' opID=HB-host-9@280-80] [VpxaMoService] GetChanges: 279 -> 280
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.836 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.836 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.837 1C807B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.837 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.837 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1446 bytes)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.837 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@280-80] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.838 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@280-80] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.838 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@280-80] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.838 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@280-80] [2-] VpxdDatastore::PrepareChanges (took 0 ms)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.838 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@280-80] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.839 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.840 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:09:52 Hostd: [2011-11-24 06:09:52.840 235C2B90 verbose 'ha-license-manager' opID=HB-host-9@280-80] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:09:52 Hostd: [2011-11-24 06:09:52.851 235C2B90 info 'Libs' opID=HB-host-9@280-80] Could not expand environment variable HOME.
Nov 24 06:09:52 Hostd: [2011-11-24 06:09:52.856 235C2B90 verbose 'App' opID=HB-host-9@280-80] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" (lastError=0, desc.IsValid:Yes)
Nov 24 06:09:52 Hostd: [2011-11-24 06:09:52.858 235C2B90 info 'Libs' opID=HB-host-9@280-80] Could not expand environment variable HOME.
Nov 24 06:09:52 Hostd: [2011-11-24 06:09:52.863 235C2B90 verbose 'Locale' opID=HB-host-9@280-80] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected in module 'default'.
Nov 24 06:09:52 Hostd: [2011-11-24 06:09:52.863 235C2B90 verbose 'Locale' opID=HB-host-9@280-80] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in module 'default'.
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.866 1C848B90 verbose 'App' opID=HB-host-9@280-80] [VpxaMoService] host changes include changed properties []
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.866 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@280-80] [2-] VpxaMoService::PrepareHostChanges (took 28 ms)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.866 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@280-80] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.866 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@280-80] [3+] HandleVMChanges for vmid:2
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.867 1C848B90 verbose 'App' opID=HB-host-9@280-80] [VpxURL] Resolved localPath /vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx to URL sanfs://vmfs_uuid:4e407bca-a51d0e62-8a8c-00304
Nov 24 06:09:52 861ab4f/Nexenta-2_1/Nexenta-2.vmx
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.867 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@280-80] [3-] HandleVMChanges for vmid:2 (took 0 ms)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.867 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@280-80] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.867 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@280-80] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.867 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@280-80] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.867 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.867 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@280-80] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.868 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@280-80] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.868 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@280-80] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.868 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@280-80] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.868 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@280-80] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.868 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@280-80] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.868 1C848B90 verbose 'VpxaHalResourcePool' opID=HB-host-9@280-80] NeedFullSync() = false
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.868 1C848B90 verbose 'VpxaHalResourcePool' opID=HB-host-9@280-80] VpxaHalResourcePoolStandalone::GetVpxaMoRef(vim.ResourcePool:pool0) = vim.ResourcePool:/Resources/Extreme
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.868 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@280-80] [1-] VpxaMoService::GetChanges (took 33 ms)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.868 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@280-80] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.868 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@280-80] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.868 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@280-80] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.869 1C848B90 info 'App' opID=HB-host-9@280-80] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-
Nov 24 06:09:52 462a-a2de-0657c7cad3d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.869 1C848B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5252888f-81e5-ea3c-cc30-a6fbf3be26d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.869 1C744B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.870 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.871 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 4318 bytes)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.873 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.873 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.873 1C848B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.873 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.874 1C785B90 info 'App' opID=HB-host-9@280-37] [VpxLRO] -- BEGIN task-internal-121 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.874 1C785B90 verbose 'SoapAdapter.HTTPService' opID=HB-host-9@280-37] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.874 1C785B90 info 'App' opID=HB-host-9@280-37] [VpxLRO] -- FINISH task-internal-121 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.876 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.876 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.876 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.876 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.876 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:09:52 Vpxa: [2011-11-24 06:09:52.877 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:09:53 vmkernel: 0:14:25:03.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:09:53 vmkernel: 0:14:25:03.423 cpu6:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:09:53 vmkernel: 0:14:25:03.423 cpu6:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:09:53 vmkernel: 0:14:25:03.423 cpu6:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:09:54 iscsid: connect failed (111,Connection refused)
Nov 24 06:09:54 vmkernel: 0:14:25:04.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f3a4b40
Nov 24 06:09:54 vmkernel: 0:14:25:04.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:09:54 vmkernel: 0:14:25:04.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:09:57 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:00 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:02 Vpxa: [2011-11-24 06:10:02.574 FFE5BB10 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:10:02 Vpxa: [2011-11-24 06:10:02.576 FFE5BB10 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:10:03 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:05 Hostd: [2011-11-24 06:10:05.229 23340B90 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:10:05 Hostd: [2011-11-24 06:10:05.518 22EF2B90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:10:05 Vpxa: [2011-11-24 06:10:05.520 1C253B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:10:05 Vpxa: [2011-11-24 06:10:05.521 1C253B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 229 to 230 (at 229)
Nov 24 06:10:05 Vpxa: [2011-11-24 06:10:05.521 1C253B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:10:06 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:09 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:12 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:15 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:17 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:10:17 Hostd: [2011-11-24 06:10:17.896 221CAB90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:10:18 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:19 Vpxa: [2011-11-24 06:10:19.088 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:10:19 Vpxa: [2011-11-24 06:10:19.089 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:10:19 Vpxa: [2011-11-24 06:10:19.089 1C807B90 info 'App' opID=task-internal-122-b5089076] [VpxLRO] -- BEGIN task-internal-122 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:10:19 Vpxa: [2011-11-24 06:10:19.090 1C807B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-122-b5089076] HTTP Response: Complete (processed 1855 bytes)
Nov 24 06:10:19 Vpxa: [2011-11-24 06:10:19.090 1C807B90 info 'App' opID=task-internal-122-b5089076] [VpxLRO] -- FINISH task-internal-122 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:10:21 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:22 Vpxa: [2011-11-24 06:10:22.574 1C6C2B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:10:22 Vpxa: [2011-11-24 06:10:22.577 1C6C2B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:10:24 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:27 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:30 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:32 vmkernel: 0:14:25:42.901 cpu3:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:10:32 vmkernel: 0:14:25:42.901 cpu3:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:10:32 vmkernel: 0:14:25:42.901 cpu6:4119)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:10:32 vmkernel: 0:14:25:42.934 cpu6:4118)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:10:33 vmkernel: 0:14:25:43.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:10:33 vmkernel: 0:14:25:43.423 cpu6:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:10:33 vmkernel: 0:14:25:43.423 cpu6:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:10:33 vmkernel: 0:14:25:43.423 cpu6:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:10:33 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:34 vmkernel: 0:14:25:44.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f3a4b40
Nov 24 06:10:34 vmkernel: 0:14:25:44.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:10:34 vmkernel: 0:14:25:44.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:10:36 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:39 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:42 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:42 Vpxa: [2011-11-24 06:10:42.575 1C6C2B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:10:42 Vpxa: [2011-11-24 06:10:42.578 1C6C2B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:10:45 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:48 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:51 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:54 iscsid: connect failed (111,Connection refused)
Nov 24 06:10:57 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:00 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:02 Vpxa: [2011-11-24 06:11:02.576 1C5BEB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:11:02 Vpxa: [2011-11-24 06:11:02.578 1C5BEB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:11:03 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:06 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:09 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:12 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:12 vmkernel: 0:14:26:22.934 cpu3:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:11:12 vmkernel: 0:14:26:22.934 cpu3:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:11:12 vmkernel: 0:14:26:22.934 cpu7:4118)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:11:12 vmkernel: 0:14:26:23.009 cpu1:4117)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:11:13 vmkernel: 0:14:26:23.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:11:13 vmkernel: 0:14:26:23.423 cpu7:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:11:13 vmkernel: 0:14:26:23.424 cpu7:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:11:13 vmkernel: 0:14:26:23.424 cpu7:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:11:14 vmkernel: 0:14:26:24.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f4a8d40
Nov 24 06:11:14 vmkernel: 0:14:26:24.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:11:14 vmkernel: 0:14:26:24.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:11:15 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:17 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:11:18 Hostd: [2011-11-24 06:11:17.999 23540B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:11:18 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:19 Vpxa: [2011-11-24 06:11:19.090 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:11:19 Vpxa: [2011-11-24 06:11:19.090 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:11:19 Vpxa: [2011-11-24 06:11:19.091 FFE5BB10 info 'App' opID=task-internal-123-8994ed9c] [VpxLRO] -- BEGIN task-internal-123 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:11:19 Vpxa: [2011-11-24 06:11:19.091 FFE5BB10 verbose 'SoapAdapter.HTTPService' opID=task-internal-123-8994ed9c] HTTP Response: Complete (processed 1853 bytes)
Nov 24 06:11:19 Vpxa: [2011-11-24 06:11:19.092 FFE5BB10 info 'App' opID=task-internal-123-8994ed9c] [VpxLRO] -- FINISH task-internal-123 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:11:21 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:22 Vpxa: [2011-11-24 06:11:22.576 1C253B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:11:22 Vpxa: [2011-11-24 06:11:22.579 1C253B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:11:24 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:27 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:30 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:33 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:35 Hostd: [2011-11-24 06:11:35.518 233C2B90 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:11:35 Hostd: [2011-11-24 06:11:35.822 223A9B90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:11:35 Hostd: [2011-11-24 06:11:35.822 223A9B90 info 'Snmpsvc'] UpdateSystemIssues: 0 out of 7 total items reporting non-normal state, 0 are new
Nov 24 06:11:35 Vpxa: [2011-11-24 06:11:35.825 1C807B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:11:35 Vpxa: [2011-11-24 06:11:35.825 1C807B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 230 to 231 (at 230)
Nov 24 06:11:35 Vpxa: [2011-11-24 06:11:35.825 1C807B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:11:36 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:39 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:42 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:42 Vpxa: [2011-11-24 06:11:42.576 FFE5BB10 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:11:42 Vpxa: [2011-11-24 06:11:42.578 FFE5BB10 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.296 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.296 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength 129)
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.296 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Auto-completing at 129/129 bytes
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.296 1C848B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.297 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.298 1C37CB90 info 'App' opID=b26b4c5f-96] [VpxLRO] -- BEGIN task-internal-124 -- host -- vim.HostSystem.acquireCimServicesTicket -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:11:45 Hostd: [2011-11-24 06:11:45.299 FFB6EE80 info 'TaskManager' opID=b26b4c5f-96] Task Created : haTask-ha-host-vim.HostSystem.acquireCimServicesTicket-610
Nov 24 06:11:45 Hostd: [2011-11-24 06:11:45.300 23381B90 verbose 'Cimsvc' opID=b26b4c5f-96] Ticket issued for CIMOM version 1.0, user vpxuser
Nov 24 06:11:45 Hostd: [2011-11-24 06:11:45.300 23381B90 info 'TaskManager' opID=b26b4c5f-96] Task Completed : haTask-ha-host-vim.HostSystem.acquireCimServicesTicket-610 Status success
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.301 1C807B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.301 1C807B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 231 to 232 (at 231)
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.302 1C37CB90 verbose 'SoapAdapter.HTTPService' opID=b26b4c5f-96] HTTP Response: Complete (processed 604 bytes)
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.302 1C37CB90 info 'App' opID=b26b4c5f-96] [VpxLRO] -- FINISH task-internal-124 -- host -- vim.HostSystem.acquireCimServicesTicket -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.304 1C848B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.305 1C848B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 232 to 233 (at 232)
Nov 24 06:11:45 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:45 Hostd: [2011-11-24 06:11:45.779 233C2B90 verbose 'vm:/vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx'] Actual VM overhead: 528289792 bytes
Nov 24 06:11:45 Hostd: [2011-11-24 06:11:45.780 233C2B90 verbose 'Vmsvc'] RefreshVms updated overhead for 1 VM
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.781 1C37CB90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.781 1C37CB90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 233 to 234 (at 233)
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.781 1C37CB90 verbose 'App'] [VpxaHalVmHostagent] 672: Runtime changed 'runtime.memoryOverhead'
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.781 1C37CB90 verbose 'App'] [VpxaHalServices] RuntimeChange Event for vm(2) 672
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.782 1C37CB90 verbose 'App'] [VpxaInvtVmChangeListener] AAM won't be notifyed. vmid 2: notifyVMAP 0,isRestarting 0
Nov 24 06:11:45 Vpxa: [2011-11-24 06:11:45.782 1C37CB90 verbose 'App'] [VpxaInvtHost] Increment master gen. no to (281): VmRuntime:VpxaInvtVmChangeListener::RuntimeChanged
Nov 24 06:11:48 Vpxa: [2011-11-24 06:11:48.060 1C5BEB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:11:48 Vpxa: [2011-11-24 06:11:48.061 1C5BEB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:11:48 Vpxa: [2011-11-24 06:11:48.061 1C848B90 info 'App' opID=6F505500-00005592-a2] [VpxLRO] -- BEGIN task-internal-125 --  -- vim.host.StorageSystem.refresh -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:11:48 Hostd: [2011-11-24 06:11:48.063 22EB1B90 info 'TaskManager' opID=6F505500-00005592-a2] Task Created : haTask-ha-host-vim.host.StorageSystem.refresh-611
Nov 24 06:11:48 Hostd: [2011-11-24 06:11:48.064 233C2B90 verbose 'Hostsvc::DatastoreSystem' opID=6F505500-00005592-a2] ReconcileVMFSDatastores called: refresh = true, rescan = true
Nov 24 06:11:48 Hostd: [2011-11-24 06:11:48.064 233C2B90 verbose 'FSVolumeProvider' opID=6F505500-00005592-a2] RefreshVMFSVolumes called
Nov 24 06:11:48 Hostd: [2011-11-24 06:11:48.064 233C2B90 verbose 'FSVolumeProvider' opID=6F505500-00005592-a2] RescanVmfs called
Nov 24 06:11:48 Vpxa: [2011-11-24 06:11:48.065 FFE5BB10 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:11:48 Vpxa: [2011-11-24 06:11:48.065 FFE5BB10 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 234 to 235 (at 234)
Nov 24 06:11:48 vmkernel: 0:14:26:58.424 cpu6:4438)ScsiDeviceIO: 1672: Command 0x25 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x1 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x1.
Nov 24 06:11:48 vmkernel: 0:14:26:58.424 cpu0:93387)WARNING: ScsiCore: 1400: Invalid sense buffer: error=0x0, valid=0x0, segment=0x0, key=0x2
Nov 24 06:11:48 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:49 vmkernel: 0:14:26:59.422 cpu6:4438)ScsiDeviceIO: 1672: Command 0x1a to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x1 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x1.
Nov 24 06:11:49 vmkernel: 0:14:26:59.422 cpu0:93387)WARNING: ScsiDeviceIO: 5172: READ CAPACITY on device "naa.600144f07b3dc70000004ec89beb0001" from Plugin "NMP" failed. I/O error
Nov 24 06:11:49 vmkernel: 0:14:26:59.545 cpu0:93387)Vol3: 1604: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:8' for probing: Permission denied
Nov 24 06:11:49 vmkernel: 0:14:26:59.546 cpu0:93387)Vol3: 644: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:8' for volume open: Permission denied
Nov 24 06:11:49 vmkernel: 0:14:26:59.549 cpu0:93387)Vol3: 1604: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:5' for probing: Permission denied
Nov 24 06:11:49 vmkernel: 0:14:26:59.549 cpu0:93387)Vol3: 644: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:5' for volume open: Permission denied
Nov 24 06:11:49 vmkernel: 0:14:26:59.552 cpu1:93387)Vol3: 1604: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:6' for probing: Permission denied
Nov 24 06:11:49 vmkernel: 0:14:26:59.553 cpu1:93387)Vol3: 644: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:6' for volume open: Permission denied
Nov 24 06:11:50 vmkernel: 0:14:27:00.424 cpu6:4438)ScsiDeviceIO: 1672: Command 0x28 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x1 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x1.
Nov 24 06:11:50 vmkernel: 0:14:27:00.424 cpu1:93387)Vol3: 1436: Error refreshing FB resMeta: No connection
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.207 233C2B90 error 'FSVolumeProvider' opID=6F505500-00005592-a2] VmkCtl RescanVmfs() failed: Unable to scan adapters for VMFS
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.207 23581B90 verbose 'Hostsvc::DatastoreSystem'] VmfsUpdate: got VMFS message [N11HostdCommon18VmkernelUpdateVmfsE:0x22277b70] timestamp=52021184964 specific=0 name= label=
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.217 233C2B90 verbose 'FSVolumeProvider' opID=6F505500-00005592-a2] RefreshVMFSVolumes: refreshed volume, id 4ec8600e-14752f7c-1a51-000423a5c8f0, name RAID10-1
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.225 233C2B90 verbose 'FSVolumeProvider' opID=6F505500-00005592-a2] RefreshVMFSVolumes: refreshed volume, id 4ec82f79-02ffca76-419b-000423a5c8f0, name RAID10-4
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.263 233C2B90 verbose 'FSVolumeProvider' opID=6F505500-00005592-a2] RefreshVMFSVolumes: refreshed volume, id 4e407bca-a51d0e62-8a8c-00304861ab4f, name datastore3
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.267 233C2B90 verbose 'FSVolumeProvider' opID=6F505500-00005592-a2] RefreshVMFSVolumes: refreshed volume, id 4ec85fef-884cf2dc-9689-000423a5c8f0, name RAID10-2
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.276 233C2B90 verbose 'FSVolumeProvider' opID=6F505500-00005592-a2] RefreshVMFSVolumes: refreshed volume, id 4ec85bfd-2986b246-6b0a-000423a5c8f0, name RAID10-3
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.286 233C2B90 verbose 'FSVolumeProvider' opID=6F505500-00005592-a2] RefreshVMFSVolumes: refreshed volume, id 4e3ca8cb-2c9d3330-d70d-000423a5c8f0, name LOCAL-Storage-ESX4.1-500GB
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.286 233C2B90 verbose 'FSVolumeProvider' opID=6F505500-00005592-a2] RefreshVMFSVolumes: refreshed volume, id 4ec91116-e8cb5ca2-cc51-000423a5c8f0, name Nexenta-2-ISCSI-1
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.287 233C2B90 verbose 'Hostsvc::Datastore' opID=6F505500-00005592-a2] SetVolume: Datastore 4ec8600e-14752f7c-1a51-000423a5c8f0 has changed provider volume pointer
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.287 233C2B90 verbose 'Hostsvc::Datastore' opID=6F505500-00005592-a2] SetVolume: Datastore 4ec82f79-02ffca76-419b-000423a5c8f0 has changed provider volume pointer
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.287 233C2B90 verbose 'Hostsvc::Datastore' opID=6F505500-00005592-a2] SetVolume: Datastore 4e407bca-a51d0e62-8a8c-00304861ab4f has changed provider volume pointer
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.287 233C2B90 verbose 'Hostsvc::Datastore' opID=6F505500-00005592-a2] SetVolume: Datastore 4ec85fef-884cf2dc-9689-000423a5c8f0 has changed provider volume pointer
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.287 233C2B90 verbose 'Hostsvc::Datastore' opID=6F505500-00005592-a2] SetVolume: Datastore 4ec85bfd-2986b246-6b0a-000423a5c8f0 has changed provider volume pointer
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.287 233C2B90 verbose 'Hostsvc::Datastore' opID=6F505500-00005592-a2] SetVolume: Datastore 4e3ca8cb-2c9d3330-d70d-000423a5c8f0 has changed provider volume pointer
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.287 233C2B90 verbose 'Hostsvc::Datastore' opID=6F505500-00005592-a2] SetVolume: Datastore 4ec91116-e8cb5ca2-cc51-000423a5c8f0 has changed provider volume pointer
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.287 233C2B90 verbose 'Hostsvc::DatastoreSystem' opID=6F505500-00005592-a2] ReconcileVMFSDatastores: Done discovering new filesystem volumes.
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.287 233C2B90 verbose 'Hostsvc::DatastoreSystem' opID=6F505500-00005592-a2] ReconcileNASDatastores: Discovering new filesystem volumes.
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.287 233C2B90 verbose 'FSVolumeProvider' opID=6F505500-00005592-a2] RefreshNASVolumes called
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.331 233C2B90 verbose 'FSVolumeProvider' opID=6F505500-00005592-a2] RefreshNASVolumes: refreshed volume, id MEM-SRV-VC-1:/NFS, name NFS-1
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.331 233C2B90 verbose 'Hostsvc::Datastore' opID=6F505500-00005592-a2] SetVolume: Datastore MEM-SRV-VC-1:/NFS has changed provider volume pointer
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.331 233C2B90 verbose 'Hostsvc::DatastoreSystem' opID=6F505500-00005592-a2] ReconcileNASDatastores: Done discovering new filesystem volumes.
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.331 233C2B90 verbose 'StorageSystem' opID=6F505500-00005592-a2] SendStorageInfoEvent() called
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.332 233C2B90 info 'TaskManager' opID=6F505500-00005592-a2] Task Completed : haTask-ha-host-vim.host.StorageSystem.refresh-611 Status success
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.333 1C848B90 verbose 'SoapAdapter.HTTPService' opID=6F505500-00005592-a2] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.333 1C848B90 info 'App' opID=6F505500-00005592-a2] [VpxLRO] -- FINISH task-internal-125 --  -- vim.host.StorageSystem.refresh -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.334 FFE5BB10 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.334 FFE5BB10 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 235 to 236 (at 235)
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.334 FFE5BB10 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec8600e-14752f7c-1a51-000423a5c8f0/
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.334 FFE5BB10 verbose 'App'] [VpxaInvtHost] Increment master gen. no (282): DetailPropertyChanged
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.336 1C848B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.336 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.336 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.336 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.337 1C6C2B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.337 1C6C2B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.337 1C848B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.337 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.338 1C848B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad
Nov 24 06:11:50 3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.338 1C848B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657
Nov 24 06:11:50 c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.338 1C848B90 info 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066
Nov 24 06:11:50 -07c53772e2fe --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.338 1C848B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [1+] VpxaMoService::GetChanges
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.338 1C848B90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [VpxaMoService] GetChanges: 280 -> 282
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.340 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.340 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.341 1C681B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.341 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.341 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1446 bytes)
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.343 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:11:50 Vpxa: [2011-11-24 06:11:50.343 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.387 FFB6EE80 info 'App'] CreateISCSIHBA
Nov 24 06:11:50 vmkernel: 0:14:27:00.734 cpu7:4636)NMP: nmp_CompleteCommandForPath: Command 0x12 (0x41027f40cd40) to NMP device "mpx.vmhba0:C0:T0:L0" failed on physical path "vmhba0:C0:T0:L0" H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.
Nov 24 06:11:50 vmkernel: 0:14:27:00.734 cpu7:4636)ScsiDeviceIO: 1672: Command 0x12 to device "mpx.vmhba0:C0:T0:L0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.517 FFB6EE80 error 'App'] Unable to build Durable Name dependent properties: Unable to query VPD pages from device, all paths are dead, no I/O possible.
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.576 FFB6EE80 verbose 'App'] Looking up object with name = "firewallSystem" failed.
Nov 24 06:11:50 Hostd: [2011-11-24 06:11:50.682 FFB6EE80 verbose 'NetConfigProvider'] FetchFn: List of pnics opted out 
Nov 24 06:11:51 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:51 Hostd: [2011-11-24 06:11:51.752 FFB6EE80 verbose 'NetConfigProvider'] FetchFn: List of pnics opted out 
Nov 24 06:11:52 Hostd: [2011-11-24 06:11:52.779 FFB6EE80 warning 'PropertyCollector'] ComputeGUReq took 2442415 microSec
Nov 24 06:11:52 vmkernel: 0:14:27:03.010 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:11:52 vmkernel: 0:14:27:03.010 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:11:52 vmkernel: 0:14:27:03.010 cpu2:4117)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.806 1C889B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.806 1C889B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 236 to 237 (at 236)
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.809 1C889B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.811 1C889B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec85fef-884cf2dc-9689-000423a5c8f0/
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.811 1C889B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (283): DetailPropertyChanged
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.811 1C889B90 verbose 'App'] [VpxaDatastore] url: netfs://192.168.11.147//NFS/
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.811 1C889B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec91116-e8cb5ca2-cc51-000423a5c8f0/
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.811 1C889B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (284): DetailPropertyChanged
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.811 1C889B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4e3ca8cb-2c9d3330-d70d-000423a5c8f0/
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.811 1C889B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (285): DetailPropertyChanged
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.811 1C889B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec82f79-02ffca76-419b-000423a5c8f0/
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.811 1C889B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (286): DetailPropertyChanged
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.811 1C889B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4e407bca-a51d0e62-8a8c-00304861ab4f/
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.811 1C889B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (287): DetailPropertyChanged
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.812 1C889B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec85bfd-2986b246-6b0a-000423a5c8f0/
Nov 24 06:11:52 Vpxa: [2011-11-24 06:11:52.812 1C889B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (288): DetailPropertyChanged
Nov 24 06:11:52 Hostd: [2011-11-24 06:11:52.859 23340B90 verbose 'App'] Looking up object with name = "firewallSystem" failed.
Nov 24 06:11:52 Hostd: [2011-11-24 06:11:52.965 23340B90 verbose 'NetConfigProvider'] FetchFn: List of pnics opted out 
Nov 24 06:11:52 vmkernel: 0:14:27:03.204 cpu0:4119)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:11:53 vmkernel: 0:14:27:03.423 cpu3:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:11:53 vmkernel: 0:14:27:03.423 cpu3:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:11:53 vmkernel: 0:14:27:03.423 cpu3:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:11:53 vmkernel: 0:14:27:03.423 cpu3:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:11:54 Hostd: [2011-11-24 06:11:54.034 23340B90 verbose 'NetConfigProvider'] FetchFn: List of pnics opted out 
Nov 24 06:11:54 vmkernel: 0:14:27:04.422 cpu2:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f370e40
Nov 24 06:11:54 vmkernel: 0:14:27:04.422 cpu2:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:11:54 vmkernel: 0:14:27:04.422 cpu2:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:11:54 iscsid: connect failed (111,Connection refused)
Nov 24 06:11:55 Hostd: [2011-11-24 06:11:55.059 23340B90 warning 'PropertyCollector'] ComputeGUReq took 2280330 microSec
Nov 24 06:11:55 Hostd: [2011-11-24 06:11:55.060 23581B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.HostSystem.acquireCimServicesTicket-538" failed.
Nov 24 06:11:55 Hostd: [2011-11-24 06:11:55.060 23581B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.HostSystem.acquireCimServicesTicket-538" failed.
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.061 1C744B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.061 1C744B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 237 to 238 (at 237)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.088 1C848B90 verbose 'VpxaHalCnxHostagent' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 236 to 2
Nov 24 06:11:55 37 (at 238)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.089 1C848B90 info 'VpxaHalCnxHostagent' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [VpxaHalCnxHostagent::ProcessUpdate] Received old update set base vers
Nov 24 06:11:55 ion 236 (< 238), discarding
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.089 1C848B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.089 1C848B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.089 1C848B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.090 1C848B90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [VpxaDatastore] Getting datastore list for LoadSchemas...
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.096 1C848B90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [VpxaDatastore] Got datastore list for LoadSchemas
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.097 1C848B90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [VpxFileSystem::LoadSchemas] Reloaded cache
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.097 1C848B90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] Loaded filesystem schemas
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.097 1C848B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [2-] VpxdDatastore::PrepareChanges (took 7 ms)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.097 1C848B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:11:55 Hostd: [2011-11-24 06:11:55.099 221CAB90 verbose 'ha-license-manager' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:11:55 Hostd: [2011-11-24 06:11:55.110 221CAB90 info 'Libs' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] Could not expand environment variable HOME.
Nov 24 06:11:55 Hostd: [2011-11-24 06:11:55.115 221CAB90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" 
Nov 24 06:11:55 (lastError=0, desc.IsValid:Yes)
Nov 24 06:11:55 Hostd: [2011-11-24 06:11:55.117 221CAB90 info 'Libs' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] Could not expand environment variable HOME.
Nov 24 06:11:55 Hostd: [2011-11-24 06:11:55.122 221CAB90 verbose 'Locale' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected
Nov 24 06:11:55  in module 'default'.
Nov 24 06:11:55 Hostd: [2011-11-24 06:11:55.122 221CAB90 verbose 'Locale' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in m
Nov 24 06:11:55 odule 'default'.
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.125 1C848B90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [VpxaMoService] host changes include changed properties []
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.125 1C848B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [2-] VpxaMoService::PrepareHostChanges (took 28 ms)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.125 1C848B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.125 1C848B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [3+] HandleVMChanges for vmid:2
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.126 1C848B90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [VpxURL] Resolved localPath /vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexen
Nov 24 06:11:55 ta-2_1/Nexenta-2.vmx to URL sanfs://vmfs_uuid:4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.126 1C848B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [3-] HandleVMChanges for vmid:2 (took 0 ms)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.126 1C848B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:11:55 cad3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.126 1C848B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:11:55 cad3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.126 1C848B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:11:55 cad3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.126 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.126 1C848B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:11:55 cad3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.127 1C848B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:11:55 cad3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.127 1C848B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:11:55 cad3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.127 1C848B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:11:55 cad3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.127 1C848B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:11:55 cad3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.127 1C848B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.127 1C848B90 verbose 'VpxaHalResourcePool' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] NeedFullSync() = false
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.127 1C848B90 verbose 'VpxaHalResourcePool' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] VpxaHalResourcePoolStandalone::GetVpxaMoRef(vim.ResourcePool:pool0)
Nov 24 06:11:55  = vim.ResourcePool:/Resources/Extreme
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.127 1C848B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [1-] VpxaMoService::GetChanges (took 4789 ms)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.127 1C848B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad
Nov 24 06:11:55 3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.127 1C848B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657
Nov 24 06:11:55 c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.128 1C848B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7ca
Nov 24 06:11:55 d3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.128 1C848B90 info 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe-550959c2] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-606
Nov 24 06:11:55 6-07c53772e2fe --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.128 1C848B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52dc3465-0612-5724-6066-07c53772e2fe
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.129 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.129 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.131 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 14330 bytes)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.135 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.136 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.136 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.136 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.137 1C7C6B90 info 'App' opID=task-internal-126-751402e9] [VpxLRO] -- BEGIN task-internal-126 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.137 1C7C6B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-126-751402e9] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.137 1C7C6B90 info 'App' opID=task-internal-126-751402e9] [VpxLRO] -- FINISH task-internal-126 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.139 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.139 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.139 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.139 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.139 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:11:55 Vpxa: [2011-11-24 06:11:55.140 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:11:57 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:00 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.576 1C744B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.578 1C744B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.850 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.850 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.850 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.850 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.851 1C681B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.851 1C681B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.851 1C7C6B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.851 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.851 1C7C6B90 verbose 'PropertyProvider' opID=HB-host-9@288-93] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.851 1C7C6B90 verbose 'PropertyProvider' opID=HB-host-9@288-93] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.852 1C7C6B90 info 'App' opID=HB-host-9@288-93] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-4
Nov 24 06:12:02 62a-a2de-0657c7cad3d9
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.852 1C7C6B90 verbose 'VpxProfiler' opID=HB-host-9@288-93] [1+] VpxaMoService::GetChanges
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.852 1C7C6B90 verbose 'App' opID=HB-host-9@288-93] [VpxaMoService] GetChanges: 282 -> 288
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.853 1C785B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.853 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.854 1C785B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.854 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.854 1C7C6B90 verbose 'VpxProfiler' opID=HB-host-9@288-93] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.855 1C7C6B90 verbose 'VpxProfiler' opID=HB-host-9@288-93] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.855 1C7C6B90 verbose 'VpxProfiler' opID=HB-host-9@288-93] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.855 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1446 bytes)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.855 1C7C6B90 verbose 'App' opID=HB-host-9@288-93] [VpxaDatastore] Getting datastore list for LoadSchemas...
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.857 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.857 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.862 1C7C6B90 verbose 'App' opID=HB-host-9@288-93] [VpxaDatastore] Got datastore list for LoadSchemas
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.863 1C7C6B90 verbose 'App' opID=HB-host-9@288-93] [VpxFileSystem::LoadSchemas] Reloaded cache
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.863 1C7C6B90 verbose 'App' opID=HB-host-9@288-93] Loaded filesystem schemas
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.863 1C7C6B90 verbose 'VpxProfiler' opID=HB-host-9@288-93] [2-] VpxdDatastore::PrepareChanges (took 8 ms)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.863 1C7C6B90 verbose 'VpxProfiler' opID=HB-host-9@288-93] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:12:02 Hostd: [2011-11-24 06:12:02.865 235C2B90 verbose 'ha-license-manager' opID=HB-host-9@288-93] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:12:02 Hostd: [2011-11-24 06:12:02.876 235C2B90 info 'Libs' opID=HB-host-9@288-93] Could not expand environment variable HOME.
Nov 24 06:12:02 Hostd: [2011-11-24 06:12:02.882 235C2B90 verbose 'App' opID=HB-host-9@288-93] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" (lastError=0, desc.IsValid:Yes)
Nov 24 06:12:02 Hostd: [2011-11-24 06:12:02.884 235C2B90 info 'Libs' opID=HB-host-9@288-93] Could not expand environment variable HOME.
Nov 24 06:12:02 Hostd: [2011-11-24 06:12:02.888 235C2B90 verbose 'Locale' opID=HB-host-9@288-93] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected in module 'default'.
Nov 24 06:12:02 Hostd: [2011-11-24 06:12:02.888 235C2B90 verbose 'Locale' opID=HB-host-9@288-93] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in module 'default'.
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.892 1C7C6B90 verbose 'App' opID=HB-host-9@288-93] [VpxaMoService] host changes include changed properties []
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.892 1C7C6B90 verbose 'VpxProfiler' opID=HB-host-9@288-93] [2-] VpxaMoService::PrepareHostChanges (took 28 ms)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.892 1C7C6B90 verbose 'VpxProfiler' opID=HB-host-9@288-93] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.892 1C7C6B90 verbose 'PropertyProvider' opID=HB-host-9@288-93] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.892 1C7C6B90 verbose 'PropertyProvider' opID=HB-host-9@288-93] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.892 1C7C6B90 verbose 'PropertyProvider' opID=HB-host-9@288-93] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.893 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.893 1C7C6B90 verbose 'PropertyProvider' opID=HB-host-9@288-93] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.893 1C7C6B90 verbose 'PropertyProvider' opID=HB-host-9@288-93] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.893 1C7C6B90 verbose 'PropertyProvider' opID=HB-host-9@288-93] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.893 1C7C6B90 verbose 'PropertyProvider' opID=HB-host-9@288-93] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.893 1C7C6B90 verbose 'PropertyProvider' opID=HB-host-9@288-93] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.893 1C7C6B90 verbose 'VpxProfiler' opID=HB-host-9@288-93] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.893 1C7C6B90 verbose 'VpxaHalResourcePool' opID=HB-host-9@288-93] NeedFullSync() = false
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.893 1C7C6B90 verbose 'VpxProfiler' opID=HB-host-9@288-93] [1-] VpxaMoService::GetChanges (took 41 ms)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.893 1C7C6B90 verbose 'PropertyProvider' opID=HB-host-9@288-93] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.894 1C7C6B90 verbose 'PropertyProvider' opID=HB-host-9@288-93] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.894 1C7C6B90 verbose 'PropertyProvider' opID=HB-host-9@288-93] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.894 1C7C6B90 info 'App' opID=HB-host-9@288-93] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-
Nov 24 06:12:02 462a-a2de-0657c7cad3d9
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.894 1C7C6B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52f79ea8-8c15-a45a-77e2-a3443eed2a82
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.894 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.895 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.896 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 9999 bytes)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.899 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.900 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.900 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.900 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.900 1C253B90 info 'App' opID=HB-host-9@288-46] [VpxLRO] -- BEGIN task-internal-127 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.900 1C253B90 verbose 'SoapAdapter.HTTPService' opID=HB-host-9@288-46] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.901 1C253B90 info 'App' opID=HB-host-9@288-46] [VpxLRO] -- FINISH task-internal-127 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.902 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.902 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.903 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.903 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.903 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:12:02 Vpxa: [2011-11-24 06:12:02.903 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:12:03 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:06 Vpxa: [2011-11-24 06:12:06.357 1C681B90 verbose 'VpxProfiler'] [1+] CheckEnvBrowserChanges
Nov 24 06:12:06 Hostd: [2011-11-24 06:12:06.389 22EF2B90 verbose 'DvsTracker'] FetchSwitches: added 0 items
Nov 24 06:12:06 Hostd: [2011-11-24 06:12:06.389 22EF2B90 verbose 'DvsTracker'] FetchDVPortgroups: added 0 items
Nov 24 06:12:06 Hostd: [2011-11-24 06:12:06.390 22EF2B90 verbose 'EnvironmentBrowser'] Skipped inaccessible datastore 4ec91116-e8cb5ca2-cc51-000423a5c8f0.
Nov 24 06:12:06 Vpxa: [2011-11-24 06:12:06.397 1C681B90 verbose 'VpxProfiler'] [1-] CheckEnvBrowserChanges (took 39 ms)
Nov 24 06:12:06 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:09 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:12 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:15 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:18 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:12:18 Hostd: [2011-11-24 06:12:18.104 23381B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:12:18 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:19 Vpxa: [2011-11-24 06:12:19.092 1C785B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:12:19 Vpxa: [2011-11-24 06:12:19.092 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:12:19 Vpxa: [2011-11-24 06:12:19.093 1C6C2B90 info 'App' opID=task-internal-128-4b23ca1b] [VpxLRO] -- BEGIN task-internal-128 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:12:19 Vpxa: [2011-11-24 06:12:19.093 1C6C2B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-128-4b23ca1b] HTTP Response: Complete (processed 1853 bytes)
Nov 24 06:12:19 Vpxa: [2011-11-24 06:12:19.093 1C6C2B90 info 'App' opID=task-internal-128-4b23ca1b] [VpxLRO] -- FINISH task-internal-128 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:12:21 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:22 Vpxa: [2011-11-24 06:12:22.576 1C785B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:12:22 Vpxa: [2011-11-24 06:12:22.579 1C785B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:12:24 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:27 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:30 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:32 vmkernel: 0:14:27:43.204 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:12:32 vmkernel: 0:14:27:43.204 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:12:32 vmkernel: 0:14:27:43.204 cpu1:4119)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:12:33 vmkernel: 0:14:27:43.250 cpu7:4118)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:12:33 vmkernel: 0:14:27:43.423 cpu4:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:12:33 vmkernel: 0:14:27:43.423 cpu4:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:12:33 vmkernel: 0:14:27:43.423 cpu4:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:12:33 vmkernel: 0:14:27:43.423 cpu4:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:12:33 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:34 vmkernel: 0:14:27:44.422 cpu2:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f47e840
Nov 24 06:12:34 vmkernel: 0:14:27:44.422 cpu2:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:12:34 vmkernel: 0:14:27:44.422 cpu2:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:12:36 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:39 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:42 Vpxa: [2011-11-24 06:12:42.576 1C37CB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:12:42 Vpxa: [2011-11-24 06:12:42.579 1C37CB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:12:42 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:45 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:48 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:51 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:54 iscsid: connect failed (111,Connection refused)
Nov 24 06:12:57 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:00 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:02 Vpxa: [2011-11-24 06:13:02.577 FFE5BB10 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:13:02 Vpxa: [2011-11-24 06:13:02.580 FFE5BB10 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:13:03 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:05 Hostd: [2011-11-24 06:13:05.823 235C2B90 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:13:06 Hostd: [2011-11-24 06:13:06.114 233C2B90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:13:06 Vpxa: [2011-11-24 06:13:06.117 1C5BEB90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:13:06 Vpxa: [2011-11-24 06:13:06.117 1C5BEB90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 238 to 239 (at 238)
Nov 24 06:13:06 Vpxa: [2011-11-24 06:13:06.118 1C5BEB90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:13:06 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:09 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:12 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:13 vmkernel: 0:14:28:23.250 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:13:13 vmkernel: 0:14:28:23.250 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:13:13 vmkernel: 0:14:28:23.250 cpu7:4118)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:13:13 vmkernel: 0:14:28:23.302 cpu3:4117)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:13:13 vmkernel: 0:14:28:23.422 cpu4:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:13:13 vmkernel: 0:14:28:23.422 cpu4:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:13:13 vmkernel: 0:14:28:23.422 cpu4:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:13:13 vmkernel: 0:14:28:23.422 cpu4:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:13:14 vmkernel: 0:14:28:24.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f3cc040
Nov 24 06:13:14 vmkernel: 0:14:28:24.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:13:14 vmkernel: 0:14:28:24.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:13:15 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:18 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:13:18 Hostd: [2011-11-24 06:13:18.206 FFB6EE80 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:13:18 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:19 Vpxa: [2011-11-24 06:13:19.094 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:13:19 Vpxa: [2011-11-24 06:13:19.094 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:13:19 Vpxa: [2011-11-24 06:13:19.095 1C785B90 info 'App' opID=task-internal-129-187f1ca5] [VpxLRO] -- BEGIN task-internal-129 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:13:19 Vpxa: [2011-11-24 06:13:19.095 1C785B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-129-187f1ca5] HTTP Response: Complete (processed 1853 bytes)
Nov 24 06:13:19 Vpxa: [2011-11-24 06:13:19.095 1C785B90 info 'App' opID=task-internal-129-187f1ca5] [VpxLRO] -- FINISH task-internal-129 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:13:21 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:22 Vpxa: [2011-11-24 06:13:22.578 1C889B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:13:22 Vpxa: [2011-11-24 06:13:22.580 1C889B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:13:24 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:27 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:30 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:32 ntpd[69828]: kernel time sync status change 6001
Nov 24 06:13:33 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:36 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:39 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:42 Vpxa: [2011-11-24 06:13:42.578 1C807B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:13:42 Vpxa: [2011-11-24 06:13:42.581 1C807B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:13:42 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:45 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:48 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:51 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:53 vmkernel: 0:14:29:03.302 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:13:53 vmkernel: 0:14:29:03.302 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:13:53 vmkernel: 0:14:29:03.302 cpu1:4117)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:13:53 vmkernel: 0:14:29:03.335 cpu1:4119)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:13:53 vmkernel: 0:14:29:03.423 cpu0:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:13:53 vmkernel: 0:14:29:03.423 cpu0:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:13:53 vmkernel: 0:14:29:03.423 cpu0:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:13:53 vmkernel: 0:14:29:03.423 cpu0:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:13:54 vmkernel: 0:14:29:04.424 cpu0:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f478d40
Nov 24 06:13:54 vmkernel: 0:14:29:04.424 cpu0:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:13:54 vmkernel: 0:14:29:04.424 cpu0:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:13:54 iscsid: connect failed (111,Connection refused)
Nov 24 06:13:57 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:00 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:02 Vpxa: [2011-11-24 06:14:02.579 1C848B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:14:02 Vpxa: [2011-11-24 06:14:02.582 1C848B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:14:03 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:06 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:09 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:12 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:15 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:18 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:14:18 Hostd: [2011-11-24 06:14:18.313 23540B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:14:18 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:19 Vpxa: [2011-11-24 06:14:19.096 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:14:19 Vpxa: [2011-11-24 06:14:19.096 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:14:19 Vpxa: [2011-11-24 06:14:19.096 1C744B90 info 'App' opID=task-internal-130-9d7eb6b3] [VpxLRO] -- BEGIN task-internal-130 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:14:19 Vpxa: [2011-11-24 06:14:19.097 1C744B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-130-9d7eb6b3] HTTP Response: Complete (processed 1853 bytes)
Nov 24 06:14:19 Vpxa: [2011-11-24 06:14:19.097 1C744B90 info 'App' opID=task-internal-130-9d7eb6b3] [VpxLRO] -- FINISH task-internal-130 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:14:22 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:22 Vpxa: [2011-11-24 06:14:22.578 1C681B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:14:22 Vpxa: [2011-11-24 06:14:22.581 1C681B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:14:25 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:28 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:31 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:33 vmkernel: 0:14:29:43.336 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:14:33 vmkernel: 0:14:29:43.336 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:14:33 vmkernel: 0:14:29:43.336 cpu1:4119)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:14:33 vmkernel: 0:14:29:43.391 cpu7:4118)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:14:33 vmkernel: 0:14:29:43.424 cpu1:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:14:33 vmkernel: 0:14:29:43.424 cpu1:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:14:33 vmkernel: 0:14:29:43.424 cpu1:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:14:33 vmkernel: 0:14:29:43.424 cpu1:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:14:34 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:34 vmkernel: 0:14:29:44.423 cpu1:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f3e0840
Nov 24 06:14:34 vmkernel: 0:14:29:44.423 cpu1:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:14:34 vmkernel: 0:14:29:44.423 cpu1:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:14:36 Hostd: [2011-11-24 06:14:36.115 233C2B90 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:14:36 Hostd: [2011-11-24 06:14:36.409 23340B90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:14:36 Vpxa: [2011-11-24 06:14:36.412 1C785B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:14:36 Vpxa: [2011-11-24 06:14:36.412 1C785B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 239 to 240 (at 239)
Nov 24 06:14:36 Vpxa: [2011-11-24 06:14:36.412 1C785B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:14:37 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:40 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:42 Vpxa: [2011-11-24 06:14:42.579 1C6C2B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:14:42 Vpxa: [2011-11-24 06:14:42.582 1C6C2B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:14:42 dropbear[68111]: exit after auth (root): Exited normally
Nov 24 06:14:43 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:45 Hostd: [2011-11-24 06:14:45.668 223A9B90 verbose 'DvsManager'] PersistAllDvsInfo called
Nov 24 06:14:45 Hostd: [2011-11-24 06:14:45.782 22EF2B90 verbose 'vm:/vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx'] Actual VM overhead: 523530240 bytes
Nov 24 06:14:45 Hostd: [2011-11-24 06:14:45.782 22EF2B90 verbose 'Vmsvc'] RefreshVms updated overhead for 1 VM
Nov 24 06:14:45 Vpxa: [2011-11-24 06:14:45.784 1C744B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:14:45 Vpxa: [2011-11-24 06:14:45.784 1C744B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 240 to 241 (at 240)
Nov 24 06:14:45 Vpxa: [2011-11-24 06:14:45.784 1C744B90 verbose 'App'] [VpxaHalVmHostagent] 672: Runtime changed 'runtime.memoryOverhead'
Nov 24 06:14:45 Vpxa: [2011-11-24 06:14:45.784 1C744B90 verbose 'App'] [VpxaHalServices] RuntimeChange Event for vm(2) 672
Nov 24 06:14:45 Vpxa: [2011-11-24 06:14:45.784 1C744B90 verbose 'App'] [VpxaInvtVmChangeListener] AAM won't be notifyed. vmid 2: notifyVMAP 0,isRestarting 0
Nov 24 06:14:45 Vpxa: [2011-11-24 06:14:45.784 1C744B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no to (289): VmRuntime:VpxaInvtVmChangeListener::RuntimeChanged
Nov 24 06:14:46 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:49 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:50 dropbear[120378]: Child connection from 192.168.11.147:21455
Nov 24 06:14:52 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.872 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.872 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.872 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength 129)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.872 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.872 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.873 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Auto-completing at 129/129 bytes
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.873 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.873 1C681B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.873 1C681B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.874 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.874 1C5BEB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.874 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@289-a] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.874 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@289-a] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.874 1C5BEB90 info 'App' opID=HB-host-9@289-a] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-46
Nov 24 06:14:52 2a-a2de-0657c7cad3d9
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.874 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@289-a] [1+] VpxaMoService::GetChanges
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.874 1C5BEB90 verbose 'App' opID=HB-host-9@289-a] [VpxaMoService] GetChanges: 288 -> 289
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.876 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.876 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.877 1C253B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.877 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@289-a] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.877 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@289-a] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.877 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@289-a] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.877 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@289-a] [2-] VpxdDatastore::PrepareChanges (took 0 ms)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.877 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.877 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@289-a] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.878 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1446 bytes)
Nov 24 06:14:52 Hostd: [2011-11-24 06:14:52.879 233C2B90 verbose 'ha-license-manager' opID=HB-host-9@289-a] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.880 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.880 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:14:52 Hostd: [2011-11-24 06:14:52.891 233C2B90 info 'Libs' opID=HB-host-9@289-a] Could not expand environment variable HOME.
Nov 24 06:14:52 Hostd: [2011-11-24 06:14:52.896 233C2B90 verbose 'App' opID=HB-host-9@289-a] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" (lastError=0, desc.IsValid:Yes)
Nov 24 06:14:52 Hostd: [2011-11-24 06:14:52.898 233C2B90 info 'Libs' opID=HB-host-9@289-a] Could not expand environment variable HOME.
Nov 24 06:14:52 Hostd: [2011-11-24 06:14:52.902 233C2B90 verbose 'Locale' opID=HB-host-9@289-a] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected in module 'default'.
Nov 24 06:14:52 Hostd: [2011-11-24 06:14:52.902 233C2B90 verbose 'Locale' opID=HB-host-9@289-a] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in module 'default'.
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.906 1C5BEB90 verbose 'App' opID=HB-host-9@289-a] [VpxaMoService] host changes include changed properties []
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.906 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@289-a] [2-] VpxaMoService::PrepareHostChanges (took 28 ms)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.906 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@289-a] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.906 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@289-a] [3+] HandleVMChanges for vmid:2
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.906 1C5BEB90 verbose 'App' opID=HB-host-9@289-a] [VpxURL] Resolved localPath /vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx to URL sanfs://vmfs_uuid:4e407bca-a51d0e62-8a8c-003048
Nov 24 06:14:52 61ab4f/Nexenta-2_1/Nexenta-2.vmx
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.907 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@289-a] [3-] HandleVMChanges for vmid:2 (took 0 ms)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.907 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@289-a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.907 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@289-a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.907 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@289-a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.907 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.907 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@289-a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.907 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@289-a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.907 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@289-a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.908 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@289-a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.908 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@289-a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.908 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@289-a] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.908 1C5BEB90 verbose 'VpxaHalResourcePool' opID=HB-host-9@289-a] NeedFullSync() = false
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.908 1C5BEB90 verbose 'VpxaHalResourcePool' opID=HB-host-9@289-a] VpxaHalResourcePoolStandalone::GetVpxaMoRef(vim.ResourcePool:pool0) = vim.ResourcePool:/Resources/Extreme
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.908 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@289-a] [1-] VpxaMoService::GetChanges (took 33 ms)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.908 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@289-a] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.908 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@289-a] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.908 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@289-a] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.908 1C5BEB90 info 'App' opID=HB-host-9@289-a] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-4
Nov 24 06:14:52 62a-a2de-0657c7cad3d9
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.908 1C5BEB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52855fc7-266e-22e5-75ba-6cff2d47037f
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.909 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.909 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.910 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 4317 bytes)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.913 1C785B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.913 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.913 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.913 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.914 1C7C6B90 info 'App' opID=HB-host-9@289-21] [VpxLRO] -- BEGIN task-internal-131 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.914 1C7C6B90 verbose 'SoapAdapter.HTTPService' opID=HB-host-9@289-21] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.914 1C7C6B90 info 'App' opID=HB-host-9@289-21] [VpxLRO] -- FINISH task-internal-131 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.916 1C744B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.916 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.916 1C744B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.916 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.916 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:14:52 Vpxa: [2011-11-24 06:14:52.917 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:14:55 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:58 iscsid: connect failed (111,Connection refused)
Nov 24 06:14:58 dropbear[120378]: pam_per_user: create_subrequest_handle(): doing map lookup for user "root"
Nov 24 06:14:58 dropbear[120378]: pam_per_user: create_subrequest_handle(): creating new subrequest (user="root", service="system-auth-generic")
Nov 24 06:14:58 dropbear[120378]: PAM password auth succeeded for 'root' from 192.168.11.147:21455
Nov 24 06:14:58 vmkernel: 0:14:30:08.556 cpu2:120378)WARNING: UserObj: 569: Failed to crossdup fd 6, fs: def5 oid: 19000000030000003 type CHAR: Busy
Nov 24 06:14:58 shell[120379]: Interactive shell session started
Nov 24 06:15:01 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:01 shell[120379]: cd /var/log
Nov 24 06:15:02 Vpxa: [2011-11-24 06:15:02.580 1C848B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:15:02 Vpxa: [2011-11-24 06:15:02.582 1C848B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:15:02 shell[120379]: ls
Nov 24 06:15:04 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:07 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:10 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:11 shell[120379]: tail messages
Nov 24 06:15:13 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:13 vmkernel: 0:14:30:23.393 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:15:13 vmkernel: 0:14:30:23.393 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:15:13 vmkernel: 0:14:30:23.393 cpu6:4118)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:15:13 vmkernel: 0:14:30:23.407 cpu1:4117)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:15:13 vmkernel: 0:14:30:23.424 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:15:13 vmkernel: 0:14:30:23.424 cpu6:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:15:13 vmkernel: 0:14:30:23.424 cpu6:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:15:13 vmkernel: 0:14:30:23.424 cpu6:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:15:14 vmkernel: 0:14:30:24.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f456d40
Nov 24 06:15:14 vmkernel: 0:14:30:24.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:15:14 vmkernel: 0:14:30:24.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:15:16 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:18 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:15:18 Hostd: [2011-11-24 06:15:18.419 221CAB90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:15:19 Vpxa: [2011-11-24 06:15:19.097 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:15:19 Vpxa: [2011-11-24 06:15:19.098 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:15:19 Vpxa: [2011-11-24 06:15:19.098 1C6C2B90 info 'App' opID=task-internal-132-f9927b45] [VpxLRO] -- BEGIN task-internal-132 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:15:19 Vpxa: [2011-11-24 06:15:19.099 1C6C2B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-132-f9927b45] HTTP Response: Complete (processed 1853 bytes)
Nov 24 06:15:19 Vpxa: [2011-11-24 06:15:19.099 1C6C2B90 info 'App' opID=task-internal-132-f9927b45] [VpxLRO] -- FINISH task-internal-132 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:15:19 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:22 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:22 Vpxa: [2011-11-24 06:15:22.580 1C744B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:15:22 Vpxa: [2011-11-24 06:15:22.583 1C744B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:15:25 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:28 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:31 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:34 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:37 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:40 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:42 Vpxa: [2011-11-24 06:15:42.580 1C807B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:15:42 Vpxa: [2011-11-24 06:15:42.583 1C807B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:15:43 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:46 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:49 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:52 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:53 vmkernel: 0:14:31:03.408 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:15:53 vmkernel: 0:14:31:03.408 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:15:53 vmkernel: 0:14:31:03.408 cpu1:4117)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:15:53 vmkernel: 0:14:31:03.420 cpu1:4119)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:15:53 vmkernel: 0:14:31:03.423 cpu4:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:15:53 vmkernel: 0:14:31:03.423 cpu4:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:15:53 vmkernel: 0:14:31:03.423 cpu4:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:15:53 vmkernel: 0:14:31:03.423 cpu4:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:15:54 vmkernel: 0:14:31:04.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f456d40
Nov 24 06:15:54 vmkernel: 0:14:31:04.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:15:54 vmkernel: 0:14:31:04.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:15:54 Hostd: [2011-11-24 06:15:54.880 23340B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.HostSystem.updateSystemResources-562" failed.
Nov 24 06:15:54 Vpxa: [2011-11-24 06:15:54.881 1C744B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:15:54 Vpxa: [2011-11-24 06:15:54.881 1C744B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 241 to 242 (at 241)
Nov 24 06:15:54 Hostd: [2011-11-24 06:15:54.883 23340B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.HostSystem.updateSystemResources-562" failed.
Nov 24 06:15:55 iscsid: connect failed (111,Connection refused)
Nov 24 06:15:58 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:01 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:02 Vpxa: [2011-11-24 06:16:02.580 1C5BEB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:16:02 Vpxa: [2011-11-24 06:16:02.584 1C5BEB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:16:04 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:06 Hostd: [2011-11-24 06:16:06.411 223A9B90 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:16:06 Hostd: [2011-11-24 06:16:06.797 23381B90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:16:06 Vpxa: [2011-11-24 06:16:06.800 1C253B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:16:06 Vpxa: [2011-11-24 06:16:06.800 1C253B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 242 to 244 (at 242)
Nov 24 06:16:06 Vpxa: [2011-11-24 06:16:06.801 1C253B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:16:07 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:10 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:13 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:16 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:18 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:16:18 Hostd: [2011-11-24 06:16:18.524 22EB1B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:16:19 Vpxa: [2011-11-24 06:16:19.099 1C5FFB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:16:19 Vpxa: [2011-11-24 06:16:19.099 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:16:19 Vpxa: [2011-11-24 06:16:19.100 1C253B90 info 'App' opID=task-internal-133-dfdde242] [VpxLRO] -- BEGIN task-internal-133 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:16:19 Vpxa: [2011-11-24 06:16:19.100 1C253B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-133-dfdde242] HTTP Response: Complete (processed 1851 bytes)
Nov 24 06:16:19 Vpxa: [2011-11-24 06:16:19.101 1C253B90 info 'App' opID=task-internal-133-dfdde242] [VpxLRO] -- FINISH task-internal-133 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:16:19 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:22 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:22 Vpxa: [2011-11-24 06:16:22.581 1C5FFB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:16:22 Vpxa: [2011-11-24 06:16:22.584 1C5FFB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:16:25 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:28 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:31 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:33 vmkernel: 0:14:31:43.420 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:16:33 vmkernel: 0:14:31:43.420 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:16:33 vmkernel: 0:14:31:43.420 cpu1:4119)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:16:33 vmkernel: 0:14:31:43.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:16:33 vmkernel: 0:14:31:43.482 cpu6:4118)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:16:33 vmkernel: 0:14:31:43.482 cpu6:4118)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:16:33 vmkernel: 0:14:31:43.482 cpu6:4118)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:16:33 vmkernel: 0:14:31:43.482 cpu6:4118)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:16:34 vmkernel: 0:14:31:44.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f408040
Nov 24 06:16:34 vmkernel: 0:14:31:44.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:16:34 vmkernel: 0:14:31:44.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:16:34 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:37 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:40 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:42 Vpxa: [2011-11-24 06:16:42.581 1C37CB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:16:42 Vpxa: [2011-11-24 06:16:42.583 1C37CB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:16:43 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:46 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:49 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:52 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:54 Hostd: [2011-11-24 06:16:54.880 FFB6EE80 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanAllHba-567" failed.
Nov 24 06:16:54 Hostd: [2011-11-24 06:16:54.880 FFB6EE80 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanVmfs-570" failed.
Nov 24 06:16:54 Vpxa: [2011-11-24 06:16:54.882 1C889B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:16:54 Vpxa: [2011-11-24 06:16:54.882 1C889B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 244 to 245 (at 244)
Nov 24 06:16:54 Hostd: [2011-11-24 06:16:54.884 22EF2B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanVmfs-570" failed.
Nov 24 06:16:54 Hostd: [2011-11-24 06:16:54.884 22EF2B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanAllHba-567" failed.
Nov 24 06:16:55 iscsid: connect failed (111,Connection refused)
Nov 24 06:16:58 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:01 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:02 Vpxa: [2011-11-24 06:17:02.581 1C744B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:17:02 Vpxa: [2011-11-24 06:17:02.584 1C744B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:17:04 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:06 Vpxa: [2011-11-24 06:17:06.397 1C889B90 verbose 'VpxProfiler'] [1+] CheckEnvBrowserChanges
Nov 24 06:17:06 Hostd: [2011-11-24 06:17:06.428 221CAB90 verbose 'DvsTracker'] FetchSwitches: added 0 items
Nov 24 06:17:06 Hostd: [2011-11-24 06:17:06.428 221CAB90 verbose 'DvsTracker'] FetchDVPortgroups: added 0 items
Nov 24 06:17:06 Hostd: [2011-11-24 06:17:06.430 221CAB90 verbose 'EnvironmentBrowser'] Skipped inaccessible datastore 4ec91116-e8cb5ca2-cc51-000423a5c8f0.
Nov 24 06:17:06 Vpxa: [2011-11-24 06:17:06.437 1C889B90 verbose 'VpxProfiler'] [1-] CheckEnvBrowserChanges (took 39 ms)
Nov 24 06:17:07 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:08 shell[120379]: ping nexenta-2
Nov 24 06:17:10 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:13 vmkernel: 0:14:32:23.483 cpu3:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:17:13 vmkernel: 0:14:32:23.483 cpu3:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:17:13 vmkernel: 0:14:32:23.483 cpu6:4118)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:17:13 vmkernel: 0:14:32:23.576 cpu0:4117)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:17:13 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:14 vmkernel: 0:14:32:24.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:17:14 vmkernel: 0:14:32:24.423 cpu6:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:17:14 vmkernel: 0:14:32:24.423 cpu6:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:17:14 vmkernel: 0:14:32:24.423 cpu6:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:17:15 vmkernel: 0:14:32:25.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f410340
Nov 24 06:17:15 vmkernel: 0:14:32:25.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:17:15 vmkernel: 0:14:32:25.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:17:16 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:18 shell[120379]: nslookup nexenta-2
Nov 24 06:17:18 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:17:18 Hostd: [2011-11-24 06:17:18.627 23540B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:17:19 Vpxa: [2011-11-24 06:17:19.101 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:17:19 Vpxa: [2011-11-24 06:17:19.101 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:17:19 Vpxa: [2011-11-24 06:17:19.102 1C253B90 info 'App' opID=task-internal-134-144f1773] [VpxLRO] -- BEGIN task-internal-134 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:17:19 Vpxa: [2011-11-24 06:17:19.103 1C253B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-134-144f1773] HTTP Response: Complete (processed 1853 bytes)
Nov 24 06:17:19 Vpxa: [2011-11-24 06:17:19.103 1C253B90 info 'App' opID=task-internal-134-144f1773] [VpxLRO] -- FINISH task-internal-134 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:17:19 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:22 Vpxa: [2011-11-24 06:17:22.581 1C681B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:17:22 Vpxa: [2011-11-24 06:17:22.584 1C681B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:17:22 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:25 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:28 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:31 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:34 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:36 Hostd: [2011-11-24 06:17:36.798 23540B90 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:17:37 Hostd: [2011-11-24 06:17:37.091 233C2B90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:17:37 Vpxa: [2011-11-24 06:17:37.094 1C785B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:17:37 Vpxa: [2011-11-24 06:17:37.094 1C785B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 245 to 247 (at 245)
Nov 24 06:17:37 Vpxa: [2011-11-24 06:17:37.094 1C785B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:17:37 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:40 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:42 Vpxa: [2011-11-24 06:17:42.581 1C5FFB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:17:42 Vpxa: [2011-11-24 06:17:42.584 1C5FFB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:17:43 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:45 Hostd: [2011-11-24 06:17:45.785 233C2B90 verbose 'vm:/vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx'] Actual VM overhead: 522461184 bytes
Nov 24 06:17:45 Hostd: [2011-11-24 06:17:45.785 233C2B90 verbose 'Vmsvc'] RefreshVms updated overhead for 1 VM
Nov 24 06:17:45 Vpxa: [2011-11-24 06:17:45.787 1C681B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:17:45 Vpxa: [2011-11-24 06:17:45.787 1C681B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 247 to 248 (at 247)
Nov 24 06:17:45 Vpxa: [2011-11-24 06:17:45.787 1C681B90 verbose 'App'] [VpxaHalVmHostagent] 672: Runtime changed 'runtime.memoryOverhead'
Nov 24 06:17:45 Vpxa: [2011-11-24 06:17:45.787 1C681B90 verbose 'App'] [VpxaHalServices] RuntimeChange Event for vm(2) 672
Nov 24 06:17:45 Vpxa: [2011-11-24 06:17:45.787 1C681B90 verbose 'App'] [VpxaInvtVmChangeListener] AAM won't be notifyed. vmid 2: notifyVMAP 0,isRestarting 0
Nov 24 06:17:45 Vpxa: [2011-11-24 06:17:45.787 1C681B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no to (290): VmRuntime:VpxaInvtVmChangeListener::RuntimeChanged
Nov 24 06:17:46 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:49 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:52 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.898 FFE5BB10 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.898 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength 129)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.898 1C848B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.898 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.898 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Auto-completing at 129/129 bytes
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.899 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.899 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.899 1C848B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.900 1C848B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.900 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.900 1C681B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.900 1C681B90 verbose 'PropertyProvider' opID=HB-host-9@290-6b] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.900 1C681B90 verbose 'PropertyProvider' opID=HB-host-9@290-6b] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.900 1C681B90 info 'App' opID=HB-host-9@290-6b] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-4
Nov 24 06:17:52 62a-a2de-0657c7cad3d9
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.901 1C681B90 verbose 'VpxProfiler' opID=HB-host-9@290-6b] [1+] VpxaMoService::GetChanges
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.901 1C681B90 verbose 'App' opID=HB-host-9@290-6b] [VpxaMoService] GetChanges: 289 -> 290
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.902 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.902 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.902 1C889B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.903 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.903 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1444 bytes)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.903 1C681B90 verbose 'VpxProfiler' opID=HB-host-9@290-6b] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.903 1C681B90 verbose 'VpxProfiler' opID=HB-host-9@290-6b] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.904 1C681B90 verbose 'VpxProfiler' opID=HB-host-9@290-6b] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.904 1C681B90 verbose 'VpxProfiler' opID=HB-host-9@290-6b] [2-] VpxdDatastore::PrepareChanges (took 0 ms)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.904 1C681B90 verbose 'VpxProfiler' opID=HB-host-9@290-6b] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.905 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:17:52 Hostd: [2011-11-24 06:17:52.905 23340B90 verbose 'ha-license-manager' opID=HB-host-9@290-6b] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.905 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:17:52 Hostd: [2011-11-24 06:17:52.917 23340B90 info 'Libs' opID=HB-host-9@290-6b] Could not expand environment variable HOME.
Nov 24 06:17:52 Hostd: [2011-11-24 06:17:52.922 23340B90 verbose 'App' opID=HB-host-9@290-6b] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" (lastError=0, desc.IsValid:Yes)
Nov 24 06:17:52 Hostd: [2011-11-24 06:17:52.924 23340B90 info 'Libs' opID=HB-host-9@290-6b] Could not expand environment variable HOME.
Nov 24 06:17:52 Hostd: [2011-11-24 06:17:52.928 23340B90 verbose 'Locale' opID=HB-host-9@290-6b] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected in module 'default'.
Nov 24 06:17:52 Hostd: [2011-11-24 06:17:52.929 23340B90 verbose 'Locale' opID=HB-host-9@290-6b] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in module 'default'.
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.932 1C681B90 verbose 'App' opID=HB-host-9@290-6b] [VpxaMoService] host changes include changed properties []
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.932 1C681B90 verbose 'VpxProfiler' opID=HB-host-9@290-6b] [2-] VpxaMoService::PrepareHostChanges (took 28 ms)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.932 1C681B90 verbose 'VpxProfiler' opID=HB-host-9@290-6b] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.932 1C681B90 verbose 'VpxProfiler' opID=HB-host-9@290-6b] [3+] HandleVMChanges for vmid:2
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.932 1C681B90 verbose 'App' opID=HB-host-9@290-6b] [VpxURL] Resolved localPath /vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx to URL sanfs://vmfs_uuid:4e407bca-a51d0e62-8a8c-00304
Nov 24 06:17:52 861ab4f/Nexenta-2_1/Nexenta-2.vmx
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.933 1C681B90 verbose 'VpxProfiler' opID=HB-host-9@290-6b] [3-] HandleVMChanges for vmid:2 (took 0 ms)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.933 1C681B90 verbose 'PropertyProvider' opID=HB-host-9@290-6b] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.933 1C681B90 verbose 'PropertyProvider' opID=HB-host-9@290-6b] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.933 1C681B90 verbose 'PropertyProvider' opID=HB-host-9@290-6b] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.933 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.933 1C681B90 verbose 'PropertyProvider' opID=HB-host-9@290-6b] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.933 1C681B90 verbose 'PropertyProvider' opID=HB-host-9@290-6b] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.934 1C681B90 verbose 'PropertyProvider' opID=HB-host-9@290-6b] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.934 1C681B90 verbose 'PropertyProvider' opID=HB-host-9@290-6b] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.934 1C681B90 verbose 'PropertyProvider' opID=HB-host-9@290-6b] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.934 1C681B90 verbose 'VpxProfiler' opID=HB-host-9@290-6b] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.934 1C681B90 verbose 'VpxaHalResourcePool' opID=HB-host-9@290-6b] NeedFullSync() = false
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.934 1C681B90 verbose 'VpxaHalResourcePool' opID=HB-host-9@290-6b] VpxaHalResourcePoolStandalone::GetVpxaMoRef(vim.ResourcePool:pool0) = vim.ResourcePool:/Resources/Extreme
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.934 1C681B90 verbose 'VpxProfiler' opID=HB-host-9@290-6b] [1-] VpxaMoService::GetChanges (took 33 ms)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.934 1C681B90 verbose 'PropertyProvider' opID=HB-host-9@290-6b] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.934 1C681B90 verbose 'PropertyProvider' opID=HB-host-9@290-6b] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.934 1C681B90 verbose 'PropertyProvider' opID=HB-host-9@290-6b] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.935 1C681B90 info 'App' opID=HB-host-9@290-6b] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-
Nov 24 06:17:52 462a-a2de-0657c7cad3d9
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.935 1C681B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522586b3-cb78-df1d-efbe-3262695053c4
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.935 FFE5BB10 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.935 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.936 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 4318 bytes)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.939 FFE5BB10 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.939 1C785B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.939 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.939 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.940 1C5BEB90 info 'App' opID=HB-host-9@290-28] [VpxLRO] -- BEGIN task-internal-135 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.940 1C5BEB90 verbose 'SoapAdapter.HTTPService' opID=HB-host-9@290-28] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.940 1C5BEB90 info 'App' opID=HB-host-9@290-28] [VpxLRO] -- FINISH task-internal-135 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.942 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.942 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.942 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.942 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.942 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:17:52 Vpxa: [2011-11-24 06:17:52.943 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:17:53 vmkernel: 0:14:33:03.576 cpu3:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:17:53 vmkernel: 0:14:33:03.576 cpu3:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:17:53 vmkernel: 0:14:33:03.576 cpu0:4117)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:17:53 vmkernel: 0:14:33:03.598 cpu1:4119)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:17:54 vmkernel: 0:14:33:04.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:17:54 vmkernel: 0:14:33:04.423 cpu7:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:17:54 vmkernel: 0:14:33:04.423 cpu7:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:17:54 vmkernel: 0:14:33:04.423 cpu7:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:17:54 Hostd: [2011-11-24 06:17:54.881 223A9B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanAllHba-573" failed.
Nov 24 06:17:54 Hostd: [2011-11-24 06:17:54.881 223A9B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanAllHba-578" failed.
Nov 24 06:17:54 Hostd: [2011-11-24 06:17:54.881 223A9B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanVmfs-574" failed.
Nov 24 06:17:54 Hostd: [2011-11-24 06:17:54.881 223A9B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanVmfs-579" failed.
Nov 24 06:17:54 Vpxa: [2011-11-24 06:17:54.882 1C848B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:17:54 Vpxa: [2011-11-24 06:17:54.882 1C848B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 248 to 249 (at 248)
Nov 24 06:17:54 Hostd: [2011-11-24 06:17:54.885 23340B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanVmfs-579" failed.
Nov 24 06:17:54 Hostd: [2011-11-24 06:17:54.885 23340B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanVmfs-574" failed.
Nov 24 06:17:54 Hostd: [2011-11-24 06:17:54.885 23340B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanAllHba-578" failed.
Nov 24 06:17:54 Hostd: [2011-11-24 06:17:54.885 23340B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanAllHba-573" failed.
Nov 24 06:17:55 vmkernel: 0:14:33:05.423 cpu0:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f462c40
Nov 24 06:17:55 vmkernel: 0:14:33:05.423 cpu0:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:17:55 vmkernel: 0:14:33:05.423 cpu0:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:17:55 iscsid: connect failed (111,Connection refused)
Nov 24 06:17:58 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:01 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:02 Vpxa: [2011-11-24 06:18:02.582 1C744B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:18:02 Vpxa: [2011-11-24 06:18:02.585 1C744B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:18:04 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:07 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:10 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:13 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:16 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:18 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:18:18 Hostd: [2011-11-24 06:18:18.735 FFB6EE80 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:18:19 Vpxa: [2011-11-24 06:18:19.103 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:18:19 Vpxa: [2011-11-24 06:18:19.103 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:18:19 Vpxa: [2011-11-24 06:18:19.104 1C744B90 info 'App' opID=task-internal-136-98afd5d3] [VpxLRO] -- BEGIN task-internal-136 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:18:19 Vpxa: [2011-11-24 06:18:19.104 1C744B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-136-98afd5d3] HTTP Response: Complete (processed 1855 bytes)
Nov 24 06:18:19 Vpxa: [2011-11-24 06:18:19.104 1C744B90 info 'App' opID=task-internal-136-98afd5d3] [VpxLRO] -- FINISH task-internal-136 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:18:19 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:22 Vpxa: [2011-11-24 06:18:22.582 1C5BEB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:18:22 Vpxa: [2011-11-24 06:18:22.585 1C5BEB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:18:22 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:25 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:28 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:31 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:33 vmkernel: 0:14:33:43.598 cpu3:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x1.
Nov 24 06:18:33 vmkernel: 0:14:33:43.598 cpu3:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:18:33 vmkernel: 0:14:33:43.598 cpu0:4119)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:18:33 vmkernel: 0:14:33:43.660 cpu4:4118)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:18:34 vmkernel: 0:14:33:44.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:18:34 vmkernel: 0:14:33:44.423 cpu6:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:18:34 vmkernel: 0:14:33:44.423 cpu6:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:18:34 vmkernel: 0:14:33:44.423 cpu6:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:18:34 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:35 vmkernel: 0:14:33:45.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f408040
Nov 24 06:18:35 vmkernel: 0:14:33:45.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:18:35 vmkernel: 0:14:33:45.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:18:37 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:40 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:42 Vpxa: [2011-11-24 06:18:42.582 1C681B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:18:42 Vpxa: [2011-11-24 06:18:42.585 1C681B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:18:43 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:46 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:49 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:52 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:55 iscsid: connect failed (111,Connection refused)
Nov 24 06:18:58 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:01 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:02 Vpxa: [2011-11-24 06:19:02.582 1C5BEB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:19:02 Vpxa: [2011-11-24 06:19:02.585 1C5BEB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:19:04 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:07 Hostd: [2011-11-24 06:19:07.092 223A9B90 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:19:07 Hostd: [2011-11-24 06:19:07.390 22EF2B90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:19:07 Hostd: [2011-11-24 06:19:07.390 22EF2B90 info 'Snmpsvc'] UpdateSystemIssues: 0 out of 7 total items reporting non-normal state, 0 are new
Nov 24 06:19:07 Vpxa: [2011-11-24 06:19:07.392 1C7C6B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:19:07 Vpxa: [2011-11-24 06:19:07.392 1C7C6B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 249 to 251 (at 249)
Nov 24 06:19:07 Vpxa: [2011-11-24 06:19:07.393 1C7C6B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:19:07 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:09 shell[120379]: nslookup nexenta-2
Nov 24 06:19:10 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:13 vmkernel: 0:14:34:23.660 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:19:13 vmkernel: 0:14:34:23.660 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:19:13 vmkernel: 0:14:34:23.660 cpu4:4118)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:19:13 vmkernel: 0:14:34:23.686 cpu0:4117)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:19:13 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:14 vmkernel: 0:14:34:24.423 cpu3:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:19:14 vmkernel: 0:14:34:24.423 cpu3:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:19:14 vmkernel: 0:14:34:24.423 cpu3:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:19:14 vmkernel: 0:14:34:24.423 cpu3:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:19:15 vmkernel: 0:14:34:25.423 cpu0:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f382e40
Nov 24 06:19:15 vmkernel: 0:14:34:25.423 cpu0:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:19:15 vmkernel: 0:14:34:25.423 cpu0:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:19:15 shell[120379]: ping nexenta-2
Nov 24 06:19:16 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:18 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:19:18 Hostd: [2011-11-24 06:19:18.838 23340B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:19:19 Vpxa: [2011-11-24 06:19:19.105 1C5BEB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:19 Vpxa: [2011-11-24 06:19:19.105 1C5BEB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:19 Vpxa: [2011-11-24 06:19:19.105 1C744B90 info 'App' opID=task-internal-137-39fbda72] [VpxLRO] -- BEGIN task-internal-137 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:19 Vpxa: [2011-11-24 06:19:19.106 1C744B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-137-39fbda72] HTTP Response: Complete (processed 1855 bytes)
Nov 24 06:19:19 Vpxa: [2011-11-24 06:19:19.106 1C744B90 info 'App' opID=task-internal-137-39fbda72] [VpxLRO] -- FINISH task-internal-137 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:19 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:22 Vpxa: [2011-11-24 06:19:22.583 1C253B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:19:22 Vpxa: [2011-11-24 06:19:22.586 1C253B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:19:22 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:25 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:27 Vpxa: [2011-11-24 06:19:27.832 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:27 Vpxa: [2011-11-24 06:19:27.832 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength 129)
Nov 24 06:19:27 Vpxa: [2011-11-24 06:19:27.832 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Auto-completing at 129/129 bytes
Nov 24 06:19:27 Vpxa: [2011-11-24 06:19:27.833 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:27 Vpxa: [2011-11-24 06:19:27.833 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:27 Vpxa: [2011-11-24 06:19:27.834 1C785B90 info 'App' opID=6F505500-000055D1-86] [VpxLRO] -- BEGIN task-internal-138 --  -- vim.host.StorageSystem.rescanAllHba -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:27 Hostd: [2011-11-24 06:19:27.835 223A9B90 info 'TaskManager' opID=6F505500-000055D1-86] Task Created : haTask-ha-host-vim.host.StorageSystem.rescanAllHba-660
Nov 24 06:19:27 Vpxa: [2011-11-24 06:19:27.837 FFE5BB10 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:19:27 Vpxa: [2011-11-24 06:19:27.837 FFE5BB10 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 251 to 252 (at 251)
Nov 24 06:19:27 iscsid: Login Target Skipped: iqn.1986-03.com.sun:02:88139dcb-01d0-ec46-c9a8ac78a2580c34 if=default addr=192.168.11.9:3260 (TPGT:2 ISID:0x2) (Already Running)
Nov 24 06:19:27 iscsid: DISCOVERY: Pending=0 Failed=0
Nov 24 06:19:27 vmkernel: 0:14:34:38.101 cpu6:87807)ScsiPath: 4100: DeletePath : adapter=vmhba38, channel=0, target=0, lun=0
Nov 24 06:19:27 vmkernel: 0:14:34:38.101 cpu6:87807)ScsiDevice: 2310: Can't unregister device naa.600144f07b3dc70000004ec89beb0001 because it is in use.  OpenCount:1 RefCount:2 FilterCount:0
Nov 24 06:19:27 vmkernel: 0:14:34:38.101 cpu6:87807)WARNING: NMP: nmp_DeviceUnregister: Could not unregister NMP device "naa.600144f07b3dc70000004ec89beb0001". Busy
Nov 24 06:19:27 vmkernel: 0:14:34:38.101 cpu6:87807)WARNING: NMP: nmpUnclaimPath: Physical path "vmhba38:C0:T0:L0" is the last path to NMP device "naa.600144f07b3dc70000004ec89beb0001". The device was not unregistered. Busy
Nov 24 06:19:27 vmkernel: 0:14:34:38.101 cpu6:87807)WARNING: ScsiPath: 3048: Path vmhba38:C0:T0:L0 is being removed
Nov 24 06:19:27 vmkernel: 0:14:34:38.101 cpu6:87807)WARNING: ScsiPath: 3178: Failed to issue command on path vmhba38:C0:T0:L0: No connection
Nov 24 06:19:27 vmkernel: 0:14:34:38.101 cpu6:87807)VMW_SATP_ALUA: satp_alua_issueCommandOnPath: Failed to issue sync command on path "vmhba38:C0:T0:L0" (DOWN) due to status No connection.
Nov 24 06:19:27 vmkernel: 0:14:34:38.101 cpu6:87807)ScsiPath: 3950: Path vmhba38:C0:T0:L0 could not be unclaimed from plugin, status Busy. Continue path unclaiming
Nov 24 06:19:27 vmkernel: 0:14:34:38.101 cpu6:87807)WARNING: ScsiScan: 1815: Could not delete path vmhba38:C0:T0:L0
Nov 24 06:19:27 vmkernel: 0:14:34:38.103 cpu6:87807)ScsiScan: 1059: Path 'vmhba1:C0:T0:L0': Vendor: 'ATA     '  Model: 'Hitachi HDS72103'  Rev: 'JPFO'
Nov 24 06:19:27 vmkernel: 0:14:34:38.103 cpu6:87807)ScsiScan: 1062: Path 'vmhba1:C0:T0:L0': Type: 0x0, ANSI rev: 5, TPGS: 0 (none)
Nov 24 06:19:27 vmkernel: 0:14:34:38.104 cpu6:87807)ScsiScan: 1059: Path 'vmhba33:C0:T0:L0': Vendor: 'ATA     '  Model: 'WDC WD1001FALS-0'  Rev: '05.0'
Nov 24 06:19:27 vmkernel: 0:14:34:38.104 cpu6:87807)ScsiScan: 1062: Path 'vmhba33:C0:T0:L0': Type: 0x0, ANSI rev: 5, TPGS: 0 (none)
Nov 24 06:19:27 vmkernel: 0:14:34:38.105 cpu6:87807)ScsiScan: 1059: Path 'vmhba34:C0:T0:L0': Vendor: 'ATA     '  Model: 'SAMSUNG HD502HJ '  Rev: '1AJ1'
Nov 24 06:19:27 vmkernel: 0:14:34:38.105 cpu6:87807)ScsiScan: 1062: Path 'vmhba34:C0:T0:L0': Type: 0x0, ANSI rev: 5, TPGS: 0 (none)
Nov 24 06:19:27 vmkernel: 0:14:34:38.106 cpu6:87807)ScsiScan: 1059: Path 'vmhba35:C0:T0:L0': Vendor: 'ATA     '  Model: 'WDC WD10EACS-07D'  Rev: '01.0'
Nov 24 06:19:27 vmkernel: 0:14:34:38.106 cpu6:87807)ScsiScan: 1062: Path 'vmhba35:C0:T0:L0': Type: 0x0, ANSI rev: 5, TPGS: 0 (none)
Nov 24 06:19:27 vmkernel: 0:14:34:38.108 cpu6:87807)ScsiScan: 1059: Path 'vmhba36:C0:T0:L0': Vendor: 'ATA     '  Model: 'SAMSUNG HD204UI '  Rev: '1AQ1'
Nov 24 06:19:27 vmkernel: 0:14:34:38.108 cpu6:87807)ScsiScan: 1062: Path 'vmhba36:C0:T0:L0': Type: 0x0, ANSI rev: 5, TPGS: 0 (none)
Nov 24 06:19:27 vmkernel: 0:14:34:38.109 cpu6:87807)ScsiScan: 1059: Path 'vmhba37:C0:T0:L0': Vendor: 'ATA     '  Model: 'ST31000333AS    '  Rev: 'CC3H'
Nov 24 06:19:27 vmkernel: 0:14:34:38.109 cpu6:87807)ScsiScan: 1062: Path 'vmhba37:C0:T0:L0': Type: 0x0, ANSI rev: 5, TPGS: 0 (none)
Nov 24 06:19:27 Hostd: [2011-11-24 06:19:27.897 22EF2B90 verbose 'StorageSystem' opID=6F505500-000055D1-86] SendStorageInfoEvent() called
Nov 24 06:19:27 Hostd: [2011-11-24 06:19:27.898 22EF2B90 verbose 'Hostsvc::DatastoreSystem' opID=6F505500-000055D1-86] ReconcileVMFSDatastores called: refresh = true, rescan = false
Nov 24 06:19:27 Hostd: [2011-11-24 06:19:27.898 22EF2B90 verbose 'FSVolumeProvider' opID=6F505500-000055D1-86] RefreshVMFSVolumes called
Nov 24 06:19:27 Hostd: [2011-11-24 06:19:27.920 22EF2B90 verbose 'FSVolumeProvider' opID=6F505500-000055D1-86] RefreshVMFSVolumes: refreshed volume, id 4ec8600e-14752f7c-1a51-000423a5c8f0, name RAID10-1
Nov 24 06:19:27 Hostd: [2011-11-24 06:19:27.929 22EF2B90 verbose 'FSVolumeProvider' opID=6F505500-000055D1-86] RefreshVMFSVolumes: refreshed volume, id 4ec82f79-02ffca76-419b-000423a5c8f0, name RAID10-4
Nov 24 06:19:27 Hostd: [2011-11-24 06:19:27.947 221CAB90 info 'App'] CreateISCSIHBA
Nov 24 06:19:27 Hostd: [2011-11-24 06:19:27.974 22EF2B90 verbose 'FSVolumeProvider' opID=6F505500-000055D1-86] RefreshVMFSVolumes: refreshed volume, id 4e407bca-a51d0e62-8a8c-00304861ab4f, name datastore3
Nov 24 06:19:27 Hostd: [2011-11-24 06:19:27.978 22EF2B90 verbose 'FSVolumeProvider' opID=6F505500-000055D1-86] RefreshVMFSVolumes: refreshed volume, id 4ec85fef-884cf2dc-9689-000423a5c8f0, name RAID10-2
Nov 24 06:19:27 Hostd: [2011-11-24 06:19:27.988 22EF2B90 verbose 'FSVolumeProvider' opID=6F505500-000055D1-86] RefreshVMFSVolumes: refreshed volume, id 4ec85bfd-2986b246-6b0a-000423a5c8f0, name RAID10-3
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.000 22EF2B90 verbose 'FSVolumeProvider' opID=6F505500-000055D1-86] RefreshVMFSVolumes: refreshed volume, id 4e3ca8cb-2c9d3330-d70d-000423a5c8f0, name LOCAL-Storage-ESX4.1-500GB
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.000 22EF2B90 verbose 'FSVolumeProvider' opID=6F505500-000055D1-86] RefreshVMFSVolumes: refreshed volume, id 4ec91116-e8cb5ca2-cc51-000423a5c8f0, name Nexenta-2-ISCSI-1
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.001 22EF2B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D1-86] SetVolume: Datastore 4ec8600e-14752f7c-1a51-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.001 22EF2B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D1-86] SetVolume: Datastore 4ec82f79-02ffca76-419b-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.001 22EF2B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D1-86] SetVolume: Datastore 4e407bca-a51d0e62-8a8c-00304861ab4f has changed provider volume pointer
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.001 22EF2B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D1-86] SetVolume: Datastore 4ec85fef-884cf2dc-9689-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.001 22EF2B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D1-86] SetVolume: Datastore 4ec85bfd-2986b246-6b0a-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.001 22EF2B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D1-86] SetVolume: Datastore 4e3ca8cb-2c9d3330-d70d-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.001 22EF2B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D1-86] SetVolume: Datastore 4ec91116-e8cb5ca2-cc51-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.001 22EF2B90 verbose 'Hostsvc::DatastoreSystem' opID=6F505500-000055D1-86] ReconcileVMFSDatastores: Done discovering new filesystem volumes.
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.001 22EF2B90 info 'TaskManager' opID=6F505500-000055D1-86] Task Completed : haTask-ha-host-vim.host.StorageSystem.rescanAllHba-660 Status success
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.003 1C785B90 verbose 'App' opID=6F505500-000055D1-86] [VpxaInvtHost] Increment master gen. no to (291): HostConfig:RescanAllHba
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.003 1C785B90 verbose 'App' opID=6F505500-000055D1-86] [VpxaInvtHost] Increment master gen. no to (292): HostConfig:RescanAllHba
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.003 1C785B90 verbose 'App' opID=6F505500-000055D1-86] [VpxaInvtHost] Increment master gen. no (293): RescanAllHba
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.003 1C785B90 verbose 'SoapAdapter.HTTPService' opID=6F505500-000055D1-86] HTTP Response: Complete (processed 390 bytes)
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.003 1C785B90 info 'App' opID=6F505500-000055D1-86] [VpxLRO] -- FINISH task-internal-138 --  -- vim.host.StorageSystem.rescanAllHba -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.006 1C744B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.006 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.006 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.006 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.007 1C807B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.007 1C807B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.007 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.007 1C785B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.007 1C785B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad
Nov 24 06:19:28 3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.007 1C785B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657
Nov 24 06:19:28 c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.007 1C785B90 info 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33
Nov 24 06:19:28 -622da5520599 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.008 1C785B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [1+] VpxaMoService::GetChanges
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.008 1C785B90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [VpxaMoService] GetChanges: 290 -> 293
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.009 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.009 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.010 1C6C2B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.010 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.010 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1446 bytes)
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.013 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:28 Vpxa: [2011-11-24 06:19:28.013 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:28 vmkernel: 0:14:34:38.291 cpu6:4636)NMP: nmp_CompleteCommandForPath: Command 0x12 (0x41027f43ee40) to NMP device "mpx.vmhba0:C0:T0:L0" failed on physical path "vmhba0:C0:T0:L0" H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.
Nov 24 06:19:28 vmkernel: 0:14:34:38.291 cpu6:4636)ScsiDeviceIO: 1672: Command 0x12 to device "mpx.vmhba0:C0:T0:L0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.081 221CAB90 error 'App'] Unable to build Durable Name dependent properties: Unable to query VPD pages from device, all paths are dead, no I/O possible.
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.141 221CAB90 verbose 'App'] Looking up object with name = "firewallSystem" failed.
Nov 24 06:19:28 Hostd: [2011-11-24 06:19:28.246 221CAB90 verbose 'NetConfigProvider'] FetchFn: List of pnics opted out 
Nov 24 06:19:29 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:29 Hostd: [2011-11-24 06:19:29.317 221CAB90 verbose 'NetConfigProvider'] FetchFn: List of pnics opted out 
Nov 24 06:19:30 Hostd: [2011-11-24 06:19:30.339 221CAB90 warning 'PropertyCollector'] ComputeGUReq took 2441404 microSec
Nov 24 06:19:30 Vpxa: [2011-11-24 06:19:30.364 1C744B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:19:30 Vpxa: [2011-11-24 06:19:30.364 1C744B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 252 to 253 (at 252)
Nov 24 06:19:30 Vpxa: [2011-11-24 06:19:30.367 1C744B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:19:30 Hostd: [2011-11-24 06:19:30.419 22EF2B90 verbose 'App'] Looking up object with name = "firewallSystem" failed.
Nov 24 06:19:30 Hostd: [2011-11-24 06:19:30.524 22EF2B90 verbose 'NetConfigProvider'] FetchFn: List of pnics opted out 
Nov 24 06:19:31 Hostd: [2011-11-24 06:19:31.592 22EF2B90 verbose 'NetConfigProvider'] FetchFn: List of pnics opted out 
Nov 24 06:19:32 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.616 22EF2B90 warning 'PropertyCollector'] ComputeGUReq took 2276780 microSec
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.623 FFE5BB10 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.623 FFE5BB10 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 253 to 254 (at 253)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.625 FFE5BB10 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec85fef-884cf2dc-9689-000423a5c8f0/
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.625 FFE5BB10 verbose 'App'] [VpxaInvtHost] Increment master gen. no (294): DetailPropertyChanged
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.625 FFE5BB10 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec91116-e8cb5ca2-cc51-000423a5c8f0/
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.625 FFE5BB10 verbose 'App'] [VpxaInvtHost] Increment master gen. no (295): DetailPropertyChanged
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.626 FFE5BB10 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4e3ca8cb-2c9d3330-d70d-000423a5c8f0/
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.626 FFE5BB10 verbose 'App'] [VpxaInvtHost] Increment master gen. no (296): DetailPropertyChanged
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.626 FFE5BB10 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec82f79-02ffca76-419b-000423a5c8f0/
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.626 FFE5BB10 verbose 'App'] [VpxaInvtHost] Increment master gen. no (297): DetailPropertyChanged
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.626 FFE5BB10 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4e407bca-a51d0e62-8a8c-00304861ab4f/
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.626 FFE5BB10 verbose 'App'] [VpxaInvtHost] Increment master gen. no (298): DetailPropertyChanged
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.626 FFE5BB10 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec85bfd-2986b246-6b0a-000423a5c8f0/
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.626 FFE5BB10 verbose 'App'] [VpxaInvtHost] Increment master gen. no (299): DetailPropertyChanged
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.626 FFE5BB10 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec8600e-14752f7c-1a51-000423a5c8f0/
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.626 FFE5BB10 verbose 'App'] [VpxaInvtHost] Increment master gen. no (300): DetailPropertyChanged
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.646 1C785B90 verbose 'VpxaHalCnxHostagent' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 252 to 2
Nov 24 06:19:32 54 (at 254)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.647 1C785B90 info 'VpxaHalCnxHostagent' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [VpxaHalCnxHostagent::ProcessUpdate] Received old update set base vers
Nov 24 06:19:32 ion 252 (< 254), discarding
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.647 1C785B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.647 1C785B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.647 1C785B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.654 1C785B90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [VpxFileSystem::LoadSchemas] Reloaded cache
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.654 1C785B90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] Loaded filesystem schemas
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.654 1C785B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [2-] VpxdDatastore::PrepareChanges (took 7 ms)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.654 1C785B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.656 FFB6EE80 verbose 'ha-license-manager' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.668 FFB6EE80 info 'Libs' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] Could not expand environment variable HOME.
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.673 FFB6EE80 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" 
Nov 24 06:19:32 (lastError=0, desc.IsValid:Yes)
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.675 FFB6EE80 info 'Libs' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] Could not expand environment variable HOME.
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.680 FFB6EE80 verbose 'Locale' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected
Nov 24 06:19:32  in module 'default'.
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.680 FFB6EE80 verbose 'Locale' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in m
Nov 24 06:19:32 odule 'default'.
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.718 1C785B90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [VpxaMoService] host changes include changed properties [config.fileSystemVolume, c
Nov 24 06:19:32 onfig.storageDevice]
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.718 1C785B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [2-] VpxaMoService::PrepareHostChanges (took 64 ms)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.718 1C785B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.719 1C785B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:32 cad3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.719 1C785B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:32 cad3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.719 1C785B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:32 cad3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.719 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.719 1C785B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:32 cad3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.719 1C785B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:32 cad3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.720 1C785B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:32 cad3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.720 1C785B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:32 cad3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.720 1C785B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:32 cad3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.720 1C785B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.720 1C785B90 verbose 'VpxaHalResourcePool' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] NeedFullSync() = false
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.720 1C785B90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [1-] VpxaMoService::GetChanges (took 4712 ms)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.720 1C785B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad
Nov 24 06:19:32 3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.720 1C785B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657
Nov 24 06:19:32 c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.720 1C785B90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7ca
Nov 24 06:19:32 d3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.720 1C785B90 info 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599-769f1dbb] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b3
Nov 24 06:19:32 3-622da5520599 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.721 1C785B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52752221-b7a3-45ea-2b33-622da5520599
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.722 1C744B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.722 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.735 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 164171 bytes)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.754 1C744B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.754 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.754 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.755 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.755 1C744B90 info 'App' opID=task-internal-139-888cba91] [VpxLRO] -- BEGIN task-internal-139 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.755 1C744B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-139-888cba91] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.756 1C744B90 info 'App' opID=task-internal-139-888cba91] [VpxLRO] -- FINISH task-internal-139 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.757 1C848B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.757 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.758 1C848B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.758 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.758 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.758 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.805 FFE5BB10 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.806 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.806 1C744B90 info 'App' opID=6F505500-000055D3-c7] [VpxLRO] -- BEGIN task-internal-140 --  -- vim.host.StorageSystem.rescanVmfs -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.808 235C2B90 info 'TaskManager' opID=6F505500-000055D3-c7] Task Created : haTask-ha-host-vim.host.StorageSystem.rescanVmfs-661
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.808 22EB1B90 verbose 'Hostsvc::DatastoreSystem' opID=6F505500-000055D3-c7] ReconcileVMFSDatastores called: refresh = true, rescan = true
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.809 22EB1B90 verbose 'FSVolumeProvider' opID=6F505500-000055D3-c7] RefreshVMFSVolumes called
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.809 22EB1B90 verbose 'FSVolumeProvider' opID=6F505500-000055D3-c7] RescanVmfs called
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.810 1C681B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.810 1C681B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 254 to 255 (at 254)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.911 1C5BEB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.911 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.911 1C5BEB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.911 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.912 1C5BEB90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.912 1C5BEB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.912 1C848B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.912 1C5BEB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.912 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@300-f] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.913 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@300-f] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.913 1C848B90 info 'App' opID=HB-host-9@300-f] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-46
Nov 24 06:19:32 2a-a2de-0657c7cad3d9
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.913 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@300-f] [1+] VpxaMoService::GetChanges
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.913 1C848B90 verbose 'App' opID=HB-host-9@300-f] [VpxaVmomi] Waiting for concurrent operation to finish (2)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.913 1C848B90 verbose 'App' opID=HB-host-9@300-f] [VpxaVmomi] Operation completed or timedout (2)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.913 1C848B90 verbose 'App' opID=HB-host-9@300-f] [VpxaMoService] GetChanges: 293 -> 300
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.914 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.915 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.915 1C253B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.915 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.915 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@300-f] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.915 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@300-f] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.915 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@300-f] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.916 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1445 bytes)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.918 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.918 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.921 1C848B90 verbose 'App' opID=HB-host-9@300-f] [VpxaDatastore] Getting datastore list for LoadSchemas...
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.927 1C848B90 verbose 'App' opID=HB-host-9@300-f] [VpxaDatastore] Got datastore list for LoadSchemas
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.928 1C848B90 verbose 'App' opID=HB-host-9@300-f] [VpxFileSystem::LoadSchemas] Reloaded cache
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.928 1C848B90 verbose 'App' opID=HB-host-9@300-f] Loaded filesystem schemas
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.928 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@300-f] [2-] VpxdDatastore::PrepareChanges (took 12 ms)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.928 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@300-f] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.930 23340B90 verbose 'ha-license-manager' opID=HB-host-9@300-f] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.941 23340B90 info 'Libs' opID=HB-host-9@300-f] Could not expand environment variable HOME.
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.946 23340B90 verbose 'App' opID=HB-host-9@300-f] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" (lastError=0, desc.IsValid:Yes)
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.948 23340B90 info 'Libs' opID=HB-host-9@300-f] Could not expand environment variable HOME.
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.953 23340B90 verbose 'Locale' opID=HB-host-9@300-f] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected in module 'default'.
Nov 24 06:19:32 Hostd: [2011-11-24 06:19:32.953 23340B90 verbose 'Locale' opID=HB-host-9@300-f] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in module 'default'.
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.957 1C848B90 verbose 'App' opID=HB-host-9@300-f] [VpxaMoService] host changes include changed properties []
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.957 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@300-f] [2-] VpxaMoService::PrepareHostChanges (took 28 ms)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.957 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@300-f] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.957 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@300-f] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.957 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@300-f] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.957 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@300-f] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.957 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@300-f] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.957 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.958 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@300-f] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.958 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@300-f] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.958 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@300-f] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.958 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@300-f] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.958 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@300-f] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.958 1C848B90 verbose 'VpxaHalResourcePool' opID=HB-host-9@300-f] NeedFullSync() = false
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.958 1C848B90 verbose 'VpxProfiler' opID=HB-host-9@300-f] [1-] VpxaMoService::GetChanges (took 45 ms)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.958 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@300-f] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.958 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@300-f] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.959 1C848B90 verbose 'PropertyProvider' opID=HB-host-9@300-f] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.959 1C848B90 info 'App' opID=HB-host-9@300-f] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-4
Nov 24 06:19:32 62a-a2de-0657c7cad3d9
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.959 1C848B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52e84e90-88a9-49e1-ff3b-9d4302f31495
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.960 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.960 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.962 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 12493 bytes)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.966 1C848B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.966 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.966 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.966 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.967 1C681B90 info 'App' opID=HB-host-9@300-2d] [VpxLRO] -- BEGIN task-internal-141 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.967 1C681B90 verbose 'SoapAdapter.HTTPService' opID=HB-host-9@300-2d] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.967 1C681B90 info 'App' opID=HB-host-9@300-2d] [VpxLRO] -- FINISH task-internal-141 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.969 1C5FFB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.969 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.969 1C5FFB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.969 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.969 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:19:32 Vpxa: [2011-11-24 06:19:32.970 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:19:33 vmkernel: 0:14:34:43.424 cpu6:4438)ScsiDeviceIO: 1672: Command 0x25 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x1 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:19:33 vmkernel: 0:14:34:43.424 cpu7:72977)WARNING: ScsiCore: 1400: Invalid sense buffer: error=0x0, valid=0x0, segment=0x0, key=0x0
Nov 24 06:19:34 vmkernel: 0:14:34:44.423 cpu6:4438)ScsiDeviceIO: 1672: Command 0x1a to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x1 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:19:34 vmkernel: 0:14:34:44.423 cpu1:72977)WARNING: ScsiDeviceIO: 5172: READ CAPACITY on device "naa.600144f07b3dc70000004ec89beb0001" from Plugin "NMP" failed. I/O error
Nov 24 06:19:34 vmkernel: 0:14:34:44.617 cpu1:72977)Vol3: 1604: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:8' for probing: Permission denied
Nov 24 06:19:34 vmkernel: 0:14:34:44.618 cpu1:72977)Vol3: 644: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:8' for volume open: Permission denied
Nov 24 06:19:34 vmkernel: 0:14:34:44.622 cpu1:72977)Vol3: 1604: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:5' for probing: Permission denied
Nov 24 06:19:34 vmkernel: 0:14:34:44.624 cpu1:72977)Vol3: 644: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:5' for volume open: Permission denied
Nov 24 06:19:34 vmkernel: 0:14:34:44.628 cpu1:72977)Vol3: 1604: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:6' for probing: Permission denied
Nov 24 06:19:34 vmkernel: 0:14:34:44.629 cpu0:72977)Vol3: 644: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:6' for volume open: Permission denied
Nov 24 06:19:35 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:35 vmkernel: 0:14:34:45.422 cpu6:4438)ScsiDeviceIO: 1672: Command 0x28 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x1 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:19:35 vmkernel: 0:14:34:45.422 cpu1:72977)Vol3: 1436: Error refreshing FB resMeta: No connection
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.212 22EB1B90 error 'FSVolumeProvider' opID=6F505500-000055D3-c7] VmkCtl RescanVmfs() failed: Unable to scan adapters for VMFS
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.212 233C2B90 verbose 'Hostsvc::DatastoreSystem'] VmfsUpdate: got VMFS message [N11HostdCommon18VmkernelUpdateVmfsE:0x232c1a00] timestamp=52486189874 specific=0 name= label=
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.231 22EB1B90 verbose 'FSVolumeProvider' opID=6F505500-000055D3-c7] RefreshVMFSVolumes: refreshed volume, id 4ec8600e-14752f7c-1a51-000423a5c8f0, name RAID10-1
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.239 22EB1B90 verbose 'FSVolumeProvider' opID=6F505500-000055D3-c7] RefreshVMFSVolumes: refreshed volume, id 4ec82f79-02ffca76-419b-000423a5c8f0, name RAID10-4
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.281 22EB1B90 verbose 'FSVolumeProvider' opID=6F505500-000055D3-c7] RefreshVMFSVolumes: refreshed volume, id 4e407bca-a51d0e62-8a8c-00304861ab4f, name datastore3
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.289 22EB1B90 verbose 'FSVolumeProvider' opID=6F505500-000055D3-c7] RefreshVMFSVolumes: refreshed volume, id 4ec85fef-884cf2dc-9689-000423a5c8f0, name RAID10-2
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.298 22EB1B90 verbose 'FSVolumeProvider' opID=6F505500-000055D3-c7] RefreshVMFSVolumes: refreshed volume, id 4ec85bfd-2986b246-6b0a-000423a5c8f0, name RAID10-3
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.303 22EB1B90 verbose 'FSVolumeProvider' opID=6F505500-000055D3-c7] RefreshVMFSVolumes: refreshed volume, id 4e3ca8cb-2c9d3330-d70d-000423a5c8f0, name LOCAL-Storage-ESX4.1-500GB
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.303 22EB1B90 verbose 'FSVolumeProvider' opID=6F505500-000055D3-c7] RefreshVMFSVolumes: refreshed volume, id 4ec91116-e8cb5ca2-cc51-000423a5c8f0, name Nexenta-2-ISCSI-1
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.303 22EB1B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D3-c7] SetVolume: Datastore 4ec8600e-14752f7c-1a51-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.303 22EB1B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D3-c7] SetVolume: Datastore 4ec82f79-02ffca76-419b-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.304 22EB1B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D3-c7] SetVolume: Datastore 4e407bca-a51d0e62-8a8c-00304861ab4f has changed provider volume pointer
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.304 22EB1B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D3-c7] SetVolume: Datastore 4ec85fef-884cf2dc-9689-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.304 22EB1B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D3-c7] SetVolume: Datastore 4ec85bfd-2986b246-6b0a-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.304 22EB1B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D3-c7] SetVolume: Datastore 4e3ca8cb-2c9d3330-d70d-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.304 22EB1B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055D3-c7] SetVolume: Datastore 4ec91116-e8cb5ca2-cc51-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.304 22EB1B90 verbose 'Hostsvc::DatastoreSystem' opID=6F505500-000055D3-c7] ReconcileVMFSDatastores: Done discovering new filesystem volumes.
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.304 22EB1B90 info 'TaskManager' opID=6F505500-000055D3-c7] Task Completed : haTask-ha-host-vim.host.StorageSystem.rescanVmfs-661 Status success
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.305 1C744B90 verbose 'App' opID=6F505500-000055D3-c7] [VpxaInvtHost] Increment master gen. no to (301): HostConfig:RescanVmfs
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.305 1C744B90 verbose 'App' opID=6F505500-000055D3-c7] [VpxaInvtHost] Increment master gen. no to (302): HostConfig:RescanVmfs
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.305 1C744B90 verbose 'App' opID=6F505500-000055D3-c7] [VpxaInvtHost] Increment master gen. no (303): RescanVmfs
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.306 1C744B90 verbose 'SoapAdapter.HTTPService' opID=6F505500-000055D3-c7] HTTP Response: Complete (processed 386 bytes)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.306 1C744B90 info 'App' opID=6F505500-000055D3-c7] [VpxLRO] -- FINISH task-internal-140 --  -- vim.host.StorageSystem.rescanVmfs -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.307 FFE5BB10 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.307 FFE5BB10 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 255 to 256 (at 255)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.308 FFE5BB10 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec82f79-02ffca76-419b-000423a5c8f0/
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.309 FFE5BB10 verbose 'App'] [VpxaInvtHost] Increment master gen. no (304): DetailPropertyChanged
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.309 FFE5BB10 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4e407bca-a51d0e62-8a8c-00304861ab4f/
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.309 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.309 FFE5BB10 verbose 'App'] [VpxaInvtHost] Increment master gen. no (305): DetailPropertyChanged
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.309 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.309 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.309 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.309 FFE5BB10 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec8600e-14752f7c-1a51-000423a5c8f0/
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.309 FFE5BB10 verbose 'App'] [VpxaInvtHost] Increment master gen. no (306): DetailPropertyChanged
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.310 1C889B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.310 1C889B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.310 1C5FFB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.310 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.311 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad
Nov 24 06:19:35 3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.311 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657
Nov 24 06:19:35 c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.311 1C5FFB90 info 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590
Nov 24 06:19:35 -f4d8e812c77f --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.311 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [1+] VpxaMoService::GetChanges
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.311 1C5FFB90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [VpxaMoService] GetChanges: 300 -> 306
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.313 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.313 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.313 1C7C6B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.313 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.314 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1445 bytes)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.315 1C37CB90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.315 1C37CB90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 256 to 257 (at 256)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.316 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.316 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.317 1C37CB90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec85fef-884cf2dc-9689-000423a5c8f0/
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.317 1C37CB90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (307): DetailPropertyChanged
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.317 1C37CB90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec91116-e8cb5ca2-cc51-000423a5c8f0/
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.317 1C37CB90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (308): DetailPropertyChanged
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.317 1C37CB90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4e3ca8cb-2c9d3330-d70d-000423a5c8f0/
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.317 1C37CB90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (309): DetailPropertyChanged
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.317 1C37CB90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec85bfd-2986b246-6b0a-000423a5c8f0/
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.317 1C37CB90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (310): DetailPropertyChanged
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.317 1C5FFB90 verbose 'VpxaHalCnxHostagent' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 256 to 2
Nov 24 06:19:35 57 (at 257)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.318 1C5FFB90 info 'VpxaHalCnxHostagent' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [VpxaHalCnxHostagent::ProcessUpdate] Received old update set base vers
Nov 24 06:19:35 ion 256 (< 257), discarding
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.318 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.318 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.318 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.325 1C5FFB90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [VpxFileSystem::LoadSchemas] Reloaded cache
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.325 1C5FFB90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] Loaded filesystem schemas
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.325 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [2-] VpxdDatastore::PrepareChanges (took 7 ms)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.325 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.326 23581B90 verbose 'ha-license-manager' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.338 23581B90 info 'Libs' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] Could not expand environment variable HOME.
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.343 23581B90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" 
Nov 24 06:19:35 (lastError=0, desc.IsValid:Yes)
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.345 23581B90 info 'Libs' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] Could not expand environment variable HOME.
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.350 23581B90 verbose 'Locale' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected
Nov 24 06:19:35  in module 'default'.
Nov 24 06:19:35 Hostd: [2011-11-24 06:19:35.350 23581B90 verbose 'Locale' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in m
Nov 24 06:19:35 odule 'default'.
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.387 1C5FFB90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [VpxaMoService] host changes include changed properties [config.fileSystemVolume, c
Nov 24 06:19:35 onfig.storageDevice]
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.388 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [2-] VpxaMoService::PrepareHostChanges (took 62 ms)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.388 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.388 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:35 cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.388 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:35 cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.388 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:35 cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.388 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.388 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:35 cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.389 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:35 cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.389 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:35 cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.389 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:35 cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.389 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:35 cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.389 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.389 1C5FFB90 verbose 'VpxaHalResourcePool' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] NeedFullSync() = false
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.389 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [1-] VpxaMoService::GetChanges (took 78 ms)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.389 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad
Nov 24 06:19:35 3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.389 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657
Nov 24 06:19:35 c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.389 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7ca
Nov 24 06:19:35 d3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.390 1C5FFB90 info 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f-aea75073] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-859
Nov 24 06:19:35 0-f4d8e812c77f --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.390 1C5FFB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]52679c9f-b2eb-b4d2-8590-f4d8e812c77f
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.391 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.391 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.404 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 164174 bytes)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.422 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.422 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.423 1C785B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.423 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.424 FFE5BB10 info 'App' opID=task-internal-142-b020fd8a] [VpxLRO] -- BEGIN task-internal-142 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.424 FFE5BB10 verbose 'SoapAdapter.HTTPService' opID=task-internal-142-b020fd8a] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.424 FFE5BB10 info 'App' opID=task-internal-142-b020fd8a] [VpxLRO] -- FINISH task-internal-142 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.426 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.426 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.426 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.426 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.426 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:19:35 Vpxa: [2011-11-24 06:19:35.426 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:19:38 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:41 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.583 1C253B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.586 1C253B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.912 FFE5BB10 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.912 1C785B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.912 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.912 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.913 FFE5BB10 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.913 FFE5BB10 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.913 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.913 1C37CB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.914 1C37CB90 verbose 'PropertyProvider' opID=HB-host-9@310-ab] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.914 1C37CB90 verbose 'PropertyProvider' opID=HB-host-9@310-ab] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.914 1C37CB90 info 'App' opID=HB-host-9@310-ab] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-4
Nov 24 06:19:42 62a-a2de-0657c7cad3d9
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.914 1C37CB90 verbose 'VpxProfiler' opID=HB-host-9@310-ab] [1+] VpxaMoService::GetChanges
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.914 1C37CB90 verbose 'App' opID=HB-host-9@310-ab] [VpxaMoService] GetChanges: 306 -> 310
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.915 1C5FFB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.916 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.916 1C5FFB90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.916 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.917 1C37CB90 verbose 'VpxProfiler' opID=HB-host-9@310-ab] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.917 1C37CB90 verbose 'VpxProfiler' opID=HB-host-9@310-ab] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.917 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1446 bytes)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.917 1C37CB90 verbose 'VpxProfiler' opID=HB-host-9@310-ab] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.919 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.919 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.924 1C37CB90 verbose 'App' opID=HB-host-9@310-ab] [VpxaDatastore] Getting datastore list for LoadSchemas...
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.930 1C37CB90 verbose 'App' opID=HB-host-9@310-ab] [VpxaDatastore] Got datastore list for LoadSchemas
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.931 1C37CB90 verbose 'App' opID=HB-host-9@310-ab] [VpxFileSystem::LoadSchemas] Reloaded cache
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.931 1C37CB90 verbose 'App' opID=HB-host-9@310-ab] Loaded filesystem schemas
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.931 1C37CB90 verbose 'VpxProfiler' opID=HB-host-9@310-ab] [2-] VpxdDatastore::PrepareChanges (took 14 ms)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.931 1C37CB90 verbose 'VpxProfiler' opID=HB-host-9@310-ab] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:19:42 Hostd: [2011-11-24 06:19:42.933 223A9B90 verbose 'ha-license-manager' opID=HB-host-9@310-ab] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:19:42 Hostd: [2011-11-24 06:19:42.945 223A9B90 info 'Libs' opID=HB-host-9@310-ab] Could not expand environment variable HOME.
Nov 24 06:19:42 Hostd: [2011-11-24 06:19:42.950 223A9B90 verbose 'App' opID=HB-host-9@310-ab] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" (lastError=0, desc.IsValid:Yes)
Nov 24 06:19:42 Hostd: [2011-11-24 06:19:42.952 223A9B90 info 'Libs' opID=HB-host-9@310-ab] Could not expand environment variable HOME.
Nov 24 06:19:42 Hostd: [2011-11-24 06:19:42.957 223A9B90 verbose 'Locale' opID=HB-host-9@310-ab] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected in module 'default'.
Nov 24 06:19:42 Hostd: [2011-11-24 06:19:42.957 223A9B90 verbose 'Locale' opID=HB-host-9@310-ab] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in module 'default'.
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.960 1C37CB90 verbose 'App' opID=HB-host-9@310-ab] [VpxaMoService] host changes include changed properties []
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.960 1C37CB90 verbose 'VpxProfiler' opID=HB-host-9@310-ab] [2-] VpxaMoService::PrepareHostChanges (took 28 ms)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.960 1C37CB90 verbose 'VpxProfiler' opID=HB-host-9@310-ab] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.960 1C37CB90 verbose 'PropertyProvider' opID=HB-host-9@310-ab] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.961 1C37CB90 verbose 'PropertyProvider' opID=HB-host-9@310-ab] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.961 1C37CB90 verbose 'PropertyProvider' opID=HB-host-9@310-ab] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.961 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.961 1C37CB90 verbose 'PropertyProvider' opID=HB-host-9@310-ab] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.961 1C37CB90 verbose 'PropertyProvider' opID=HB-host-9@310-ab] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.961 1C37CB90 verbose 'PropertyProvider' opID=HB-host-9@310-ab] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.961 1C37CB90 verbose 'PropertyProvider' opID=HB-host-9@310-ab] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.961 1C37CB90 verbose 'PropertyProvider' opID=HB-host-9@310-ab] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.961 1C37CB90 verbose 'VpxProfiler' opID=HB-host-9@310-ab] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.962 1C37CB90 verbose 'VpxaHalResourcePool' opID=HB-host-9@310-ab] NeedFullSync() = false
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.962 1C37CB90 verbose 'VpxProfiler' opID=HB-host-9@310-ab] [1-] VpxaMoService::GetChanges (took 47 ms)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.962 1C37CB90 verbose 'PropertyProvider' opID=HB-host-9@310-ab] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.962 1C37CB90 verbose 'PropertyProvider' opID=HB-host-9@310-ab] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.962 1C37CB90 verbose 'PropertyProvider' opID=HB-host-9@310-ab] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.962 1C37CB90 info 'App' opID=HB-host-9@310-ab] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-
Nov 24 06:19:42 462a-a2de-0657c7cad3d9
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.962 1C37CB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]529f98af-0b2f-8ff5-f6a1-8149fe0ff5da
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.963 1C744B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.963 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.965 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 12496 bytes)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.969 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.969 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.969 1C5BEB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.969 1C5BEB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.970 1C253B90 info 'App' opID=HB-host-9@310-75] [VpxLRO] -- BEGIN task-internal-143 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.970 1C253B90 verbose 'SoapAdapter.HTTPService' opID=HB-host-9@310-75] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.970 1C253B90 info 'App' opID=HB-host-9@310-75] [VpxLRO] -- FINISH task-internal-143 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.972 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.972 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.972 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.972 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.972 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:19:42 Vpxa: [2011-11-24 06:19:42.973 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:19:44 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:45 Hostd: [2011-11-24 06:19:45.668 23381B90 verbose 'DvsManager'] PersistAllDvsInfo called
Nov 24 06:19:47 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:50 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:50 Vpxa: [2011-11-24 06:19:50.634 1C785B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:50 Vpxa: [2011-11-24 06:19:50.634 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:50 Vpxa: [2011-11-24 06:19:50.635 1C37CB90 info 'App' opID=6F505500-000055DB-6f] [VpxLRO] -- BEGIN task-internal-144 --  -- vim.host.StorageSystem.refresh -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:50 Hostd: [2011-11-24 06:19:50.637 23581B90 info 'TaskManager' opID=6F505500-000055DB-6f] Task Created : haTask-ha-host-vim.host.StorageSystem.refresh-664
Nov 24 06:19:50 Hostd: [2011-11-24 06:19:50.638 23540B90 verbose 'Hostsvc::DatastoreSystem' opID=6F505500-000055DB-6f] ReconcileVMFSDatastores called: refresh = true, rescan = true
Nov 24 06:19:50 Hostd: [2011-11-24 06:19:50.638 23540B90 verbose 'FSVolumeProvider' opID=6F505500-000055DB-6f] RefreshVMFSVolumes called
Nov 24 06:19:50 Hostd: [2011-11-24 06:19:50.638 23540B90 verbose 'FSVolumeProvider' opID=6F505500-000055DB-6f] RescanVmfs called
Nov 24 06:19:50 Vpxa: [2011-11-24 06:19:50.639 1C744B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:19:50 Vpxa: [2011-11-24 06:19:50.639 1C744B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 257 to 258 (at 257)
Nov 24 06:19:51 vmkernel: 0:14:35:01.423 cpu7:4438)ScsiDeviceIO: 1672: Command 0x25 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x1 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:19:51 vmkernel: 0:14:35:01.423 cpu0:93388)WARNING: ScsiCore: 1400: Invalid sense buffer: error=0x0, valid=0x0, segment=0x0, key=0x0
Nov 24 06:19:52 vmkernel: 0:14:35:02.424 cpu7:4438)ScsiDeviceIO: 1672: Command 0x1a to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x1 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:19:52 vmkernel: 0:14:35:02.424 cpu0:93388)WARNING: ScsiDeviceIO: 5172: READ CAPACITY on device "naa.600144f07b3dc70000004ec89beb0001" from Plugin "NMP" failed. I/O error
Nov 24 06:19:52 vmkernel: 0:14:35:02.549 cpu0:93388)Vol3: 1604: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:8' for probing: Permission denied
Nov 24 06:19:52 vmkernel: 0:14:35:02.550 cpu0:93388)Vol3: 644: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:8' for volume open: Permission denied
Nov 24 06:19:52 vmkernel: 0:14:35:02.552 cpu0:93388)Vol3: 1604: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:6' for probing: Permission denied
Nov 24 06:19:52 vmkernel: 0:14:35:02.553 cpu0:93388)Vol3: 644: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:6' for volume open: Permission denied
Nov 24 06:19:52 vmkernel: 0:14:35:02.556 cpu0:93388)Vol3: 1604: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:5' for probing: Permission denied
Nov 24 06:19:52 vmkernel: 0:14:35:02.557 cpu0:93388)Vol3: 644: Could not open device 't10.ATA_____Hitachi_HDS721032CLA362_______________________JP1411HN0AM97C:5' for volume open: Permission denied
Nov 24 06:19:53 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:53 vmkernel: 0:14:35:03.423 cpu7:4438)ScsiDeviceIO: 1672: Command 0x28 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x1 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:19:53 vmkernel: 0:14:35:03.423 cpu0:93388)Vol3: 1436: Error refreshing FB resMeta: No connection
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.212 23540B90 error 'FSVolumeProvider' opID=6F505500-000055DB-6f] VmkCtl RescanVmfs() failed: Unable to scan adapters for VMFS
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.213 23340B90 verbose 'Hostsvc::DatastoreSystem'] VmfsUpdate: got VMFS message [N11HostdCommon18VmkernelUpdateVmfsE:0x5910008] timestamp=52504190579 specific=0 name= label=
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.228 23540B90 verbose 'FSVolumeProvider' opID=6F505500-000055DB-6f] RefreshVMFSVolumes: refreshed volume, id 4ec8600e-14752f7c-1a51-000423a5c8f0, name RAID10-1
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.236 23540B90 verbose 'FSVolumeProvider' opID=6F505500-000055DB-6f] RefreshVMFSVolumes: refreshed volume, id 4ec82f79-02ffca76-419b-000423a5c8f0, name RAID10-4
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.264 23540B90 verbose 'FSVolumeProvider' opID=6F505500-000055DB-6f] RefreshVMFSVolumes: refreshed volume, id 4e407bca-a51d0e62-8a8c-00304861ab4f, name datastore3
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.272 23540B90 verbose 'FSVolumeProvider' opID=6F505500-000055DB-6f] RefreshVMFSVolumes: refreshed volume, id 4ec85fef-884cf2dc-9689-000423a5c8f0, name RAID10-2
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.281 23540B90 verbose 'FSVolumeProvider' opID=6F505500-000055DB-6f] RefreshVMFSVolumes: refreshed volume, id 4ec85bfd-2986b246-6b0a-000423a5c8f0, name RAID10-3
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.286 23540B90 verbose 'FSVolumeProvider' opID=6F505500-000055DB-6f] RefreshVMFSVolumes: refreshed volume, id 4e3ca8cb-2c9d3330-d70d-000423a5c8f0, name LOCAL-Storage-ESX4.1-500GB
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.287 23540B90 verbose 'FSVolumeProvider' opID=6F505500-000055DB-6f] RefreshVMFSVolumes: refreshed volume, id 4ec91116-e8cb5ca2-cc51-000423a5c8f0, name Nexenta-2-ISCSI-1
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.287 23540B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055DB-6f] SetVolume: Datastore 4ec8600e-14752f7c-1a51-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.287 23540B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055DB-6f] SetVolume: Datastore 4ec82f79-02ffca76-419b-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.287 23540B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055DB-6f] SetVolume: Datastore 4e407bca-a51d0e62-8a8c-00304861ab4f has changed provider volume pointer
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.287 23540B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055DB-6f] SetVolume: Datastore 4ec85fef-884cf2dc-9689-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.287 23540B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055DB-6f] SetVolume: Datastore 4ec85bfd-2986b246-6b0a-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.287 23540B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055DB-6f] SetVolume: Datastore 4e3ca8cb-2c9d3330-d70d-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.287 23540B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055DB-6f] SetVolume: Datastore 4ec91116-e8cb5ca2-cc51-000423a5c8f0 has changed provider volume pointer
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.287 23540B90 verbose 'Hostsvc::DatastoreSystem' opID=6F505500-000055DB-6f] ReconcileVMFSDatastores: Done discovering new filesystem volumes.
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.288 23540B90 verbose 'Hostsvc::DatastoreSystem' opID=6F505500-000055DB-6f] ReconcileNASDatastores: Discovering new filesystem volumes.
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.288 23540B90 verbose 'FSVolumeProvider' opID=6F505500-000055DB-6f] RefreshNASVolumes called
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.331 23540B90 verbose 'FSVolumeProvider' opID=6F505500-000055DB-6f] RefreshNASVolumes: refreshed volume, id MEM-SRV-VC-1:/NFS, name NFS-1
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.331 23540B90 verbose 'Hostsvc::Datastore' opID=6F505500-000055DB-6f] SetVolume: Datastore MEM-SRV-VC-1:/NFS has changed provider volume pointer
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.332 23540B90 verbose 'Hostsvc::DatastoreSystem' opID=6F505500-000055DB-6f] ReconcileNASDatastores: Done discovering new filesystem volumes.
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.332 23540B90 verbose 'StorageSystem' opID=6F505500-000055DB-6f] SendStorageInfoEvent() called
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.332 23540B90 info 'TaskManager' opID=6F505500-000055DB-6f] Task Completed : haTask-ha-host-vim.host.StorageSystem.refresh-664 Status success
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.333 1C37CB90 verbose 'SoapAdapter.HTTPService' opID=6F505500-000055DB-6f] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.333 1C37CB90 info 'App' opID=6F505500-000055DB-6f] [VpxLRO] -- FINISH task-internal-144 --  -- vim.host.StorageSystem.refresh -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.334 1C5BEB90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.334 1C5BEB90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 258 to 259 (at 258)
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.335 1C5BEB90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec82f79-02ffca76-419b-000423a5c8f0/
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.335 1C5BEB90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (311): DetailPropertyChanged
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.335 1C5BEB90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec8600e-14752f7c-1a51-000423a5c8f0/
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.335 1C5BEB90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (312): DetailPropertyChanged
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.336 1C848B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.336 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.336 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.336 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.337 1C37CB90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.337 1C37CB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.337 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.337 1C5FFB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.338 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad
Nov 24 06:19:53 3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.338 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657
Nov 24 06:19:53 c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.338 1C5FFB90 info 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0
Nov 24 06:19:53 -7be118bedfda --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.338 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [1+] VpxaMoService::GetChanges
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.338 1C5FFB90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [VpxaMoService] GetChanges: 310 -> 312
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.340 1C848B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.340 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.340 1C848B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.341 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.341 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1446 bytes)
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.343 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:53 Vpxa: [2011-11-24 06:19:53.343 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.388 221CAB90 info 'App'] CreateISCSIHBA
Nov 24 06:19:53 vmkernel: 0:14:35:03.686 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:19:53 vmkernel: 0:14:35:03.686 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:19:53 vmkernel: 0:14:35:03.686 cpu1:4117)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:19:53 vmkernel: 0:14:35:03.729 cpu6:4636)NMP: nmp_CompleteCommandForPath: Command 0x12 (0x41027f382e40) to NMP device "mpx.vmhba0:C0:T0:L0" failed on physical path "vmhba0:C0:T0:L0" H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.
Nov 24 06:19:53 vmkernel: 0:14:35:03.729 cpu6:4636)ScsiDeviceIO: 1672: Command 0x12 to device "mpx.vmhba0:C0:T0:L0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.519 221CAB90 error 'App'] Unable to build Durable Name dependent properties: Unable to query VPD pages from device, all paths are dead, no I/O possible.
Nov 24 06:19:53 vmkernel: 0:14:35:03.766 cpu0:4119)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.578 221CAB90 verbose 'App'] Looking up object with name = "firewallSystem" failed.
Nov 24 06:19:53 Hostd: [2011-11-24 06:19:53.684 221CAB90 verbose 'NetConfigProvider'] FetchFn: List of pnics opted out 
Nov 24 06:19:54 vmkernel: 0:14:35:04.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:19:54 vmkernel: 0:14:35:04.422 cpu6:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:19:54 vmkernel: 0:14:35:04.422 cpu6:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:19:54 vmkernel: 0:14:35:04.422 cpu6:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:19:54 Hostd: [2011-11-24 06:19:54.759 221CAB90 verbose 'NetConfigProvider'] FetchFn: List of pnics opted out 
Nov 24 06:19:55 vmkernel: 0:14:35:05.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f3d0940
Nov 24 06:19:55 vmkernel: 0:14:35:05.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:19:55 vmkernel: 0:14:35:05.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:19:55 Hostd: [2011-11-24 06:19:55.787 221CAB90 warning 'PropertyCollector'] ComputeGUReq took 2450718 microSec
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.814 1C681B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.815 1C681B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 259 to 260 (at 259)
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.817 1C681B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.819 1C681B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec85fef-884cf2dc-9689-000423a5c8f0/
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.837 1C681B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (313): DetailPropertyChanged
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.837 1C681B90 verbose 'App'] [VpxaDatastore] url: netfs://192.168.11.147//NFS/
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.837 1C681B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec91116-e8cb5ca2-cc51-000423a5c8f0/
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.837 1C681B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (314): DetailPropertyChanged
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.838 1C681B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4e3ca8cb-2c9d3330-d70d-000423a5c8f0/
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.838 1C681B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (315): DetailPropertyChanged
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.838 1C681B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4e407bca-a51d0e62-8a8c-00304861ab4f/
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.838 1C681B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (316): DetailPropertyChanged
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.838 1C681B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec85bfd-2986b246-6b0a-000423a5c8f0/
Nov 24 06:19:55 Vpxa: [2011-11-24 06:19:55.838 1C681B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (317): DetailPropertyChanged
Nov 24 06:19:55 Hostd: [2011-11-24 06:19:55.871 235C2B90 verbose 'App'] Looking up object with name = "firewallSystem" failed.
Nov 24 06:19:55 Hostd: [2011-11-24 06:19:55.977 235C2B90 verbose 'NetConfigProvider'] FetchFn: List of pnics opted out 
Nov 24 06:19:56 iscsid: connect failed (111,Connection refused)
Nov 24 06:19:57 Hostd: [2011-11-24 06:19:57.046 235C2B90 verbose 'NetConfigProvider'] FetchFn: List of pnics opted out 
Nov 24 06:19:57 Vpxa: [2011-11-24 06:19:57.835 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:57 Vpxa: [2011-11-24 06:19:57.836 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength 129)
Nov 24 06:19:57 Vpxa: [2011-11-24 06:19:57.836 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Auto-completing at 129/129 bytes
Nov 24 06:19:58 Hostd: [2011-11-24 06:19:58.070 235C2B90 warning 'PropertyCollector'] ComputeGUReq took 2281884 microSec
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.099 1C5FFB90 verbose 'VpxaHalCnxHostagent' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 259 to 2
Nov 24 06:19:58 60 (at 260)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.099 1C5FFB90 info 'VpxaHalCnxHostagent' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [VpxaHalCnxHostagent::ProcessUpdate] Received old update set base vers
Nov 24 06:19:58 ion 259 (< 260), discarding
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.100 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.100 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.100 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.100 1C5FFB90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [VpxaDatastore] Getting datastore list for LoadSchemas...
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.107 1C5FFB90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [VpxaDatastore] Got datastore list for LoadSchemas
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.108 1C5FFB90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [VpxFileSystem::LoadSchemas] Reloaded cache
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.108 1C5FFB90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] Loaded filesystem schemas
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.108 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [2-] VpxdDatastore::PrepareChanges (took 8 ms)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.108 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:19:58 Hostd: [2011-11-24 06:19:58.110 223A9B90 verbose 'ha-license-manager' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:19:58 Hostd: [2011-11-24 06:19:58.122 223A9B90 info 'Libs' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] Could not expand environment variable HOME.
Nov 24 06:19:58 Hostd: [2011-11-24 06:19:58.127 223A9B90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" 
Nov 24 06:19:58 (lastError=0, desc.IsValid:Yes)
Nov 24 06:19:58 Hostd: [2011-11-24 06:19:58.129 223A9B90 info 'Libs' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] Could not expand environment variable HOME.
Nov 24 06:19:58 Hostd: [2011-11-24 06:19:58.133 223A9B90 verbose 'Locale' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected
Nov 24 06:19:58  in module 'default'.
Nov 24 06:19:58 Hostd: [2011-11-24 06:19:58.134 223A9B90 verbose 'Locale' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in m
Nov 24 06:19:58 odule 'default'.
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.137 1C5FFB90 verbose 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [VpxaMoService] host changes include changed properties []
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.137 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [2-] VpxaMoService::PrepareHostChanges (took 28 ms)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.137 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.137 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:58 cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.137 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:58 cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.137 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:58 cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.138 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:58 cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.138 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.138 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:58 cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.138 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:58 cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.138 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:58 cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.138 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7
Nov 24 06:19:58 cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.138 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.138 1C5FFB90 verbose 'VpxaHalResourcePool' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] NeedFullSync() = false
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.138 1C5FFB90 verbose 'VpxProfiler' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [1-] VpxaMoService::GetChanges (took 4800 ms)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.138 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad
Nov 24 06:19:58 3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.138 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657
Nov 24 06:19:58 c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.139 1C5FFB90 verbose 'PropertyProvider' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7ca
Nov 24 06:19:58 d3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.139 1C5FFB90 info 'App' opID=session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda-1bd55130] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da
Nov 24 06:19:58 0-7be118bedfda --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.139 1C5FFB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]524c3d35-9f5f-24f8-4da0-7be118bedfda
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.140 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.140 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.142 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 11427 bytes)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.146 1C744B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.146 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.146 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.146 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.147 1C37CB90 info 'App' opID=task-internal-145-5e9b1a14] [VpxLRO] -- BEGIN task-internal-145 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.147 1C37CB90 verbose 'SoapAdapter.HTTPService' opID=task-internal-145-5e9b1a14] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.147 1C37CB90 info 'App' opID=task-internal-145-5e9b1a14] [VpxLRO] -- FINISH task-internal-145 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.149 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.149 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.149 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.149 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.149 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:19:58 Vpxa: [2011-11-24 06:19:58.149 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:19:59 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:02 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.583 1C6C2B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.586 1C6C2B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.915 FFE5BB10 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.915 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.915 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.916 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.916 FFE5BB10 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.916 FFE5BB10 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.916 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.916 1C5FFB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.917 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@317-44] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.917 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@317-44] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.917 1C5FFB90 info 'App' opID=HB-host-9@317-44] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-4
Nov 24 06:20:02 62a-a2de-0657c7cad3d9
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.917 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@317-44] [1+] VpxaMoService::GetChanges
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.917 1C5FFB90 verbose 'App' opID=HB-host-9@317-44] [VpxaMoService] GetChanges: 312 -> 317
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.919 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.919 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.919 1C807B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.920 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.920 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@317-44] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.920 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@317-44] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.920 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@317-44] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.920 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1446 bytes)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.921 1C5FFB90 verbose 'App' opID=HB-host-9@317-44] [VpxaDatastore] Getting datastore list for LoadSchemas...
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.922 1C744B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.922 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.927 1C5FFB90 verbose 'App' opID=HB-host-9@317-44] [VpxaDatastore] Got datastore list for LoadSchemas
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.928 1C5FFB90 verbose 'App' opID=HB-host-9@317-44] [VpxFileSystem::LoadSchemas] Reloaded cache
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.928 1C5FFB90 verbose 'App' opID=HB-host-9@317-44] Loaded filesystem schemas
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.928 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@317-44] [2-] VpxdDatastore::PrepareChanges (took 8 ms)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.929 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@317-44] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:20:02 Hostd: [2011-11-24 06:20:02.930 23340B90 verbose 'ha-license-manager' opID=HB-host-9@317-44] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:20:02 Hostd: [2011-11-24 06:20:02.941 23340B90 info 'Libs' opID=HB-host-9@317-44] Could not expand environment variable HOME.
Nov 24 06:20:02 Hostd: [2011-11-24 06:20:02.947 23340B90 verbose 'App' opID=HB-host-9@317-44] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" (lastError=0, desc.IsValid:Yes)
Nov 24 06:20:02 Hostd: [2011-11-24 06:20:02.949 23340B90 info 'Libs' opID=HB-host-9@317-44] Could not expand environment variable HOME.
Nov 24 06:20:02 Hostd: [2011-11-24 06:20:02.953 23340B90 verbose 'Locale' opID=HB-host-9@317-44] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected in module 'default'.
Nov 24 06:20:02 Hostd: [2011-11-24 06:20:02.954 23340B90 verbose 'Locale' opID=HB-host-9@317-44] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in module 'default'.
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.957 1C5FFB90 verbose 'App' opID=HB-host-9@317-44] [VpxaMoService] host changes include changed properties []
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.957 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@317-44] [2-] VpxaMoService::PrepareHostChanges (took 28 ms)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.957 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@317-44] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.957 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@317-44] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.958 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@317-44] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.958 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@317-44] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.958 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@317-44] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.958 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.958 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@317-44] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.958 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@317-44] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.958 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@317-44] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.958 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@317-44] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.959 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@317-44] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.959 1C5FFB90 verbose 'VpxaHalResourcePool' opID=HB-host-9@317-44] NeedFullSync() = false
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.959 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@317-44] [1-] VpxaMoService::GetChanges (took 41 ms)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.959 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@317-44] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.959 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@317-44] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.959 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@317-44] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.959 1C5FFB90 info 'App' opID=HB-host-9@317-44] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-
Nov 24 06:20:02 462a-a2de-0657c7cad3d9
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.959 1C5FFB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5226002a-d0c6-7009-9006-2d4780b9583b
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.960 1C744B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.960 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.962 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 8573 bytes)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.965 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.966 1C848B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.966 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.966 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.966 1C5BEB90 info 'App' opID=HB-host-9@317-a3] [VpxLRO] -- BEGIN task-internal-146 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.967 1C5BEB90 verbose 'SoapAdapter.HTTPService' opID=HB-host-9@317-a3] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.967 1C5BEB90 info 'App' opID=HB-host-9@317-a3] [VpxLRO] -- FINISH task-internal-146 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.968 1C5BEB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.969 1C5BEB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.969 1C5BEB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.969 1C5BEB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.969 1C5BEB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:20:02 Vpxa: [2011-11-24 06:20:02.969 1C5BEB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:20:05 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:08 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:11 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:14 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:17 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:18 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:20:18 Hostd: [2011-11-24 06:20:18.948 22EF2B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:20:19 Vpxa: [2011-11-24 06:20:19.106 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:19 Vpxa: [2011-11-24 06:20:19.106 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:19 Vpxa: [2011-11-24 06:20:19.107 1C5BEB90 info 'App' opID=task-internal-147-34a57d7b] [VpxLRO] -- BEGIN task-internal-147 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:20:19 Vpxa: [2011-11-24 06:20:19.107 1C5BEB90 verbose 'SoapAdapter.HTTPService' opID=task-internal-147-34a57d7b] HTTP Response: Complete (processed 1855 bytes)
Nov 24 06:20:19 Vpxa: [2011-11-24 06:20:19.108 1C5BEB90 info 'App' opID=task-internal-147-34a57d7b] [VpxLRO] -- FINISH task-internal-147 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:20:20 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:22 Vpxa: [2011-11-24 06:20:22.584 1C889B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:20:22 Vpxa: [2011-11-24 06:20:22.587 1C889B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:20:23 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:26 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:29 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:32 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:33 vmkernel: 0:14:35:43.766 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:20:33 vmkernel: 0:14:35:43.766 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:20:33 vmkernel: 0:14:35:43.766 cpu0:4119)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:20:33 vmkernel: 0:14:35:43.958 cpu3:4118)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:20:34 vmkernel: 0:14:35:44.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:20:34 vmkernel: 0:14:35:44.423 cpu7:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:20:34 vmkernel: 0:14:35:44.423 cpu7:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:20:34 vmkernel: 0:14:35:44.423 cpu7:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:20:35 vmkernel: 0:14:35:45.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f438740
Nov 24 06:20:35 vmkernel: 0:14:35:45.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:20:35 vmkernel: 0:14:35:45.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:20:35 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:37 Hostd: [2011-11-24 06:20:37.390 FFB6EE80 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:20:37 Hostd: [2011-11-24 06:20:37.697 23540B90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:20:37 Vpxa: [2011-11-24 06:20:37.699 1C744B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:20:37 Vpxa: [2011-11-24 06:20:37.700 1C744B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 260 to 261 (at 260)
Nov 24 06:20:37 Vpxa: [2011-11-24 06:20:37.700 1C744B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:20:38 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:41 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:42 Vpxa: [2011-11-24 06:20:42.583 FFE5BB10 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:20:42 Vpxa: [2011-11-24 06:20:42.586 FFE5BB10 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:20:44 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:45 Hostd: [2011-11-24 06:20:45.787 22EF2B90 verbose 'vm:/vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx'] Actual VM overhead: 517177344 bytes
Nov 24 06:20:45 Hostd: [2011-11-24 06:20:45.787 22EF2B90 verbose 'Vmsvc'] RefreshVms updated overhead for 1 VM
Nov 24 06:20:45 Vpxa: [2011-11-24 06:20:45.789 1C253B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:20:45 Vpxa: [2011-11-24 06:20:45.789 1C253B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 261 to 262 (at 261)
Nov 24 06:20:45 Vpxa: [2011-11-24 06:20:45.789 1C253B90 verbose 'App'] [VpxaHalVmHostagent] 672: Runtime changed 'runtime.memoryOverhead'
Nov 24 06:20:45 Vpxa: [2011-11-24 06:20:45.789 1C253B90 verbose 'App'] [VpxaHalServices] RuntimeChange Event for vm(2) 672
Nov 24 06:20:45 Vpxa: [2011-11-24 06:20:45.789 1C253B90 verbose 'App'] [VpxaInvtVmChangeListener] AAM won't be notifyed. vmid 2: notifyVMAP 0,isRestarting 0
Nov 24 06:20:45 Vpxa: [2011-11-24 06:20:45.789 1C253B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no to (318): VmRuntime:VpxaInvtVmChangeListener::RuntimeChanged
Nov 24 06:20:47 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:50 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.921 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.921 1C848B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.921 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength 129)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.921 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.921 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.921 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Auto-completing at 129/129 bytes
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.921 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.922 1C848B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.922 1C848B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.923 1C5BEB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.923 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.923 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@318-35] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.923 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@318-35] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.923 1C5BEB90 info 'App' opID=HB-host-9@318-35] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-4
Nov 24 06:20:52 62a-a2de-0657c7cad3d9
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.923 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@318-35] [1+] VpxaMoService::GetChanges
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.923 1C5BEB90 verbose 'App' opID=HB-host-9@318-35] [VpxaMoService] GetChanges: 317 -> 318
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.924 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.925 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.925 1C6C2B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.926 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.926 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@318-35] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.926 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@318-35] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.926 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@318-35] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.926 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@318-35] [2-] VpxdDatastore::PrepareChanges (took 0 ms)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.926 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1446 bytes)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.926 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@318-35] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:20:52 Hostd: [2011-11-24 06:20:52.928 FFB6EE80 verbose 'ha-license-manager' opID=HB-host-9@318-35] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.928 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.928 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:52 Hostd: [2011-11-24 06:20:52.939 FFB6EE80 info 'Libs' opID=HB-host-9@318-35] Could not expand environment variable HOME.
Nov 24 06:20:52 Hostd: [2011-11-24 06:20:52.944 FFB6EE80 verbose 'App' opID=HB-host-9@318-35] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" (lastError=0, desc.IsValid:Yes)
Nov 24 06:20:52 Hostd: [2011-11-24 06:20:52.947 FFB6EE80 info 'Libs' opID=HB-host-9@318-35] Could not expand environment variable HOME.
Nov 24 06:20:52 Hostd: [2011-11-24 06:20:52.951 FFB6EE80 verbose 'Locale' opID=HB-host-9@318-35] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected in module 'default'.
Nov 24 06:20:52 Hostd: [2011-11-24 06:20:52.951 FFB6EE80 verbose 'Locale' opID=HB-host-9@318-35] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in module 'default'.
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.955 1C5BEB90 verbose 'App' opID=HB-host-9@318-35] [VpxaMoService] host changes include changed properties []
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.955 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@318-35] [2-] VpxaMoService::PrepareHostChanges (took 28 ms)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.955 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@318-35] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.955 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@318-35] [3+] HandleVMChanges for vmid:2
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.955 1C5BEB90 verbose 'App' opID=HB-host-9@318-35] [VpxURL] Resolved localPath /vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx to URL sanfs://vmfs_uuid:4e407bca-a51d0e62-8a8c-00304
Nov 24 06:20:52 861ab4f/Nexenta-2_1/Nexenta-2.vmx
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.956 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@318-35] [3-] HandleVMChanges for vmid:2 (took 0 ms)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.956 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@318-35] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.956 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@318-35] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.956 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@318-35] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.956 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@318-35] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.956 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.956 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@318-35] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.957 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@318-35] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.957 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@318-35] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.957 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@318-35] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.957 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@318-35] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.957 1C5BEB90 verbose 'VpxaHalResourcePool' opID=HB-host-9@318-35] NeedFullSync() = false
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.957 1C5BEB90 verbose 'VpxaHalResourcePool' opID=HB-host-9@318-35] VpxaHalResourcePoolStandalone::GetVpxaMoRef(vim.ResourcePool:pool0) = vim.ResourcePool:/Resources/Extreme
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.957 1C5BEB90 verbose 'VpxProfiler' opID=HB-host-9@318-35] [1-] VpxaMoService::GetChanges (took 34 ms)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.957 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@318-35] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.957 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@318-35] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.957 1C5BEB90 verbose 'PropertyProvider' opID=HB-host-9@318-35] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.957 1C5BEB90 info 'App' opID=HB-host-9@318-35] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-
Nov 24 06:20:52 462a-a2de-0657c7cad3d9
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.958 1C5BEB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5219554f-8c37-ca68-9fcd-1c02fff39818
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.958 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.959 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.959 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 4318 bytes)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.964 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.964 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.964 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.964 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.965 1C5FFB90 info 'App' opID=HB-host-9@318-2] [VpxLRO] -- BEGIN task-internal-148 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.965 1C5FFB90 verbose 'SoapAdapter.HTTPService' opID=HB-host-9@318-2] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.965 1C5FFB90 info 'App' opID=HB-host-9@318-2] [VpxLRO] -- FINISH task-internal-148 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.966 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.966 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.967 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.967 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.967 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:20:52 Vpxa: [2011-11-24 06:20:52.967 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:20:53 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:56 iscsid: connect failed (111,Connection refused)
Nov 24 06:20:59 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:02 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:02 Vpxa: [2011-11-24 06:21:02.584 1C37CB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:21:02 Vpxa: [2011-11-24 06:21:02.586 1C37CB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:21:05 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:08 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:11 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:13 vmkernel: 0:14:36:23.958 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:21:13 vmkernel: 0:14:36:23.958 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:21:13 vmkernel: 0:14:36:23.958 cpu6:4118)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:21:13 vmkernel: 0:14:36:23.966 cpu1:4117)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:21:14 vmkernel: 0:14:36:24.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:21:14 vmkernel: 0:14:36:24.422 cpu6:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:21:14 vmkernel: 0:14:36:24.422 cpu6:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:21:14 vmkernel: 0:14:36:24.422 cpu6:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:21:14 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:15 vmkernel: 0:14:36:25.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f4b0340
Nov 24 06:21:15 vmkernel: 0:14:36:25.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:21:15 vmkernel: 0:14:36:25.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:21:17 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:19 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:21:19 Hostd: [2011-11-24 06:21:19.062 233C2B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:21:19 Vpxa: [2011-11-24 06:21:19.108 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:21:19 Vpxa: [2011-11-24 06:21:19.108 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:21:19 Vpxa: [2011-11-24 06:21:19.109 FFE5BB10 info 'App' opID=task-internal-149-22523730] [VpxLRO] -- BEGIN task-internal-149 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:21:19 Vpxa: [2011-11-24 06:21:19.109 FFE5BB10 verbose 'SoapAdapter.HTTPService' opID=task-internal-149-22523730] HTTP Response: Complete (processed 1855 bytes)
Nov 24 06:21:19 Vpxa: [2011-11-24 06:21:19.109 FFE5BB10 info 'App' opID=task-internal-149-22523730] [VpxLRO] -- FINISH task-internal-149 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:21:20 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:22 Vpxa: [2011-11-24 06:21:22.584 1C37CB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:21:22 Vpxa: [2011-11-24 06:21:22.587 1C37CB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:21:23 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:23 shell[120379]: vmkping 192.168.11.9:2000
Nov 24 06:21:26 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:29 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:29 shell[120379]: vmkping 192.168.11.9
Nov 24 06:21:32 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:35 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:38 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:41 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:42 Vpxa: [2011-11-24 06:21:42.585 1C6C2B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:21:42 Vpxa: [2011-11-24 06:21:42.588 1C6C2B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:21:44 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:46 Vpxa: [2011-11-24 06:21:46.006 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:21:46 Vpxa: [2011-11-24 06:21:46.006 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:21:46 Vpxa: [2011-11-24 06:21:46.007 1C5BEB90 info 'App' opID=efc9dbfc-8e] [VpxLRO] -- BEGIN task-internal-150 -- host -- vim.HostSystem.acquireCimServicesTicket -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:21:46 Hostd: [2011-11-24 06:21:46.009 22EF2B90 info 'TaskManager' opID=efc9dbfc-8e] Task Created : haTask-ha-host-vim.HostSystem.acquireCimServicesTicket-677
Nov 24 06:21:46 Hostd: [2011-11-24 06:21:46.010 23340B90 verbose 'Cimsvc' opID=efc9dbfc-8e] Ticket issued for CIMOM version 1.0, user vpxuser
Nov 24 06:21:46 Hostd: [2011-11-24 06:21:46.010 23340B90 info 'TaskManager' opID=efc9dbfc-8e] Task Completed : haTask-ha-host-vim.HostSystem.acquireCimServicesTicket-677 Status success
Nov 24 06:21:46 Vpxa: [2011-11-24 06:21:46.011 1C253B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:21:46 Vpxa: [2011-11-24 06:21:46.011 1C253B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 262 to 263 (at 262)
Nov 24 06:21:46 Vpxa: [2011-11-24 06:21:46.011 1C5BEB90 verbose 'SoapAdapter.HTTPService' opID=efc9dbfc-8e] HTTP Response: Complete (processed 604 bytes)
Nov 24 06:21:46 Vpxa: [2011-11-24 06:21:46.012 1C5BEB90 info 'App' opID=efc9dbfc-8e] [VpxLRO] -- FINISH task-internal-150 -- host -- vim.HostSystem.acquireCimServicesTicket -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:21:46 Vpxa: [2011-11-24 06:21:46.014 1C889B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:21:46 Vpxa: [2011-11-24 06:21:46.014 1C889B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 263 to 264 (at 263)
Nov 24 06:21:47 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:50 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:53 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:53 vmkernel: 0:14:37:03.966 cpu3:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:21:53 vmkernel: 0:14:37:03.966 cpu3:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:21:53 vmkernel: 0:14:37:03.966 cpu1:4117)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:21:53 vmkernel: 0:14:37:04.013 cpu0:4119)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:21:54 vmkernel: 0:14:37:04.422 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:21:54 vmkernel: 0:14:37:04.422 cpu5:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:21:54 vmkernel: 0:14:37:04.422 cpu5:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:21:54 vmkernel: 0:14:37:04.423 cpu5:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:21:54 Hostd: [2011-11-24 06:21:54.882 FFB6EE80 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.refresh-611" failed.
Nov 24 06:21:54 Hostd: [2011-11-24 06:21:54.882 FFB6EE80 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.HostSystem.acquireCimServicesTicket-610" failed.
Nov 24 06:21:54 Vpxa: [2011-11-24 06:21:54.883 1C744B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:21:54 Vpxa: [2011-11-24 06:21:54.884 1C744B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 264 to 265 (at 264)
Nov 24 06:21:54 Hostd: [2011-11-24 06:21:54.886 22EB1B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.refresh-611" failed.
Nov 24 06:21:54 Hostd: [2011-11-24 06:21:54.886 22EB1B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.HostSystem.acquireCimServicesTicket-610" failed.
Nov 24 06:21:55 vmkernel: 0:14:37:05.423 cpu4:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f3e2a40
Nov 24 06:21:55 vmkernel: 0:14:37:05.423 cpu4:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:21:55 vmkernel: 0:14:37:05.423 cpu4:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:21:56 iscsid: connect failed (111,Connection refused)
Nov 24 06:21:59 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:02 Vpxa: [2011-11-24 06:22:02.586 1C7C6B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:22:02 Vpxa: [2011-11-24 06:22:02.588 1C7C6B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:22:02 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:02 shell[120379]: ls
Nov 24 06:22:05 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:06 Vpxa: [2011-11-24 06:22:06.437 1C5FFB90 verbose 'VpxProfiler'] [1+] CheckEnvBrowserChanges
Nov 24 06:22:06 Hostd: [2011-11-24 06:22:06.467 23381B90 verbose 'DvsTracker'] FetchSwitches: added 0 items
Nov 24 06:22:06 Hostd: [2011-11-24 06:22:06.467 23381B90 verbose 'DvsTracker'] FetchDVPortgroups: added 0 items
Nov 24 06:22:06 Hostd: [2011-11-24 06:22:06.468 23381B90 verbose 'EnvironmentBrowser'] Skipped inaccessible datastore 4ec91116-e8cb5ca2-cc51-000423a5c8f0.
Nov 24 06:22:06 Vpxa: [2011-11-24 06:22:06.476 1C5FFB90 verbose 'VpxProfiler'] [1-] CheckEnvBrowserChanges (took 38 ms)
Nov 24 06:22:07 Hostd: [2011-11-24 06:22:07.697 22EB1B90 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:22:08 Hostd: [2011-11-24 06:22:08.001 23340B90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:22:08 Vpxa: [2011-11-24 06:22:08.004 1C848B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:22:08 Vpxa: [2011-11-24 06:22:08.004 1C848B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 265 to 267 (at 265)
Nov 24 06:22:08 Vpxa: [2011-11-24 06:22:08.004 1C848B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:22:08 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:08 shell[120379]: vi messages
Nov 24 06:22:11 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:14 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:17 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:19 Vpxa: [2011-11-24 06:22:19.110 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:22:19 Vpxa: [2011-11-24 06:22:19.110 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:22:19 Vpxa: [2011-11-24 06:22:19.111 1C5BEB90 info 'App' opID=task-internal-151-28fa78a3] [VpxLRO] -- BEGIN task-internal-151 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:22:19 Vpxa: [2011-11-24 06:22:19.111 1C5BEB90 verbose 'SoapAdapter.HTTPService' opID=task-internal-151-28fa78a3] HTTP Response: Complete (processed 1855 bytes)
Nov 24 06:22:19 Vpxa: [2011-11-24 06:22:19.111 1C5BEB90 info 'App' opID=task-internal-151-28fa78a3] [VpxLRO] -- FINISH task-internal-151 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:22:19 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:22:19 Hostd: [2011-11-24 06:22:19.168 235C2B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:22:20 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:22 Vpxa: [2011-11-24 06:22:22.586 1C744B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:22:22 Vpxa: [2011-11-24 06:22:22.589 1C744B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:22:23 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:26 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:29 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:32 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:33 vmkernel: 0:14:37:44.013 cpu3:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:22:33 vmkernel: 0:14:37:44.013 cpu3:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:22:33 vmkernel: 0:14:37:44.013 cpu0:4119)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:22:33 vmkernel: 0:14:37:44.084 cpu7:4118)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:22:34 vmkernel: 0:14:37:44.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:22:34 vmkernel: 0:14:37:44.423 cpu6:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:22:34 vmkernel: 0:14:37:44.423 cpu6:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:22:34 vmkernel: 0:14:37:44.423 cpu6:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:22:35 vmkernel: 0:14:37:45.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f466040
Nov 24 06:22:35 vmkernel: 0:14:37:45.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:22:35 vmkernel: 0:14:37:45.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:22:35 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:38 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:41 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:42 Vpxa: [2011-11-24 06:22:42.586 1C5BEB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:22:42 Vpxa: [2011-11-24 06:22:42.588 1C5BEB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:22:44 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:47 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:50 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:53 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:56 iscsid: connect failed (111,Connection refused)
Nov 24 06:22:59 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:02 Vpxa: [2011-11-24 06:23:02.587 1C5FFB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:23:02 Vpxa: [2011-11-24 06:23:02.589 1C5FFB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:23:02 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:05 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:08 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:11 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:13 vmkernel: 0:14:38:24.085 cpu3:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:23:13 vmkernel: 0:14:38:24.085 cpu3:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:23:13 vmkernel: 0:14:38:24.085 cpu7:4118)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:23:13 vmkernel: 0:14:38:24.155 cpu0:4117)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:23:14 vmkernel: 0:14:38:24.424 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:23:14 vmkernel: 0:14:38:24.424 cpu7:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:23:14 vmkernel: 0:14:38:24.424 cpu7:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:23:14 vmkernel: 0:14:38:24.424 cpu7:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:23:14 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:15 vmkernel: 0:14:38:25.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f3aea40
Nov 24 06:23:15 vmkernel: 0:14:38:25.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:23:15 vmkernel: 0:14:38:25.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:23:17 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:19 Vpxa: [2011-11-24 06:23:19.112 1C5BEB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:23:19 Vpxa: [2011-11-24 06:23:19.112 1C5BEB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:23:19 Vpxa: [2011-11-24 06:23:19.112 1C253B90 info 'App' opID=task-internal-152-1034ae48] [VpxLRO] -- BEGIN task-internal-152 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:23:19 Vpxa: [2011-11-24 06:23:19.113 1C253B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-152-1034ae48] HTTP Response: Complete (processed 1855 bytes)
Nov 24 06:23:19 Vpxa: [2011-11-24 06:23:19.113 1C253B90 info 'App' opID=task-internal-152-1034ae48] [VpxLRO] -- FINISH task-internal-152 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:23:19 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:23:19 Hostd: [2011-11-24 06:23:19.272 233C2B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:23:20 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:22 Vpxa: [2011-11-24 06:23:22.587 FFE5BB10 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:23:22 Vpxa: [2011-11-24 06:23:22.590 FFE5BB10 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:23:23 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:26 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:29 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:32 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:35 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:38 Hostd: [2011-11-24 06:23:38.002 22EB1B90 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:23:38 Hostd: [2011-11-24 06:23:38.292 221CAB90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:23:38 Vpxa: [2011-11-24 06:23:38.295 1C37CB90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:23:38 Vpxa: [2011-11-24 06:23:38.295 1C37CB90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 267 to 268 (at 267)
Nov 24 06:23:38 Vpxa: [2011-11-24 06:23:38.295 1C37CB90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:23:38 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:41 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:42 Vpxa: [2011-11-24 06:23:42.587 1C681B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:23:42 Vpxa: [2011-11-24 06:23:42.590 1C681B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:23:44 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:45 Hostd: [2011-11-24 06:23:45.789 22EB1B90 verbose 'vm:/vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx'] Actual VM overhead: 510836736 bytes
Nov 24 06:23:45 Hostd: [2011-11-24 06:23:45.789 22EB1B90 verbose 'Vmsvc'] RefreshVms updated overhead for 1 VM
Nov 24 06:23:45 Vpxa: [2011-11-24 06:23:45.791 FFE5BB10 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:23:45 Vpxa: [2011-11-24 06:23:45.791 FFE5BB10 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 268 to 269 (at 268)
Nov 24 06:23:45 Vpxa: [2011-11-24 06:23:45.792 FFE5BB10 verbose 'App'] [VpxaHalVmHostagent] 672: Runtime changed 'runtime.memoryOverhead'
Nov 24 06:23:45 Vpxa: [2011-11-24 06:23:45.792 FFE5BB10 verbose 'App'] [VpxaHalServices] RuntimeChange Event for vm(2) 672
Nov 24 06:23:45 Vpxa: [2011-11-24 06:23:45.792 FFE5BB10 verbose 'App'] [VpxaInvtVmChangeListener] AAM won't be notifyed. vmid 2: notifyVMAP 0,isRestarting 0
Nov 24 06:23:45 Vpxa: [2011-11-24 06:23:45.792 FFE5BB10 verbose 'App'] [VpxaInvtHost] Increment master gen. no to (319): VmRuntime:VpxaInvtVmChangeListener::RuntimeChanged
Nov 24 06:23:47 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:50 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.946 1C785B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.946 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength 129)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.946 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Auto-completing at 129/129 bytes
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.946 1C5BEB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.946 1C5BEB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.947 1C744B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.947 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.947 1C5BEB90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.947 1C5BEB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.948 1C785B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.948 1C5BEB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.948 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@319-ea] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.948 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@319-ea] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.948 1C785B90 info 'App' opID=HB-host-9@319-ea] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-4
Nov 24 06:23:52 62a-a2de-0657c7cad3d9
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.948 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@319-ea] [1+] VpxaMoService::GetChanges
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.948 1C785B90 verbose 'App' opID=HB-host-9@319-ea] [VpxaMoService] GetChanges: 318 -> 319
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.950 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.950 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.950 1C807B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.951 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@319-ea] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.951 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@319-ea] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.951 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@319-ea] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.951 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.951 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@319-ea] [2-] VpxdDatastore::PrepareChanges (took 0 ms)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.951 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@319-ea] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.951 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1445 bytes)
Nov 24 06:23:52 Hostd: [2011-11-24 06:23:52.953 FFB6EE80 verbose 'ha-license-manager' opID=HB-host-9@319-ea] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.953 1C5FFB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.954 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:23:52 Hostd: [2011-11-24 06:23:52.964 FFB6EE80 info 'Libs' opID=HB-host-9@319-ea] Could not expand environment variable HOME.
Nov 24 06:23:52 Hostd: [2011-11-24 06:23:52.969 FFB6EE80 verbose 'App' opID=HB-host-9@319-ea] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" (lastError=0, desc.IsValid:Yes)
Nov 24 06:23:52 Hostd: [2011-11-24 06:23:52.971 FFB6EE80 info 'Libs' opID=HB-host-9@319-ea] Could not expand environment variable HOME.
Nov 24 06:23:52 Hostd: [2011-11-24 06:23:52.976 FFB6EE80 verbose 'Locale' opID=HB-host-9@319-ea] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected in module 'default'.
Nov 24 06:23:52 Hostd: [2011-11-24 06:23:52.976 FFB6EE80 verbose 'Locale' opID=HB-host-9@319-ea] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in module 'default'.
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.979 1C785B90 verbose 'App' opID=HB-host-9@319-ea] [VpxaMoService] host changes include changed properties []
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.980 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@319-ea] [2-] VpxaMoService::PrepareHostChanges (took 28 ms)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.980 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@319-ea] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.980 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@319-ea] [3+] HandleVMChanges for vmid:2
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.980 1C785B90 verbose 'App' opID=HB-host-9@319-ea] [VpxURL] Resolved localPath /vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx to URL sanfs://vmfs_uuid:4e407bca-a51d0e62-8a8c-00304
Nov 24 06:23:52 861ab4f/Nexenta-2_1/Nexenta-2.vmx
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.980 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@319-ea] [3-] HandleVMChanges for vmid:2 (took 0 ms)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.980 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@319-ea] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.981 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@319-ea] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.981 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@319-ea] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.981 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.981 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@319-ea] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.981 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@319-ea] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.981 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@319-ea] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.981 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@319-ea] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.981 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@319-ea] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.982 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@319-ea] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.982 1C785B90 verbose 'VpxaHalResourcePool' opID=HB-host-9@319-ea] NeedFullSync() = false
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.982 1C785B90 verbose 'VpxaHalResourcePool' opID=HB-host-9@319-ea] VpxaHalResourcePoolStandalone::GetVpxaMoRef(vim.ResourcePool:pool0) = vim.ResourcePool:/Resources/Extreme
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.982 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@319-ea] [1-] VpxaMoService::GetChanges (took 33 ms)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.982 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@319-ea] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.982 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@319-ea] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.982 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@319-ea] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.982 1C785B90 info 'App' opID=HB-host-9@319-ea] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-
Nov 24 06:23:52 462a-a2de-0657c7cad3d9
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.982 1C785B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]525e1515-33b9-7831-6a57-69d9e7360e1f
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.983 1C5BEB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.983 1C5BEB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.984 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 4318 bytes)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.988 1C681B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.988 1C848B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.988 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.988 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.989 1C6C2B90 info 'App' opID=HB-host-9@319-e3] [VpxLRO] -- BEGIN task-internal-153 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.989 1C6C2B90 verbose 'SoapAdapter.HTTPService' opID=HB-host-9@319-e3] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.989 1C6C2B90 info 'App' opID=HB-host-9@319-e3] [VpxLRO] -- FINISH task-internal-153 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.991 FFE5BB10 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.991 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.991 FFE5BB10 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.991 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.991 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:23:52 Vpxa: [2011-11-24 06:23:52.991 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:23:53 vmkernel: 0:14:39:04.155 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:23:53 vmkernel: 0:14:39:04.155 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:23:53 vmkernel: 0:14:39:04.155 cpu0:4117)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:23:53 vmkernel: 0:14:39:04.158 cpu0:4119)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:23:54 iscsid: connect failed (111,Connection refused)
Nov 24 06:23:54 vmkernel: 0:14:39:04.423 cpu3:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:23:54 vmkernel: 0:14:39:04.423 cpu3:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:23:54 vmkernel: 0:14:39:04.423 cpu3:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:23:54 vmkernel: 0:14:39:04.423 cpu3:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:23:55 vmkernel: 0:14:39:05.422 cpu3:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f3aea40
Nov 24 06:23:55 vmkernel: 0:14:39:05.422 cpu3:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:23:55 vmkernel: 0:14:39:05.422 cpu3:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:23:57 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:00 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:02 Vpxa: [2011-11-24 06:24:02.587 1C7C6B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:24:02 Vpxa: [2011-11-24 06:24:02.590 1C7C6B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:24:03 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:06 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:09 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:12 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:15 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:18 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:19 Vpxa: [2011-11-24 06:24:19.114 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:24:19 Vpxa: [2011-11-24 06:24:19.114 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:24:19 Vpxa: [2011-11-24 06:24:19.114 1C848B90 info 'App' opID=task-internal-154-d84b636a] [VpxLRO] -- BEGIN task-internal-154 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:24:19 Vpxa: [2011-11-24 06:24:19.115 1C848B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-154-d84b636a] HTTP Response: Complete (processed 1855 bytes)
Nov 24 06:24:19 Vpxa: [2011-11-24 06:24:19.115 1C848B90 info 'App' opID=task-internal-154-d84b636a] [VpxLRO] -- FINISH task-internal-154 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:24:19 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:24:19 Hostd: [2011-11-24 06:24:19.379 23581B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:24:21 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:22 Vpxa: [2011-11-24 06:24:22.587 1C785B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:24:22 Vpxa: [2011-11-24 06:24:22.590 1C785B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:24:24 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:27 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:30 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:33 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:33 vmkernel: 0:14:39:44.158 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:24:33 vmkernel: 0:14:39:44.158 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:24:33 vmkernel: 0:14:39:44.158 cpu0:4119)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:24:33 vmkernel: 0:14:39:44.204 cpu7:4118)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:24:34 vmkernel: 0:14:39:44.424 cpu4:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:24:34 vmkernel: 0:14:39:44.424 cpu4:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:24:34 vmkernel: 0:14:39:44.424 cpu4:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:24:34 vmkernel: 0:14:39:44.424 cpu4:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:24:35 vmkernel: 0:14:39:45.423 cpu4:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f420d40
Nov 24 06:24:35 vmkernel: 0:14:39:45.423 cpu4:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:24:35 vmkernel: 0:14:39:45.423 cpu4:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:24:36 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:39 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:42 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:42 Vpxa: [2011-11-24 06:24:42.587 1C253B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:24:42 Vpxa: [2011-11-24 06:24:42.590 1C253B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:24:45 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:45 Hostd: [2011-11-24 06:24:45.669 235C2B90 verbose 'DvsManager'] PersistAllDvsInfo called
Nov 24 06:24:48 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:51 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:54 iscsid: connect failed (111,Connection refused)
Nov 24 06:24:57 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:00 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:02 Vpxa: [2011-11-24 06:25:02.588 1C889B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:25:02 Vpxa: [2011-11-24 06:25:02.590 1C889B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:25:03 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:06 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:08 Hostd: [2011-11-24 06:25:08.294 FFB6EE80 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:25:08 Hostd: [2011-11-24 06:25:08.597 23540B90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:25:08 Vpxa: [2011-11-24 06:25:08.600 1C681B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:25:08 Vpxa: [2011-11-24 06:25:08.600 1C681B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 269 to 270 (at 269)
Nov 24 06:25:08 Vpxa: [2011-11-24 06:25:08.600 1C681B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:25:09 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:12 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:13 vmkernel: 0:14:40:24.205 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:25:13 vmkernel: 0:14:40:24.205 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:25:13 vmkernel: 0:14:40:24.205 cpu7:4118)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:25:14 vmkernel: 0:14:40:24.268 cpu0:4117)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:25:14 vmkernel: 0:14:40:24.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:25:14 vmkernel: 0:14:40:24.422 cpu6:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:25:14 vmkernel: 0:14:40:24.422 cpu6:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:25:14 vmkernel: 0:14:40:24.422 cpu6:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:25:15 vmkernel: 0:14:40:25.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f402d40
Nov 24 06:25:15 vmkernel: 0:14:40:25.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:25:15 vmkernel: 0:14:40:25.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:25:15 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:18 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:19 Vpxa: [2011-11-24 06:25:19.115 1C744B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:25:19 Vpxa: [2011-11-24 06:25:19.115 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:25:19 Vpxa: [2011-11-24 06:25:19.116 1C785B90 info 'App' opID=task-internal-155-5db31ba5] [VpxLRO] -- BEGIN task-internal-155 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:25:19 Vpxa: [2011-11-24 06:25:19.116 1C785B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-155-5db31ba5] HTTP Response: Complete (processed 1855 bytes)
Nov 24 06:25:19 Vpxa: [2011-11-24 06:25:19.117 1C785B90 info 'App' opID=task-internal-155-5db31ba5] [VpxLRO] -- FINISH task-internal-155 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:25:19 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:25:19 Hostd: [2011-11-24 06:25:19.484 221CAB90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:25:21 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:22 Vpxa: [2011-11-24 06:25:22.588 1C6C2B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:25:22 Vpxa: [2011-11-24 06:25:22.591 1C6C2B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:25:24 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:27 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:30 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:33 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:36 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:39 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:42 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:42 Vpxa: [2011-11-24 06:25:42.588 1C744B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:25:42 Vpxa: [2011-11-24 06:25:42.591 1C744B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:25:45 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:48 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:51 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:54 vmkernel: 0:14:41:04.268 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:25:54 vmkernel: 0:14:41:04.268 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:25:54 vmkernel: 0:14:41:04.268 cpu1:4117)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:25:54 vmkernel: 0:14:41:04.333 cpu5:4119)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:25:54 vmkernel: 0:14:41:04.423 cpu2:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:25:54 vmkernel: 0:14:41:04.423 cpu2:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:25:54 vmkernel: 0:14:41:04.423 cpu2:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:25:54 vmkernel: 0:14:41:04.423 cpu2:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:25:54 iscsid: connect failed (111,Connection refused)
Nov 24 06:25:55 vmkernel: 0:14:41:05.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f414e40
Nov 24 06:25:55 vmkernel: 0:14:41:05.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:25:55 vmkernel: 0:14:41:05.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:25:57 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:00 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:02 Vpxa: [2011-11-24 06:26:02.588 1C5BEB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:26:02 Vpxa: [2011-11-24 06:26:02.591 1C5BEB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:26:03 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:06 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:09 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:12 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:15 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:18 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:19 Vpxa: [2011-11-24 06:26:19.117 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:26:19 Vpxa: [2011-11-24 06:26:19.118 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:26:19 Vpxa: [2011-11-24 06:26:19.118 1C889B90 info 'App' opID=task-internal-156-4f0ac71a] [VpxLRO] -- BEGIN task-internal-156 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:26:19 Vpxa: [2011-11-24 06:26:19.119 1C889B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-156-4f0ac71a] HTTP Response: Complete (processed 1855 bytes)
Nov 24 06:26:19 Vpxa: [2011-11-24 06:26:19.119 1C889B90 info 'App' opID=task-internal-156-4f0ac71a] [VpxLRO] -- FINISH task-internal-156 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:26:19 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:26:19 Hostd: [2011-11-24 06:26:19.593 22EB1B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:26:21 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:22 Vpxa: [2011-11-24 06:26:22.589 1C848B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:26:22 Vpxa: [2011-11-24 06:26:22.591 1C848B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:26:24 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:27 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:30 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:33 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:34 vmkernel: 0:14:41:44.333 cpu3:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:26:34 vmkernel: 0:14:41:44.333 cpu3:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:26:34 vmkernel: 0:14:41:44.333 cpu5:4119)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:26:34 vmkernel: 0:14:41:44.340 cpu7:4118)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:26:34 vmkernel: 0:14:41:44.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:26:34 vmkernel: 0:14:41:44.423 cpu7:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:26:34 vmkernel: 0:14:41:44.423 cpu7:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:26:34 vmkernel: 0:14:41:44.423 cpu7:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:26:35 vmkernel: 0:14:41:45.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f37c340
Nov 24 06:26:35 vmkernel: 0:14:41:45.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:26:35 vmkernel: 0:14:41:45.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:26:36 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:38 Hostd: [2011-11-24 06:26:38.598 233C2B90 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:26:38 Hostd: [2011-11-24 06:26:38.885 23581B90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:26:38 Hostd: [2011-11-24 06:26:38.885 23581B90 info 'Snmpsvc'] UpdateSystemIssues: 0 out of 7 total items reporting non-normal state, 0 are new
Nov 24 06:26:38 Vpxa: [2011-11-24 06:26:38.888 1C807B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:26:38 Vpxa: [2011-11-24 06:26:38.888 1C807B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 270 to 271 (at 270)
Nov 24 06:26:38 Vpxa: [2011-11-24 06:26:38.888 1C807B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:26:39 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:42 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:42 Vpxa: [2011-11-24 06:26:42.590 1C785B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:26:42 Vpxa: [2011-11-24 06:26:42.593 1C785B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:26:45 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:45 Hostd: [2011-11-24 06:26:45.792 23340B90 verbose 'vm:/vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx'] Actual VM overhead: 511348736 bytes
Nov 24 06:26:45 Hostd: [2011-11-24 06:26:45.792 23340B90 verbose 'Vmsvc'] RefreshVms updated overhead for 1 VM
Nov 24 06:26:45 Vpxa: [2011-11-24 06:26:45.794 1C6C2B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:26:45 Vpxa: [2011-11-24 06:26:45.794 1C6C2B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 271 to 272 (at 271)
Nov 24 06:26:45 Vpxa: [2011-11-24 06:26:45.794 1C6C2B90 verbose 'App'] [VpxaHalVmHostagent] 672: Runtime changed 'runtime.memoryOverhead'
Nov 24 06:26:45 Vpxa: [2011-11-24 06:26:45.794 1C6C2B90 verbose 'App'] [VpxaHalServices] RuntimeChange Event for vm(2) 672
Nov 24 06:26:45 Vpxa: [2011-11-24 06:26:45.794 1C6C2B90 verbose 'App'] [VpxaInvtVmChangeListener] AAM won't be notifyed. vmid 2: notifyVMAP 0,isRestarting 0
Nov 24 06:26:45 Vpxa: [2011-11-24 06:26:45.795 1C6C2B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no to (320): VmRuntime:VpxaInvtVmChangeListener::RuntimeChanged
Nov 24 06:26:48 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:51 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.969 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.969 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.969 1C5FFB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.969 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength 129)
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.969 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Auto-completing at 129/129 bytes
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.969 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.969 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.969 1C253B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.970 1C253B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.970 1C5FFB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.970 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.970 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@320-7a] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.970 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@320-7a] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.970 1C5FFB90 info 'App' opID=HB-host-9@320-7a] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-4
Nov 24 06:26:52 62a-a2de-0657c7cad3d9
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.970 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@320-7a] [1+] VpxaMoService::GetChanges
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.970 1C5FFB90 verbose 'App' opID=HB-host-9@320-7a] [VpxaMoService] GetChanges: 319 -> 320
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.972 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.972 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.973 1C889B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.973 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@320-7a] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.973 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@320-7a] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.973 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@320-7a] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.973 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@320-7a] [2-] VpxdDatastore::PrepareChanges (took 0 ms)
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.973 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@320-7a] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.973 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.973 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1446 bytes)
Nov 24 06:26:52 Hostd: [2011-11-24 06:26:52.975 23540B90 verbose 'ha-license-manager' opID=HB-host-9@320-7a] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.975 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:26:52 Vpxa: [2011-11-24 06:26:52.975 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:26:52 Hostd: [2011-11-24 06:26:52.986 23540B90 info 'Libs' opID=HB-host-9@320-7a] Could not expand environment variable HOME.
Nov 24 06:26:52 Hostd: [2011-11-24 06:26:52.991 23540B90 verbose 'App' opID=HB-host-9@320-7a] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" (lastError=0, desc.IsValid:Yes)
Nov 24 06:26:52 Hostd: [2011-11-24 06:26:52.993 23540B90 info 'Libs' opID=HB-host-9@320-7a] Could not expand environment variable HOME.
Nov 24 06:26:52 Hostd: [2011-11-24 06:26:52.998 23540B90 verbose 'Locale' opID=HB-host-9@320-7a] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected in module 'default'.
Nov 24 06:26:52 Hostd: [2011-11-24 06:26:52.998 23540B90 verbose 'Locale' opID=HB-host-9@320-7a] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in module 'default'.
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.001 1C5FFB90 verbose 'App' opID=HB-host-9@320-7a] [VpxaMoService] host changes include changed properties []
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.001 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@320-7a] [2-] VpxaMoService::PrepareHostChanges (took 28 ms)
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.001 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@320-7a] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.002 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@320-7a] [3+] HandleVMChanges for vmid:2
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.002 1C5FFB90 verbose 'App' opID=HB-host-9@320-7a] [VpxURL] Resolved localPath /vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx to URL sanfs://vmfs_uuid:4e407bca-a51d0e62-8a8c-00304
Nov 24 06:26:53 861ab4f/Nexenta-2_1/Nexenta-2.vmx
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.002 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@320-7a] [3-] HandleVMChanges for vmid:2 (took 0 ms)
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.002 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@320-7a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.002 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@320-7a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.002 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@320-7a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.003 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@320-7a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.003 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.003 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@320-7a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.003 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@320-7a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.003 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@320-7a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.003 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@320-7a] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.003 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@320-7a] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.003 1C5FFB90 verbose 'VpxaHalResourcePool' opID=HB-host-9@320-7a] NeedFullSync() = false
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.003 1C5FFB90 verbose 'VpxaHalResourcePool' opID=HB-host-9@320-7a] VpxaHalResourcePoolStandalone::GetVpxaMoRef(vim.ResourcePool:pool0) = vim.ResourcePool:/Resources/Extreme
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.003 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@320-7a] [1-] VpxaMoService::GetChanges (took 33 ms)
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.003 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@320-7a] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.004 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@320-7a] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.004 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@320-7a] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.004 1C5FFB90 info 'App' opID=HB-host-9@320-7a] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-
Nov 24 06:26:53 462a-a2de-0657c7cad3d9
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.004 1C5FFB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]5265242c-7a93-4e9c-4794-910e4a0f62a0
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.004 1C744B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.005 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.005 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 4318 bytes)
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.008 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.008 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.008 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.008 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.009 1C807B90 info 'App' opID=HB-host-9@320-84] [VpxLRO] -- BEGIN task-internal-157 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.009 1C807B90 verbose 'SoapAdapter.HTTPService' opID=HB-host-9@320-84] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.009 1C807B90 info 'App' opID=HB-host-9@320-84] [VpxLRO] -- FINISH task-internal-157 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.011 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.011 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.011 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.011 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.011 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:26:53 Vpxa: [2011-11-24 06:26:53.011 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:26:54 iscsid: connect failed (111,Connection refused)
Nov 24 06:26:57 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:00 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:02 Vpxa: [2011-11-24 06:27:02.590 1C253B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:27:02 Vpxa: [2011-11-24 06:27:02.593 1C253B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:27:03 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:06 Vpxa: [2011-11-24 06:27:06.476 1C785B90 verbose 'VpxProfiler'] [1+] CheckEnvBrowserChanges
Nov 24 06:27:06 Hostd: [2011-11-24 06:27:06.507 23540B90 verbose 'DvsTracker'] FetchSwitches: added 0 items
Nov 24 06:27:06 Hostd: [2011-11-24 06:27:06.507 23540B90 verbose 'DvsTracker'] FetchDVPortgroups: added 0 items
Nov 24 06:27:06 Hostd: [2011-11-24 06:27:06.508 23540B90 verbose 'EnvironmentBrowser'] Skipped inaccessible datastore 4ec91116-e8cb5ca2-cc51-000423a5c8f0.
Nov 24 06:27:06 Vpxa: [2011-11-24 06:27:06.516 1C785B90 verbose 'VpxProfiler'] [1-] CheckEnvBrowserChanges (took 39 ms)
Nov 24 06:27:06 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:09 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:12 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:13 Hostd: [2011-11-24 06:27:13.798 223A9B90 verbose 'FSVolumeProvider'] RefreshOneNasVolume called on MEM-SRV-VC-1:/NFS
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.824 1C7C6B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.824 1C7C6B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 272 to 273 (at 272)
Nov 24 06:27:13 Hostd: [2011-11-24 06:27:13.825 22EB1B90 verbose 'FSVolumeProvider'] RefreshOneVmfsVolume on /vmfs/volumes/4e3ca8cb-2c9d3330-d70d-000423a5c8f0
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.825 1C7C6B90 verbose 'App'] [VpxaDatastore] url: netfs://192.168.11.147//NFS/
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.830 1C889B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.830 1C889B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 273 to 274 (at 273)
Nov 24 06:27:13 Hostd: [2011-11-24 06:27:13.831 23581B90 verbose 'FSVolumeProvider'] RefreshOneVmfsVolume on /vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.831 1C889B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4e3ca8cb-2c9d3330-d70d-000423a5c8f0/
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.831 1C889B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (321): DetailPropertyChanged
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.869 1C681B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:27:13 Hostd: [2011-11-24 06:27:13.869 235C2B90 verbose 'FSVolumeProvider'] RefreshOneVmfsVolume on /vmfs/volumes/4ec82f79-02ffca76-419b-000423a5c8f0
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.869 1C681B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 274 to 275 (at 274)
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.870 1C681B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4e407bca-a51d0e62-8a8c-00304861ab4f/
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.870 1C681B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (322): DetailPropertyChanged
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.876 1C848B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.876 1C848B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 275 to 276 (at 275)
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.877 1C848B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec82f79-02ffca76-419b-000423a5c8f0/
Nov 24 06:27:13 Hostd: [2011-11-24 06:27:13.877 22EB1B90 verbose 'FSVolumeProvider'] RefreshOneVmfsVolume on /vmfs/volumes/4ec85bfd-2986b246-6b0a-000423a5c8f0
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.877 1C848B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (323): DetailPropertyChanged
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.884 1C848B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.884 1C848B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 276 to 277 (at 276)
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.884 1C848B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec85bfd-2986b246-6b0a-000423a5c8f0/
Nov 24 06:27:13 Hostd: [2011-11-24 06:27:13.884 235C2B90 verbose 'FSVolumeProvider'] RefreshOneVmfsVolume on /vmfs/volumes/4ec85fef-884cf2dc-9689-000423a5c8f0
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.885 1C848B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (324): DetailPropertyChanged
Nov 24 06:27:13 Hostd: [2011-11-24 06:27:13.891 235C2B90 verbose 'FSVolumeProvider'] RefreshOneVmfsVolume on /vmfs/volumes/4ec8600e-14752f7c-1a51-000423a5c8f0
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.891 1C681B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.891 1C681B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 277 to 278 (at 277)
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.892 1C681B90 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec85fef-884cf2dc-9689-000423a5c8f0/
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.892 1C681B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no (325): DetailPropertyChanged
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.918 FFE5BB10 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.918 FFE5BB10 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 278 to 279 (at 278)
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.919 FFE5BB10 verbose 'App'] [VpxaDatastore] url: sanfs://vmfs_uuid:4ec8600e-14752f7c-1a51-000423a5c8f0/
Nov 24 06:27:13 Vpxa: [2011-11-24 06:27:13.919 FFE5BB10 verbose 'App'] [VpxaInvtHost] Increment master gen. no (326): DetailPropertyChanged
Nov 24 06:27:14 vmkernel: 0:14:42:24.340 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:27:14 vmkernel: 0:14:42:24.340 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:27:14 vmkernel: 0:14:42:24.340 cpu2:4118)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:27:14 vmkernel: 0:14:42:24.348 cpu1:4117)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:27:14 vmkernel: 0:14:42:24.422 cpu2:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:27:14 vmkernel: 0:14:42:24.422 cpu2:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:27:14 vmkernel: 0:14:42:24.422 cpu2:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:27:14 vmkernel: 0:14:42:24.422 cpu2:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:27:15 vmkernel: 0:14:42:25.424 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f43ab40
Nov 24 06:27:15 vmkernel: 0:14:42:25.424 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:27:15 vmkernel: 0:14:42:25.424 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:27:15 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:18 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:19 Vpxa: [2011-11-24 06:27:19.119 1C848B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:27:19 Vpxa: [2011-11-24 06:27:19.119 1C848B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:27:19 Vpxa: [2011-11-24 06:27:19.120 1C744B90 info 'App' opID=task-internal-158-b414a2d9] [VpxLRO] -- BEGIN task-internal-158 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:27:19 Vpxa: [2011-11-24 06:27:19.120 1C744B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-158-b414a2d9] HTTP Response: Complete (processed 1855 bytes)
Nov 24 06:27:19 Vpxa: [2011-11-24 06:27:19.120 1C744B90 info 'App' opID=task-internal-158-b414a2d9] [VpxLRO] -- FINISH task-internal-158 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:27:19 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:27:19 Hostd: [2011-11-24 06:27:19.703 221CAB90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:27:21 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.590 1C889B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.593 1C889B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.972 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.972 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.972 1C5FFB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.972 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.973 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength 129)
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.973 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.973 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Auto-completing at 129/129 bytes
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.973 1C37CB90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.973 1C37CB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.974 1C5FFB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.974 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.974 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@326-69] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.974 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@326-69] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.974 1C5FFB90 info 'App' opID=HB-host-9@326-69] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-4
Nov 24 06:27:22 62a-a2de-0657c7cad3d9
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.974 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@326-69] [1+] VpxaMoService::GetChanges
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.974 1C5FFB90 verbose 'App' opID=HB-host-9@326-69] [VpxaMoService] GetChanges: 320 -> 326
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.976 FFE5BB10 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.976 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.976 FFE5BB10 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.977 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@326-69] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.977 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@326-69] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.977 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@326-69] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.977 FFE5BB10 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.977 1C744B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1446 bytes)
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.977 1C5FFB90 verbose 'App' opID=HB-host-9@326-69] [VpxaDatastore] Getting datastore list for LoadSchemas...
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.979 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.979 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.983 1C5FFB90 verbose 'App' opID=HB-host-9@326-69] [VpxaDatastore] Got datastore list for LoadSchemas
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.984 1C5FFB90 verbose 'App' opID=HB-host-9@326-69] [VpxFileSystem::LoadSchemas] Reloaded cache
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.984 1C5FFB90 verbose 'App' opID=HB-host-9@326-69] Loaded filesystem schemas
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.985 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@326-69] [2-] VpxdDatastore::PrepareChanges (took 7 ms)
Nov 24 06:27:22 Vpxa: [2011-11-24 06:27:22.985 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@326-69] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:27:22 Hostd: [2011-11-24 06:27:22.986 FFB6EE80 verbose 'ha-license-manager' opID=HB-host-9@326-69] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:27:22 Hostd: [2011-11-24 06:27:22.998 FFB6EE80 info 'Libs' opID=HB-host-9@326-69] Could not expand environment variable HOME.
Nov 24 06:27:23 Hostd: [2011-11-24 06:27:23.003 FFB6EE80 verbose 'App' opID=HB-host-9@326-69] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" (lastError=0, desc.IsValid:Yes)
Nov 24 06:27:23 Hostd: [2011-11-24 06:27:23.005 FFB6EE80 info 'Libs' opID=HB-host-9@326-69] Could not expand environment variable HOME.
Nov 24 06:27:23 Hostd: [2011-11-24 06:27:23.010 FFB6EE80 verbose 'Locale' opID=HB-host-9@326-69] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected in module 'default'.
Nov 24 06:27:23 Hostd: [2011-11-24 06:27:23.010 FFB6EE80 verbose 'Locale' opID=HB-host-9@326-69] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in module 'default'.
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.013 1C5FFB90 verbose 'App' opID=HB-host-9@326-69] [VpxaMoService] host changes include changed properties []
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.013 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@326-69] [2-] VpxaMoService::PrepareHostChanges (took 28 ms)
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.013 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@326-69] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.013 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@326-69] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.013 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@326-69] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.014 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@326-69] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.014 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@326-69] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.014 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.014 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@326-69] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.014 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@326-69] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.014 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@326-69] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.014 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@326-69] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.014 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@326-69] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.014 1C5FFB90 verbose 'VpxaHalResourcePool' opID=HB-host-9@326-69] NeedFullSync() = false
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.014 1C5FFB90 verbose 'VpxProfiler' opID=HB-host-9@326-69] [1-] VpxaMoService::GetChanges (took 40 ms)
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.015 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@326-69] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.015 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@326-69] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.015 1C5FFB90 verbose 'PropertyProvider' opID=HB-host-9@326-69] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.015 1C5FFB90 info 'App' opID=HB-host-9@326-69] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-
Nov 24 06:27:23 462a-a2de-0657c7cad3d9
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.015 1C5FFB90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]522a0d21-a1c6-30eb-8c25-135bb0a5e87c
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.016 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.016 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.018 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 10063 bytes)
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.021 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.021 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.022 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.022 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.022 1C848B90 info 'App' opID=HB-host-9@326-b2] [VpxLRO] -- BEGIN task-internal-159 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.022 1C848B90 verbose 'SoapAdapter.HTTPService' opID=HB-host-9@326-b2] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.023 1C848B90 info 'App' opID=HB-host-9@326-b2] [VpxLRO] -- FINISH task-internal-159 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.024 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.024 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.025 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.025 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.025 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:27:23 Vpxa: [2011-11-24 06:27:23.025 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:27:24 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:27 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:30 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:33 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:36 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:39 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:42 Vpxa: [2011-11-24 06:27:42.590 1C5FFB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:27:42 Vpxa: [2011-11-24 06:27:42.593 1C5FFB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:27:42 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:45 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:48 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:51 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:54 vmkernel: 0:14:43:04.348 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:27:54 vmkernel: 0:14:43:04.348 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:27:54 vmkernel: 0:14:43:04.348 cpu0:4117)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:27:54 vmkernel: 0:14:43:04.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:27:54 vmkernel: 0:14:43:04.453 cpu5:4119)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:27:54 vmkernel: 0:14:43:04.453 cpu5:4119)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:27:54 vmkernel: 0:14:43:04.453 cpu5:4119)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:27:54 vmkernel: 0:14:43:04.453 cpu5:4119)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:27:54 iscsid: connect failed (111,Connection refused)
Nov 24 06:27:55 vmkernel: 0:14:43:05.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f488d40
Nov 24 06:27:55 vmkernel: 0:14:43:05.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:27:55 vmkernel: 0:14:43:05.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:27:57 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:00 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:02 Vpxa: [2011-11-24 06:28:02.590 1C848B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:28:02 Vpxa: [2011-11-24 06:28:02.593 1C848B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:28:03 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:04 dropbear[120378]: exit after auth (root): Exited normally
Nov 24 06:28:06 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:08 Hostd: [2011-11-24 06:28:08.886 23340B90 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:28:09 Hostd: [2011-11-24 06:28:09.189 233C2B90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:28:09 Vpxa: [2011-11-24 06:28:09.192 1C6C2B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:28:09 Vpxa: [2011-11-24 06:28:09.192 1C6C2B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 279 to 280 (at 279)
Nov 24 06:28:09 Vpxa: [2011-11-24 06:28:09.192 1C6C2B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:28:09 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:12 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:15 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:18 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:19 Vpxa: [2011-11-24 06:28:19.121 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:28:19 Vpxa: [2011-11-24 06:28:19.121 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:28:19 Vpxa: [2011-11-24 06:28:19.121 1C5FFB90 info 'App' opID=task-internal-160-80f44a65] [VpxLRO] -- BEGIN task-internal-160 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:28:19 Vpxa: [2011-11-24 06:28:19.122 1C5FFB90 verbose 'SoapAdapter.HTTPService' opID=task-internal-160-80f44a65] HTTP Response: Complete (processed 1857 bytes)
Nov 24 06:28:19 Vpxa: [2011-11-24 06:28:19.122 1C5FFB90 info 'App' opID=task-internal-160-80f44a65] [VpxLRO] -- FINISH task-internal-160 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:28:19 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:28:19 Hostd: [2011-11-24 06:28:19.811 22EF2B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:28:21 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:22 Vpxa: [2011-11-24 06:28:22.591 1C6C2B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:28:22 Vpxa: [2011-11-24 06:28:22.594 1C6C2B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:28:24 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:27 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:30 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:33 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:34 vmkernel: 0:14:43:44.453 cpu2:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:28:34 vmkernel: 0:14:43:44.453 cpu2:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:28:34 vmkernel: 0:14:43:44.453 cpu5:4119)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:28:34 vmkernel: 0:14:43:44.457 cpu2:4118)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:28:35 vmkernel: 0:14:43:45.422 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:28:35 vmkernel: 0:14:43:45.422 cpu7:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:28:35 vmkernel: 0:14:43:45.422 cpu7:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:28:35 vmkernel: 0:14:43:45.422 cpu7:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:28:36 vmkernel: 0:14:43:46.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f4b0640
Nov 24 06:28:36 vmkernel: 0:14:43:46.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:28:36 vmkernel: 0:14:43:46.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:28:36 dropbear[123227]: Child connection from 192.168.11.147:21727
Nov 24 06:28:36 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:38 dropbear[123227]: pam_per_user: create_subrequest_handle(): doing map lookup for user "root"
Nov 24 06:28:38 dropbear[123227]: pam_per_user: create_subrequest_handle(): creating new subrequest (user="root", service="system-auth-generic")
Nov 24 06:28:38 dropbear[123227]: PAM password auth succeeded for 'root' from 192.168.11.147:21727
Nov 24 06:28:38 dropbear[123227]: exit after auth (root): Exited normally
Nov 24 06:28:39 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:42 Vpxa: [2011-11-24 06:28:42.591 1C744B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:28:42 Vpxa: [2011-11-24 06:28:42.594 1C744B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:28:42 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:43 dropbear[123235]: Child connection from 192.168.11.147:21731
Nov 24 06:28:43 dropbear[123235]: pam_per_user: create_subrequest_handle(): doing map lookup for user "root"
Nov 24 06:28:43 dropbear[123235]: pam_per_user: create_subrequest_handle(): creating new subrequest (user="root", service="system-auth-generic")
Nov 24 06:28:43 dropbear[123235]: PAM password auth succeeded for 'root' from 192.168.11.147:21731
Nov 24 06:28:44 dropbear[123235]: exit after auth (root): Exited normally
Nov 24 06:28:45 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:48 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:51 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:54 iscsid: connect failed (111,Connection refused)
Nov 24 06:28:57 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:00 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:02 Vpxa: [2011-11-24 06:29:02.591 1C889B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:29:02 Vpxa: [2011-11-24 06:29:02.594 1C889B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:29:03 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:06 dropbear[123238]: Child connection from 192.168.11.147:21736
Nov 24 06:29:06 dropbear[123238]: pam_per_user: create_subrequest_handle(): doing map lookup for user "root"
Nov 24 06:29:06 dropbear[123238]: pam_per_user: create_subrequest_handle(): creating new subrequest (user="root", service="system-auth-generic")
Nov 24 06:29:06 dropbear[123238]: PAM password auth succeeded for 'root' from 192.168.11.147:21736
Nov 24 06:29:06 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:09 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:13 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:14 vmkernel: 0:14:44:24.457 cpu3:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:29:14 vmkernel: 0:14:44:24.457 cpu3:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:29:14 vmkernel: 0:14:44:24.457 cpu2:4118)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:29:14 vmkernel: 0:14:44:24.457 cpu2:4118)WARNING: FS3: 7333: Reclaiming timed out heartbeat [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46] failed: Timeout
Nov 24 06:29:14 vmkernel: 0:14:44:24.524 cpu0:4117)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:29:15 vmkernel: 0:14:44:25.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:29:15 vmkernel: 0:14:44:25.423 cpu5:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:29:15 vmkernel: 0:14:44:25.423 cpu5:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:29:15 vmkernel: 0:14:44:25.423 cpu5:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:29:16 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:16 vmkernel: 0:14:44:26.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f3eac40
Nov 24 06:29:16 vmkernel: 0:14:44:26.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:29:16 vmkernel: 0:14:44:26.423 cpu5:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:29:19 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:19 Vpxa: [2011-11-24 06:29:19.122 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:29:19 Vpxa: [2011-11-24 06:29:19.122 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:29:19 Vpxa: [2011-11-24 06:29:19.123 FFE5BB10 info 'App' opID=task-internal-161-5c413fe] [VpxLRO] -- BEGIN task-internal-161 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:29:19 Vpxa: [2011-11-24 06:29:19.123 FFE5BB10 verbose 'SoapAdapter.HTTPService' opID=task-internal-161-5c413fe] HTTP Response: Complete (processed 1857 bytes)
Nov 24 06:29:19 Vpxa: [2011-11-24 06:29:19.124 FFE5BB10 info 'App' opID=task-internal-161-5c413fe] [VpxLRO] -- FINISH task-internal-161 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:29:19 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:29:19 Hostd: [2011-11-24 06:29:19.920 23581B90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:29:22 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:22 Vpxa: [2011-11-24 06:29:22.591 1C848B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:29:22 Vpxa: [2011-11-24 06:29:22.594 1C848B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:29:25 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:28 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:29 dropbear[123238]: exit after auth (root): Exited normally
Nov 24 06:29:31 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:34 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:37 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:39 Hostd: [2011-11-24 06:29:39.191 221CAB90 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Nov 24 06:29:39 Hostd: [2011-11-24 06:29:39.480 233C2B90 verbose 'Snmpsvc'] ProcessDiscreteSensor: Reported 0 out of 0
Nov 24 06:29:39 Vpxa: [2011-11-24 06:29:39.482 1C744B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:29:39 Vpxa: [2011-11-24 06:29:39.483 1C744B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 280 to 281 (at 280)
Nov 24 06:29:39 Vpxa: [2011-11-24 06:29:39.483 1C744B90 verbose 'App'] [VpxaHalServices] HostChanged Event Fired, properties changed []
Nov 24 06:29:40 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:42 Vpxa: [2011-11-24 06:29:42.592 1C744B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:29:42 Vpxa: [2011-11-24 06:29:42.595 1C744B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:29:43 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:45 Hostd: [2011-11-24 06:29:45.670 235C2B90 verbose 'DvsManager'] PersistAllDvsInfo called
Nov 24 06:29:45 Hostd: [2011-11-24 06:29:45.794 233C2B90 verbose 'vm:/vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx'] Actual VM overhead: 509227008 bytes
Nov 24 06:29:45 Hostd: [2011-11-24 06:29:45.795 233C2B90 verbose 'Vmsvc'] RefreshVms updated overhead for 1 VM
Nov 24 06:29:45 Vpxa: [2011-11-24 06:29:45.796 1C744B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:29:45 Vpxa: [2011-11-24 06:29:45.796 1C744B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 281 to 282 (at 281)
Nov 24 06:29:45 Vpxa: [2011-11-24 06:29:45.796 1C744B90 verbose 'App'] [VpxaHalVmHostagent] 672: Runtime changed 'runtime.memoryOverhead'
Nov 24 06:29:45 Vpxa: [2011-11-24 06:29:45.797 1C744B90 verbose 'App'] [VpxaHalServices] RuntimeChange Event for vm(2) 672
Nov 24 06:29:45 Vpxa: [2011-11-24 06:29:45.797 1C744B90 verbose 'App'] [VpxaInvtVmChangeListener] AAM won't be notifyed. vmid 2: notifyVMAP 0,isRestarting 0
Nov 24 06:29:45 Vpxa: [2011-11-24 06:29:45.797 1C744B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no to (327): VmRuntime:VpxaInvtVmChangeListener::RuntimeChanged
Nov 24 06:29:46 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:49 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:49 dropbear[123464]: Child connection from 192.168.11.147:21751
Nov 24 06:29:49 dropbear[123464]: pam_per_user: create_subrequest_handle(): doing map lookup for user "root"
Nov 24 06:29:49 dropbear[123464]: pam_per_user: create_subrequest_handle(): creating new subrequest (user="root", service="system-auth-generic")
Nov 24 06:29:49 dropbear[123464]: PAM password auth succeeded for 'root' from 192.168.11.147:21751
Nov 24 06:29:52 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.994 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.994 1C253B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.994 1C785B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.994 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.994 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength 129)
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.995 1C785B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.995 1C253B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Auto-completing at 129/129 bytes
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.995 1C807B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.996 1C807B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.reason, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.996 1C785B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.startTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.996 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 522 bytes)
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.996 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@327-e2] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.996 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@327-e2] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.996 1C785B90 info 'App' opID=HB-host-9@327-e2] [VpxLRO] -- BEGIN session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-4
Nov 24 06:29:52 62a-a2de-0657c7cad3d9
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.996 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@327-e2] [1+] VpxaMoService::GetChanges
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.996 1C785B90 verbose 'App' opID=HB-host-9@327-e2] [VpxaMoService] GetChanges: 326 -> 327
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.998 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.998 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.998 1C37CB90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.999 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.999 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@327-e2] [2+] VpxaStatsMetadata::PrepareStatsChanges
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.999 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@327-e2] [2-] VpxaStatsMetadata::PrepareStatsChanges (took 0 ms)
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.999 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@327-e2] [2+] VpxdDatastore::PrepareChanges
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.999 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@327-e2] [2-] VpxdDatastore::PrepareChanges (took 0 ms)
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.999 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@327-e2] [2+] VpxaMoService::PrepareHostChanges
Nov 24 06:29:52 Vpxa: [2011-11-24 06:29:52.999 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 1445 bytes)
Nov 24 06:29:53 Hostd: [2011-11-24 06:29:53.001 22EB1B90 verbose 'ha-license-manager' opID=HB-host-9@327-e2] Load: Loading existing file: /etc/vmware/license.cfg
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.001 1C807B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.001 1C807B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:29:53 Hostd: [2011-11-24 06:29:53.013 22EB1B90 info 'Libs' opID=HB-host-9@327-e2] Could not expand environment variable HOME.
Nov 24 06:29:53 Hostd: [2011-11-24 06:29:53.018 22EB1B90 verbose 'App' opID=HB-host-9@327-e2] ha-license-manager:Validate -> Valid license detected for "VMware ESX Server 4.0" (lastError=0, desc.IsValid:Yes)
Nov 24 06:29:53 Hostd: [2011-11-24 06:29:53.020 22EB1B90 info 'Libs' opID=HB-host-9@327-e2] Could not expand environment variable HOME.
Nov 24 06:29:53 Hostd: [2011-11-24 06:29:53.025 22EB1B90 verbose 'Locale' opID=HB-host-9@327-e2] Default resource used for 'LicenseManager.LicenseInfo.dpvmotion.label' expected in module 'default'.
Nov 24 06:29:53 Hostd: [2011-11-24 06:29:53.025 22EB1B90 verbose 'Locale' opID=HB-host-9@327-e2] Default resource used for 'LicenseManager.LicenseInfo.vaai.label' expected in module 'default'.
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.028 1C785B90 verbose 'App' opID=HB-host-9@327-e2] [VpxaMoService] host changes include changed properties []
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.028 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@327-e2] [2-] VpxaMoService::PrepareHostChanges (took 29 ms)
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.028 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@327-e2] [2+] VpxaMoService::PrepareVmChanges
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.028 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@327-e2] [3+] HandleVMChanges for vmid:2
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.029 1C785B90 verbose 'App' opID=HB-host-9@327-e2] [VpxURL] Resolved localPath /vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx to URL sanfs://vmfs_uuid:4e407bca-a51d0e62-8a8c-00304
Nov 24 06:29:53 861ab4f/Nexenta-2_1/Nexenta-2.vmx
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.029 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@327-e2] [3-] HandleVMChanges for vmid:2 (took 0 ms)
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.029 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@327-e2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.029 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@327-e2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.029 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@327-e2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.029 1C5FFB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 824 bytes)
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.029 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@327-e2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.030 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@327-e2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.030 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@327-e2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.030 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@327-e2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.030 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@327-e2] RecordOp ASSIGN: info.progress, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.030 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@327-e2] [2-] VpxaMoService::PrepareVmChanges (took 1 ms)
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.030 1C785B90 verbose 'VpxaHalResourcePool' opID=HB-host-9@327-e2] NeedFullSync() = false
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.030 1C785B90 verbose 'VpxaHalResourcePool' opID=HB-host-9@327-e2] VpxaHalResourcePoolStandalone::GetVpxaMoRef(vim.ResourcePool:pool0) = vim.ResourcePool:/Resources/Extreme
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.030 1C785B90 verbose 'VpxProfiler' opID=HB-host-9@327-e2] [1-] VpxaMoService::GetChanges (took 34 ms)
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.030 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@327-e2] RecordOp ASSIGN: info.state, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.030 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@327-e2] RecordOp ASSIGN: info.cancelable, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.031 1C785B90 verbose 'PropertyProvider' opID=HB-host-9@327-e2] RecordOp ASSIGN: info.result, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.031 1C785B90 info 'App' opID=HB-host-9@327-e2] [VpxLRO] -- FINISH session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240 --  -- vpxapi.VpxaService.retrieveChanges -- 52293b20-c0a7-
Nov 24 06:29:53 462a-a2de-0657c7cad3d9
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.031 1C785B90 verbose 'PropertyProvider'] RecordOp ASSIGN: info.completeTime, session[52293b20-c0a7-462a-a2de-0657c7cad3d9]528687cf-d97c-eec7-bd9a-5b1e7b2d9240
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.031 1C37CB90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.032 1C37CB90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.032 1C681B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 4318 bytes)
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.035 1C889B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.035 1C889B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.035 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.036 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.036 1C253B90 info 'App' opID=HB-host-9@327-53] [VpxLRO] -- BEGIN task-internal-162 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.037 1C253B90 verbose 'SoapAdapter.HTTPService' opID=HB-host-9@327-53] HTTP Response: Complete (processed 408 bytes)
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.037 1C253B90 info 'App' opID=HB-host-9@327-53] [VpxLRO] -- FINISH task-internal-162 --  -- vmodl.query.PropertyCollector.Filter.destroy -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.038 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.038 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.039 1C6C2B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.039 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.039 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
Nov 24 06:29:53 Vpxa: [2011-11-24 06:29:53.039 1C6C2B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
Nov 24 06:29:54 vmkernel: 0:14:45:04.525 cpu3:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:29:54 vmkernel: 0:14:45:04.525 cpu3:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:29:54 vmkernel: 0:14:45:04.525 cpu0:4117)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:29:54 vmkernel: 0:14:45:04.551 cpu4:4119)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:29:54 Hostd: [2011-11-24 06:29:54.885 233C2B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanVmfs-661" failed.
Nov 24 06:29:54 Hostd: [2011-11-24 06:29:54.885 233C2B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.refresh-664" failed.
Nov 24 06:29:54 Hostd: [2011-11-24 06:29:54.885 233C2B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanAllHba-660" failed.
Nov 24 06:29:54 Vpxa: [2011-11-24 06:29:54.886 1C744B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:29:54 Vpxa: [2011-11-24 06:29:54.886 1C744B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 282 to 283 (at 282)
Nov 24 06:29:54 Hostd: [2011-11-24 06:29:54.888 235C2B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanVmfs-661" failed.
Nov 24 06:29:54 Hostd: [2011-11-24 06:29:54.888 235C2B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.rescanAllHba-660" failed.
Nov 24 06:29:54 Hostd: [2011-11-24 06:29:54.889 235C2B90 verbose 'App'] Looking up object with name = "haTask-ha-host-vim.host.StorageSystem.refresh-664" failed.
Nov 24 06:29:55 iscsid: connect failed (111,Connection refused)
Nov 24 06:29:55 vmkernel: 0:14:45:05.423 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:29:55 vmkernel: 0:14:45:05.423 cpu7:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:29:55 vmkernel: 0:14:45:05.423 cpu7:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:29:55 vmkernel: 0:14:45:05.423 cpu7:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:29:56 vmkernel: 0:14:45:06.422 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f4b6840
Nov 24 06:29:56 vmkernel: 0:14:45:06.422 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:29:56 vmkernel: 0:14:45:06.422 cpu7:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:29:58 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:01 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:02 Vpxa: [2011-11-24 06:30:02.592 1C37CB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:30:02 Vpxa: [2011-11-24 06:30:02.594 1C37CB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:30:04 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:07 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:10 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:13 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:16 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:19 Vpxa: [2011-11-24 06:30:19.124 1C7C6B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
Nov 24 06:30:19 Vpxa: [2011-11-24 06:30:19.124 1C7C6B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
Nov 24 06:30:19 Vpxa: [2011-11-24 06:30:19.125 FFE5BB10 info 'App' opID=task-internal-163-6ac206d9] [VpxLRO] -- BEGIN task-internal-163 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:30:19 Vpxa: [2011-11-24 06:30:19.125 FFE5BB10 verbose 'SoapAdapter.HTTPService' opID=task-internal-163-6ac206d9] HTTP Response: Complete (processed 1855 bytes)
Nov 24 06:30:19 Vpxa: [2011-11-24 06:30:19.126 FFE5BB10 info 'App' opID=task-internal-163-6ac206d9] [VpxLRO] -- FINISH task-internal-163 --  -- vpxapi.VpxaService.fetchQuickStats -- 52293b20-c0a7-462a-a2de-0657c7cad3d9
Nov 24 06:30:19 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:20 nssquery: Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:30:20 Hostd: [2011-11-24 06:30:20.028 221CAB90 warning 'UserDirectory'] Group lookup failed for 'MYAD2\ESX Admins'
Nov 24 06:30:22 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:22 Vpxa: [2011-11-24 06:30:22.593 1C681B90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:30:22 Vpxa: [2011-11-24 06:30:22.596 1C681B90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:30:25 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:28 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:31 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:34 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:34 vmkernel: 0:14:45:44.551 cpu3:48684)ScsiDeviceIO: 1672: Command 0x16 to device "naa.600144f07b3dc70000004ec89beb0001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Nov 24 06:30:34 vmkernel: 0:14:45:44.551 cpu3:48684)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:30:34 vmkernel: 0:14:45:44.551 cpu4:4119)WARNING: FS3: 7096: Reservation error: Timeout
Nov 24 06:30:34 vmkernel: 0:14:45:44.650 cpu2:4118)FS3: 7044: Starting HB reclaim for [HB state abcdef02 offset 3903488 gen 43 stamp 51301344623 uuid 4ecd1548-f949bebe-a7db-000423a5c8f0 jrnl <FB 153400> drv 8.46]
Nov 24 06:30:35 vmkernel: 0:14:45:45.423 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world restore device "naa.600144f07b3dc70000004ec89beb0001" - no more commands to retry
Nov 24 06:30:35 vmkernel: 0:14:45:45.423 cpu6:4438)WARNING: NMP: nmp_IssueCommandToDevice: I/O could not be issued to device "naa.600144f07b3dc70000004ec89beb0001" due to Not found
Nov 24 06:30:35 vmkernel: 0:14:45:45.423 cpu6:4438)WARNING: NMP: nmp_DeviceRetryCommand: Device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
Nov 24 06:30:35 vmkernel: 0:14:45:45.423 cpu6:4438)WARNING: NMP: nmp_DeviceStartLoop: NMP Device "naa.600144f07b3dc70000004ec89beb0001" is blocked. Not starting I/O from device.
Nov 24 06:30:36 vmkernel: 0:14:45:46.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - issuing command 0x41027f3e6740
Nov 24 06:30:36 vmkernel: 0:14:45:46.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Retry world failover device "naa.600144f07b3dc70000004ec89beb0001" - failed to issue command due to Not found (APD), try again...
Nov 24 06:30:36 vmkernel: 0:14:45:46.422 cpu6:4438)WARNING: NMP: nmpDeviceAttemptFailover: Logical device "naa.600144f07b3dc70000004ec89beb0001": awaiting fast path state update...
Nov 24 06:30:37 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:40 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:42 Vpxa: [2011-11-24 06:30:42.593 1C5BEB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
Nov 24 06:30:42 Vpxa: [2011-11-24 06:30:42.596 1C5BEB90 verbose 'App'] Set internal stats for VM: 2 (vpxa VM id), 21 (vpxd VM id). Is FT primary? 0
Nov 24 06:30:43 iscsid: connect failed (111,Connection refused)
Nov 24 06:30:45 Hostd: [2011-11-24 06:30:45.795 22EF2B90 verbose 'vm:/vmfs/volumes/4e407bca-a51d0e62-8a8c-00304861ab4f/Nexenta-2_1/Nexenta-2.vmx'] Actual VM overhead: 517607424 bytes
Nov 24 06:30:45 Hostd: [2011-11-24 06:30:45.795 22EF2B90 verbose 'Vmsvc'] RefreshVms updated overhead for 1 VM
Nov 24 06:30:45 Vpxa: [2011-11-24 06:30:45.797 1C785B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
Nov 24 06:30:45 Vpxa: [2011-11-24 06:30:45.797 1C785B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 283 to 285 (at 283)
Nov 24 06:30:45 Vpxa: [2011-11-24 06:30:45.797 1C785B90 verbose 'App'] [VpxaHalVmHostagent] 672: Runtime changed 'runtime.memoryOverhead'
Nov 24 06:30:45 Vpxa: [2011-11-24 06:30:45.797 1C785B90 verbose 'App'] [VpxaHalServices] RuntimeChange Event for vm(2) 672
Nov 24 06:30:45 Vpxa: [2011-11-24 06:30:45.797 1C785B90 verbose 'App'] [VpxaInvtVmChangeListener] AAM won't be notifyed. vmid 2: notifyVMAP 0,isRestarting 0
Nov 24 06:30:45 Vpxa: [2011-11-24 06:30:45.797 1C785B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no to (328): VmRuntime:VpxaInvtVmChangeListener::RuntimeChanged
Nov 24 06:30:46 iscsid: connect failed (111,Connection refused)