{"id":1633,"date":"2015-07-08T13:56:45","date_gmt":"2015-07-08T13:56:45","guid":{"rendered":"http:\/\/pariswells.com\/blog\/?p=1633"},"modified":"2015-07-08T13:56:45","modified_gmt":"2015-07-08T13:56:45","slug":"ha-unsuccessfully-failed-over-vm-on-host-in-cluster-vsphere-ha-will-retry-if-the-maximum-number-of-attempts-has-not-been-exceeded-reason-operation-timed-out","status":"publish","type":"post","link":"https:\/\/pariswells.com\/blog\/research\/ha-unsuccessfully-failed-over-vm-on-host-in-cluster-vsphere-ha-will-retry-if-the-maximum-number-of-attempts-has-not-been-exceeded-reason-operation-timed-out","title":{"rendered":"HA unsuccessfully failed over VM on HOST in cluster vSphere HA will retry if the maximum number of attempts has not been exceeded. Reason: Operation timed out."},"content":{"rendered":"\r\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-thumbnail wp-image-1634 img-responsive\" src=\"http:\/\/pariswells.com\/blog\/wp-content\/uploads\/2015\/07\/2014-06-17_16h26_591-150x150.png\" alt=\"2014-06-17_16h26_59[1]\" width=\"150\" height=\"150\" \/>Recently during a Veeam backup HA kicked in due to a problem with VCenter and marked two machines as Invalid<\/p>\r\n<ul>\r\n\t<li>\u00a0Veeam started backup and created snapshot on affected VMs<\/li>\r\n\t<li>HA kicked in after VCenter Server\u00a0failure<\/li>\r\n\t<li>Vcenter tried to move the machines after the HA event but they were locked by the snapshot Veeam had (the hypervisor has a lock because of the snapshot)<\/li>\r\n\t<li>Machine couldn\u2019t move but Vmware removed them from inventory and tried to register them to another host, without success<\/li>\r\n\t<li>Machines marked as Invalid, Removing machines from Inventory and registering\u00a0the machines manually did not work<\/li>\r\n\t<li>The machines are locked however still powered on and response<\/li>\r\n<\/ul>\r\n<p>Fix to get VM&#8217;s registered on VCenter<\/p>\r\n<ul>\r\n\t<li>Stop any tasks (i.e. Veeam) that might trigger a snapshot on affected machines<\/li>\r\n\t<li>Temporarily disable DRS in the cluster (when we power up the machine we don\u2019t want Vsphere to power it up on another host otherwise the lock will persists)<\/li>\r\n\t<li>Power affected VMs off gracefully from within the OS.<\/li>\r\n\t<li>Login to vcenter and select Host which failed and\u00a0. Unregister\u00a0&#8220;unkown&#8221; VM&#8217;s listed\u00a0(these should be the actual Vms). Unregistering should remove the lock.<\/li>\r\n\t<li>Register the virtual machines using the vmx files in the datastore<\/li>\r\n\t<li>Check no snapshots are present, if yes delete or consolidate<\/li>\r\n\t<li>Power on Vm<\/li>\r\n\t<li>Re-enable DRS<\/li>\r\n<\/ul>\r\n","protected":false},"excerpt":{"rendered":"<p>Recently during a Veeam backup HA kicked in due to a problem with VCenter and marked two machines as Invalid \u00a0Veeam started backup and created snapshot on [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[1076,1078,1075,1079,1077,739,594],"class_list":["post-1633","post","type-post","status-publish","format-standard","hentry","category-research","tag-ha-unsuccessfully-failed-over-vm-on-host-in-cluster-vsphere-ha-will-retry-if-the-maximum-number-of-attempts-has-not-been-exceeded-reason","tag-invalid","tag-operation-timed-out","tag-register","tag-snapshot","tag-veeam","tag-vmware"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/pariswells.com\/blog\/wp-json\/wp\/v2\/posts\/1633","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pariswells.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/pariswells.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/pariswells.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/pariswells.com\/blog\/wp-json\/wp\/v2\/comments?post=1633"}],"version-history":[{"count":1,"href":"https:\/\/pariswells.com\/blog\/wp-json\/wp\/v2\/posts\/1633\/revisions"}],"predecessor-version":[{"id":1635,"href":"https:\/\/pariswells.com\/blog\/wp-json\/wp\/v2\/posts\/1633\/revisions\/1635"}],"wp:attachment":[{"href":"https:\/\/pariswells.com\/blog\/wp-json\/wp\/v2\/media?parent=1633"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/pariswells.com\/blog\/wp-json\/wp\/v2\/categories?post=1633"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/pariswells.com\/blog\/wp-json\/wp\/v2\/tags?post=1633"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}