Loading

×Sorry to interrupt
Uncaught ReferenceError: addCTracking is not defined
throws at https://kb.vmware.com/resource/KM_TealiumTrackingJS?v=0.5:100:1

Refresh

Cookie Preference Center

General Information on cookies

When you visit our website, we use cookies to ensure that we give you the best experience. This information does not usually directly identify you, but it can give you a more personalized web experience. Because we respect your right to privacy, you can choose not to allow some types of cookies by clicking on the different category headings to find out more and change your settings. However, blocking some types of cookies may impact your experience on the site and the services we are able to offer. Further information can be found in our

Cookie Policy.

Strictly Necessary

Strictly Necessary

Always Active

Strictly Necessary

Strictly necessary cookies are always enabled since they are essential for our website to function. They enable core functionality such as security, network management, and website accessibility. You can set your browser to block or alert you about these cookies, but this may affect how the website functions. For more information please visit www.aboutcookies.org or www.allaboutcookies.org.

Cookie Details‎

Performance

Performance

Performance

Performance cookies are used to analyze the user experience to improve our website by collecting and reporting information on how you use it. They allow us to know which pages are the most and least popular, see how visitors move around the site, optimize our website and make it easier to navigate.

Cookie Details‎

Please confirm your settings by refreshing the page.

Functional

Functional

Functional

Functional cookies help us keep track of your past browsing choices so we can improve usability and customize your experience. These cookies enable the website to remember your preferred settings, language preferences, location and other customizable elements such as font or text size. If you do not allow these cookies, then some or all of these services may not function properly.

Cookie Details‎

Advertising

Advertising

Advertising

Advertising cookies are used to send you relevant advertising and promotional information. They may be set through our site by third parties to build a profile of your interests and show you relevant advertisements on other sites. These cookies do not directly store personal information, but their function is based on uniquely identifying your browser and internet device.

Cookie Details‎

Advertising Cookies

Consent Leg.Interest

Select All Vendors

Select All Vendors

Select All Hosts

Select All

Clear Filters

Information storage and access

Apply

Confirm My Choices Reject All Allow All

My Subscriptions

Loading

Knowledge Base

The deployment of a vRealize product has failed in VMware Cloud Foundation and there is no option to uninstall it (65201)

Last Updated: 2/8/2019Categories: TroubleshootingTotal Views: 4230Language:
English

Subscribe to get an email
newsletter with new updates

Please provide article feedback:

Symptoms

The deployment of a vRealize product has failed in VMware Cloud Foundation and there is no option to uninstall it.

You see messages similar to the following in the /var/log/vmware/vcf/domainmanager.log file on the SDDC Manager VM:

2018-10-18 13:56:34.067 [Executor-4] INFO [ c.v.e.s.c.v.vrlcm.service.VrlcmServiceImpl] <dd9aa550-d2c5-11e8-98f8-0797e3868e2d> Returned request progress details status = FAILED request ID = a90df022a0a848755787eec3dbdfb
2018-10-18 13:56:34.067 [Executor-4] INFO [c.vmware.evo.sddc.vrealize.vra.DeployVraContract] <dd9aa550-d2c5-11e8-98f8-0797e3868e2d> Persisting vRSLCM vRealize operation details in inventory.
2018-10-18 13:56:34.072 [Executor-4] ERROR [c.vmware.evo.sddc.vrealize.vra.DeployVraContract] <dd9aa550-d2c5-11e8-98f8-0797e3868e2d> vRA deployment failed. vRSLCM Request state is FAILED.
2018-10-18 13:56:34.072 [Executor-4] ERROR [c.vmware.evo.sddc.vrealize.vra.DeployVraContract] <dd9aa550-d2c5-11e8-98f8-0797e3868e2d> vRSLCM vRealize operation has failed. Error code is VRA_IAAS_MANAGEMENT_AGENT_INSTALLATION_FAILED.
vRSLCM exception message is VM Not Found : vrealize-01.corp.local.
vRSLCM error message is vRA Iaas Management Agent Installation Failed..
2018-10-18 13:56:34.122 [Executor-4] INFO [ c.v.e.s.c.client.vmware.vsphere.VsphereClient] <dd9aa550-d2c5-11e8-98f8-0797e3868e2d> Successfully logged in to https://vcenter.corp.local/sdk
2018-10-18 13:56:34.123 [Executor-4] INFO [ c.v.e.s.c.client.vmware.vsphere.VcManagerBase] <dd9aa550-d2c5-11e8-98f8-0797e3868e2d> Toggle HA feature on cluster vcfbreda-mgmt-01 to true
2018-10-18 13:56:34.148 [Executor-4] DEBUG [c.v.e.s.c.client.vmware.vsphere.InventoryService] <dd9aa550-d2c5-11e8-98f8-0797e3868e2d> No more results to retrieve
2018-10-18 13:56:34.167 [Executor-4] INFO [ c.v.e.s.c.client.vmware.vsphere.VsphereUtils] <dd9aa550-d2c5-11e8-98f8-0797e3868e2d> Task: (MOR:task-2771) (Name:unknown) is started
2018-10-18 13:56:36.171 [Executor-4] INFO [ c.v.e.s.c.client.vmware.vsphere.VsphereUtils] <dd9aa550-d2c5-11e8-98f8-0797e3868e2d> Task: (MOR:task-2771) (Name:reconfigureEx) Entity: (MOR:domain-c7) (Name:mgmt-01) is complete
2018-10-18 13:56:36.171 [Executor-4] INFO [ c.v.e.s.c.client.vmware.vsphere.VcManagerBase] <dd9aa550-d2c5-11e8-98f8-0797e3868e2d> HA feature on cluster mgmt-01 is true
2018-10-18 13:56:36.174 [Executor-4] WARN [c.v.v.v.c.h.i.HttpConfigurationCompilerBase$ConnectionMonitorThreadBase] <dd9aa550-d2c5-11e8-98f8-0797e3868e2d> Shutting down the connection monitor.
2018-10-18 13:56:36.174 [monitor-80] WARN [c.v.v.v.c.h.i.HttpConfigurationCompilerBase$ConnectionMonitorThreadBase] Interrupted, no more connection pool cleanups will be performed.
2018-10-18 13:56:36.174 [Executor-4] ERROR [c.v.e.sddc.orchestrator.model.error.ErrorFactory] [SJDNSH] VRA_IAAS_MANAGEMENT_AGENT_INSTALLATION_FAILED vRA Iaas Management Agent Installation Failed.
com.vmware.evo.sddc.common.vrealize.vrslcm.error.reporting.exceptions.VrslcmOrchTaskException: vRA Iaas Management Agent Installation Failed.
snip
2018-10-18 14:16:05.888 [ main] DEBUG [ c.v.v.v.s.VrealizeExecutionSubscriberHelper] Found a Vrealize VRA_DEPLOY workflow
2018-10-18 14:16:05.898 [ main] INFO [ c.v.v.v.s.VrealizeExecutionSubscriberHelper] Built the following extended resource operation status: {
"type": "DEPLOY",
"state": "FAILED",
"taskId": "dd9aa550-d2c5-11e8-98f8-0797e3868e2d",
"retriable": true
}
2018-10-18 14:16:05.899 [ main] INFO [ c.v.v.v.s.VrealizeExecutionSubscriberHelper] Getting vRealize Edge ID
2018-10-18 14:16:06.084 [ main] INFO [ c.v.vcf.vault.services.impl.VaultServiceImpl] Getting secret with id dd9aa550-d2c5-11e8-98f8-0797e3868e2d
2018-10-18 14:16:06.102 [ main] WARN [ c.v.vcf.vrealize.subscriber.VraResourceHelper] Failed to update entity at the end of execution with ID dd9aa550-d2c5-11e8-98f8-0797e3868e2d.
com.vmware.evo.sddc.inventory.model.error.SddcManagerException: java.lang.NullPointerException
at com.vmware.vcf.vault.services.impl.VaultServiceImpl.getSecret(VaultServiceImpl.java:104)
at com.vmware.vcf.domainmanager.service.config.EncryptedVaultFsmContextStoreImpl.loadExecutionContext(EncryptedVaultFsmContextStoreImpl.java:31)

You see messages similar to the following in the /var/log/vmware/vcf/operationsmanager.log file on the SDDC Manager VM:

2018-10-18 14:43:14.988 [300-exec-9] DEBUG [ c.v.v.p.service.PasswordLookupService] Unable to get some resource details. reason: {}
java.util.concurrent.ExecutionException: java.lang.RuntimeException: Retriable operation 'Inventory collection task for VRA' failed to complete after 3 retries.
snip
Caused by: java.lang.RuntimeException: Retriable operation 'Inventory collection task for VRA' failed to complete after 3 retries.
at com.vmware.evo.sddc.common.util.RetriableCallable.call(RetriableCallable.java:183)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 common frames omitted
Caused by: java.net.UnknownHostException: vrealize-vra-vip.corp.local

You see that the state of the task is still IN_PROGRESS:

curl http://localhost/commonsvcs/vrealize/internal/vra/status | >json_pp

"state" : "NOT_DEPLOYED",
"operations" : {
"uninstall" : {
"state" : "NOT_AVAILABLE"
},
"deploy" : {
"taskId" : "dd9aa550-d2c5-11e8-98f8-0797e3868e2d",
"state" : "IN_PROGRESS"
}
}
}

Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.

Resolution

This is a known issue affecting VMware Cloud Foundation 3.0. There is currently no resolution.

Workaround

The following steps can be used to workaround this issue:

Note: Take a snapshot of the SDDC Manager VM prior to starting. The snapshot should be removed once the steps are completed and the issue is resolved.

For a vRealize Automation Deployment:

ssh to the SDDC Manager VM as the vcf user.

Issue the following command to collect information related to the failed workflow:

cqlsh --cqlversion=3.4.4 -e "expand on; select id,status,operationstatus from inventory.vra"

Note: You will see output similar to the following:

@ Row 1

-----------------+-------------------------------------------------------------------------------------------------------------------------------

id | a57382d1-fa39-4fb1-9765-ac5f8b387165

status | ACTIVATING

operationstatus | {"resourceStatus":"ACTIVATING","lastOperation":{"type":"DEPLOY","state":"IN_PROGRESS","taskId":"be955b80-d394-11e8-893a-230716dc2e97"}}

Note: Make a note of the id value (a57382d1-fa39-4fb1-9765-ac5f8b387165 in this example) and the taskId value (be955b80-d394-11e8-893a-230716dc2e97 in this example) as they will be used in the next step.

Issue a command similar to the following to update the status and state of the workflow:

cqlsh --cqlversion=3.4.4 -e "update inventory.vra set operationstatus= '{\"resourceStatus\":\"ERROR\",\"lastOperation\":{\"type\":\"DEPLOY\",\"state\":\"FAILED\",\"taskId\":\"be955b80-d394-11e8-893a-230716dc2e97\"}}' where id = 'a57382d1-fa39-4fb1-9765-ac5f8b387165'"

Notes:

The resourceStatus value of ACTIVATING is replaced with ERROR and the state value of IN_PROGRESS is replaced with  FAILED.

Replace a57382d1-fa39-4fb1-9765-ac5f8b387165 with the id value returned in Step 2 and a57382d1-fa39-4fb1-9765-ac5f8b387165 with the taskId value returned in Step 2.

Issue the command from Step 2 again. You should see output similar to the following:

@ Row 1

-----------------+-------------------------------------------------------------------------------------------------------------------------------

id | a57382d1-fa39-4fb1-9765-ac5f8b387165

status | ACTIVE

operationstatus | {"resourceStatus":"ERROR","lastOperation":{"type":"DEPLOY","state":"FAILED","taskId":"be955b80-d394-11e8-893a-230716dc2e97"}}

Note: It is normal for the status value to remain as ACTIVE.

Log out of SDDC Manager UI and then log back in. Navigate to Administration -> vRealize Suite -> vRealize Automation. The option to uninstall will now be visible.

Click the Uninstall button.

Correct any issues that were related to the failed vRealize Automation deployment.

Initiate a new vRealize Automation deployment.

For a vRealize Operations Deployment:

The process for correcting this issue in a vRealize Operations deployment should be nearly identical to the process documented for vRealize Automation. The primary difference is the table in the database where the record is held. For a vRealize Automation deployment, the table is inventory.vra while for vRealize Operations the table is inventory.vrops. Any command referencing the inventory.vra table would need to be updated to reference the inventory.vrops table.

Detectable by VMware SkylineTM

Actions

Copy

link to clipboard
copied!

Print

Language:
English

Attachments

Additional Resources

KB
•
End Of General Availability of the Free vSphere Hypervisor (ESXi 7.x and 8.x) (2107518)

Result 1 of 1

Ask The Community

Get answers quickly from VMware experts in the community

Post Subject

CONTINUE IN COMMUNITIES

Related Products:

VMware Cloud Foundation

Related Versions:

VMware Cloud Foundation 3.0.x

Take Our Survey

Support Assistant