Loading

×Sorry to interrupt
CSS Error

Refresh

Cookie Preference Center

General Information on cookies

When you visit our website, we use cookies to ensure that we give you the best experience. This information does not usually directly identify you, but it can give you a more personalized web experience. Because we respect your right to privacy, you can choose not to allow some types of cookies by clicking on the different category headings to find out more and change your settings. However, blocking some types of cookies may impact your experience on the site and the services we are able to offer. Further information can be found in our

Cookie Policy.

Strictly Necessary

Strictly Necessary

Always Active

Strictly Necessary

Strictly necessary cookies are always enabled since they are essential for our website to function. They enable core functionality such as security, network management, and website accessibility. You can set your browser to block or alert you about these cookies, but this may affect how the website functions. For more information please visit www.aboutcookies.org or www.allaboutcookies.org.

Cookie Details‎

Performance

Performance

Performance

Performance cookies are used to analyze the user experience to improve our website by collecting and reporting information on how you use it. They allow us to know which pages are the most and least popular, see how visitors move around the site, optimize our website and make it easier to navigate.

Cookie Details‎

Please confirm your settings by refreshing the page.

Functional

Functional

Functional

Functional cookies help us keep track of your past browsing choices so we can improve usability and customize your experience. These cookies enable the website to remember your preferred settings, language preferences, location and other customizable elements such as font or text size. If you do not allow these cookies, then some or all of these services may not function properly.

Cookie Details‎

Advertising

Advertising

Advertising

Advertising cookies are used to send you relevant advertising and promotional information. They may be set through our site by third parties to build a profile of your interests and show you relevant advertisements on other sites. These cookies do not directly store personal information, but their function is based on uniquely identifying your browser and internet device.

Cookie Details‎

Advertising Cookies

Consent Leg.Interest

Select All Vendors

Select All Vendors

Select All Hosts

Select All

Clear Filters

Information storage and access

Apply

Confirm My Choices Reject All Allow All

My Subscriptions

Loading

Knowledge Base

Enabling or disabling simultaneous write protection provided by VMFS using the multi-writer flag (1034165)

Last Updated: 11/16/2023Categories: How toTotal Views: 84406Language:
Chinese (Simplified)JapaneseEnglish

69 like this article

Subscribe to get an email
newsletter with new updates

69 people found this helpful Please provide article feedback:

Learn how VMware Skyline Advisor and Skyline Health Diagnostics work together to provide proactive intelligence and self-service log analysis.

Use Skyline Advisor to avoid issues before they occur across VCF, vSphere, vSAN, NSX, vROps & Horizon. Skyline Findings are based on top KBs, VMSAs/CVEs and design best practices.

Use Skyline Health Diagnostics to root cause vSphere & vSAN logs when an issue occurs. Skyline Health Diagnostic Findings are based on top KBs and VMSA/CVEs. You can use the Skyline Health Diagnostics tool in online or offline mode.

If you require additional help from technical support, please use Skyline Advisor to initiate a Log Assist to reduce time to upload logs. TSEs can also initiate logs to reduce effort.

Details

VMFS is a clustered file system that disables (by default) multiple virtual machines from opening and writing to the same virtual disk (.vmdk file). This prevents more than one virtual machine from inadvertently accessing the same .vmdk file.

The multi-writer option allows VMFS-backed disks to be shared by multiple virtual machines. This option is used to support VMware fault tolerance, which allows a primary virtual machine and a standby virtual machine to simultaneously access a .vmdk file.

You can use this option to disable the protection for certain cluster-aware applications where the applications ensure that writes originating from two or more different virtual machines does not cause data loss. This document describes methods to set the multi-writer flag for a virtual disk.

Warning: Be careful when you disable this protection. This change might cause data corruption in cases where the applications in the virtual machine do not maintain consistency in the writes performed to the shared disk. As a result, some virtual machine operations and vSphere features are not supported and these are listed below.

Use cases:

VMware FT relies on VMware vLockstep technology to establish and maintain an active secondary virtual machine that runs in virtual lockstep with the primary virtual machine. The secondary virtual machine resides on a different host and executes exactly the same sequence of virtual (guest) instructions as the primary virtual machine. The multi-writer flag is automatically enabled when you turn on FT in the vSphere Client.

Third-party cluster-aware applications, in which the applications ensure that writes originate from two or more different virtual machines, does not cause data loss (for example, you would use this for Oracle RAC virtual machines). For this case, manually enable the multi-writer flag using the instructions in this article. Follow the same procedure when using virtual RDMs.

Starting vSphere 7.0 Update 1, NVMe over Fibre Channel and NVMe over RDMA (RoCE v2) datastores now support multi-writer option enabling in-guest systems that leverage cluster-aware file systems to have distributed write capability. Please refer to the VMware NVMe Storage guidelines before configuring the NVMe Storage for shared disks with the multi-writer attribute. For more information, see About VMware NVMe Storage

Starting vSphere 7.0 Update 3, vVOL datastore backed by FC, iSCSI protocols now support multi-writer option enabling in-guest systems that leverage cluster-aware file systems to have distributed write capability. For more information, see Oracle workloads on VMware Virtual Volumes (vVOLS) using Pure Storage FlashArray X50 and Broadcom LPe36000 Fibre Channel Adapter – better performance

Starting vSphere 8.0 Update 2, vVOL datastores backed by NVMe FC, NVMe TCP  also supports multi-writer option .

For Oracle RAC virtual machines to work correctly with the multi-writer flag enabled the ESXi 5.5 hosts the virtual machines are running on must be patched to VMware ESXi 5.5, Patch ESXi550-201407401-BG: Updates esx-base (2077407) or later.

For configurations using VMware vSAN, see Using Oracle RAC on vSphere 6.x vSAN Datastore (2121181).

Support information for Veritas InfoScale in ESXi guests can be found at Veritas InfoScale Enterprise 7.x in guest storage, high availability, and disaster recovery support (Partner Verified and Supported) (51476)

Supported and unsupported actions or features:

Actions or Features

Supported

Unsupported

Notes

Power on, off, restart virtual machine

√

Suspend VM

×

Hot add virtual disks

√

Only to existing adapters

Hot remove devices

√

Hot extend virtual disk

√

For shared disks from vvols backend datastores from vSphere 8.0 update 2 onwards

Connect and disconnect devices

√

Snapshots of VMs with dependent disks

×

Virtual backup solutions leverage snapshots through the vStorage APIs; for example, VMware Data Recovery, vSphere Data Protection. These are also not supported.

Snapshots of VMs with independent-persistent disks

√

Supported in vSphere 5.1 update2 and later versions.

The snapshot task will be completed successfully but will skip the independent disks from the snapshot operation.

Powered on virtual machines with independent disks cannot support memory snapshots.

Cloning

×

Storage vMotion

×

Neither shared nor non-shared disks can be migrated using Storage vMotion due to the virtual machine stun required to initiate the storage migration.

Changed Block Tracking (CBT)

×

vSphere Flash Read Cache (vFRC)

×

Stale writes can lead to data loss and/or corruption

vMotion

√

Supported for ORAC only and limited to 8 ESX/ESXi hosts

Limitations:

When using the multi-writer mode for disks from VMFS datastore, the virtual disk must be eager zeroed thick; it cannot be zeroed thick or thin provisioned. For more information, see A virtual machine fails to power on with the error: Thin/TBZ disks cannot be opened in multiwriter mode. VMware ESX cannot open the virtual disk for clustering. (1033570).

When using the multi-writer mode for disks from vVOLs datastore, the virtual disk can be either thin or thick.

Hot adding a virtual disk removes Multi-Writer Flag. For more information, see Hot adding a virtual disk in ESXi 5.5 removes the multi-writer flag (2078540).

From vSphere 8.0 update 2 onwards virtual NVMe controller is  also supported for the virtual disks with multi-writer mode.

From vSphere 6.7 Update 1 onwards, the virtual disks sharing support in multi-writer has been extended to more than 8 hosts. "This applies to VMFS5 / VMFS6 as well". In order to enable this feature, you need to enable /VMFS3/GBLAllowMW advance config option  as shown below:

Login to ESXi host and execute the below command:

esxcli system settings advanced set -i 1 -o /VMFS3/GBLAllowMW

Note: This will enable the multi-writer lock. GBLAllowMW config option is disabled by default on ESXi host.
Note: Maximum number of hosts that can support a shared virtual disk is 64 as for vSphere 6.7 Update 1 .

Execute the below command to check the value set.

esxcli system settings advanced list -o /VMFS3/GBLAllowMW
Path: /VMFS3/GBLAllowMW
Type: integer
Int Value: 1             =========== > Value set to 1 from default 0
Default Int Value: 0
Min Value: 0
Max Value: 1
String Value:
Default String Value:
Valid Characters:
Description: Allow multi-writer GBLs.

Note: Run esxcli system settings advanced set -i 0 -o /VMFS3/GBLAllowMW to disable this option.

Enable the above config option on ALL the hosts that are part of the shared environment.

Solution

Enabling Virtual Disk Sharing

To configure a shared virtual disk by setting the multi-writer flag:

For ESXi 6.x

Configure virtual machine & add a second hard disk (thick EZT disk type) by mentioning the sharing as multiwriter. (In virtual machine edit settings > virtual hardware > second hard disk > sharing > Multiwriter)

For previous versions of ESXi

Create a virtual disk to be shared using any acceptable approach. For example, through the vSphere Client:

Create a new disk for a virtual machine on a VMFS data store:

In the Create a Disk window, for ESX/ESXi versions earlier than 5.0, click Support clustering features such as Fault Tolerance to create the new virtual disk in the required format, eager zeroed thick.

In ESXi 5.x versions, the Create a Disk window provides Thick Provision Lazy Zeroed, Thick Provision Eager Zeroed, and Thin Provision options under Disk Provisioning. Be sure to select Thick Provision Eager Zeroed. Also, note that the documentation may refer to this as Flat pre-initialized.

Choose a Virtual Device Node setting, such as SCSI (1:0). Make a note of it, as it is required later.

Add the multi-writer flag to configure sharing.

Note: Do not change the SCSI Controller's SCSI Bus Sharing options. Keep the default selection, None.

To enable Multi Writer flag for sharing a particular disks, apply one of these options:

Power off the virtual machine.

In the . vmx file that defines the virtual machine, add an entry similar to:
scsiX:Y.sharing = "multi-writer"

where X is the controller ID and Y is the disk ID on that controller. The setting screen of a virtual machine shows these values.

Add this setting for each virtual disk that you want to share. For example, to share four disks, the configuration file entries look like this:
scsi1:0.sharing = "multi-writer"
scsi1:1.sharing = "multi-writer"
scsi1:2.sharing = "multi-writer"
scsi1:3.sharing = "multi-writer"

Save the .vmx file and power on the virtual machine.

Note: In vSphere 6.0 and later, the GUI has the capability of setting Multi Writer flag without any need to edit .vmx file.

In the vSphere Client, power off the virtual machine, navigate to Edit Settings > Options > Advanced > General > Configuration Parameters. Add rows for each of the shared disks and set their values to multi-writer.

Add this disk to another virtual machine:

In the vSphere Client inventory, right-click the virtual machine and click Edit Settings.

Click the Hardware and click Add.

Select Hard Disk and click Next.

Select Use an Existing Virtual Disk.

Note: You do not need to create a disk because the disk is already created.

Enable sharing on this virtual machine, using one of the approaches listed in step 2.

To configure the multi-writer flag via Host Client:

Right Click the VM required and then choose Edit Settings.

Click on the Tab VM Options.

Choose Advanced and then click on Edit Configuration under the Configuration parameters.

Add the Settings for each virtual disk that you want to share as below.
scsi1:0.sharing = ""multi-writer""
scsi1:1.sharing = ""multi-writer""
scsi1:2.sharing = ""multi-writer""
scsi1:3.sharing = ""multi-writer""

NOTE: While migrating the multi -writer-VM, do disconnect the disk and reconnect after migration. Some times you will get duplicate disk information.[ Make sure to use same SCSI-id]. You can follow the process listed in Migrating VMs with shared or multi-writer disks.

For more information on the steps described in this article, see:

Oracle on VMware vSphere Essential Database Deployment Tips

Oracle Databases on VMware RAC Deployment Guide

Oracle Databases on VMware: Best Practices Guide

Additional Information

For translated versions of this article, see:

Español: Deshabilitar la protección de escritura simultánea que brinda VMFS con el indicador de escritura múltiple (2072887)

Português: Como desabilitar a proteção contra gravação simultânea fornecida pelo VMFS usando o sinalizador multi-writer (2046562)

日本語: マルチライター フラグを使用して、VMFS が提供する同時書き込み保護を無効にする (2080040)

简体中文: 使用多写入器标记禁用 VMFS 提供的同步写入保护 (2076182)

Detectable by VMware SkylineTM

Actions

Copy

link to clipboard
copied!

Print

Language:
Chinese (Simplified)JapaneseEnglish

Attachments

Additional Resources

No results for undefined

Ask The Community

Get answers quickly from VMware experts in the community

Post Subject

CONTINUE IN COMMUNITIES

Related Products:

VMware vSphere ESXi

Related Versions:

VMware vSphere ESXi 8.0.2

VMware vSphere ESXi 8.0.1

VMware vSphere ESXi 7.0.0

VMware vSphere ESXi 6.7

VMware vSphere ESXi 6.5

Take Our Survey

Support Assistant