Quantcast
Channel: Veeam Support Knowledge Base
Viewing all 4487 articles
Browse latest View live

HCL - Pure Storage FlashBlade (SSD)

$
0
0

Challenge

VeeamReadyRepo

Product Information:

Company name: Pure Storage
Product Family: FlashBlade
Status: Veeam Ready - Repository
Classification Description: Verified backup storage that supports all Veeam backup and restore features.

Solution

Product Details:

Model number: Pure Storage FlashBlade
Drive quantity, size, type: 7 Blades / 8TB per blade - SSD
Firmware version: Purity//FB 2.1.0
General product family overview:

FlashBlade is a fast and dense unstructured data platform from Pure Storage that provides on-premise rapid backup and recovery of archival data. Additionally, Pure Storage FlashBlade provides high-performance in a dense-form factor for other unstructured data primary use cases such as machine learning, deep learning, and electronic design automation (EDA), among others.

 

Veeam testing configuration:

Note: The following settings were used by the vendor to meet Veeam Ready testing requirements and should not be considered best practices. Additional changes or settings may be needed to meet the storage efficiency or performance needs for each environment. For each setting, reference links are provided for further clarification.
 

Veeam Build Number: 9.5.0.823

Job Settings:

Deduplication: Enabled (Default)
Compression: Optimal (Default)
Storage Optimization: Local Target (Default)
 

Repository Settings:

Repository Type: Shared Folder (CIFS)
Align backup file blocks: Disabled (Default)
Decompress before storing: Disabled (Default)
Per-VM Backup Files: Enabled

HCL - Pure Storage ObjectEngine VM Edition

$
0
0

Challenge

VeeamReadyObject

Product Information:

Company name: Pure Storage
Product Family: ObjectEngine
Status: Veeam Ready – Object
Classification Description: Verified object storage solutions that has been tested with Veeam Backup & Replication Cloud Tier features.

Solution

Product Details:

Model number: ObjectEngine //A
Storage Category: Appliance
Drive quantity, size, type: ObjectEngine //A270 includes the minimum of 4 nodes.  Nodes can be added to the cluster, in increments of 2, to provide additional throughput.  ObjectEngine reduces the data inline (via deduplication and compression) as it’s being written to the permanent storage media.  FlashBlade provides the underlying object storage and can be configured with a minimum of 7 and up to 15 blades per chassis, and each blade can be 17TB or 52TB of flash storage.  Up to 5 FlashBlade chassis can be connected together.
Storage configuration: Tests were performed on 4-Node Pure Storage ObjectEngine //A270, with 15 blade (17TB per blade) FlashBlade using erasure encoding for unstructured data storage.
Firmware version: OES 5.0.0
Connection protocol and speed: 8x 10 GbE
Additional support: All models and configurations of ObjectEngine for S3 compatible storage with specifications equivalent or greater than the above.

General product family overview: ObjectEngine’s cloud-native technology reduces storage and bandwidth costs, enabling flash plus cloud solutions across a variety of use cases, including data protection. The FlashBlade solution provides an all-flash storage for this unstructured data platform.
 

Veeam testing configuration:

Veeam Build Number: 9.5.4.2753

 

Vendor recommended configuration:

Vendor Settings:

  • Array deduplication used during testing
  • Aray compression used during testing
  • Default S3 connection settings

HCL - Red Hat Ceph Storage 3.1

$
0
0

Challenge

VeeamReadyObject

Product Information:

Company name: Red Hat, Inc.
Product Family: Red Hat Ceph Storage
Status: Veeam Ready – Object
Classification Description: Verified object storage solutions that has been tested with Veeam Backup & Replication Cloud Tier features.

Solution

Product Details:

Model number: 3.1
Storage Category: Software Defined Storage
Drive quantity, size, type: 7 - 1TB SATA hard drives per cluster node, for a total of 21 drives across the cluster.
Storage configuration: Hard drives were all used in single, standalone mode. No hardware or software RAID used.
Firmware version: ceph version 12.2.5-59.el7cp
Connection protocol and speed: 1GbE
Additional support: All models and configurations of Red Hat Ceph 3.1 or higher for S3 compatible storage with specifications equivalent or greater than the above.

General product family overview:
Red Hat Ceph Storage 3.1 running on a 3-node cluster, with all nodes running the Object Storage Daemons (OSDs), and one node dedicated for the Monitor daemon (MON), Manager daemon (MGR), and Object Gateway daemon (RGW).

Veeam testing configuration:

Veeam Build Number: 9.5.4.2282

 

Vendor recommended configuration:

Vendor Settings:

  • No hardware deduplication used in testing
  • No hardware compression used in testing

HCL - Scality RING (Object Storage)

$
0
0

Challenge

VeeamReadyObject

Product Information:

Company name: Scality
Product Family: Scality RING
Status: Veeam Ready – Object
Classification Description: Verified object storage solutions that has been tested with Veeam Backup & Replication Cloud Tier features.

Solution

Product Details:

Model number: Scality RING
Storage Category: Web-scale Software Defined Storage
Drive quantity, size, type: 156x 6TB NL-SAS, 12x 400GB SSD
Storage configuration: ARC 9+3
Firmware version: 7.4.2
Connection protocol and speed: 40GbE
Additional support: All models and configurations of Scality RING for S3 compatible storage with specifications equivalent or greater than the above.

General product family overview:
The Scality RING is software that turns any standard x86 servers into web-scale storage. With the RING, you can store any amount of data, of any type, with incredible efficiency and 100% reliability, guaranteed—all while reducing costs by as much as 90% over legacy systems.

Veeam testing configuration:

Veeam Build Number: 9.5.4.2753

 

Vendor recommended configuration:

Vendor Settings:

  • Jumbo frames used during testing
  • Storage Servers used in testing:6x Cisco UCS S3260 M4 Dual Node, 2x Intel(R) Xeon(R) CPU E5-2650 v4@ 2.20GHz, 128GB RAM

HCL - SwiftStack Storage

$
0
0

Challenge

VeeamReadyObject

Product Information:

Company name: SwiftStack
Product Family: SwiftStack Storage
Status: Veeam Ready – Object
Classification Description: Verified object storage solutions that has been tested with Veeam Backup & Replication Cloud Tier features.

Solution

Product Details:

Model number: N/A
Storage Category: On-premise cloud-native storage
Drive quantity, size, type: 27 X 12 TB 10000 RPM hard disk drives (HDDs) are used per node to store objects and 1 X 400 GB SSD is used per node to store account information and metadata only
Storage configuration: 6-node cluster comprising UCS S3260 servers were used to test the solution
Firmware version: v6.24
Connection protocol and speed: 10GbE
Additional support: All models and configurations of SwiftStack Storage with specifications equivalent or greater than the above.

General product family overview:

SwiftStack is a cloud-native storage platform for managing unstructured data in a single namespace that is policy-driven and can scale across both private and public infrastructure.  Supports all drive types. Size and quantity of drives per node will vary depending on deployment configuration and use cases. SwiftStack supports scale-out object storage clusters comprised of standard Intel-based servers, starting with 3 nodes or greater.
 

Veeam testing configuration:

Veeam Build Number: 9.5.4.2753

 

Vendor recommended configuration:

Vendor Settings:

  • Triple replicas and Erasure coding storage policy settings to protect data in the storage cluster.

Veeam Agent Managed by Agent jobs mapping

$
0
0

Challenge

You want to map an existing Veeam Agent Managed by Agent backup chain from one Veeam Backup & Replication repository to another.

Cause

There is no default ‘Map backup’ feature in comparison to ‘Managed by backup server’ Veeam Agent jobs. However, it is possible to map the backup through the following steps below.

Solution

A “Managed by Agent” job can be mapped by following steps, which will be outlined with an example:

1. Get the name of the job that you want to move, in this example, the job is named “Map Managed by Agent”
User-added image
2. Determine the location of the existing chain by looking at the destination info on Storage tab to determine your backup location. In this example, the backup was located on a Veeam Backup Repository Named “Source Repo”
User-added image

3. At this step, browse to and copy the backup files from location holding the backups to the desired new repository path. To find the path of the current backup, just go to Home > Backups > Disk > Expand the Job that you plan wish to move > Right click the hostname or IP of the machines that you wish to move then click “Properties”. You will see a new Window that includes a folder path. Copy the entire “VeeamAgentUser{GUID}” folder and its content to the new repository
User-added image

In our example, we are moving to a repository named “Target Repo” that has the following path: F:\Backups, so, as we discussed in the previous step, we will copy the entire folder over to the target path.

4. After moving the backup, the repository rescan has to be made to update the backup links. Rescan the target repository as outlined in this article. After the rescan completes, the copied backup will appear in “Disk (Imported)” section on the “Home” screen.

5. After the rescan of the repository has completed, edit and update the policy job to target the new repository and then apply the policy to the machines. 

After applying the policy, the moved backup job will go from “Disk (Imported) to “Disk”. After all, the job can be started as usual and it will continue the chain.

LIMITATION: It is not possible to map Veeam Agent Managed by Agent backup from a Shared folder or Local Target to a Veeam Backup & Replication Repository. 
 

Required modules and permissions for Multi-OS FLR and Repository support for Linux

$
0
0

Challenge

To configure Linux guests and repositories to work with Veeam Backup and Replication and utilize our software’s features.

Cause

There are several requirements that must be met, by a Linux OS, in order for us to effectively utilize all of our features and make sure they run consistently. On top of that we require root permissions to launch several modules. If these settings are not in place, then we won’t be able to properly write to and recover the system. 

Solution

Authentication Methods
Linux servers registered with Veeam Backup & Replication infrastructure must use Password or Certificate-based authentication methods. At this time we do not support any other forms of authentication like biometrics, smart cards, etc.


Bash
We require Bash to be installed as shell on the Linux environment. At the time we do not support any other command shell. This is usually the default shell set in place by most Linux distributions. 


"sudo"
Important Note: accounts using "sudo" must be in the "/etc/sudoers" file and have the ‘nopasswd’ setting put into the "/etc/sudoers" file.

In order to launch our script we require the "sudo" command to be able to launch from the credentials we are given at the time of setup. "sudo" is a command that allows us to make administrator level (root) changes and executions in the Linux environment. 

One of the primary reasons that we use "sudo" is to make sure that we can access the /tmp folder and launch a script from it. There are many other ways you can launch scripts from the "/tmp" folder but "sudo" is the most consistent way across multiple distribution’s to do it. This also allows us to complete the operation without having change user permissions so the user doesn’t have to modify them afterword’s to get them back to their original configuration, as well as we will be able to relinquish root privileges on the fly.


Perl
Many Linux distributions come with Perl pre-installed but this does not mean that it has all the Perl modules that are required for us to utilize the server in a backup and restore function and once all of the correct modules are install we must be able to launch these modules as needed. Some systems are setup with software called SELinux. This software will make it so that only certain modules can be launched from SSH. The Linux distribution must allow us to launch all of these modules from "SSH" at any amount at a time. 

Here is a list of the modules that we require for Veeam to work properly with a Linux install:
  • Constant
  • Carp
  • Cwd
  • Data::Dumper
  • Encode
  • Encode::Alias
  • Encode::Config
  • Encode::Encoding
  • Encode::MIME::Name
  • Exporter
  • Exporter::Heavy
  • File::Path
  • File::Spec
  • File::Spec::Unix
  • File::Temp
  • List::Util
  • Scalar::Util
  • SOAP::Lite
  • Socket
  • Storable
  • Threads
You can find out which modules are installed by running:
perldoc -q installed

One of the most widely used Linux distribution’s currently is CentOS 6/7 and in this distribution the "Data::Dumper Perl" module is not installed by default. 


SSH
SSH is a program for logging into a remote machine and for executing commands on a remote machine. This is software that we use to log in to a Linux environment. Most systems have this software installed by default but if the Veeam server is having issues logging into a Linux environment you should check if SSH is installed. 

The configuration of your SSH install must allow using tunneled clear text passwords. Info on how to do this can be found on this KB: http://www.veeam.com/kb1512


SCP
SCP copies files between hosts on a network. It uses SSH for data transfer, and uses the same authentication and provides the same security as SSH. We use this software as our file mover on Linux. It is common for Centos core to not include this SCP module in the default install. 


"mlocate", "gzip" and "tar"
"mlocate" is a new implementation of locate, a tool to find files anywhere in the file system based on their name, using a fixed pattern or a regular expression. We utilize "mlocateonly for  VM Guest OS Indexing (Linux) .

"gzip" and "tar" are archive tools very much like WinZip. We use these to compress and decompress files going to and from the server. 

All of these files and their required configurations must be installed on the Linux environment prior to its usage with Veeam Backup and Replication to fully use all of our features. 

 

More Information

http://www.veeam.com/kb2007 merged
 

Veeam Management Pack 8.0 Update 6 cumulative patch for Veeam Backup&Replication monitoring

$
0
0

Challenge

Veeam Management Pack 8.0 Update 6 cumulative patch for Veeam Backup&Replication monitoring.

Cause

Сonfirm that you have Veeam Management Packs version 8.0.0.2467 installed prior to installing this cumulative patch. You can check this under SCOM console > Administration > Management Packs. After upgrading, the build versions for Veeam Backup Monitoring and Veeam Backup Discovery Management Packs will be 8.0.0.2474.
 
As a result of on-going R&D effort and in response to customer feedback, cumulative patch for Veeam Backup & Replication monitoring includes a set of bug fixes which are listed below:
  • Veeam Backup&Replication related reports in Veeam Management Pack result in displaying incorrect data or “No relevant data found” message. Protected VMs report show all VMs as Unprotected.
  • Backup Jobs data is missing in Veeam MP views in SCOM for particular Veeam Backup & Replication servers.
  • "Veeam Backup Repository Maintenance Mode Renewal" monitor changes its state from Healthy to Warning every interval (1 hour, by default).

Solution

To apply the cumulative patch:
  1. Unpack the archive.
  2. Import the Management Packs to SCOM: SCOM > Administration > Management Packs > Import MPs.
  3. Ensure that the build number for Veeam Backup Monitoring and Veeam Backup Discovery management packs became 8.0.0.2474.
In case Backup jobs data is missing in Veeam MP views in SCOM for particular Veeam Backup & Replication servers, perform the following steps after applying the patch:
  1. Open SCOM > Authoring > Object Discoveries > Veeam Backup Job Discovery (Discovered type: Veeam Backup Abstract Job).
  2. Right-click and select "Override for all objects of class: Veeam Backup Jobs".
  3. In the Override Properties change the Discovery SQL Job parameter value from True to False.
  4. Save the overrides to the dedicated Management Pack.

More Information

[[DOWNLOAD|DOWNLOAD CUMULATIVE PATCH|https://www.veeam.com/download_add_packs/vmware-microsoft-esx-monitoring/kb2940/]]

MD5: 4DF2471112086034EAECF842A7350760
SHA-1: 9E879E21F296120AFDC8C54038E24A5398EB4A05
SHA-256: 3181FA48D6A619F21806A0BBD509E307A94A67096FC665AF10173A78AE7E4238

Should you have any questions, contact Veeam Support.

Veeam Backup & Replication 9.5 U4 Day 0 Update [U4 RTM to U4 GA]

$
0
0

Challenge

This  "Day 0" update is intended only for environments where Veeam Backup & Replication U4 RTM (9.5.4.2399) is installed.

If you are trying to update Veeam Backup & Replication and running a version older than 9.5.4.2399, download the most recent Update ISO directly Veeam website.
 

This update is provided to enable upgrading existing installations of Veeam Backup & Replication 9.5 U4 RTM (build 9.5.4.2399) to generally available version of Veeam Backup & Replication 9.5 U4 GA (build 9.5.4.2615). This update addresses a number of issues reported by early adopters on the U4 RTM build.

All new installations should be performed using Veeam Backup & Replication 9.5.4.2615 ISO that is available for download starting January 22th, 2019. Please, delete the U4 RTM build ISO to ensure you don't accidentally use with your prospects and customers in the future.

Solution

The following RTM build issues are addressed with this update:

•    Legacy subscription license grace period bug for licenses with 0 Workstations causes agent jobs to stop working until you install an Instance license.
•    Non-existing VMs specified in advanced job settings cause jobs to fail, when their presence was not an issue in Update 3a.
•    Direct SAN transport fails for vSphere backup proxies installed on certain non-English OS locales due to "special" characters present in the OS temp path.
•    Backup Copy jobs fail to start after data transfer window opens, if their copy period started during the restricted window.
•    Transaction log backup email reports are missing for Windows agent-based log backup jobs Windows.
•    Inoperational RESTful API V1_3 protocol version (API version used in Update 3a). 

Known Issues

Remote console update will be initiated normally when the RTM console connects to the GA server, however update installation will fail with transport update error. All remote backup consoles must be updated manually with this patch.

More Information

Please confirm you are running version 9.5.4.2399 prior to installing this update. You can check this under Help | About in Veeam Backup & Replication console. After upgrading, your build will be version 9.5.4.2615.

If you are trying to update Veeam Backup & Replication and running a version older than 9.5.4.2399, download the most recent Update ISO directly Veeam website.

Prior to installing this update please reboot the Veeam server to clear any locks on the Veeam services and when the reboot is done, please stop all the Veeam services and apply the update. After installing the update, please start the Veeam services, open the console and allow Veeam B&R to update its components.

NOTE: This patch must be installed on all remote backup consoles manually.

[[DOWNLOAD|DOWNLOAD NOW|https://www.veeam.com/download_add_packs/vmware-esx-backup/9.5.4.2615.update0/]]
MD5: 63e3b0b0bdc1b10f89707045eb9aa826
SHA1: 23cf299ceae2ab74ee6554a7b79a2339b2907de1

NOTE: "Add or Remove Programs" will still show version 9.5.4.2399 after Veeam Backup & Replication 9.5 U4 Day 0 Update is installed. This is expected behavior. The actual version can be looked up in Help | About dialog of Veeam Backup & Replication console.

Veeam Agent for Linux support of Red Hat Enterprise Linux

$
0
0

Challenge

This article describes Veeam Agent for Linux support of different kernel versions of Red Hat Enterprise Linux and its derivatives.
 

Cause

Last-minute kernel patches for Red Hat Enterprise Linux and its derivatives may cause Veeam Agent for Linux to go unstable (veeam.com/kb2786).
 

Red Hat Enterprise Linux versionVAL build numberKernel supported up to
7.x3.0.1.10463.10.0-957.12.1
6.x3.0.0.8652.6.32-754.9.1


 

Failed job is marked as Successful on the Cloud Provider side

$
0
0

Challenge

In some cases a SP backup server receives "Success" status of a tenant job even when the job has failed on the Tenant's server.

Cause

Generally, cloud job sessions are marked failed on the SP backup server in the following cases:
  • All cloud gateways are unavailable
  • There is not enough space on the disk
  • An existing connection was forcibly closed by the remote host
  • Repository quota exceeded
All issues above should be corrected by a SP, and therefore Veeam reports such jobs as failed. For other types of issues, a failed job may be marked successful because it cannot be fixed on the SP side and requires involving a tenant.

NOTE: Direct Agent to Cloud job sessions are always marked as successful in the SP's console.
 

Release Notes for Veeam Management Pack 8.0 Update 6

$
0
0

Challenge

Release Notes for Veeam Management Pack 8.0 Update 6

Cause

Please confirm you are running Veeam Management Pack 8.0 prior to installing this update. You can check this in Operations Manager console under Administration | Management Packs, the build number should be 8.0.0.2218 or later.

To install the update, import the management packs through Operations Manager console > Administration > Management Packs > Import Management Packs.

To obtain Veeam MP 8.0 for System Center - Update 6, please download it here.

NOTE: It is important that you update Veeam Management Pack Core Services to Support TLS 1.2 Protocol for Update 6.

Solution

New in This Release
  • Additional Hypervisor support vSphere 6.7. VMware vSphere 4.0 and later (including vSphere 6, vSphere 6.5, vSphere 6.7 and vSphere 6.7 U2) 
  • Monitoring SQL Transaction Log Backup Job. Veeam MP separately monitors SQL Transaction Log Backup jobs running inside backup jobs with the enabled application-aware processing option. For this purpose, Veeam MP includes a new Veeam SQL Transaction Log Backup Jobs view and Veeam Backup: SQL Transaction Log Job Status monitor.
  • Improved performance of Morning Coffee Dashboards. In previous versions, Morning Coffee Dashboards tended to load slowly for large-scale environments. In Veeam MP 8.0 Update 6, the performance of Morning Coffee Dashboards has been significantly improved.
  • A new metric for Veeam VMware Collector. Due to the Ops Mgr Health Service (Monitoring Agent Service) limitations that appear when a Veeam VMware Collector processes a large amount of data, it is required to distribute monitoring load among multiple Veeam VMware Collectors in large environments. To assess the monitoring load on Veeam VMware Collectors more precisely, Veeam MP provides a new % Object Monitoring Load metric.
Resolved Issues
  • No monitoring for Hyper-V hosts that exceeded the license limit. Veeam MP license limits the number of Hyper-V hosts enabled for monitoring in Ops Mgr. Earlier, if the number of licensed Hyper-V hosts was exceeded and new hosts were added to the Ops Mgr infrastructure, Ops Mgr automatically stopped monitoring the old infrastructure and started monitoring the newly added hosts. In Veeam MP 8.0 Update 6, the issue was resolved, and Ops Mgr continues monitoring the old infrastructure.
  • Ops Mgr event log shows excessive BackupCopyJobSessionFinished events. In previous versions, the Ops Mgr event log contained a large number of 3101 events caused by errors in the backup copy job status collection process. In Veeam MP 8.0 Update 6, the issue was resolved.
Known Issues and Limitations
  • Collector Autodeploy limitations. If you use the Collector Auto-Deployment feature to automatically deploy Veeam VMware Collectors on Management Servers, keep in mind that it will install clear 8.0 version without patches. When the installation completes, run the ISO\Update\VeeamMP80_Update6.exe installation file on each Veeam Collector to install patches.  
  • Veeam MP for Hyper-V stops collecting storage metrics. If storage migrates to another volume, the storage performance collection will halt and Veeam MP will stop collecting the following metrics: Storage IOPS, Storage KB Total/sec, Storage Flush Count and Storage Error Count. Note that this issue does not affect migration between hosts. To work around the issue, restart the Ops Mgr agent after storage migration.

More Information

Should you have any questions, contact Veeam Support.

SQL - A VSS critical writer has failed. Writer's state: [VSS_WS_FAILED_AT_PREPARE_SNAPSHOT]

$
0
0

Challenge

When attempting to backup a SQL server that is hosting a significant amount of databases the following error is thrown:
 

Unable to release guest. Error: Unfreeze error: [Backup job failed. Cannot create a shadow copy of the volumes containing writer's data. A VSS critical writer has failed. Writer name: [SqlServerWriter]. Class ID: [{}]. Instance ID: [{}]. Writer's state: [VSS_WS_FAILED_AT_PREPARE_SNAPSHOT]. Error code: [0x800423f4].]
 
Error: Unfreeze error: [Backup job failed. Cannot create a shadow copy of the volumes containing writer's data. A VSS critical writer has failed. Writer name: [SqlServerWriter]. Class ID: [{}]. Instance ID: [{}]. Writer's state: [VSS_WS_FAILED_AT_PREPARE_SNAPSHOT]. Error code: [0x800423f4].]

Cause

Veeam Backup & Replication sends a VSS API request to freeze an entire SQL server including all databases. In SQL Server, the snapshot backup of each database uses five threads in the Sqlservr.exe process. Additionally, other activities may also use threads in the Sqlservr.exe process. Depending on the configuration of SQL Server, the available threads may be used up if you create a snapshot backup of many databases at the same time. 

It is possible to process the VM in a crash-consistent manner by disabling Application-Aware Image Processing within the job.

Solution

Microsoft does not recommend creating a snapshot for more than 35 databases at the same time. It is advised to create another SQL Server and move the databases that are causing failure to the other SQL server. Adding additional CPU cores and RAM may also fix the issue.
In certain scenarios changing the max worker threads Server Configuration Option may help negate the issue. However, it is advisable to contact Microsoft support for verifying this step.

For further troubleshooting, Microsoft recommends figuring out which SQL instance has the problem. Usually, the problematic SQL instance will be named in the first recorded SQLVDI error.

Please refer to the following articles for details:

More Information

Note: Veeam Support is not able to provide assistance with modifying the number of threads within SQL. Please contact Microsoft Support for assistance.

Insufficient Storage for VSS Error "0x8004231F or Error: VSSControl: -2147467259"

$
0
0

Challenge

The following error occurs during backup or replication:
 
VSSControl: -2147467259 Backup job failed. Cannot create a shadow copy of the volumes containing writer's data. VSS asynchronous operation is not completed. Operation: [Shadow copies commit]. Code: [0x8004231f].

Cause

This error is usually caused by insufficient disk space on one volume in the Windows OS being backed up. This can include the System Reserved Partition.
 
It can also be caused by defining shadow storage associations with a maximum size smaller than necessary to create the shadow copy.
 
This issue may also occur if the volume is larger than the size which Microsoft VSS supports (64TB).
Operation: [Shadow copies commit]. Code: [0x80042306]
More information: https://support.microsoft.com/en-us/help/2967756/usability-limit-for-volume-shadow-copy-service-vss-in-windows

Solution

Verify Sufficient Free Space

Within the VM guest OS that cannot be backed up or replicated, use the Disk Management utility (diskmgmt.msc) to view free space on each NTFS volume:
User-added image

If a volume is low on disk space, the solution is to delete files, expand the volume, or redirect shadow copies to another volume. For virtual machines, the simplest solution is usually to increase the size of the VM’s hard disk, then expand the volume in Disk Management.

Although it is sometimes possible to create a shadow copy using less than 1% of the free space on a volume, 15%-20% free space is often required on busy volumes. The smallest amount of space that can be allocated is configurable, but Microsoft Support has recommended maintaining at least 42 MB free on the system reserved partition.

If it is not clear which volume has insufficient space, see “How to Check Which Volume is Causing the Error”, below.

 

(Optionally) Redirect Shadow Copies

It is possible to change the shadow storage association to use a volume with sufficient free space; The location can be changed from the Shadow Copies utility, or from the command line. To access the utility, right click any volume and choose Configure Shadow Copies.
Warning: This is not recommended in a Hyper-V environment.

Shadow Copies Utility (Server OS Only)

To access the utility, right click any volume and choose Configure Shadow Copies. On older server operating systems, this may instead be a tab in Properties.
  1. Select the volume with insufficient space;
  2. Click Settings…
  3. In the dropdown labeled Located on this volume, select a volume with sufficient space to store the shadow copies.
User-added image

Command Line (Client or Server OS)

All commands below should be run from an administrator command prompt.

Use vssadmin list shadowstorage to view existing shadow storage associations. If no shadow storage exists for any volume, the command response will be “No items found that satisfy the query.”

If no association is listed for the volume, run vssadmin add shadowstorage to change the location of the shadow storage area. For example, to redirect shadows from D: to E:


vssadmin add shadowstorage /for=D: /on=E: /maxsize=200GB

If a shadow storage association already exists, run vssadmin resize shadowstorage to change the size of the shadow storage area. For example, to redirect shadows from D: to E:

vssadmin resize shadowstorage /for=D: /on=E: /maxsize=200GB

The /maxsize parameter is not optional, but can be set as /maxsize=UNBOUNDED. Otherwise, a value of 15-20% of the source volume’s size is generally recommended for busy servers.
 

How to Check Which Volume is Causing the Error

In some cases, it may not be obvious which volume needs to be modified. To isolate the problem, perform the following steps within the VM guest OS that cannot be backed up or replicated.
Create and then delete a shadow copy of each volume, one at a time. To access the GUI, right click any volume and choose Configure Shadow Copies. On older operating systems, this may instead be a tab in Properties. In the Shadow Copies utility:
  1. Select a volume;
  2. Click Create Now;
  3. If this is successful, select the shadow copy and click Delete Now;
  4. Repeat steps 1-3 for each volume.
User-added image
This can also be performed using the Diskshadow utility, which may provide a better match for the behavior of the VSS API used by Veeam Backup & Replication.

If the affected volume has sufficient free disk space, the shadow storage limit may be too small. Redirect the shadow copies as shown above, or increase the shadow storage limit.

 

More Information

It is not necessary to enable shadow copies for shared folders. It is normal for “Next Run Time” to show "Disabled".

Hyper-V Guest processing skipped (check guest OS VSS state and integration components version)

$
0
0

Challenge

Guest VMs will fail to engage VSS when application-aware image processing is enabled generating an error:

Error Guest processing skipped (check guest OS VSS state and integration components version) (System.Exception)

Cause

This issue has multiple potential causes, usually related to the Integration Services version of the failing guest server. This issue occurs when Application-Aware image processing is utilized in the Backup or Replication job settings for transactional quiescence using Microsoft VSS

Solution

Please Note:

  • A list of supported Guest OSes for each version of Hyper-V can be found here
  • Important! Server 2012 R2 and higher guests are not supported for VSS-enabled (AAIP) backups on 2008 R2 hosts due to integration components incompatibility.
  • If the VM Guest OS is 2012 and the Host is 2008R2:
    • View the Guest OS Application Event logs for errors with source: vmicvss and Event ID: 13.
    • If this error is present, open the Registry Editor (regedit) and navigate to:
      HKLM\SOFTWARE\Microsoft\WindowsNT\CurrentVersion\SystemRestore\
      Within that key create a new DWORD
      Name: ScopeSnapshots
      Value: 0
    • Note: If the SystemRestore key is not present, you will have to create it.

The solution section of this knowledge base article has been split into four different sections. Please review each step of the following sections.

  1. Integration Services
  2. Within the Guest
  3. VM Configuration
  4. Verification

 

 

1. Integration Services

Click here for a list of Hyper-V Integration Services and their corresponding build numbers.

How to identify…

1. Using Event Viewer

This section will provide directions on ensuring the Hyper-V Integration Services are up to date within the Guest OS of the VM that is failing to backup.

If Hyper-V Integration Services are out of date you will find Event ID 4000 within the Hyper-V-Integration section of the Event Viewer on the Hyper-V host where the VM is located.
User-added image

2. Using PowerShell (Server 2012 or newer)

Run the follow command in an Administrative PowerShell prompt on the host where the VM that failed to backup resides.
 

Get-VM | select VMName, IntegrationServicesState


The results of which will list out each present VM, and the state of its integration services.
User-added image

How to correct:

Note: A reboot of the virtual machine will most likely be required to complete the Integration Services update.

The following information is from the Microsoft page found here.

Install or update integration services

For hosts earlier than Windows Server 2016 you'll need to manually perform install the update from within the guest operating system. These steps cannot be automated or executed within a Windows PowerShell session.

  1. Open Hyper-V Manager. From the Tools menu of Server Manager, click Hyper-V Manager.
  2. Connect to the virtual machine. Right-click the virtual machine and click Connect.
    User-added image
  3. From the Action menu of Virtual Machine Connection, click Insert Integration Services Setup Disk. This action loads the setup disk in the virtual DVD drive.
    User-added image
    Depending on the guest operating system, you may need to start the installation manually.
    User-added image
  4. After the installation finishes, you may be prompted to restart.
    User-added image

 

 

2. Within the Guest

The following steps and checks are to be performed within the Guest OS of the VM that is failing to backup.

  1. Make sure Windows is running the most recent service pack.
     
  2. Ensure that the VSS Storage Area and Volume Match
    1. From an Administrative Command Prompt, run the command ‘VSSUIRUN.exe”
      User-added image
    2. Check the [Settings] for each Volume and ensure that the Volume and the Storage area match.
      User-added image
       
  3. Ensure there are no Dynamic disk or FAT\FAT32 volumes
    1. Open Disk Management (diskmgmt.msc)
    2. Review the Type and File System columns
    3. VSS is not compatible with Dynamic disks or FAT\FAT32
      Note: The VHD(X) that the VM runs off can be dynamic. The volume within the Guest OS cannot.
      User-added image
      All volumes must be NTFS or ReFS
       
  4. Check System Reserved partition free space.
    1. System Reserved partition must have more than 42MB of space free.
    2. If less than 42MB is free, try creating a shadow copy for the volume.
      User-added image
    3. Remember to delete the Shadow Copy if it is successful.
       
  5. Start\Restart the “Hyper-V Volume Shadow Copy Requestor
    1. Open Services (services.msc)
    2. Find the “Hyper-V Volume Shadow Copy Requestor” service.
    3. If it is ‘Stopped’, Start it. (If the service will not start, check in the VM settings under Integration Services, and ensure the "Backup (volume Checkpoint)" option is enabled.)
    4. If it is ‘Running’, restart it.

 


 

 

3. VM Configuration

The following steps and checks are to be performed from the Hyper-V host level.

  1. Make sure the VM has a SCSI controller. One must be present, even if there are no devices to use the SCSI controller.
    •  The error will present itself in the Hyper-V VMMS > Admin Event log. Example:User-added image
      “The virtual machine ' Vm-Name' cannot be hot backed up since it has no SCSI controllers attached. Please add one or more SCSI controllers to the virtual machine before performing a backup. (Virtual machine ID).”
  2. Within the Virtual Machine settings verify that the “Backup (Volume Snapshot)” option is enabled.
    • User-added image
    • User-added image
  3. Make sure that the virtual machine files (VHD files) are not sitting in the root folder of the CSV, as this may prevent correct snapshot creation due to permission restrictions. We strongly recommend keeping virtual machine files in separate folder. More information regarding this can be found here.
    • User-added image

 


 

 

Verification

Performing the following will allow you to determine if the steps performed above have corrected the issue without the need to run the Veeam Backup & Replication job again.

Perform the following steps on the Hyper-V host that the VM is running on.
    1. Open an Administrator Command Prompt.
    2. Run the command:
      Diskshadow /L C:\writers.txt
      User-added image
    3. Run the command:
      list writers
      User-added image

Open the file that was created and and locate the VM name in the section for the Hyper-V writer. For each VM there's a "Caption" entry. The caption should read "online" or "child partition", and not "offline" or "saved state".

More Information

PowerShell script to tell you if you need to update your Integration Services
https://blogs.msdn.microsoft.com/virtual_pc_guy/2013/04/29/powershell-script-to-tell-you-if-you-need-to-update-your-integration-services/

Recommended hotfixes for Hyper-V servers:

http://www.veeam.com/kb1838
http://blogs.msdn.com/b/virtual_pc_guy/archive/2009/02/02/looking-at-the-hyper-v-event-log.aspx
http://blogs.technet.com/b/virtualization/archive/2008/08/29/backing-up-hyper-v-virtual-machines.aspx


HCL - Cloudian HyperStore

$
0
0

Challenge

VeeamReadyObject

Product Information:

Company name: Cloudian
Product Family: HyperStore
Status: Veeam Ready – Object
Classification Description: Verified object storage solutions that has been tested with Veeam Backup & Replication Cloud Tier features.

Solution

Product Details:

Model number: Cloudian HyperStore 1508
Storage Category: Scale-out Object Storage System
Drive quantity, size, type: Each node has 2x480 GB SSD mirrored for boot devices and 12x 8 GB SAS disks for object storage to store user data
Storage configuration: 3 nodes minimum. Storage policies with either replication factor (RF) or erasure coded (EC) or a combination of both define protection levels and are applied on a per bucket basis. For test bucket, storage policy used RF replication factor.
Firmware version: v7.1.3
Connection protocol and speed: 2x 10 Gb/s ports on single NIC (Ethernet) per node
Additional support: All models and configurations of HyperStore for S3 compatible storage with specifications equivalent or greater than the above.

General product family overview:
Break through the capacity barrier with Cloudian HyperStore S3 object storage. Gain simplicity and one-click data management in your data center, across sites, around the world, or in the cloud. Cloudian’s limitless capacity, global data fabric and single management view lets you do more, at less cost, and derive more value from your data.

Veeam testing configuration:

Veeam Build Number: 9.5.4.2282

 

Vendor recommended configuration:

Vendor Settings:

  • At least one S3 bucket with a folder for Veeam data is required
  • Cloudian HyperStore SSL must be enabled to use the https S3 endpoint. After deploying HyperStore, the included online documentation and administration manual describes the detailed procedure.

HCL - Huawei FusionStorage

$
0
0

Challenge

VeeamReadyObject

Product Information:

Company name: Huawei Technologies Co., Ltd.
Product Family: FusionStorage
Status: Veeam Ready – Object
Classification Description: Verified object storage solutions that has been tested with Veeam Backup & Replication Cloud Tier features.

Solution

Product Details:

Model number: FusionStorage
Storage Category: Scale-out Cloud Storage
Drive quantity, size, type: Storage Mediums: HDD\SSD | Cache type: SSD, NVDIMM, and RDIMM
Storage configuration: FusionStorage uses EC (erasure coding) technology to achieve data redundancy. Optional, FusionStorage uses 2 SSDs for cache.
Firmware version: v7.0.0
Connection protocol and speed: Ethernet, RoCE, and InfiniBand
Additional support: All models and configurations of FusionStorage for S3 compatible storage with specifications equivalent or greater than the above.

General product family overview:
Fully distributed cloud storage with excellent scalability. The on-board system software integrates the local storage resources of general-purpose servers into fully distributed storage pools, to provide block, object, or file storage resources to the upper layer.

Veeam testing configuration:

Veeam Build Number: 9.5.4.2753

HCL - Wasabi Hot Cloud Storage

$
0
0

Challenge

VeeamReadyObject

Product Information:

Company name: Wasabi Technologies
Product Family: Wasabi Hot Cloud Storage
Status: Veeam Ready – Object
Classification Description: Verified object storage solutions that has been tested with Veeam Backup & Replication Cloud Tier features.

Solution

Product Details:

Object Storage Tiers: Wasabi Hot Cloud Storage (Wasabi currently has one tier of storage)
Object Storage Service Description: Wasabi is a S3-compatible public cloud object storage service

General product family overview:
Wasabi is a cloud-based object storage service for a broad range of applications and use cases. Wasabi is designed for individuals and organizations that require a high-performance, reliable, and secure data storage infrastructure at minimal cost.
Wasabi has much higher sustained read and write speeds. In addition, with Wasabi, the time to first byte is a fraction of the time comparatively. Wasabi is accessed over any public or private network speeds.

Veeam testing configuration:

Veeam Build Number: 9.5.4.2753

HCL - NetApp StorageGrid

$
0
0

Challenge

VeeamReadyObject

Product Information:

Company name: NetApp
Product Family: StorageGrid
Status: Veeam Ready – Object
Classification Description: Verified object storage solutions that has been tested with Veeam Backup & Replication Cloud Tier features.

Solution

Product Details:

Model number: SG5760
Storage Category: Webscale Object Storage
Drive quantity, size, type: 240 x 4TB NS-SAS drives
Storage configuration: 4x SG5760s each with 60x4TB NL-SAS drives, configured using dynamic disk pools (8+2)
Firmware version: 11.1.1.3-20181130.1854.43f37b8
Connection protocol and speed: 10GbE
Additional support: All models and configurations of StorageGrid for S3 compatible storage with specifications equivalent or greater than the above.

General product family overview:
NetApp StorageGRID Webscale (SGWS) is an Object Storage platform which is flexible and highly scalable while supporting multiple RESTful APIs for storing and managing data. Efficient, Durable, and Flexible. Drive cost savings without sacrificing durability with NetApp StorageGRID Webscale’s hierarchical erasure coding. Protecting at the node level and with geo-distributed coding, customers can create policy-driven data protection with multiple levels of granularity. They can choose a combination of full copies and/or geo-distributed coded copies to balance performance needs and cost savings between different sets of data or during the object’s lifecycle.

Veeam testing configuration:

Veeam Build Number: 9.5.4.2399

 

Vendor recommended configuration:

Vendor Settings:

  • For data protection, used default 2-copy rule

HCL - Pure Storage FlashBlade (Object)

$
0
0

Challenge

VeeamReadyObject

Product Information:

Company name: Pure Storage
Product Family: FlashBlade
Status: Veeam Ready – Object
Classification Description: Verified object storage solutions that has been tested with Veeam Backup & Replication Cloud Tier features.

Solution

Product Details:

Model number: FlashBlade
Storage Category: All Flash Storage
Drive quantity, size, type: 7x 8TB Blades – supports up to 15 blades with various capacities available
Storage configuration: N/A
Firmware version: 2.2.11
Connection protocol and speed: 40 GbE
Additional support: All models and configurations of FlashBlade for S3 compatible storage with specifications equivalent or greater than the above.

General product family overview:
FlashBlade is a fast and dense unstructured data platform from Pure Storage that provides on-premise rapid backup and recovery of archival data. Additionally, Pure Storage FlashBlade provides high-performance in a dense-form factor for other unstructured data primary use cases such as machine learning, deep learning, and electronic design automation (EDA), among others.

Veeam testing configuration:

Veeam Build Number: 9.5.4.2399

Viewing all 4487 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>