Challenge

Cause

You have reached the limit of simultaneously opened SSH sessions.

Solution

You may increase the limit of SSH connections on the linux repository by changing etc/ssh/sshd_conf settings:

ClientAliveInterval 30
TCPKeepAlive yes
ClientAliveCountMax 99999
MaxSessions 200
MaxStartups 100:30:200

Challenge

You need to be able to access the Internet from the isolated Virtual Lab.

Solution

NOTE: The function documented in this KB enables the virtual lab proxy appliance to act as an internet proxy. This proxy function only passes web browser traffic. This will not allow for any other type of traffic (e.g. ICMP, FTP, or SSH) to leave the isolated environment.

──────────────────────────────────────────────────────────
Veeam Backup & Replication 7.x, 8.x, 9.x
──────────────────────────────────────────────────────────
 
Within the configuration of the Virtual Lab, on the Proxy tab, select the Allow proxy appliance to act as internet proxy for virtual machines in this lab check box. In the Port field, specify a port for HTTP traffic. By default, port 8080 is used. In the Production proxy field, you can optionally specify an IP address or a fully qualified domain name of an Internet-facing proxy server that VMs must use to access the Internet.
 
After a VM has been started using this Virtual Lab you must adjust the proxy settings to enable internet access. To do this, open Internet Options > Connections > LAN Settings > Proxy server and specify the IP address of the proxy appliance on the isolated network and port number.





──────────────────────────────────────────────────────────
Veeam Backup & Replication 5.x and 6.x
──────────────────────────────────────────────────────────

1. Open the registry editor and create the following key:
   HKLM\SOFTWARE\VeeaM\Veeam Backup and Replication\SureBackup
   
   The following features can be enabled:
   1. Enable Internet access from inside lab.
      Create a new DWORD in the above key (1=enabled,0=disabled):
      
      v5: VLabProxyEnable
      v6: VLabProxyEnabled
       
   2. Customize the proxy port
      Create the following DWORD.
      If the DWORD is not created port 8080 is used.
      Note: Remember to change the option to decimal before entering a value.
      
      VLabProxyHTTPPort
       
   3. Set upstream proxy server.
      For use if Virtual Lab production interface cannot access internet.
      If this String does not exist, the proxy appliance must have direct internet access from its production network interface.
      Create the following String.
      
      VLabProxyServer
      
      Note: Authentication on upstream proxy (username/password) is NOT supported.
       
2. Restart Veeam Backup Service.
3. Create a NEW virtual lab.

Remember to adjust proxy settings in the Internet Options on every sandboxed VM. To do that, open Internet Options > Connections > LAN Settings > Proxy server, and specify the proxy appliance IP address on the isolated network and the port number.

 

Challenge

To ensure sufficient use of resources and faster jobs performance, it is important to plan your backup, replication and copying jobs in a proper way.

Solution

For information regarding Job Layout, Object Selection, Job Scheduling,  and Best Practices for any Backup Job Settings, please refer to this page:
https://www.veeambp.com/job_configuration/backup_job.html
  
 For information regarding the Backup Methods and the differences here and Pros and Cons for each, please refer to this page:
https://www.veeambp.com/job_configuration/backup_methods.html
 
For information regarding Encryption and Recommendations on When to Utilize it, please refer to this page:
https://www.veeambp.com/job_configuration/encryption.html
 
For information regarding Deduplication and Compression settings for any backup jobs, please refer to this page:
https://www.veeambp.com/job_configuration/deduplication_and_compression.html
 
For information regarding Backup Copy Jobs and Suggestions for Scheduling, Job Layout, and Object Selection, please refer to this page:
https://www.veeambp.com/job_configuration/backup_copy_job.html
 
For information regarding Replication Jobs and Proper Setup and Configuration, please refer to this page:
https://www.veeambp.com/job_configuration/replication_job.html
 
For information regarding Application-Aware Image Processing and When to Use and How it Works, please refer to this page:
https://www.veeambp.com/job_configuration/application_aware_image_processing.html

More Information

Challenge

Product Information:

Company name: Quest Software, Inc.
Product Family: QoreStor 6.0
Status: Veeam Ready – Archive
Classification Description: Verified disk archive storage that can be used as a Backup Copy target. Synthetic full backups, granular restores, and vPower features may not provide sufficient performance or be supported.

Solution

Product Details:

Model number: DELL OEM R540
Storage Category: Software Defined Storage
Drive quantity, size, type: 12 – 8TB NL-SAS HDD, 2 – 960GB SATA SSD
Storage configuration: RAID6 for HDD (data), RAID1 for SSD (metadata)
Firmware version: V6.0.0 Build 668
Connection protocol and speed: SMB, 2-10GbE bonded LACP
Additional support: All models and configurations of QoreStor 6.0 on hardware platforms with specifications equivalent or greater than the above

Software-defined secondary storage platform for backup. ... Your storage will shrink with QoreStor deduplication. Accelerate backups, variable block deduplication, and direct to storage backup by using QoreStor with Veeam Software.

Veeam testing configuration:

Veeam Build Number: 9.5.4.2753

Job Settings:

Repository Settings:

Vendor recommended configuration:

Hardware Settings:

• Array deduplication used in testing – Yes
• Array compression used in testing – Yes
• Jumbo frames used in testing – Yes, 9000 MTU

More Information

Challenge

Product Information:

Company name: Huawei Technologies Co., Ltd.
Product Family: Huawei OceanStor
Status: Veeam Ready - Repository
Classification Description: Verified backup storage that supports all Veeam backup and restore features.

Solution

Product Details:

Model number: Huawei OceanStor V5 Converged StorageSystem
Drive quantity, size, type: 25 - 600GB SAS
Firmware version: V5
General product family overview:

Huawei OceanStor V5 Converged Storage provides Cloud architecture-oriented operating system, high-performance hardware platform, and a complete suite of smart management software. Convergence of file, flash, backup, high-, mid, and low-end storage, and third-party storage – allocate the resources you need, when you need them. Leading active-active integrated SAN and NAS solution, ensuring business continuity for customers.

Veeam testing configuration:

Veeam Build Number: 9.5

Job Settings:

Repository Settings:

More Information

Challenge

Product Information:

Company name: Quest Software, Inc.
Product Family: QoreStor 6.0
Status: Veeam Ready – Archive
Classification Description: Verified disk archive storage that can be used as a Backup Copy target. Synthetic full backups, granular restores, and vPower features may not provide sufficient performance or be supported.

Solution

Product Details:

Model number: DELL OEM R540
Storage Category: Software Defined Storage
Drive quantity, size, type: 12 – 8TB NL-SAS HDD, 2 – 960GB SATA SSD
Storage configuration: RAID6 for HDD (data), RAID1 for SSD (metadata)
Firmware version: V6.0.0 Build 668
Connection protocol and speed: SMB, 2-10GbE bonded LACP
Additional support: All models and configurations of QoreStor 6.0 on hardware platforms with specifications equivalent or greater than the above

Software-defined secondary storage platform for backup. ... Your storage will shrink with QoreStor deduplication. Accelerate backups, variable block deduplication, and direct to storage backup by using QoreStor with Veeam Software.

Veeam testing configuration:

Veeam Build Number: 9.5.4.2753

Job Settings:

Repository Settings:

Vendor recommended configuration:

Hardware Settings:

• Array deduplication used in testing – Yes
• Array compression used in testing – Yes
• Jumbo frames used in testing – Yes, 9000 MTU

More Information

Challenge

Product Information:

Company name: QNAP Systems, Inc.
Product Family: TS-2088xu
Status: Veeam Ready - Repository
Classification Description: Verified backup storage that supports all Veeam backup and restore features.

Solution

Product Details:

Model number: TS-2088xu
Storage Category: RAID Storage Array
Drive quantity, size, type: 8 – 4TB SATA HDD
Storage configuration: RAID 6, no SSD caching
Firmware version: 4.4.1.0998
Connection protocol and speed: SMB 10GbE
Additional support: All models and configurations of TS-2088xu with specifications equivalent or greater than the above

A NAS compute and storage solution in a box, with versatile storage interfaces which can take care of the demands of storage and capacity. The TS-2088XU Extreme Computing Platform is built with Intel® Xeon® W processor supporting multiple graphics/acceleration cards, DDR4 memory, and support for both 2.5” and 3.5” SSDs and SATA SSDs.

Veeam testing configuration:

Veeam Build Number: 9.5.4.2866

Job Settings:

Repository Settings:

Vendor recommended configuration:

Hardware Settings:

• No array deduplication used in testing
• No array compression used in testing
• Jumbo frames used in testing (MTU=9000)

Challenge

Cause

Solution

More Information

Challenge

Product Information:

Company name: Nexenta
Product Family: NexentaStor
Status: Veeam Ready - Repository
Classification Description: Verified backup storage that supports all Veeam backup and restore features.

Solution

Product Details:

Model number: NexentaStor
Drive quantity, size, type: 24 - SAS HDD
Firmware version: 5.1
Additional support: Any NexentaStor with the listed firmware, including an equal or greater quantity of disk drives

NexentaStor delivers unified file (NFS and SMB) and block (FC and iSCSI) storage services, runs on industry standard hardware supporting all-flash, hybrid, and all-disk scaling from tens of terabytes to petabyte configurations, and includes all data management functionality by default through an easy to deploy and use graphical user interface.

Veeam testing configuration:

Veeam Build Number: 9.5

Job Settings:

Repository Settings:

More Information

Challenge

Cause

Solution

More Information

Challenge

Solution

• New resource manager added for optimizing parallel task processing.
• Improved speed of the full backup for some guest filesystems.
• Fixed rare service crashes caused by memory leaks.
• Fixed rare service crashes on source clusters with high loads.
• Optimized deleted VM retention for configurations with large number of VMs.
• Persistent job retries have been updated to continue jobs interrupted by the reboot of the proxy appliance.

More Information

Challenge

Solution

• Improved backup performance in some cases due to not enough queue depth on read operations.
• In some cases, the proxy appliance would schedule too many parallel tasks causing resource and performance issues. The bug has been fixed to offer optimal operation.
• Resolved issue with configuration backups being larger than required due to ignoring of configuration backup settings.
• Fixed bug with deleted VM retention not properly cleaning backups of deleted VMs.
• Fixed bug with Veeam Availability for Nutanix AHV service crashes in rare circumstances.
• Fixed bug with backup failures on highly loaded proxy appliances.

More Information

Challenge

Cause

Solution

More Information

Challenge

This update supersedes Veeam Availability Console v3 Patch 1 (build 2703).

Cause

Solution

• Cloud Copies counter on the Overview dashboard does not return any data.
• Backup agents managed by Veeam Backup & Replication report 0 restore points available in the backup policy drill down view. 

• Portal administrators can log in only when using a full domain name of the Veeam Availability Console server. 
• Users belonging to a domain user group which is added to a Veeam Availability Console security group cannot log in to the portal.
• Users belonging to a nested domain group cannot log in to the portal.

• Under certain conditions, Veeam.MBP.Service might be consuming excessive memory.
• Under certain conditions, data collection job fails to retrieve information from a Cloud Connect server that has lots of task sessions on cloud gateway servers. This results in displaying these tenants’ companies as deleted in the Veeam Availability Console UI.
• Tenant password changed in Veeam Cloud Connect is not synchronized with Veeam Availability Console.

• Office 365 and Gmail SMTP servers are not supported for notifications.  

• Inaccessible computers cannot be located when using CSV and IP discovery rule options.

• Full Access UI mode cannot be applied to a backup agent.  
• When using Select All checkbox on the Managed Backup Agents tab agent settings are applied to all computers of all managed companies regardless of the selected scope in the Company\Reseller filter.  
• Licensing attribute is not updated for managed backup agents which leads to license expiration on the backup agent.    
• Backup agent files are not validated when the installation is performed from a local folder without using a master management agent. This may result in a corrupted installation/upgrade of the backup agent. 

• Under certain conditions, management agents fail to upgrade with the following error message “The system cannot find the file specified.”

• Workstation and server backup counters in the Veeam Cloud Connect usage report are mixed up.
• Under certain conditions License usage report for Veeam Backup & Replication servers is not generated. 

• Under certain conditions, all VMs with a cloud copy which belong to different locations are reported as VMs from the default location in the invoice. 

• Querying tenant information with SetLinks parameter may take considerable time.
• The vMsBackudUpToCloud counter does not display data about VM and Agent backup copy jobs targeted to a cloud repository.  

• Cloud repository usage is not updated in ConnectWise Manage agreements when there are unknown files (not related to Veeam backups) in the repository. 
• Tickets state synchronization may stop working when triggering a mass-resolve operation in the ConnectWise Manage application. 

More Information

Challenge

Cause

• Veeam Availability Console server starts using 100% of CPU resources when registering a Company (aka tenant) from the Cloud Connect server.
• Unable to delete a company from VAC UI if a tenant has been already deleted in Veeam Cloud Connect. 
• Optimized PowerShell queries to Veeam Cloud Connect to decrease Veeam.Backup.Satellite processes count. 

• Under certain conditions a company owner may view failover plans that belong to a different company.

• Veeam management agents show "Out-of-date" as their version status.

• Veeam Agent for Microsoft Windows disappears from the Veeam Availability Console UI after applying the backup policy. 
• Backup policies may fail to apply to computers with Scandinavian locales due to a different DateTime delimiter.
• Under certain conditions, a backup policy may fail to delete. 

• Under certain conditions "Cloud Host Memory Quota" and "Company Cloud Host Storage Quota" alarms are not triggered after breaching the configured threshold. 
• When defining RPO in hours in the "VM without backup" alarm, values above 24 are converted into days.
• A failed job after a successful retry is still reported as "failed".
• Under certain conditions, the "Computer without backup" alarm may not trigger.

• Re-configuring a report may result in the "An item with the same key has already been added" error message.
• Under certain conditions, RPO is reported incorrectly in the "Protected VMs" report.
• Total Gross may not be correctly calculated when specifying VAT for managed services.
• Tenant Used Storage may be calculated incorrectly in invoices when VMs are backed up to Cloud Connect repository.
• Compute Time Usage may be calculated incorrectly if the "per month" counter is specified.
• A "Protected Computers" report may fail to generate due to the total files path field for the File-Level Backup mode exceeding the allowed maximum. By default, backup jobs contain folder names along with their location.
• Cloud repository used storage quota may be calculated incorrectly, when the backup agent is backed up to the Veeam Cloud Connect repository.

• Under certain conditions "UsedStorageQuota" and "UsedTrafficQuota" are reported incorrectly through RestAPI. 

Solution

msiexec /update c:\VAC.ApplicationServer.x64_2.0.1.1376.msp /l*v C:\ProgramData\Veeam\Setup\Temp\VACApplicationServerSetup.txt

4. To install the Web UI cumulative hotfix, execute VAC.WebUI.x64_2.0.1.1376.msp as administrator on the VAC Web UI server, or run this cmdlet as administrator:

msiexec /update c:\VAC.WebUI.x64_2.0.1.1376.msp /l*v C:\ProgramData\Veeam\Setup\Temp\VACWebUISetup.txt

5. Log in to VAC Web UI.

More Information

Challenge

Cause

Solution

More Information

Challenge

Veeam Availability Console U1 Cumulative Patch 1913.

This update supersedes Veeam Availability Console U1 Cumulative Patch 1850.

Cause

Please confirm you are running version 2.0.2.1750 or later prior to installing this cumulative patch 1913. You can check this under Windows > Programs and features. After upgrading, your build will be version 2.0.2.1913.

As a result of on-going R&D effort and in response to customer feedback, cumulative patch 1913 includes a set of bug fixes, the most significant of which are listed below:

New Features

• Veeam Backup & Replication 9.5 Update 4 compatibility support. 
• Veeam Cloud Connect 9.5 Update 4 compatibility support.

Resolved Issues

Server

• Under certain conditions password in the SMTP server settings is reset
• Veeam Management Portal Service cannot be started after installing Update 1
• After deleting WAN accelerator component from the Veeam Cloud Connect inventory, records about backup resources available to the tenant might be duplicated

Management Agent

• Management agent RAM consumption might significantly increase when running computer discovery process
• Under certain conditions management agent service fails to start.

Backup Agent

• Under certain conditions backup agent fails to update to version 2.2 via master management agent. 
• Backup policy cannot be applied correctly when folders that are backed up with this policy contain special characters in their names.
• Backup agent cannot be installed to a computer running Windows 10 Home edition.   

Discovery Rules

• After deploying Patch 1824 discovery rules cannot install backup agents to remote computers. To resolve this, install the latest patch and re-create all discovery rules.

Users and Roles 

• Sub-tenant’s password is reset when changing cloud quota in the assigned backup policy 

UI

• After upgrading to Update 1, backup resources of the managed company cannot be adjusted when backup portal is running under heavy load. 

Monitoring & Alarms

• Job name filtering is ignored in the job session state alarm.
• Storage snapshots are treated as a backup repository resulting in triggered alarms for the repository free space.
• Under certain conditions Computer with no backup alarm can send false-positive notifications
• “Item with the same key has already been added” message is displayed when opening the Managed Backup Servers tab in the UI

Notifications

• Multiple email addresses cannot be specified in the Global Notification Settings

Reporting & Billing

• Cloud repository quota usage may report incorrect values when Veeam Agent backups are sent to the cloud repository via backup copy jobs
• Under certain conditions Cloud replication quota usage is not displayed on the dashboard when logged in using managed company user account
• Management agent re-installation results in losing collected data about protected VMs from the managed backup server. This affects Overview dashboard and Protected VMs report that display zero protected VMs
• Overview dashboard and Protected VMs report can display zero protected VMs when using Veeam Cloud Connect 9.5 Update 3a
• After changing report scheduling settings, reports are sent out using the previous and the new time schedule
• Backup policy change was not correctly updated in the Protected Computers report.

RESTful APIs

• Under certain conditions vMsBackedUpToCloud counter does not include backup copies sent to a cloud repository

ConnectWise Manage Plugin

• Under certain conditions ConnectWise Manage configurations cannot be created.
• Under certain conditions not all products created in ConnectWise Manage are accessible for mapping when using the billing function.
• Companies data cannot be collected from ConnectWise Manage due to the following error "An item with the same key has already been added"
• Companies with multiple types cannot be collected from ConnectWise Manage  
• Product quantity in agreements might not be updated when VAC and Manage servers are located in different time zones 

Solution

msiexec /update c:\VAC.ApplicationServer.x64_2.0.2.1913.msp /l*v C:\ProgramData\Veeam\Setup\Temp\VACApplicationServerSetup.txt

msiexec /update c:\VAC.ConnectorService.x64_1.0.0.339.msp /l*v C:\ProgramData\Veeam\Setup\Temp\VACConnectorServiceSetup.txt

msiexec /update c:\VAC.ConnectorWebUI.x64_1.0.0.339.msp /l*v C:\ProgramData\Veeam\Setup\Temp\VACConnectorWebUI.txt

msiexec /update c:\VAC.WebUI.x64_2.0.2.1913.msp /l*v C:\ProgramData\Veeam\Setup\Temp\VACWebUI.txt

More Information

Challenge

Cause

Solution

• Under certain conditions password in the SMTP server settings is reset
• Veeam Management Portal Service cannot be started after installing Update 1
• After deleting WAN accelerator component from the Veeam Cloud Connect inventory, records about backup resources available to the tenant might be duplicated

• Management agent RAM consumption might significantly increase when running computer discovery process

• After deploying Patch 1824 discovery rules cannot install backup agents to remote computers. To resolve this, install the latest patch and re-create all discovery rules.

• Sub-tenant’s password is reset when changing cloud quota in the assigned backup policy 

• After upgrading to Update 1, backup resources of the managed company cannot be adjusted when backup portal is running under heavy load. 

• Job name filtering is ignored in the job session state alarm.
• Storage snapshots are treated as a backup repository resulting in triggered alarms for the repository free space.
• Under certain conditions Computer with no backup alarm can send false-positive notifications
• “Item with the same key has already been added” message is displayed when opening the Managed Backup Servers tab in the UI

• Multiple email addresses cannot be specified in the Global Notification Settings

• Cloud repository quota usage may report incorrect values when Veeam Agent backups are sent to the cloud repository via backup copy jobs
• Under certain conditions Cloud replication quota usage is not displayed on the dashboard when logged in using managed company user account
• Management agent re-installation results in losing collected data about protected VMs from the managed backup server. This affects Overview dashboard and Protected VMs report that display zero protected VMs
• Overview dashboard and Protected VMs report can display zero protected VMs when using Veeam Cloud Connect 9.5 Update 3a
• After changing report scheduling settings, reports are sent out using the previous and the new time schedule

• Under certain conditions ConnectWise Manage configurations cannot be created.
• Under certain conditions not all products created in ConnectWise Manage are accessible for mapping when using the billing function.
• Companies data cannot be collected from ConnectWise Manage due to the following error "An item with the same key has already been added"
• Companies with multiple types cannot be collected from ConnectWise Manage  
• Product quantity in agreements might not be updated when VAC and Manage servers are located in different time zones 

More Information

Challenge

Cause

Solution

• Under certain conditions password in the SMTP server settings is reset
• Veeam Management Portal Service cannot be started after installing Update 1
• After deleting WAN accelerator component from the Veeam Cloud Connect inventory, records about backup resources available to the tenant might be duplicated

• Management agent RAM consumption might significantly increase when running computer discovery process

• Sub-tenant’s password is reset when changing cloud quota in the assigned backup policy 

• After upgrading to Update 1, backup resources of the managed company cannot be adjusted when backup portal is running under heavy load. 

• Job name filtering is ignored in the job session state alarm.
• Storage snapshots are treated as a backup repository resulting in triggered alarms for the repository free space.
• Under certain conditions Computer with no backup alarm can send false-positive notifications

• Cloud repository quota usage may report incorrect values when Veeam Agent backups are sent to the cloud repository via backup copy jobs
• Under certain conditions Cloud replication quota usage is not displayed on the dashboard when logged in using managed company user account
• Management agent re-installation results in losing collected data about protected VMs from the managed backup server. This affects Overview dashboard and Protected VMs report that display zero protected VMs
• Overview dashboard and Protected VMs report can display zero protected VMs when using Veeam Cloud Connect 9.5 Update 3a

• Under certain conditions ConnectWise Manage configurations cannot be created.
• Under certain conditions not all products created in ConnectWise Manage are accessible for mapping when using the billing function.
• Companies data cannot be collected from ConnectWise Manage due to the following error "An item with the same key has already been added"
• Companies with multiple types cannot be collected from ConnectWise Manage  

More Information

Challenge

Cause

Solution

• Under certain conditions password in the SMTP server settings is reset.
• Veeam Management Portal Service cannot be started after installing Update 1.

• Management agent RAM consumption might significantly increase when running computer discovery process.

• After upgrading to Update 1, backup resources of the managed company cannot be adjusted when backup portal is running under heavy load. 

• Job name filtering is ignored in the job session state alarm.
• Storage snapshots are treated as a backup repository resulting in triggered alarms for the repository free space. 

• Cloud repository quota usage may report incorrect values when Veeam Agent backups are sent to the cloud repository via backup copy jobs. 
• Under certain conditions Cloud replication quota usage is not displayed on the dashboard when logged in using managed company user account
• Management agent re-installation results in losing collected data about protected VMs from the managed backup server. This affects Overview dashboard and Protected VMs report that display zero protected VMs.

• Under certain conditions ConnectWise Manage configurations cannot be created.
• Under certain conditions not all products created in ConnectWise Manage are accessible for mapping when using the billing function.  

More Information