User Tools

Site Tools


public:8067_faq:discrepancy_between_ahsaycbs_storage_statistics_vs_physical_data_size

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
public:8067_faq:discrepancy_between_ahsaycbs_storage_statistics_vs_physical_data_size [2020/02/07 16:49]
yuk.cheng
public:8067_faq:discrepancy_between_ahsaycbs_storage_statistics_vs_physical_data_size [2020/11/17 11:30] (current)
edward.chan
Line 17: Line 17:
  </​b>​  </​b>​
  <​br/>​  <​br/>​
- Ahsay Software: ​v7.3.x to v7.17.2.x, v8.1.0.24 to 8.1.1.174, ​v8.3.0.30 or above+ Ahsay Software: ​7.3 to 7.17.2.x<​br>​ 
 +8.1.0.24 to 8.1.1.174, ​8.3.0.30 or above
 </​html>​ </​html>​
  
Line 25: Line 26:
 ===== Description ===== ===== Description =====
  
-Starting from v7 and continuing ​in v8, Ahsay implemented a new storage format for backup data on AhsayCBS and cloud destinations to enhance the backup performance and improve the overall performance of AhsayCBS backup server. ​ All files backed up are stored in either 16 MB or 32 MB blocks depending in the file size on the backup destination(s),​ which can be on AhsayCBS server, local, and or cloud storage destinations. ​+Starting from version 7 and continuing ​on version 8, Ahsay implemented a new storage format for backup data on AhsayCBS and cloud destinations to enhance the backup performance and improve the overall performance of AhsayCBS backup server. ​ All files backed up are stored in either 16 MB or 32 MB blocks depending in the file size on the backup destination(s),​ which can be on AhsayCBS server, local, and or cloud storage destinations. ​
 <WRAP indent> <WRAP indent>
 • The backup and storage of multiple small files (< 16 MB) are combined and stored in 16 MB data blocks or “shared blocks”. Depending on the file type and size of the source file, a 16 MB data block can contain a few small files or even hundreds of small files. • The backup and storage of multiple small files (< 16 MB) are combined and stored in 16 MB data blocks or “shared blocks”. Depending on the file type and size of the source file, a 16 MB data block can contain a few small files or even hundreds of small files.
Line 38: Line 39:
 </​WRAP>​ </​WRAP>​
  
-The discrepancy stems from the handling of small files stored in the 16 MB blocks or shared blocks” in v7/v8+The discrepancy stems from the handling of small files stored in the 16 MB blocks or "shared blocks" ​in version 7 8
 <WRAP indent> <WRAP indent>
 • When a file has been backed up is subsequently deleted from a customer machine, on the next backup job AhsayOBM/​AhsayACB will detect the change and update the related index file to mark the file as deleted and change the location of the files from the data area to retention area. To minimize disk I/O load on the AhsayCBS server, the deleted remains in the 16 MB block. • When a file has been backed up is subsequently deleted from a customer machine, on the next backup job AhsayOBM/​AhsayACB will detect the change and update the related index file to mark the file as deleted and change the location of the files from the data area to retention area. To minimize disk I/O load on the AhsayCBS server, the deleted remains in the 16 MB block.
Line 50: Line 51:
  
 ===== Affected Backup Sets ===== ===== Affected Backup Sets =====
-As the issue stems from the handling of small files stored in the 16 MB blocks or shared blocks” in v7/v8, this issue visible on the following backup set types;// File, Cloud File, MS Exchange Mail level, and Office 365// where the possibility of backup of small files is common. This can be further compounded if there are frequent changes in the content backup source which will result in files frequently been moved to the retention area.+As the issue stems from the handling of small files stored in the 16 MB blocks or "shared blocks" ​in version 7 8, this issue visible on the following backup set types;// File, Cloud File, MS Exchange Mail level, and Office 365// where the possibility of backup of small files is common. This can be further compounded if there are frequent changes in the content backup source which will result in files frequently been moved to the retention area.
  
 While other backup types are not affected; //MS Exchange database, MS SQL Server, Oracle, VMware, Hyper-V, MS Windows System backup, MS System State backup, and Lotus Domino// usually involve backup of large files which are stored in 32 MB blocks. ​ While other backup types are not affected; //MS Exchange database, MS SQL Server, Oracle, VMware, Hyper-V, MS Windows System backup, MS System State backup, and Lotus Domino// usually involve backup of large files which are stored in 32 MB blocks. ​
Line 62: Line 63:
 Due to feedback from our partners relating to the storage statistics discrepancy,​ Ahsay attempted to provide a solution to this issue using a hotfix, where the calculation of storage statistics was re-calibrated to accurately reflect the physical size of the 16 MB and 32 MB data blocks stored on AhsayCBS server, local, and, cloud destinations. ​ Due to feedback from our partners relating to the storage statistics discrepancy,​ Ahsay attempted to provide a solution to this issue using a hotfix, where the calculation of storage statistics was re-calibrated to accurately reflect the physical size of the 16 MB and 32 MB data blocks stored on AhsayCBS server, local, and, cloud destinations. ​
  
-This version was made able to partners who applied the following hotfix ​**v8.3.0.50 ​ to 8.3.0.131** from the Ahsay Partners Portal. ​ After upgrading, the storage statistics for each backup set were re-calculated based the physical size of the files located in the **%CBS_USER_HOME%\%username%\%backupset_id%\blocks** folder.+This version was made able to partners who applied the following hotfix ​version 8.3.0.50 to 8.3.0.131 from the Ahsay Partners Portal. ​ After upgrading, the storage statistics for each backup set were re-calculated based the physical size of the files located in the **%CBS_user_home%\%username%\%backupset_id%\blocks** folder.
  
 There was no option is choose another statistics calculation method. There was no option is choose another statistics calculation method.
Line 68: Line 69:
  
 ===== Results ===== ===== Results =====
-After upgrading to AhsayCBS **v8.3.0.50 to v8.3.0.122** the following issues were encountered. ​+After upgrading to AhsayCBS ** version 8.3.0.50 to 8.3.0.122 ** the following issues were encountered. ​
 <WRAP indent> <WRAP indent>
 • The storage statistics for each backup user account with the affected backup sets increase significantly. ​ • The storage statistics for each backup user account with the affected backup sets increase significantly. ​
Line 77: Line 78:
 </​WRAP>​ </​WRAP>​
  
-After feedback from our partners, it was decided to temporarily suspend the new storage statistic calculation method in next release ​v8.3.2.0 or above, to continue to use the original storage statistic calculation method until further notice. Therefore, partners who have been using **v8.3.0.50 to v8.3.0.131** hotfix, after they apply next official release **v8.3.2.0 or above** will find the storage statistics for the affected backup sets and user will be reduced ​ and calculated based on restorable data and not by physical storage size.+After feedback from our partners, it was decided to temporarily suspend the new storage statistic calculation method in next release ​8.3.2.0 or above, to continue to use the original storage statistic calculation method until further notice. Therefore, partners who have been using ** version 8.3.0.50 to 8.3.0.131 ** hotfix, after they apply next official release ** 8.3.2.0 or above** will find the storage statistics for the affected backup sets and user will be reduced ​ and calculated based on restorable data and not by physical storage size.
  
  
 ===== Addressing Physical Storage Provisioning ​ ===== ===== Addressing Physical Storage Provisioning ​ =====
-The new storage format for backup data written to AhsayCBS, local, and cloud destinations containing ​shared blocks, could affect your storage provisioning,​ you should closely monitor your storage to avoid reaching capacity. Unfortunately,​ there is no workaround to reduce the shared blocks usage from affected backup set, or method to list the block’s content, or report the gap between restorable data vs physical storage.+The new storage format for backup data written to AhsayCBS, local, and cloud destinations containing ​"shared blocks", could affect your storage provisioning,​ you should closely monitor your storage to avoid reaching capacity. Unfortunately,​ there is no workaround to reduce the shared blocks usage from affected backup set, or method to list the block’s content, or report the gap between restorable data vs physical storage.
  
  
public/8067_faq/discrepancy_between_ahsaycbs_storage_statistics_vs_physical_data_size.txt · Last modified: 2020/11/17 11:30 by edward.chan