✎ ISSUE: java.lang.OutOfMemoryError: Java heap space error when performing an Office 365 backup [Ahsay Wiki]

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
=====  ISSUE: java.lang.OutOfMemoryError: Java heap space error when performing an Office 365 backup   =====

<html>
 <b>
  Article ID:
 </b>
 8027
 <br/>
 <b>
  Reviewed:
 </b>
 04/08/2020
 <br/>
 <br/>
 <b>
  Product Version:
 </b>
 <br/>
 AhsayCBS / AhsayOBM: 8.1.0.0 - 8.3.2.200
 <br/>
 OS: All platforms
 </html>


===== Problem Description =====
<html>
When performing an Office 365 Run on Server backup, the backup job and the AhsayCBS service stopped responding.  The following info message is received in the backup report:
 <br/>

 <table border="0" cellpadding="0" cellspacing="0" width="850">
  <tr>
   <td bgcolor="#E8E8E8" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-TOP: #C0C0C0  1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    No.
   </td>
   <td bgcolor="#E8E8E8" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-TOP: #C0C0C0  1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    Type
   </td>
   <td bgcolor="#E8E8E8" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-TOP: #C0C0C0  1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    Timestamp
   </td>
   <td bgcolor="#E8E8E8" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-TOP: #C0C0C0 1px solid; BORDER-RIGHT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    Log
   </td>
  </tr>
  <tr>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    *
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    ...
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    ...
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-RIGHT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    ...
   </td>
  </tr>
  <tr>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    *
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    info
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    ...
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-RIGHT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    Finished running pre-commands
   </td>
  </tr>
  <tr>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    *
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    info
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    ...
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-RIGHT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    ...
   </td>
  </tr>
  <tr>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    *
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
     info
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
     YYYY/MM/DD
     hh:mm:ss
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-RIGHT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    Sleep 20000 for next retry... (Connect to server.sharepoint.com:443 [server.sharepoint.com/xx.xx.xx.xx]<br>
    timed out)
    
   </td>
  </tr>
  <tr>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    *
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    ...
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    ...
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-RIGHT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    ...
   </td>
  </tr>
 </table>


Further checking on the context logs (e.g. cbs_context_YYYY-MM-DD.log / obs_context_YYYY-MM-DD.log), the following error messages are displayed:
<br>
<br>
<i>
DD-MMM-YYYY hh:mm:ss.xxx SEVERE [https-openssl-nio-0.0.0.0-443-exec-107] org.apache.catalina.core.ApplicationContext.log java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space</i>
<br>
<br>
or
<br>
<br>
<i>
DD-MMM-YYYY hh:mm:ss.xxx SEVERE [[Job][ScheduleBackup]] org.apache.catalina.core.ApplicationContext.log [Job]
 java.lang.OutOfMemoryError: Java heap space
<br>
DD-MMM-YYYY hh:mm:ss.xxx SEVERE [https-openssl-nio-0.0.0.0-443-exec-117] org.apache.catalina.core.ApplicationContext.log [LogInfo]
 java.lang.OutOfMemoryError: Java heap space
<br>
DD-MMM-YYYY hh:mm:ss.xxx SEVERE [[Job][MigrateV6File]] org.apache.catalina.core.ApplicationContext.log [Job]
 java.lang.OutOfMemoryError: Java heap space
<br>
DD-MMM-YYYY hh:mm:ss.xxx SEVERE [[Job][ScheduleBackup]] org.apache.catalina.core.ApplicationContext.log [Job]
 java.lang.OutOfMemoryError: Java heap space
<br>
DD-MMM-YYYY hh:mm:ss.xxx SEVERE [https-openssl-nio-0.0.0.0-443-exec-63] org.apache.catalina.core.StandardWrapperValve.invoke Servlet.service() for servlet [OBC v7 REST Service] in context with path [/obs] threw exception [java.lang.OutOfMemoryError: Java heap space] with root cause
java.lang.OutOfMemoryError: Java heap space
</i>

<br>
<br>
The same issue can also occur for an Office 365 Run on Client backup. The following error message is received in the backup report: 
<br>
<br>
 <table border="0" cellpadding="0" cellspacing="0" width="850">
  <tr>
   <td bgcolor="#E8E8E8" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-TOP: #C0C0C0  1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    No.
   </td>
   <td bgcolor="#E8E8E8" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-TOP: #C0C0C0  1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    Type
   </td>
   <td bgcolor="#E8E8E8" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-TOP: #C0C0C0  1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    Timestamp
   </td>
   <td bgcolor="#E8E8E8" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-TOP: #C0C0C0 1px solid; BORDER-RIGHT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    Log
   </td>
  </tr>
  <tr>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    *
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    ...
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    ...
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-RIGHT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    ...
   </td>
  </tr>
  <tr>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    *
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    info
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    ...
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-RIGHT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
Start running post-commands
   </td>
  </tr>
  <tr>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    *
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    ...
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    ...
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-RIGHT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    ...
   </td>
  </tr>
  <tr>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    *
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    <font color=red>
    erro
    </font>
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    <font color=red>
    YYYY/MM/DD hh:mm:ss
    </font>
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-RIGHT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
   <font color=red>
    [BackupIpcThread.doRunException] error: java.lang.OutOfMemoryError: Java heap space Message: &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<br>
   Java heap space
    </font>
   </td>
  </tr>
  <tr>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    *
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    ...
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="top">
    ...
   </td>
   <td bgcolor="#ffffff" style="BORDER-LEFT: #C0C0C0 1px solid; BORDER-RIGHT: #C0C0C0 1px solid; BORDER-BOTTOM: #C0C0C0 1px solid" valign="middle">
    ...
   </td>
  </tr>
 </table>
Note:<br>
For a Office 365 Run on Client backup, the AhsayCBS services will not be affected.

</html>

===== Cause =====
The message suggests that the AhsayCBS server or AhsayOBM client application had ran out of memory during the backup process. 

===== Resolution =====
<html>
For Office 365 backup with OneDrive or Site Collections / Personal Site(s) selected for backup, extra memory must be allocated for the AhsayCBS server application (for Run on Server backup set) or AhsayOBM client application (for Run on Client backup set).
<br/>
<br/>
The memory requirement is dependent on the number of OneDrive or Site Collections / Personal Site(s) selected for backup. It is recommended to allocate 100 MB per OneDrive account, and 150 MB per Site Collections / Personal Site selected for backup.
<br/>
<br/>
<u>Example 1</u><br>
For a Run on Server Office 365 backup set with 100 Site Collections selected for backup, 15 GB (150 MB * 100) of memory is required for the backup operation. 
<br>
<br>
An additional 2 - 4 GB are recommended for the AhsayCBS server operation.  &nbsp;Therefore, the Java heap size setting of the AhsayCBS server should be set to at least 18 GB.
<br>
<br>
<u>Example 2</u><br>
For a Run on Client Office 365 backup set with 80 Personal Sites and 100 OneDrive accounts selected for backup, 22 GB ((150 MB * 80) + (100 MB * 100)) of memory is required for the backup operation. 
<br>
<br>
The Java heap size setting of the AhsayOBM client should be set to 22 GB.
<br>
<br>
For instruction on how to modify the Java heap size setting for your AhsayCBS server application / AhsayOBM client application, please refer to the following articles for details:
<br>
<br>
<a href="http://wiki.ahsay.com/doku.php?id=public:8003_faq:how_to_modify_the_java_heap_size_of_ahsaycbs">FAQ: How to modify the Java heap size of AhsayCBS?</a>
<br>
<a href="http://wiki.ahsay.com/doku.php?id=public:8011_faq:how_to_modify_the_java_heap_size_of_ahsayobc">FAQ: How to modify the Java heap size of AhsayOBM / AhsayACB?</a>
<br>
<br>
Note:<br>
The Java heap size to be configured should not exceed 2/3 of RAM available, to allow sufficient resources for the operating system.

</html>


===== Keywords =====
o365, cbs, heap, java, memory
User Tools

Site Tools

Page Tools
