Import Properties Task Fail (Errno: 28 - No space left on device)

Products

• VMware Smart Assurance

Issue/Introduction

Import property jobs are failing after upgrading to 7.7.0.1 from any of the MnR 7.x version. 

Change the default temp directory used for MySql dump files / mysql tmp dir.

Log includes error similar to (Errcode: 28 - No space left on device).

Database task on frontend is failing with below: 

250203 13:04:48 : SEVERE: Importing data from 'data_property' into '/app/APG/Databases/APG-Property-Store/Default/tmp/DB/APG-DB-01' failed !

250203 13:04:48 : java.sql.SQLException: Error writing file '/tmp/MYLyrGir' (OS errno 28 - No space left on device)

250203 13:04:48 :       at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:965)

250203 13:04:48 :       at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3978)

250203 13:04:48 :       at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3914)

250203 13:04:48 :       at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:871)

250203 13:04:48 :       at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1999)

250203 13:04:48 :       at com.mysql.jdbc.RowDataDynamic.nextRecord(RowDataDynamic.java:374)

250203 13:04:48 :       at com.mysql.jdbc.RowDataDynamic.next(RowDataDynamic.java:354)

250203 13:04:48 :       at com.mysql.jdbc.ResultSetImpl.next(ResultSetImpl.java:6313)

250203 13:04:48 :       at org.apache.commons.dbcp.DelegatingResultSet.next(DelegatingResultSet.java:207)

250203 13:04:48 :       at org.apache.commons.dbcp.DelegatingResultSet.next(DelegatingResultSet.java:207)

Environment

Watch4Net/MnR - 7.7

Cause

The mysql upgrade replaces the my.cnf file instead of upgrading it.

At the time the task is running, tmp directory runs out of the space and fails to execute the task.

On Unix, MySQL uses the value of the TMPDIR environment variable as the path name of the directory in which to store temporary files. If TMPDIR is not set, MySQL uses the system default, which is usually /tmp, /var/tmp, or /usr/tmp. 

Resolution

No Space error is coming from MySQL and not from Property-Store.

• Note the APG home directory, ie /opt/APG/ in default installation. (Note: This would vary based on user's installation path)
• Replace <APG HOME> with the appropriate path as noted in above step.
• Edit <APG HOME>/Databases/MySQL/Default/my.cnf
• Add the path to the tmp directory.
  
  • Look for line: #tmpdir = /tmp/
  • Update:
    #/tmpdir = /tmp/
    tmpdir = <APG HOME>/tmp/ (Note: Anywhere per User's requirement which has enough space and permission for MySql to write)
• Restart mysql: <APG HOME>/bin/manage-module.sh service restart mysql Default