Policy Server fails to startup

Products

• SITEMINDER

Issue/Introduction

Policy Server starts up but shuts down after the following messages in the smps.log

[2645/140660410152832][Thu Jan 13 2022 16:29:07][Database.cpp:666][InitDB][INFO][sm-xpsxps-00120] Initializing XPS Version 12.8.0300.2138
[2645/140660410152832][Thu Jan 13 2022 16:29:08][XPSConfig.cpp:1428][LoadCFG][WARN][sm-xpsxps-00030] Config file was in use by another process. Retrying... (Invalid argument, 22)
[2645/140660410152832][Thu Jan 13 2022 16:29:08][XPSConfig.cpp:1428][LoadCFG][WARN][sm-xpsxps-00030] Config file was in use by another process. Retrying... (Invalid argument, 22)
[2645/140660410152832][Thu Jan 13 2022 16:29:09][XPSConfig.cpp:1428][LoadCFG][WARN][sm-xpsxps-00030] Config file was in use by another process. Retrying... (Invalid argument, 22)
[2645/140660410152832][Thu Jan 13 2022 16:29:09][XPSConfig.cpp:1428][LoadCFG][WARN][sm-xpsxps-00030] Config file was in use by another process. Retrying... (Invalid argument, 22)
[2645/140660410152832][Thu Jan 13 2022 16:29:10][XPSConfig.cpp:1428][LoadCFG][WARN][sm-xpsxps-00030] Config file was in use by another process. Retrying... (Invalid argument, 22)
[2645/140660410152832][Thu Jan 13 2022 16:29:10][XPSConfig.cpp:1428][LoadCFG][WARN][sm-xpsxps-00030] Config file was in use by another process. Retrying... (Invalid argument, 22)
[2645/140660410152832][Thu Jan 13 2022 16:29:11][XPSConfig.cpp:1428][LoadCFG][WARN][sm-xpsxps-00030] Config file was in use by another process. Retrying... (Invalid argument, 22)
[2645/140660410152832][Thu Jan 13 2022 16:29:11][XPSConfig.cpp:1428][LoadCFG][WARN][sm-xpsxps-00030] Config file was in use by another process. Retrying... (Invalid argument, 22)
[2645/140660410152832][Thu Jan 13 2022 16:29:12][XPSConfig.cpp:1428][LoadCFG][WARN][sm-xpsxps-00030] Config file was in use by another process. Retrying... (Invalid argument, 22)
[2645/140660410152832][Thu Jan 13 2022 16:29:12][XPSConfig.cpp:1438][LoadCFG][FATAL][sm-xpsxps-00040] Timeout waiting for config file. It is in use by another process.
[2645/140660410152832][Thu Jan 13 2022 16:29:12][Database.cpp:672][InitDB][FATAL][sm-xpsxps-00130] Unable to load configuration data file.
[2645/140660410152832][Thu Jan 13 2022 16:29:12][SmPolicyServer.cpp:734][ERROR][sm-Server-00450] Failed to initialize policy store 
[2645/140660410152832][Thu Jan 13 2022 16:29:12][CServer.cpp:4552][INFO][sm-Server-01880] smpolicysrv shutting down

 

Environment

Release : 12.8.0x

Component : SITEMINDER SECURE PROXY SERVER

Cause

During startup, policy server will create '<PolicyServer>/config/XPS.lck' file.

If for any reason this fails, Policy Server will assume there is another process and shutdown.
Following is "strace" capturing this event. ("strace -Ff -t -i -v -o strace.log -s 16384 ./start-ps")

2645  16:29:07 [00007fee0512291d] open("/opt/CA/siteminder/config/XPS.lck", O_RDWR|O_CREAT, 0640) = 18
2645  16:29:07 [00007fee073fb6fd] write(18, "x", 1) = -1 ENOSPC (No space left on device)
2645  16:29:07 [00007fee05122fc4] fcntl(18, F_SETLK, {l_type=F_WRLCK, l_whence=SEEK_CUR, l_start=0, l_len=-1}) = -1 EINVAL (Invalid argument)
2645  16:29:07 [00007fee050f89fd] nanosleep({tv_sec=0, tv_nsec=500000000},  <unfinished ...>

 

A common condition is the partition hosting the siteminder has run out of space as sample shown above.

 

Resolution

Please ensure there is sufficient storage space available for policy server operation.