Access Gateway is crashing after upgrade to R12.8.7

Products

• SITEMINDER

Issue/Introduction

Access Gateway was upgraded from R12.8.2 to R12.8.7 and started to crash frequently.

Environment

Release : 12.8.07
OS: RHEL

Cause

The packaged core has provided following stack.

(gdb) #0  0x00007fe6c581d387 in raise () from /lib64/libc.so.6 #1  0x00007fe6c581ea78 in abort () from /lib64/libc.so.6 #2  0x00007fe687051972 in log_assert_failed () from /lib64/libnss_myhostname.so.2 #3  0x00007fe68705016e in safe_close () from /lib64/libnss_myhostname.so.2 #4  0x00007fe687052ba8 in sd_rtnl_unref () from /lib64/libnss_myhostname.so.2 #5  0x00007fe687055cfb in local_addresses () from /lib64/libnss_myhostname.so.2 #6  0x00007fe68704fb77 in _nss_myhostname_gethostbyaddr2_r () from /lib64/libnss_myhostname.so.2 #7  0x00007fe68704ffe5 in _nss_myhostname_gethostbyaddr_r () from /lib64/libnss_myhostname.so.2 #8  0x00007fe6c5900160 in gethostbyaddr_r@@GLIBC_2.2.5 () from /lib64/libc.so.6 #9  0x00007fe6c59096bb in getnameinfo () from /lib64/libc.so.6 #10 0x00007fe687def487 in Java_java_net_Inet6AddressImpl_getHostByAddr () from /opt/jdk1.8.0_201/jre/lib/amd64/libnet.so

So the jvm was trying to lookup hostname by address and that is where it crashed. Nothing to do with Access Gateway code.

The query is handled by the OS by /lib64/libnss_myhostname.so file and then the java crashed.

Resolution

One possibility is selinux blocking the libnss and your system administrator should review the selinux logs.

/var/log/audit/audit.log (when auditd is enabled)
/var/log/messages (when auditd is not enabled)

 

Another way would be to prevent this libnss calls.
Sysadmin can review the nsswitch.conf and see if myhostname is enabled and that can be removed to test if that prevents this libnss calls.

https://www.freedesktop.org/software/systemd/man/nss-myhostname.html