EDR Server: Server Dashboard Storage Statistics Not Displaying

Products

• Carbon Black EDR (formerly Cb Response)

Issue/Introduction

• In the Server Dashboard, Storage Statistics is missing/blank.
• Items found in logs :
  • /var/log/cb/jobrunner/job_runner.log :

2022-05-02 00:00:05 [66108] <err> [storage_usage] 500 Server Error: Server Error for url: http://localhost:9000/cbfs/admin/statistics
Traceback (most recent call last):
File "/usr/share/cb/virtualenv/lib/python3.9/site-packages/cb/maintenance/job_runner.py", line 248, in main
File "/usr/share/cb/virtualenv/lib/python3.9/site-packages/cb/maintenance/job_runner.py", line 194, in _run_job
File "/usr/share/cb/virtualenv/lib/python3.9/site-packages/cb/maintenance/jobs/storage_usage_monitor.py", line 33, in run
File "/usr/share/cb/virtualenv/lib/python3.9/site-packages/cb/maintenance/jobs/storage_usage_monitor.py", line 22, in get_datastore_storage_stats
File "/usr/share/cb/virtualenv/lib64/python3.9/site-packages/requests/models.py", line 943, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Server Error for url: http://localhost:9000/cbfs/admin/statistics

• /var/log/cb/datastore/debug.log :

2022-05-05 14:34:48,261 - [ERROR] - from com.carbonblack.cbfs.http.servlets.GetStatistics in qtp1659791576-141769
Exception processing request
java.nio.file.AccessDeniedException: /home/nfs/username
at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90)
at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116)
at java.base/sun.nio.fs.UnixFileStore.readAttributes(UnixFileStore.java:115)
at java.base/sun.nio.fs.UnixFileStore.getTotalSpace(UnixFileStore.java:122)
at com.carbonblack.cbfs.utils.FileUtils$CbFileSystems.<init>(FileUtils.java:112)
at com.carbonblack.cbfs.storage_model_4.DataStore$Engine.getStatistics(DataStore.java:208)
at com.carbonblack.cbfs.http.servlets.GetStatistics.doWork(GetStatistics.java:17)
at com.carbonblack.cbfs.http.servlets.CbfsServletBase.doPost(CbfsServletBase.java:61)
at com.carbonblack.cbfs.http.servlets.CbfsServletBase.doGet(CbfsServletBase.java:148)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:687)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:811)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at org.eclipse.jetty.servlets.QoSFilter.doFilter(QoSFilter.java:200)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:584)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:142)
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:576)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:222)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1126)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:514)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:184)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1060)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:140)
at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:212)
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:109)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:96)
at org.eclipse.jetty.server.Server.handle(Server.java:498)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:258)
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.base/java.lang.Thread.run(Thread.java:829)

 

Environment

• EDR Server: 7.5.X

Cause

• Datastore pulls statistics on all mount points including attempting those NFS shares.  If those shares cannot be read by the CB user account, this type of behavior will occur.

Resolution

• This is a defect that can be referenced via: CB-39348.  It will be resolved in a future EDR build.
• Currently the only workaround is to unmount these shares or allow access to the from the CB user.