EDR: Error on Startup "TimeoutError: Request timed out after 5 seconds."
Article ID: 287403
Updated On:
Products
Carbon Black Hosted EDR (formerly Cb Response Cloud)
Issue/Introduction
- The exception below is encountered upon starting services :
Dec 12 06:26:09 edr-server systemd: Starting SYSV: VMware Carbon Black EDR is a surveillance camera for your computer -- always recording so you know precisely what happened and where. This component provides an internal interface to the primary datastore.... Dec 12 06:26:09 edr-server cb-enterprise: Redirecting to /bin/systemctl status crond.service Dec 12 06:26:09 edr-server cb-enterprise: Redirecting to /bin/systemctl status rsyslog.service Dec 12 06:26:11 edr-server systemd: Reloading. Dec 12 06:26:16 edr-server systemd: Starting SYSV: Starts and stops the supervisord daemon.... Dec 12 06:26:17 edr-server cb-supervisord: Starting cb-supervisord: [ OK ] Dec 12 06:26:17 edr-server systemd: Started SYSV: Starts and stops the supervisord daemon.. Dec 12 06:26:17 edr-server cb-enterprise: Starting cb-supervisord (via systemctl): [ OK ] Dec 12 06:26:25 edr-server cb-enterprise: Starting cb-pgsql: [^[[32m OK ^[[0m] Dec 12 06:26:34 edr-server cb-enterprise: Starting cb-datagrid: [^[[32m OK ^[[0m] Dec 12 06:26:44 edr-server cb-enterprise: Starting cb-redis: [^[[32m OK ^[[0m] Dec 12 06:26:53 edr-server cb-enterprise: Starting cb-rabbitmq: [^[[32m OK ^[[0m] Dec 12 06:26:58 edr-server systemd: Removed slice User Slice of cb. Dec 12 06:26:59 edr-server systemd: Created slice User Slice of root. Dec 12 06:26:59 edr-server systemd: Started Session c47928 of user root. Dec 12 06:27:00 edr-server systemd: Removed slice User Slice of root. Dec 12 06:27:01 edr-server systemd: Created slice User Slice of root. Dec 12 06:27:01 edr-server systemd: Started Session c47929 of user root. Dec 12 06:27:01 edr-server systemd: Started Session 27126 of user root. Dec 12 06:27:04 edr-server cb-enterprise: Request timed out after 5 seconds. Dec 12 06:27:04 edr-server cb-enterprise: Traceback (most recent call last): Dec 12 06:27:04 edr-server cb-enterprise: File "/usr/share/cb/virtualenv/lib/python3.9/site-packages/cb/utils/exceptions.py", line 106, in decorator Dec 12 06:27:04 edr-server cb-enterprise: File "/usr/share/cb/virtualenv/lib/python3.9/site-packages/cb/maintenance/cbstartup/main.py", line 176, in main Dec 12 06:27:04 edr-server cb-enterprise: File "/usr/share/cb/virtualenv/lib/python3.9/site-packages/cb/maintenance/cbstartup/main.py", line 116, in run Dec 12 06:27:04 edr-server cb-enterprise: File "/usr/share/cb/virtualenv/lib/python3.9/site-packages/cb/maintenance/cbstartup/actions/init_cache_db.py", line 19, in execute Dec 12 06:27:04 edr-server cb-enterprise: File "/usr/share/cb/virtualenv/lib/python3.9/site-packages/cb/maintenance/cbstartup/actions/init_cache_db.py", line 75, in _init_cache_db Dec 12 06:27:04 edr-server cb-enterprise: File "/usr/share/cb/virtualenv/lib/python3.9/site-packages/cb/cache/cached_object.py", line 1299, in _get_map Dec 12 06:27:04 edr-server cb-enterprise: File "/usr/share/cb/virtualenv/lib/python3.9/site-packages/cb/cache/session.py", line 136, in __getitem__ Dec 12 06:27:04 edr-server cb-enterprise: File "/usr/share/cb/virtualenv/lib64/python3.9/site-packages/hazelcast/client.py", line 167, in get_map Dec 12 06:27:04 edr-server cb-enterprise: return self.proxy.get_or_create(MAP_SERVICE, name) Dec 12 06:27:04 edr-server cb-enterprise: File "/usr/share/cb/virtualenv/lib64/python3.9/site-packages/hazelcast/proxy/__init__.py", line 77, in get_or_create Dec 12 06:27:04 edr-server cb-enterprise: proxy = self.create_proxy(service_name, name, create_on_remote, **kwargs) Dec 12 06:27:04 edr-server cb-enterprise: File "/usr/share/cb/virtualenv/lib64/python3.9/site-packages/hazelcast/proxy/__init__.py", line 85, in create_proxy Dec 12 06:27:04 edr-server cb-enterprise: self._client.invoker.invoke_on_random_target(message).result() Dec 12 06:27:04 edr-server cb-enterprise: File "/usr/share/cb/virtualenv/lib64/python3.9/site-packages/hazelcast/future.py", line 61, in result Dec 12 06:27:04 edr-server cb-enterprise: six.reraise(self._exception.__class__, self._exception, self._traceback) Dec 12 06:27:04 edr-server cb-enterprise: File "/usr/share/cb/virtualenv/lib64/python3.9/site-packages/hazelcast/six.py", line 689, in reraise Dec 12 06:27:04 edr-server cb-enterprise: raise value Dec 12 06:27:04 edr-server cb-enterprise: hazelcast.exception.TimeoutError: Request timed out after 5 seconds. Dec 12 06:27:04 edr-server cb-enterprise: Waiting up to 30 seconds for cb cronjobs to exit... Dec 12 06:27:35 edr-server cb-enterprise: Killing remaining cb cronjobs. Dec 12 06:27:35 edr-server systemd: Removed slice User Slice of root. Dec 12 06:27:36 edr-server cb-enterprise: Stopping cb-nginx: [^[[32m OK ^[[0m] Dec 12 06:27:37 edr-server cb-enterprise: Stopping cb-enterprised: [^[[32m OK ^[[0m] Dec 12 06:27:37 edr-server cb-enterprise: Stopping cb-allianceclient: [^[[32m OK ^[[0m] Dec 12 06:27:38 edr-server cb-enterprise: Stopping cb-liveresponse: [^[[32m OK ^[[0m] Dec 12 06:27:38 edr-server cb-enterprise: Stopping cb-coreservices: [^[[32m OK ^[[0m] Dec 12 06:27:39 edr-server cb-enterprise: Stopping cb-sensorservices: [^[[32m OK ^[[0m] Dec 12 06:27:40 edr-server cb-enterprise: Stopping cb-datastore: [^[[32m OK ^[[0m] Dec 12 06:27:40 edr-server cb-enterprise: Stopping cb-solr: [^[[32m OK ^[[0m] Dec 12 06:27:42 edr-server epmd: epmd: got KILL_REQ - terminates normal Dec 12 06:27:44 edr-server cb-enterprise: Stopping cb-rabbitmq: [^[[32m OK ^[[0m] Dec 12 06:27:45 edr-server cb-enterprise: Stopping cb-redis: [^[[32m OK ^[[0m] Dec 12 06:27:47 edr-server cb-enterprise: Stopping cb-datagrid: [^[[32m OK ^[[0m]
Environment
- EDR Server: 7.6.0
Cause
- Datagrid service requires timeout change to allow services to start appropriately.
Resolution
- To resolve this issue, increase/add the value below in the /etc/cb/cb.conf file:
DataGridInvocationAttemptTimeout=30
- Once done, please follow this article to stop all services and processes before starting the instance/cluster back up: EDR Server: How To Manually Stop Service When Stopping cb-enterprise Fails
Feedback
Yes
No
Powered by
