How to check the AAI logs for Start and Completion time of an admin task like creating or updating a jobstream.

Products

• Automic Automation Intelligence

Issue/Introduction

For every Admin task there is start and completion time. So, how do I check when task started and completed in AAI logs. 

Environment

Release : 6.0.1

Component : AUTOMIC AUTOMATION INTELLIGENCE ENGINE

Resolution

For adding a new jobstream I used the tail below using "test1" as the jobstream name:

less -f <Installation Dir>/jboss/standalone/log/*.log | grep 'jobstream\|JOB_STREAM\|test1'

Below are the key lines

2020-09-01 15:05:25,235 INFO [AdminOperationQueuePolicy] task started: ADD_JOB_STREAM
2020-09-01 15:05:25,235 INFO [JobStreamBuilder] add job stream "test1"
2020-09-01 15:05:28,092 INFO [AdminOperationQueuePolicy] task finished: ADD_JOB_STREAM
2020-09-01 15:05:28,092 INFO [AUDIT] 2020-09-01 15:05:07,714 2020-09-01 15:05:28,92 admin:type=jawsApp:sessionId=a018c1cf:password=/v8AAAAuAEoAHgA5AB4APwBW AXRLD0H0SG4= Add Job Stream: test1

Here is the full output. If you grep through all the logs you will also pickup the Audit log which has the name and timestamp of when its completed.

2020-09-01 15:05:25,235 INFO [AdminOperationQueuePolicy] task started: ADD_JOB_STREAM
2020-09-01 15:05:25,235 INFO [JobStreamBuilder] add job stream "test1"
2020-09-01 15:05:25,240 INFO [HistoricalJobStreamRunBuilder] Processing jobstream history from time: 2020/08/02 00:00:00.000 EDT
2020-09-01 15:05:26,317 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 1,000
2020-09-01 15:05:26,340 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 2,000
2020-09-01 15:05:26,363 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 3,000
2020-09-01 15:05:26,385 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 4,000
2020-09-01 15:05:26,407 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 5,000
2020-09-01 15:05:26,430 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 6,000
2020-09-01 15:05:26,455 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 7,000
2020-09-01 15:05:26,483 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 8,000
2020-09-01 15:05:26,509 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 9,000
2020-09-01 15:05:26,535 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 10,000
2020-09-01 15:05:26,560 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 11,000
2020-09-01 15:05:26,584 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 12,000
2020-09-01 15:05:26,614 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 13,000
2020-09-01 15:05:26,640 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 14,000
2020-09-01 15:05:26,663 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 15,000
2020-09-01 15:05:26,690 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 16,000
2020-09-01 15:05:26,716 INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 17,000
2020-09-01 15:05:27,988 INFO [HistoricalJobStreamRunBuilder] Processing jobstream history from time: 2020/09/01 15:04:00.000 EDT (last batch)
2020-09-01 15:05:27,990 INFO [HistoricalJobStreamRunBuilder] Built runs for stream "test1"
2020-09-01 15:05:27,990 INFO [HistoricalJobStreamRunBuilder] Finished building runs for stream "test1"
2020-09-01 15:05:28,023 INFO [JobStreamStatisticsCalculator] Found runs for 1 jobstreams
2020-09-01 15:05:28,025 INFO [JobStreamVendorImpl] Writing updated averages for 1 jobstreams
2020-09-01 15:05:28,092 INFO [AdminOperationQueuePolicy] task finished: ADD_JOB_STREAM
2020-09-01 15:05:28,092 INFO [AUDIT] 2020-09-01 15:05:07,714 2020-09-01 15:05:28,92 admin:type=jawsApp:sessionId=a018c1cf:password=/v8AAAAuAEoAHgA5AB4APwBW AXRLD0H0SG4= Add Job Stream: test1

For a jobstream update you can use a command like below:

less -f <Installation Dir>/jboss/standalone/log/*.log | grep 'JOB_STREAM\|JobstreamName'

 

There will be a line for start and stop like below in the jaws.log:

INFO [AdminOperationQueuePolicy] task started: REBUILD_JOB_STREAM
INFO [AdminOperationQueuePolicy] task finished: REBUILD_JOB_STREAM

After the first line, for adding a start job you would see a line like below which would include the jobstream name:

INFO [JobStreamBuilder] update start/excluded jobs for stream ""

When it finishes you will see:

INFO [AdminOperationQueuePolicy] task finished: REBUILD_JOB_STREAM

Here is an example log sequence for adding a start job for a jobstream named test.box.job1.

[AdminOperationQueuePolicy] task started: REBUILD_JOB_STREAM
INFO [JobStreamBuilder] update start/excluded jobs for stream "test.box.job1"
INFO [HistoricalJobStreamRunBuilder] Processing jobstream history from time: 2020/08/02 00:00:00.000 EDT
INFO [PredecessorBasedHistoricalJobStreamRunBuilder] Associating runs w/ jobstreams: 1,000
INFO [HistoricalJobStreamRunBuilder] Processing jobstream history from time: 2020/09/01 14:00:01.000 EDT (last batch)
INFO [HistoricalJobStreamRunBuilder] Built runs for stream "test.box.job1"
INFO [HistoricalJobStreamRunBuilder] Finished building runs for stream "test.box.job1"
INFO [StatisticsGenerator] Reading job stream runs: pass 1 (writing temp file)
INFO [TemporaryFileStorage] Temp file opened for writing: /opt/aai/jboss/standalone/tmp/singleStreamRuns.out
INFO [StatisticsGenerator] Wrote temp stream run cache (6.88 KB for 733 stream runs)
INFO [JobStreamStatisticsCalculator] 1 of 1 streams still need outliers removed
INFO [StatisticsGenerator] Reading job stream runs from cache: pass 2
2020-09-01 14:50:21,926 INFO [JobStreamStatisticsCalculator] 1 of 1 streams still need outliers removed
2020-09-01 14:50:21,926 INFO [StatisticsGenerator] Reading job stream runs from cache: pass 3
2020-09-01 14:50:21,926 INFO [JobStreamStatisticsCalculator] done removing outliers for 1 streams
2020-09-01 14:50:21,927 INFO [TemporaryFileStorage] Temp file deleted: /opt/aai/jboss/standalone/tmp/singleStreamRuns.out
2020-09-01 14:50:21,927 INFO [JobStreamStatisticsCalculator] Found runs for 1 jobstreams
2020-09-01 14:50:21,927 INFO [JobStreamStatisticsCalculator] Total number of runs with end times: 733
2020-09-01 14:50:21,927 INFO [JobStreamStatisticsCalculator] Number of runs after outlier removal: 732
2020-09-01 14:50:21,929 INFO [JobStreamVendorImpl] Writing updated averages for 1 jobstreams
2020-09-01 14:50:21,954 INFO [AdminOperationQueuePolicy] task finished: REBUILD_JOB_STREAM