Capture individual transactions across the different capabilities/services within CP4D

We would like to capture individual transactions across the different capabilities/services within CP4D. This will provide visibility on what customer transactions are running on the platform. The key fields that we are interested in are as follows.

1. User Name - We would like to capture the user name alias this way we can join that to our employee dimension to do further analytics
2. Start Time
3. End Time - This field in combination of with the start time would help us determine the duration and we could build a notification around long running transactions
4. Command – Examples would be the Job Name, SQL  statement, Cognos report name, workbook name etc.
5. Status - Indicates the status of the request/job run etc.
6. Node/Container – Where the command/request is running from
7. Service (i.e. Watson Query, Cognos etc.)

Other notable requirements
• We want the data on scheduled job runs, user-invoked transactions, and any other transactions that occur on the platform. We have an API for assets that are part of jobs (i.e. /v2/jobs/{job_id}/runs)  however, we do not have an API method for assets not part of jobs.
• The option to retrieve this data through an API, a database, or alternative methods (not yet considered).
• Ultimately we want the ability to store the collected data in a database, so that it can be joined with our Employee Dimension table and used for further analysis, such as identifying the user with the most requests, departments with the most requests, average duration by user or department etc.