Description of problem:

Currently when printing a log line, the VMDBLogger class searches for a valid task_id field in the worker current message, and if one it exists the logger adds this to the log line, wrapped in the text "Q-task_id(...)".

Many users of CloudForms/ManageIQ are using enterprise class logging systems such as Splunk or ElasticSearch/Kibana to search for logs. It would be very useful to be able to search for all log lines that were related to the user issuing some kind of request, be it VM or service provisioning, or automation task for example. In such cases the request ID is returned to the user, but not the task ID. If we could add a Q-request_id field to the log line as follows, this would enable all tasks related to the single request to be monitored:

[----] I, [2016-08-26T12:21:55.640116 #20290:363990]  INFO -- : Q-task_id([automation_task_1000000004810]) Q-request_id([1000000003602]) Method exited with rc=MIQ_OK

I tried doing this by patching the 'call' method in VMDBLogger to recognise (via regex) the task type in the Q-task_d, and make a MiqRequestTask.where(:id => task_id).first lookup to get the request ID. This worked for 'production' rails environment (although not for 'development' because of the extra logging), but this is clearly not the right way to go about the problem.

I think a better way of doing this would be to add a new column called 'request_id' to the miq_queue table, and to modify any methods that call MiqQueue.put to make a request_id lookup at that time, and add this to the argument list, i.e.

MiqQueue.put(
      :class_name  => self.class.name,
      :instance_id => id,
      :method_name => "create_request_tasks",
      :zone        => options.fetch(:miq_zone, my_zone),
      :role        => my_role,
      :task_id     => "#{self.class.name.underscore}_#{id}",
      :request_id  => ...
      :msg_timeout => 3600,
      :deliver_on  => deliver_on
    )
  end

The logger could then simply retrieve this from the message and add to the log line in the same way that it does for the Q-task_id.