Bug 806071

Summary:	Update Job/Query Server definition
Product:	Red Hat Enterprise MRG	Reporter:	Robert Rati <rrati>
Component:	condor-wallaby-base-db	Assignee:	Robert Rati <rrati>
Status:	CLOSED ERRATA	QA Contact:	Daniel Horák <dahorak>
Severity:	unspecified	Docs Contact:
Priority:	medium
Version:	Development	CC:	dahorak, matt, mkudlej, pmackinn
Target Milestone:	2.2
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	condor-wallaby-base-db-1.20-1	Doc Type:	Bug Fix
Doc Text:	C: Using Red Hat High Availability to manage multiple job/query server configurations on a single node C: The remote configuration database needed to have new features and parameters added C: Added new features and parameters for Job/Query servers R: The remote configuration base database supports easily configuration multiple job/query servers on a single node.	Story Points:	---
Clone Of:		Environment:
Last Closed:	2012-09-19 17:43:08 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	828434

Description Robert Rati 2012-03-22 20:21:41 UTC

Description of problem:
Update the Job/Query Server feature to include the following for each:
DC_DAEMON_LIST
xx_ADDRESS_FILE
xx_LOG
DAEMON_LIST
xx.SPOOL
xx.HISTORY

Add Base Job/Query Server feature with:
MAX_xx_LOG
xx_DEBUG
xx

Appropriate params should be scoped to the subsystem type.

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.
  
Actual results:


Expected results:


Additional info:

Comment 1 Robert Rati 2012-03-27 21:11:25 UTC

Updated the db with new features, modified existing features, and updated the subsystem param lists to catch some additional params.

Changed/new feature definitions:
  name: JobServer
  conflicts: []
  depends:
  - Master
  included:
  - BaseJobServer
  params:
    JOB_SERVER.HISTORY: $(JOB_SERVER.SPOOL)/history
    JOB_SERVER.JOB_SERVER_LOG: $(LOG)/JobServerLog
    JOB_SERVER.JOB_SERVER_ADDRESS_FILE: $(LOG)/.job_server_address
    DC_DAEMON_LIST: ">= JOB_SERVER"
    DAEMON_LIST: ">= JOB_SERVER"
    JOB_SERVER.SPOOL: 0

  name: BaseJobServer
  conflicts: []
  depends:
  - QMF
  included: []
  params:
    JOB_SERVER.JOB_SERVER_DEBUG: ""
    JOB_SERVER: $(SBIN)/condor_job_server
    QMF_PUBLISH_SUBMISSIONS: "false"
    MAX_JOB_SERVER_LOG: "1000000"

  name: QueryServer
  conflicts: []
  depends:
  - Master
  included:
  - BaseQueryServer
  params:
    QUERY_SERVER.HISTORY: $(QUERY_SERVER.SPOOL)/history
    QUERY_SERVER.QUERY_SERVER_LOG: $(LOG)/QueryServerLog
    QUERY_SERVER.QUERY_SERVER_ADDRESS_FILE: $(LOG)/.query_server_address
    DC_DAEMON_LIST: ">= QUERY_SERVER"
    DAEMON_LIST: ">= QUERY_SERVER"
    QUERY_SERVER.HTTP_PORT: "9091"
    QUERY_SERVER.SPOOL: 0

  name: BaseQueryServer
  conflicts: []
  depends: []
  included:
  - Axis2Home
  params:
    QUERY_SERVER.QUERY_SERVER_DEBUG: D_ALWAYS,
    QUERY_SERVER: $(SBIN)/aviary_query_server,
    MAX_QUERY_SERVER_LOG: "1000000,"
    QUERY_SERVER_ARGS: -f
    QUERY_SERVER.HISTORY_INTERVAL: "120"

Changed/new subsystem definitions:
  name: query_server
  params:
  - MAX_QUERY_SERVER_LOG
  - QUERY_SERVER
  - QUERY_SERVER.AVIARY_SSL
  - QUERY_SERVER.AVIARY_SSL_CA_DIR
  - QUERY_SERVER.AVIARY_SSL_CA_FILE
  - QUERY_SERVER.AVIARY_SSL_SERVER_CERT
  - QUERY_SERVER.AVIARY_SSL_SERVER_KEY
  - QUERY_SERVER.HISTORY
  - QUERY_SERVER.HISTORY_INTERVAL
  - QUERY_SERVER.HTTP_PORT
  - QUERY_SERVER.QUERY_SERVER_ADDRESS_FILE
  - QUERY_SERVER.QUERY_SERVER_DEBUG
  - QUERY_SERVER.QUERY_SERVER_LOG
  - QUERY_SERVER.SCHEDD_NAME
  - QUERY_SERVER.SPOOL
  - QUERY_SERVER_ARGS
  - WSFCPP_HOME

  name: job_server
  params:
  - HISTORY_INTERVAL
  - JOB_SERVER
  - JOB_SERVER.HISTORY
  - JOB_SERVER.JOB_SERVER_ADDRESS_FILE
  - JOB_SERVER.JOB_SERVER_DEBUG
  - JOB_SERVER.JOB_SERVER_LOG
  - JOB_SERVER.SCHEDD_NAME
  - JOB_SERVER.SPOOL
  - JOB_SERVER_ADDRESS_FILE
  - JOB_SERVER_DEBUG
  - JOB_SERVER_LOG
  - MAX_JOB_SERVER_LOG
  - QMF_BROKER_AUTH_MECH
  - QMF_BROKER_HOST
  - QMF_BROKER_PASSWORD_FILE
  - QMF_BROKER_PORT
  - QMF_BROKER_USERNAME
  - QMF_DELETE_ON_SHUTDOWN
  - QMF_PUBLISH_SUBMISSIONS

  name: schedd
  params:
  - ALLOW_NEGOTIATOR_SCHEDD
  - ALLOW_WRITE
  - HISTORY
  - MAX_SCHEDD_LOG
  - MAX_SHADOW_LOG
  - MAX_STARTER_LOG
  - QMF_BROKER_AUTH_MECH
  - QMF_BROKER_HOST
  - QMF_BROKER_PASSWORD_FILE
  - QMF_BROKER_PORT
  - QMF_BROKER_USERNAME
  - QMF_DELETE_ON_SHUTDOWN
  - QMF_PUBLISH_SUBMISSIONS
  - QUEUE_ALL_USERS_TRUSTED
  - QUEUE_SUPER_USERS
  - SCHEDD
  - SCHEDD.AVIARY_SSL
  - SCHEDD.AVIARY_SSL_CA_DIR
  - SCHEDD.AVIARY_SSL_CA_FILE
  - SCHEDD.AVIARY_SSL_SERVER_CERT
  - SCHEDD.AVIARY_SSL_SERVER_KEY
  - SCHEDD.HTTP_PORT
  - SCHEDD.PLUGINS
  - SCHEDD_ADDRESS_FILE
  - SCHEDD_DAEMON_AD_FILE
  - SCHEDD_DEBUG
  - SCHEDD_LOG
  - SHADOW
  - SHADOW_DEBUG
  - SHADOW_LIST
  - SHADOW_LOCK
  - SHADOW_LOG
  - SHADOW_SIZE_ESTIMATE
  - STARTER_DEBUG
  - STARTER_LOCAL
  - STARTER_LOG
  - START_LOCAL_UNIVERSE
  - START_SCHEDULER_UNIVERSE

Updated on master

Comment 2 Robert Rati 2012-03-27 21:17:38 UTC

Also added params:
JOB_SERVER.HISTORY
JOB_SERVER.JOB_SERVER_ADDRESS_FILE
JOB_SERVER.JOB_SERVER_DEBUG
JOB_SERVER.JOB_SERVER_LOG
JOB_SERVER.SCHEDD_NAME
JOB_SERVER.SPOOL
MAX_QUERY_SERVER_LOG
QUERY_SERVER.HISTORY
QUERY_SERVER.QUERY_SERVER_ADDRESS_FILE
QUERY_SERVER.SPOOL

Comment 4 Robert Rati 2012-04-02 13:48:27 UTC

    Technical note added. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    New Contents:
C: Using Red Hat High Availability to manage multiple job/query server configurations on a single node
C: The remote configuration database needed to have new features and parameters added
C: Added new features and parameters for Job/Query servers
R: The remote configuration base database supports easily configuration multiple job/query servers on a single node.

Comment 6 Daniel Horák 2012-06-12 08:34:30 UTC

Tested on RHEL 5.8, 6.3 - i386, x86_64 with condor-wallaby-base-db-1.22-4:

Changed/new feature definitions:
- !ruby/object:Mrg::Grid::SerializedConfigs::Feature
  conflicts: []

  depends:
  - Master
  included:
  - BaseJobServer
  name: JobServer
  params:
    JOB_SERVER.JOB_SERVER_ADDRESS_FILE: $(LOG)/.job_server_address
    DC_DAEMON_LIST: ">= JOB_SERVER"
    JOB_SERVER.SPOOL: 0
    JOB_SERVER.JOB_SERVER_LOG: $(LOG)/JobServerLog
    DAEMON_LIST: ">= JOB_SERVER"
    JOB_SERVER.HISTORY: $(JOB_SERVER.SPOOL)/history

- !ruby/object:Mrg::Grid::SerializedConfigs::Feature
  conflicts: []

  depends:
  - QMF
  included: []

  name: BaseJobServer
  params:
    JOB_SERVER.JOB_SERVER_DEBUG: ""
    MAX_JOB_SERVER_LOG: "1000000"
    JOB_SERVER: $(SBIN)/condor_job_server
    QMF_PUBLISH_SUBMISSIONS: "false"

- !ruby/object:Mrg::Grid::SerializedConfigs::Feature
  conflicts: []

  depends:
  - Master
  included:
  - BaseQueryServer
  name: QueryServer
  params:
    QUERY_SERVER.HTTP_PORT: "9091"
    QUERY_SERVER.SPOOL: 0
    DC_DAEMON_LIST: ">= QUERY_SERVER"
    QUERY_SERVER.QUERY_SERVER_ADDRESS_FILE: $(LOG)/.query_server_address
    QUERY_SERVER.QUERY_SERVER_LOG: $(LOG)/QueryServerLog
    DAEMON_LIST: ">= QUERY_SERVER"
    QUERY_SERVER.HISTORY: $(QUERY_SERVER.SPOOL)/history

- !ruby/object:Mrg::Grid::SerializedConfigs::Feature
  conflicts: []

  depends: []

  included:
  - Axis2Home
  name: BaseQueryServer
  params:
    QUERY_SERVER_ARGS: -f
    QUERY_SERVER.HISTORY_INTERVAL: "120"
    QUERY_SERVER: $(SBIN)/aviary_query_server
    QUERY_SERVER.QUERY_SERVER_DEBUG: D_ALWAYS
    MAX_QUERY_SERVER_LOG: "1000000"

- !ruby/object:Mrg::Grid::SerializedConfigs::Subsystem
  name: query_server
  params:
  - AVIARY_PUBLISH_INTERVAL
  - AVIARY_PUBLISH_LOCATION
  - ENABLE_RUNTIME_CONFIG
  - MAX_QUERY_SERVER_LOG
  - QUERY_SERVER
  - QUERY_SERVER.AVIARY_SSL
  - QUERY_SERVER.AVIARY_SSL_CA_DIR
  - QUERY_SERVER.AVIARY_SSL_CA_FILE
  - QUERY_SERVER.AVIARY_SSL_SERVER_CERT
  - QUERY_SERVER.AVIARY_SSL_SERVER_KEY
  - QUERY_SERVER.HISTORY
  - QUERY_SERVER.HISTORY_INTERVAL
  - QUERY_SERVER.HTTP_PORT
  - QUERY_SERVER.QUERY_SERVER_ADDRESS_FILE
  - QUERY_SERVER.QUERY_SERVER_DEBUG
  - QUERY_SERVER.QUERY_SERVER_LOG
  - QUERY_SERVER.SCHEDD_NAME
  - QUERY_SERVER.SPOOL
  - QUERY_SERVER_ARGS
  - WSFCPP_HOME


Changed/new subsystem definitions:
- !ruby/object:Mrg::Grid::SerializedConfigs::Subsystem
  name: job_server
  params:
  - ENABLE_RUNTIME_CONFIG
  - HISTORY_INTERVAL
  - JOB_SERVER
  - JOB_SERVER.HISTORY
  - JOB_SERVER.JOB_SERVER_ADDRESS_FILE
  - JOB_SERVER.JOB_SERVER_DEBUG
  - JOB_SERVER.JOB_SERVER_LOG
  - JOB_SERVER.SCHEDD_NAME
  - JOB_SERVER.SPOOL
  - JOB_SERVER_ADDRESS_FILE
  - JOB_SERVER_DEBUG
  - JOB_SERVER_LOG
  - MAX_JOB_SERVER_LOG
  - QMF_BROKER_AUTH_MECH
  - QMF_BROKER_HOST
  - QMF_BROKER_PASSWORD_FILE
  - QMF_BROKER_PORT
  - QMF_BROKER_USERNAME
  - QMF_DELETE_ON_SHUTDOWN
  - QMF_PUBLISH_SUBMISSIONS

- !ruby/object:Mrg::Grid::SerializedConfigs::Subsystem
  name: schedd
  params:
  - ALLOW_NEGOTIATOR_SCHEDD
  - ALLOW_WRITE
  - AVIARY_PUBLISH_INTERVAL
  - AVIARY_PUBLISH_LOCATION
  - ENABLE_RUNTIME_CONFIG
  - HISTORY
  - MAX_SCHEDD_LOG
  - MAX_SHADOW_LOG
  - MAX_STARTER_LOG
  - QMF_BROKER_AUTH_MECH
  - QMF_BROKER_HOST
  - QMF_BROKER_PASSWORD_FILE
  - QMF_BROKER_PORT
  - QMF_BROKER_USERNAME
  - QMF_DELETE_ON_SHUTDOWN
  - QMF_PUBLISH_SUBMISSIONS
  - QUEUE_ALL_USERS_TRUSTED
  - QUEUE_SUPER_USERS
  - SCHEDD
  - SCHEDD.AVIARY_SSL
  - SCHEDD.AVIARY_SSL_CA_DIR
  - SCHEDD.AVIARY_SSL_CA_FILE
  - SCHEDD.AVIARY_SSL_SERVER_CERT
  - SCHEDD.AVIARY_SSL_SERVER_KEY
  - SCHEDD.HTTP_PORT
  - SCHEDD.PLUGINS
  - SCHEDD_ADDRESS_FILE
  - SCHEDD_DAEMON_AD_FILE
  - SCHEDD_DEBUG
  - SCHEDD_LOG
  - SHADOW
  - SHADOW_DEBUG
  - SHADOW_LIST
  - SHADOW_LOCK
  - SHADOW_LOG
  - SHADOW_SIZE_ESTIMATE
  - STARTER_DEBUG
  - STARTER_LOCAL
  - STARTER_LOG
  - START_LOCAL_UNIVERSE
  - START_SCHEDULER_UNIVERSE

Added params:
- !ruby/object:Mrg::Grid::SerializedConfigs::Parameter
  conflicts: []

  default_val: $(JOB_SERVER.SPOOL)/history
  depends:
  - JOB_SERVER.SPOOL
  description: The location of the historical jobs file used by the Job Server
  kind: String
  level: 0
  must_change: false
  name: JOB_SERVER.HISTORY
  needs_restart: true

- !ruby/object:Mrg::Grid::SerializedConfigs::Parameter
  conflicts: []

  default_val: $(LOG)/.job_server_address
  depends: []

  description: The file where the Job Server will store its address information
  kind: String
  level: 0
  must_change: false
  name: JOB_SERVER.JOB_SERVER_ADDRESS_FILE
  needs_restart: true

- !ruby/object:Mrg::Grid::SerializedConfigs::Parameter
  conflicts: []

  default_val: ""
  depends: []

  description: The level of debugging output the Job Server will produce in its log file
  kind: String
  level: 0
  must_change: false
  name: JOB_SERVER.JOB_SERVER_DEBUG
  needs_restart: false

- !ruby/object:Mrg::Grid::SerializedConfigs::Parameter
  conflicts: []

  default_val: $(LOG)/JobServerLog
  depends: []

  description: The location of the Job Server log file
  kind: String
  level: 0
  must_change: false
  name: JOB_SERVER.JOB_SERVER_LOG
  needs_restart: false

- !ruby/object:Mrg::Grid::SerializedConfigs::Parameter
  conflicts: []

  default_val: ""
  depends: []

  description: The name of the Scehduler that the Job Server is working with
  kind: string
  level: 0
  must_change: true
  name: JOB_SERVER.SCHEDD_NAME
  needs_restart: false

- !ruby/object:Mrg::Grid::SerializedConfigs::Parameter
  conflicts: []

  default_val: ""
  depends: []

  description: The location of the job queue file used by the Job Server
  kind: String
  level: 0
  must_change: true
  name: JOB_SERVER.SPOOL
  needs_restart: true

- !ruby/object:Mrg::Grid::SerializedConfigs::Parameter
  conflicts: []

  default_val: "1000000"
  depends: []

  description: The maximum size of the Query Server daemon log
  kind: Integer
  level: 0
  must_change: false
  name: MAX_QUERY_SERVER_LOG
  needs_restart: true

- !ruby/object:Mrg::Grid::SerializedConfigs::Parameter
  conflicts: []

  default_val: $(QUERY_SERVER.SPOOL)/history
  depends:
  - QUERY_SERVER.SPOOL
  description: The location of the historical jobs file used by the Query Server
  kind: String
  level: 0
  must_change: false
  name: QUERY_SERVER.HISTORY
  needs_restart: true

- !ruby/object:Mrg::Grid::SerializedConfigs::Parameter
  conflicts: []

  default_val: $(LOG)/.query_server_address
  depends: []

  description: The file where the Query Server will write its address information
  kind: String
  level: 0
  must_change: false
  name: QUERY_SERVER.QUERY_SERVER_ADDRESS_FILE
  needs_restart: true

- !ruby/object:Mrg::Grid::SerializedConfigs::Parameter
  conflicts: []

  default_val: ""
  depends: []

  description: The location of the job queue file used by the Query Server
  kind: String
  level: 0
  must_change: true
  name: QUERY_SERVER.SPOOL
  needs_restart: true

All features and subsystems from comment 1 and parameters from comment 2 were checked in configuration store snapshot file. Job/Query Server feature contain expected params.

>>> VERIFIED

Comment 8 errata-xmlrpc 2012-09-19 17:43:08 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHSA-2012-1278.html