Bug 1085418 - reboot of box and rabbitmq-server restart is removing /var/run/rabbitmq directory
Summary: reboot of box and rabbitmq-server restart is removing /var/run/rabbitmq direc...
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Fedora EPEL
Classification: Fedora
Component: rabbitmq-server
Version: epel7
Hardware: Unspecified
OS: Unspecified
urgent
unspecified
Target Milestone: ---
Assignee: Hubert Plociniczak
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-04-08 14:41 UTC by wes hayutin
Modified: 2014-06-23 13:09 UTC (History)
11 users (show)

Fixed In Version: rabbitmq-server-3.1.5-6.el7
Clone Of:
Environment:
Last Closed: 2014-06-16 13:23:36 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)
proposed patch (1.10 KB, patch)
2014-04-08 23:57 UTC, Alan Pevec
jeckersb: review+
Details | Diff

Description wes hayutin 2014-04-08 14:41:59 UTC
Description of problem:

rabbitmq-server fails to restart on rhel7 icehouse due to a missing /var/run/rabbitmq directory.

fix..
mkdir /var/run/rabbitmq
chown rabbitmq /var/run/rabbitmq

will attach logs when I get them.

Comment 1 wes hayutin 2014-04-08 15:22:28 UTC
Last login: Tue Apr  8 10:58:56 EDT 2014 on pts/1
[root@rdo-ice-rhel70-stage-master-controller ~]# service rabbitmq-server status
Redirecting to /bin/systemctl status  rabbitmq-server.service
rabbitmq-server.service - RabbitMQ broker
   Loaded: loaded (/usr/lib/systemd/system/rabbitmq-server.service; enabled)
   Active: activating (start-post) since Tue 2014-04-08 11:12:20 EDT; 43s ago
  Process: 784 ExecStartPre=/bin/sh -c /usr/lib/rabbitmq/bin/rabbitmqctl status > /dev/null 2>&1 (code=exited, status=2)
 Main PID: 1165 (beam.smp);         : 1166 (beam.smp)
   CGroup: /system.slice/rabbitmq-server.service
           ├─1165 /usr/lib64/erlang/erts-5.10.4/bin/beam.smp -W w -K true -A30 -P 1048576 -- -root /usr/lib64/erlang -progname erl --...
           ├─2083 inet_gethost 4
           ├─2084 inet_gethost 4
           └─control
             ├─1166 /usr/lib64/erlang/erts-5.10.4/bin/beam.smp -- -root /usr/lib64/erlang -progname erl -- -home /var/lib/rabbitmq --...
             └─1251 /usr/lib64/erlang/erts-5.10.4/bin/epmd -daemon

Apr 08 11:12:22 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: mkdir: cannot create directory ‘/var/run/...ed
Apr 08 11:12:22 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: /usr/lib/rabbitmq/bin/rabbitmq-server: line...ry
Apr 08 11:12:23 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmqctl[1166]: Waiting for 'rabbit@rdo-ice-rhel70-stage-maste......
Apr 08 11:12:25 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: RabbitMQ 3.1.5. Copyright (C) 2007-2013 GoP...c.
Apr 08 11:12:25 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: ##  ##      Licensed under the MPL.  See ht...m/
Apr 08 11:12:25 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: ##  ##
Apr 08 11:12:25 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: ##########  Logs: /var/log/rabbitmq/rabbit@...og
Apr 08 11:12:25 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: ######  ##        /var/log/rabbitmq/rabbit@...og
Apr 08 11:12:25 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: ##########
Apr 08 11:12:26 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: Starting broker... completed with 0 plugins.
Hint: Some lines were ellipsized, use -l to show in full.
[root@rdo-ice-rhel70-stage-master-controller ~]# rpm -q rabbitmq-server
rabbitmq-server-3.1.5-3.el7.noarch
[root@rdo-ice-rhel70-stage-master-controller ~]# rpm -ql rabbitmq-server
/etc/logrotate.d/rabbitmq-server
/etc/rabbitmq
/usr/lib/ocf/resource.d/rabbitmq/rabbitmq-server
/usr/lib/rabbitmq/bin
/usr/lib/rabbitmq/bin/rabbitmq-defaults
/usr/lib/rabbitmq/bin/rabbitmq-env
/usr/lib/rabbitmq/bin/rabbitmq-plugins
/usr/lib/rabbitmq/bin/rabbitmq-server
/usr/lib/rabbitmq/bin/rabbitmqctl
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/app_utils.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/background_gc.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/credit_flow.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/delegate.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/delegate_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/dtree.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/file_handle_cache.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/gatherer.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/gen_server2.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/gm.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/gm_soak_test.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/gm_speed_test.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/gm_tests.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/lqueue.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/mirrored_supervisor.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/mirrored_supervisor_tests.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/mnesia_sync.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/mochijson2.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/mochinum.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/pg2_fixed.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/pg_local.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/pmon.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/priority_queue.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit.app
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_access_control.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_alarm.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_amqqueue.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_amqqueue_process.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_amqqueue_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_app.in
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_auth_backend.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_auth_backend_internal.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_auth_mechanism.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_auth_mechanism_amqplain.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_auth_mechanism_cr_demo.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_auth_mechanism_plain.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_autoheal.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_backing_queue.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_backing_queue_qc.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_basic.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_binary_generator.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_binary_parser.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_binding.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_channel.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_channel_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_channel_sup_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_client_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_command_assembler.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_connection_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_control_main.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_ctl_usage.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_direct.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_disk_monitor.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_error_logger.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_error_logger_file_h.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_event.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_exchange.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_exchange_decorator.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_exchange_type.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_exchange_type_direct.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_exchange_type_fanout.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_exchange_type_headers.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_exchange_type_invalid.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_exchange_type_topic.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_file.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_framing.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_framing_amqp_0_8.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_framing_amqp_0_9_1.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_guid.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_heartbeat.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_intermediate_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_limiter.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_log.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_memory_monitor.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_mirror_queue_coordinator.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_mirror_queue_master.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_mirror_queue_misc.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_mirror_queue_mode.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_mirror_queue_mode_all.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_mirror_queue_mode_exactly.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_mirror_queue_mode_nodes.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_mirror_queue_slave.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_mirror_queue_slave_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_mirror_queue_sync.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_misc.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_mnesia.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_msg_file.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_msg_store.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_msg_store_ets_index.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_msg_store_gc.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_msg_store_index.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_net.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_networking.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_node_monitor.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_nodes.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_parameter_validation.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_plugins.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_plugins_main.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_plugins_usage.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_policy.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_policy_validator.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_prelaunch.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_queue_collector.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_queue_index.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_reader.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_registry.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_restartable_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_router.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_runtime_parameter.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_runtime_parameters.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_runtime_parameters_test.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_sasl_report_file_h.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_ssl.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_table.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_tests.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_tests_event_receiver.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_trace.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_types.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_upgrade.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_upgrade_functions.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_variable_queue.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_version.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_vhost.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_vm.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/rabbit_writer.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/supervised_lifecycle.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/supervisor2.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/supervisor2_tests.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/tcp_acceptor.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/tcp_acceptor_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/tcp_listener.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/tcp_listener_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/test_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/vm_memory_monitor.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/worker_pool.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/worker_pool_sup.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/ebin/worker_pool_worker.beam
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/include
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/include/gm_specs.hrl
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/include/rabbit.hrl
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/include/rabbit_framing.hrl
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/include/rabbit_msg_store.hrl
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/README
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/amqp_client-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/cowboy-0.5.0-rmq3.1.5-git4b93c2d.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/eldap-3.1.5-gite309de4.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/mochiweb-2.7.0-rmq3.1.5-git680dba8.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_amqp1_0-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_auth_backend_ldap-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_auth_mechanism_ssl-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_consistent_hash_exchange-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_federation-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_federation_management-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_jsonrpc-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_jsonrpc_channel-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_jsonrpc_channel_examples-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_management-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_management_agent-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_management_visualiser-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_mqtt-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_shovel-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_shovel_management-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_stomp-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_tracing-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_web_dispatch-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_web_stomp-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rabbitmq_web_stomp_examples-3.1.5.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/rfc4627_jsonrpc-3.1.5-git5e67120.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/sockjs-0.3.4-rmq3.1.5-git3132eb9.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/plugins/webmachine-1.10.3-rmq3.1.5-gite9359c7.ez
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/sbin
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/sbin/rabbitmq-defaults
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/sbin/rabbitmq-env
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/sbin/rabbitmq-plugins
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/sbin/rabbitmq-server
/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/sbin/rabbitmqctl
/usr/lib/systemd/system/rabbitmq-server.service
/usr/sbin/rabbitmq-server
/usr/sbin/rabbitmqctl
/usr/share/doc/rabbitmq-server-3.1.5
/usr/share/doc/rabbitmq-server-3.1.5/LICENSE
/usr/share/doc/rabbitmq-server-3.1.5/LICENSE-APACHE2-ExplorerCanvas
/usr/share/doc/rabbitmq-server-3.1.5/LICENSE-APL2-Stomp-Websocket
/usr/share/doc/rabbitmq-server-3.1.5/LICENSE-Apache-Basho
/usr/share/doc/rabbitmq-server-3.1.5/LICENSE-BSD-base64js
/usr/share/doc/rabbitmq-server-3.1.5/LICENSE-BSD-glMatrix
/usr/share/doc/rabbitmq-server-3.1.5/LICENSE-MIT-EJS10
/usr/share/doc/rabbitmq-server-3.1.5/LICENSE-MIT-Flot
/usr/share/doc/rabbitmq-server-3.1.5/LICENSE-MIT-Mochi
/usr/share/doc/rabbitmq-server-3.1.5/LICENSE-MIT-Sammy060
/usr/share/doc/rabbitmq-server-3.1.5/LICENSE-MIT-eldap
/usr/share/doc/rabbitmq-server-3.1.5/LICENSE-MIT-jQuery164
/usr/share/doc/rabbitmq-server-3.1.5/LICENSE-MPL-RabbitMQ
/usr/share/man/man1/rabbitmq-plugins.1.gz
/usr/share/man/man1/rabbitmq-server.1.gz
/usr/share/man/man1/rabbitmqctl.1.gz
/usr/share/man/man5/rabbitmq-env.conf.5.gz
/var/lib/rabbitmq
/var/log/rabbitmq
/var/run/rabbitmq
[root@rdo-ice-rhel70-stage-master-controller ~]# ls /var/run/
auditd.pid    cron.reboot        faillock     libvirtd.pid  mariadb    openvswitch   rpc.statd.pid  sshd.pid     udev
avahi-daemon  dbus               httpd        lock          mdadm      radvd         saslauthd      syslogd.pid  user
chronyd.pid   dhclient-eth0.pid  initramfs    log           mount      rhsm          sepermit       systemd      utmp
console       dmeventd-client    ksmtune.pid  lvm           mysqld     rpcbind.lock  setrans        tmpfiles.d
crond.pid     dmeventd-server    libvirt      lvmetad.pid   netreport  rpcbind.sock  sm-notify.pid  tuned
[root@rdo-ice-rhel70-stage-master-controller ~]#



rabbitmq-server.service - RabbitMQ broker
   Loaded: loaded (/usr/lib/systemd/system/rabbitmq-server.service; enabled)
   Active: failed (Result: exit-code) since Tue 2014-04-08 11:13:53 EDT; 5min ago
  Process: 2662 ExecStopPost=/usr/bin/rm /var/run/rabbitmq/pid (code=exited, status=1/FAILURE)
  Process: 2628 ExecStop=/usr/lib/rabbitmq/bin/rabbitmqctl stop (code=exited, status=0/SUCCESS)
  Process: 1165 ExecStart=/usr/lib/rabbitmq/bin/rabbitmq-server (code=killed, signal=TERM)
  Process: 784 ExecStartPre=/bin/sh -c /usr/lib/rabbitmq/bin/rabbitmqctl status > /dev/null 2>&1 (code=exited, status=2)
 Main PID: 1165 (code=killed, signal=TERM)
   CGroup: /system.slice/rabbitmq-server.service

Apr 08 11:12:22 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: mkdir: cannot create directory ‘/var/run/...ed
Apr 08 11:12:22 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: /usr/lib/rabbitmq/bin/rabbitmq-server: line...ry
Apr 08 11:12:23 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmqctl[1166]: Waiting for 'rabbit@rdo-ice-rhel70-stage-maste......
Apr 08 11:12:25 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: RabbitMQ 3.1.5. Copyright (C) 2007-2013 GoP...c.
Apr 08 11:12:25 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: ##  ##      Licensed under the MPL.  See ht...m/
Apr 08 11:12:25 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: ##  ##
Apr 08 11:12:25 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: ##########  Logs: /var/log/rabbitmq/rabbit@...og
Apr 08 11:12:25 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: ######  ##        /var/log/rabbitmq/rabbit@...og
Apr 08 11:12:25 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: ##########
Apr 08 11:12:26 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1165]: Starting broker... completed with 0 plugins.
Apr 08 11:13:52 rdo-ice-rhel70-stage-master-controller.novalocal systemd[1]: rabbitmq-server.service operation timed out. Stopping.
Apr 08 11:13:52 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmqctl[2628]: Stopping and halting node 'rabbit@rdo-ice-rhel......
Apr 08 11:13:53 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmqctl[2628]: ...done.
Apr 08 11:13:53 rdo-ice-rhel70-stage-master-controller.novalocal systemd[1]: rabbitmq-server.service: control process exited, code...s=1
Apr 08 11:13:53 rdo-ice-rhel70-stage-master-controller.novalocal systemd[1]: Failed to start RabbitMQ broker.
Apr 08 11:13:53 rdo-ice-rhel70-stage-master-controller.novalocal systemd[1]: Unit rabbitmq-server.service entered failed state.
Apr 08 11:13:53 rdo-ice-rhel70-stage-master-controller.novalocal rm[2662]: /usr/bin/rm: cannot remove ‘/var/run/rabbitmq/pid’...tory
Hint: Some lines were ellipsized, use -l to show in full.
[root@rdo-ice-rhel70-stage-master-controller ~]#

Comment 2 wes hayutin 2014-04-08 15:27:52 UTC
seems like a reboot send rabbitmq-server into "activating" status.. 

The activation fails and the service is deleting /var/run/rabbitmq

[root@rdo-ice-rhel70-stage-master-controller ~(keystone_admin)]# service rabbitmq-server status
Redirecting to /bin/systemctl status  rabbitmq-server.service
rabbitmq-server.service - RabbitMQ broker
   Loaded: loaded (/usr/lib/systemd/system/rabbitmq-server.service; enabled)
   Active: activating (start-post) since Tue 2014-04-08 11:21:55 EDT; 1min 25s ago
  Process: 785 ExecStartPre=/bin/sh -c /usr/lib/rabbitmq/bin/rabbitmqctl status > /dev/null 2>&1 (code=exited, status=2)
 Main PID: 1098 (beam.smp);         : 1099 (beam.smp)
   CGroup: /system.slice/rabbitmq-server.service
           ├─1098 /usr/lib64/erlang/erts-5.10.4/bin/beam.smp -W w -K true -A30 -P 1048576 -- -root /usr/lib64/erlang -progname erl --...
           ├─2100 inet_gethost 4
           ├─2101 inet_gethost 4
           └─control
             ├─1099 /usr/lib64/erlang/erts-5.10.4/bin/beam.smp -- -root /usr/lib64/erlang -progname erl -- -home /var/lib/rabbitmq --...
             └─1171 /usr/lib64/erlang/erts-5.10.4/bin/epmd -daemon

Apr 08 11:21:57 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: mkdir: cannot create directory ‘/var/run/...ed
Apr 08 11:21:57 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: /usr/lib/rabbitmq/bin/rabbitmq-server: line...ry
Apr 08 11:21:58 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmqctl[1099]: Waiting for 'rabbit@rdo-ice-rhel70-stage-maste......
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: RabbitMQ 3.1.5. Copyright (C) 2007-2013 GoP...c.
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ##  ##      Licensed under the MPL.  See ht...m/
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ##  ##
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ##########  Logs: /var/log/rabbitmq/rabbit@...og
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ######  ##        /var/log/rabbitmq/rabbit@...og
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ##########
Apr 08 11:22:02 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: Starting broker... completed with 0 plugins.
Hint: Some lines were ellipsized, use -l to show in full.
[root@rdo-ice-rhel70-stage-master-controller ~(keystone_admin)]# service rabbitmq-server status
Redirecting to /bin/systemctl status  rabbitmq-server.service
rabbitmq-server.service - RabbitMQ broker
   Loaded: loaded (/usr/lib/systemd/system/rabbitmq-server.service; enabled)
   Active: deactivating (stop) (Result: timeout)
  Process: 785 ExecStartPre=/bin/sh -c /usr/lib/rabbitmq/bin/rabbitmqctl status > /dev/null 2>&1 (code=exited, status=2)
 Main PID: 1098 (beam.smp);         : 2816 (beam.smp)
   CGroup: /system.slice/rabbitmq-server.service
           ├─1098 /usr/lib64/erlang/erts-5.10.4/bin/beam.smp -W w -K true -A30 -P 1048576 -- -root /usr/lib64/erlang -progname erl --...
           ├─2100 inet_gethost 4
           ├─2101 inet_gethost 4
           └─control
             ├─1099 /usr/lib64/erlang/erts-5.10.4/bin/beam.smp -- -root /usr/lib64/erlang -progname erl -- -home /var/lib/rabbitmq --...
             ├─1171 /usr/lib64/erlang/erts-5.10.4/bin/epmd -daemon
             └─2816 /usr/lib64/erlang/erts-5.10.4/bin/beam.smp -- -root /usr/lib64/erlang -progname erl -- -home /var/lib/rabbitmq --...

Apr 08 11:21:57 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: /usr/lib/rabbitmq/bin/rabbitmq-server: line...ry
Apr 08 11:21:58 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmqctl[1099]: Waiting for 'rabbit@rdo-ice-rhel70-stage-maste......
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: RabbitMQ 3.1.5. Copyright (C) 2007-2013 GoP...c.
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ##  ##      Licensed under the MPL.  See ht...m/
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ##  ##
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ##########  Logs: /var/log/rabbitmq/rabbit@...og
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ######  ##        /var/log/rabbitmq/rabbit@...og
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ##########
Apr 08 11:22:02 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: Starting broker... completed with 0 plugins.
Apr 08 11:23:27 rdo-ice-rhel70-stage-master-controller.novalocal systemd[1]: rabbitmq-server.service operation timed out. Stopping.
Hint: Some lines were ellipsized, use -l to show in full.
[root@rdo-ice-rhel70-stage-master-controller ~(keystone_admin)]# 
[root@rdo-ice-rhel70-stage-master-controller ~(keystone_admin)]# service rabbitmq-server status
Redirecting to /bin/systemctl status  rabbitmq-server.service
rabbitmq-server.service - RabbitMQ broker
   Loaded: loaded (/usr/lib/systemd/system/rabbitmq-server.service; enabled)
   Active: failed (Result: exit-code) since Tue 2014-04-08 11:23:27 EDT; 4s ago
  Process: 2859 ExecStopPost=/usr/bin/rm /var/run/rabbitmq/pid (code=exited, status=1/FAILURE)
  Process: 2816 ExecStop=/usr/lib/rabbitmq/bin/rabbitmqctl stop (code=exited, status=0/SUCCESS)
  Process: 1098 ExecStart=/usr/lib/rabbitmq/bin/rabbitmq-server (code=killed, signal=TERM)
  Process: 785 ExecStartPre=/bin/sh -c /usr/lib/rabbitmq/bin/rabbitmqctl status > /dev/null 2>&1 (code=exited, status=2)
 Main PID: 1098 (code=killed, signal=TERM)
   CGroup: /system.slice/rabbitmq-server.service

Apr 08 11:21:57 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: mkdir: cannot create directory ‘/var/run/...ed
Apr 08 11:21:57 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: /usr/lib/rabbitmq/bin/rabbitmq-server: line...ry
Apr 08 11:21:58 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmqctl[1099]: Waiting for 'rabbit@rdo-ice-rhel70-stage-maste......
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: RabbitMQ 3.1.5. Copyright (C) 2007-2013 GoP...c.
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ##  ##      Licensed under the MPL.  See ht...m/
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ##  ##
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ##########  Logs: /var/log/rabbitmq/rabbit@...og
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ######  ##        /var/log/rabbitmq/rabbit@...og
Apr 08 11:22:01 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: ##########
Apr 08 11:22:02 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmq-server[1098]: Starting broker... completed with 0 plugins.
Apr 08 11:23:27 rdo-ice-rhel70-stage-master-controller.novalocal systemd[1]: rabbitmq-server.service operation timed out. Stopping.
Apr 08 11:23:27 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmqctl[2816]: Stopping and halting node 'rabbit@rdo-ice-rhel......
Apr 08 11:23:27 rdo-ice-rhel70-stage-master-controller.novalocal rabbitmqctl[2816]: ...done.
Apr 08 11:23:27 rdo-ice-rhel70-stage-master-controller.novalocal systemd[1]: rabbitmq-server.service: control process exited, code...s=1
Apr 08 11:23:27 rdo-ice-rhel70-stage-master-controller.novalocal systemd[1]: Failed to start RabbitMQ broker.
Apr 08 11:23:27 rdo-ice-rhel70-stage-master-controller.novalocal systemd[1]: Unit rabbitmq-server.service entered failed state.
Apr 08 11:23:27 rdo-ice-rhel70-stage-master-controller.novalocal rm[2859]: /usr/bin/rm: cannot remove ‘/var/run/rabbitmq/pid’...tory
Hint: Some lines were ellipsized, use -l to show in full.
[root@rdo-ice-rhel70-stage-master-controller ~(keystone_admin)]#

Comment 3 wes hayutin 2014-04-08 15:30:13 UTC
I can only reproduce this behavior w/ a reboot

Comment 4 wes hayutin 2014-04-08 15:40:11 UTC
[root@rdo-ice-rhel70-stage-master-controller ~(keystone_admin)]# mount | grep run
tmpfs on /run type tmpfs (rw,nosuid,nodev,seclabel,mode=755)


[root@rdo-ice-rhel70-stage-master-controller ~(keystone_admin)]# ls /run/
auditd.pid    cron.reboot        faillock     libvirtd.pid  mariadb    openvswitch   rpcbind.sock   sm-notify.pid  tuned
avahi-daemon  dbus               httpd        lock          mdadm      rabbitmq      rpc.statd.pid  sshd.pid       udev
chronyd.pid   dhclient-eth0.pid  initramfs    log           mount      radvd         saslauthd      syslogd.pid    user
console       dmeventd-client    ksmtune.pid  lvm           mysqld     rhsm          sepermit       systemd        utmp
crond.pid     dmeventd-server    libvirt      lvmetad.pid   netreport  rpcbind.lock  setrans        tmpfiles.d
[root@rdo-ice-rhel70-stage-master-controller ~(keystone_admin)]#

Comment 5 Alan Pevec 2014-04-08 20:58:27 UTC
rabbitmq-server-3.1.5-3.el7.noarch doesn't include fix for bug 1059913
epel7 branch wasn't updated, you could try epel7 scratch build from Fedora master: fedpkg --dist epel7 scratch-build

Comment 6 Alan Pevec 2014-04-08 23:35:08 UTC
Ignore c5 - it's epel7 build missing tmpfiles:

%if 0%{?fedora} > 14
install -D -p -m 0644 %{SOURCE5} %{buildroot}%{_sysconfdir}/tmpfiles.d/%{name}.conf
%endif

Comment 7 Alan Pevec 2014-04-08 23:57:17 UTC
Created attachment 884288 [details]
proposed patch

Comment 9 John Eckersberg 2014-04-09 13:00:18 UTC
I'm guessing we should also bring RHEL >= 7 in for these bits too:

%if 0%{?fedora}
BuildRequires:  systemd
%endif

...

%if 0%{?fedora}
Requires(pre): systemd
Requires(post): systemd
Requires(preun): systemd
%else
Requires(pre): initscripts
Requires(post): chkconfig
Requires(preun):chkconfig
Requires(preun):initscripts
%endif


Note You need to log in before you can comment on or make changes to this bug.