Hide Forgot
Description of problem: After using dnf to upgrade from Fedora 24 -> 25 all of my Ruby on Rails applications now throw a Server 500 error in Apache. If you create a new Rails Application it also throws a 500 Error. I reported this bug to "phusion/passenger" on GitHub - Ticket #1900. They were able to re-create the bug. According to Phusion if you install the same version of Passenger 5.0.30 from a tarball and manually compile it, it works just fine. Phusion also claims that if you point mod_passenger at the compiled version of Passenger it work. Phusion concluded the problem is in the rpm. Everyone passes the buck! :) I have 7 separate Rails Applications that were all working perfectly before the upgrade to Fedora 25. They are all down now. Plus any new application will not work. Version-Release number of selected component (if applicable): httpd-2.4.23-4.fc25.x86_64 httpd-filesystem-2.4.23-4.fc25.noarch httpd-tools-2.4.23-4.fc25.x86_64 http-parser-2.7.1-3.fc25.x86_64 mod_passenger-5.0.30-1.fc25.x86_64 passenger-5.0.30-1.fc25.x86_64 ruby-2.3.3-61.1.fc25.x86_64 ruby-devel-2.3.3-61.1.fc25.x86_64 rubygem-actioncable-5.0.0.1-1.fc25.noarch rubygem-actionmailer-5.0.0.1-1.fc25.noarch rubygem-actionpack-5.0.0.1-2.fc25.noarch rubygem-actionview-5.0.0.1-2.fc25.noarch rubygem-activejob-5.0.0.1-1.fc25.noarch rubygem-activemodel-5.0.0.1-1.fc25.noarch rubygem-activerecord-5.0.0.1-1.fc25.noarch rubygem-activesupport-5.0.0.1-1.fc25.noarch rubygem-ansi-1.5.0-3.fc24.noarch rubygem-arel-7.0.0-1.fc25.noarch rubygem-bcrypt-3.1.10-4.fc24.x86_64 rubygem-bigdecimal-1.2.8-61.1.fc25.x86_64 rubygem-binding_of_caller-0.7.2-4.fc24.noarch rubygem-builder-3.2.2-5.fc24.noarch rubygem-bundler-1.12.5-1.fc25.noarch rubygem-byebug-9.0.6-1.fc25.x86_64 rubygem-capybara-2.4.1-3.fc24.noarch rubygem-climate_control-0.0.3-5.fc21.noarch rubygem-cliver-0.3.2-4.fc24.noarch rubygem-cocaine-0.5.7-3.fc24.noarch rubygem-coffee-rails-4.2.1-1.fc25.noarch rubygem-coffee-script-2.4.1-3.fc25.noarch rubygem-coffee-script-source-1.10.0-2.fc24.noarch rubygem-concurrent-ruby-1.0.2-1.fc25.noarch rubygem-daemon_controller-1.2.0-4.fc24.noarch rubygem-debug_inspector-0.0.2-5.fc24.x86_64 rubygem-did_you_mean-1.0.0-61.1.fc25.x86_64 rubygem-erubis-2.7.0-11.fc25.noarch rubygem-execjs-2.7.0-1.fc25.noarch rubygem-ffi-1.9.10-3.fc24.x86_64 rubygem-font-awesome-rails-4.7.0.0-1.fc25.noarch rubygem-globalid-0.3.6-1.fc25.noarch rubygem-hike-2.1.3-2.fc24.noarch rubygem-i18n-0.7.0-3.fc24.noarch rubygem-io-console-0.4.5-61.1.fc25.x86_64 rubygem-jbuilder-2.5.0-1.fc25.noarch rubygem-jquery-rails-4.0.4-3.fc25.noarch rubygem-json-1.8.3-103.fc25.x86_64 rubygem-kaminari-0.16.1-3.fc24.noarch rubygem-listen-3.1.5-1.fc25.noarch rubygem-loofah-2.0.3-2.fc24.noarch rubygem-mail-2.6.4-1.fc25.noarch rubygem-method_source-0.8.2-3.fc24.noarch rubygem-mime-types-3.1-1.fc25.noarch rubygem-mime-types-data-3.2016.0521-1.fc25.noarch rubygem-minitest-5.8.5-61.1.fc25.noarch rubygem-multi_json-1.10.1-3.fc24.noarch rubygem-mysql2-0.4.4-1.fc25.x86_64 rubygem-net-http-persistent-2.9.4-6.fc24.noarch rubygem-nio4r-1.2.1-2.fc25.x86_64 rubygem-nokogiri-1.6.8.1-1.fc25.x86_64 rubygem-orm_adapter-0.5.0-2.fc21.noarch rubygem-pkg-config-1.1.7-2.fc24.noarch rubygem-polyglot-0.3.4-4.fc24.noarch rubygem-psych-2.1.0-61.1.fc25.x86_64 rubygem-puma-3.6.0-3.fc25.x86_64 rubygem-rack-2.0.1-1.fc25.noarch rubygem-rack-test-0.6.3-3.fc24.noarch rubygem-rails-5.0.0.1-1.fc25.noarch rubygem-rails-deprecated_sanitizer-1.0.3-4.fc24.noarch rubygem-rails-dom-testing-2.0.1-1.fc25.noarch rubygem-rails-html-sanitizer-1.0.3-2.fc24.noarch rubygem-railties-5.0.0.1-2.fc25.noarch rubygem-rake-10.4.2-100.fc24.1.noarch rubygem-rb-inotify-0.9.7-1.fc25.noarch rubygem-rdoc-4.2.2-2.fc25.noarch rubygem-ref-1.0.5-4.fc24.noarch rubygems-2.5.2-61.1.fc25.noarch rubygem-sass-3.4.22-1.fc25.noarch rubygem-sass-rails-5.0.6-1.fc25.noarch rubygem-slim-2.0.2-1.fc21.noarch rubygem-spring-1.7.2-1.fc25.noarch rubygem-spring-watcher-listen-2.0.0-1.fc25.noarch rubygem-sprockets-3.7.0-1.fc25.noarch rubygem-sprockets-rails-3.1.1-1.fc25.noarch rubygem-sqlite3-1.3.11-2.fc24.x86_64 rubygem-temple-0.6.7-3.fc24.noarch rubygem-term-ansicolor-1.3.0-5.fc24.noarch rubygem-thor-0.19.1-5.fc25.noarch rubygem-thread_safe-0.3.5-3.fc24.noarch rubygem-tilt-2.0.4-1.fc25.noarch rubygem-tins-1.0.0-6.fc24.noarch rubygem-treetop-1.6.3-2.fc24.noarch rubygem-turbolinks-5.0.0-1.fc25.noarch rubygem-turbolinks-source-5.0.0-1.fc25.noarch rubygem-tzinfo-1.2.2-3.fc24.noarch rubygem-uglifier-3.0.0-1.fc25.noarch rubygem-web-console-3.3.1-1.fc25.noarch rubygem-websocket-driver-0.6.4-1.fc25.x86_64 rubygem-websocket-extensions-0.1.2-1.fc25.noarch rubygem-will_paginate-3.1.5-1.fc25.noarch rubygem-xpath-2.0.0-4.fc25.noarch ruby-irb-2.3.3-61.1.fc25.noarch ruby-libs-2.3.3-61.1.fc25.x86_64 rubypick-1.1.1-5.fc24.noarch How reproducible: Steps to Reproduce (Done By "phusion/passenger" maintainers): 1. Clean Fedora 25 install. 2. Desiable SELinux 3. "dnf install httpd mod_passenger mod_ssl rubygem-rails" 4. Create and call a Rails App. Actual results: Apache tosses a 500 Error instead of the app splash page. Expected results: The Application to run. :) Additional info: Apache V-Host Entry: <VirtualHost 1.2.3.4:80> ServerName app-01.domain.com ErrorLog logs/app-01.domain.com-error_log CustomLog logs/app-01.domain.com-access_log combined DocumentRoot /home/rails-devel/development/rails/app-01/public PassengerAppRoot /home/rails-devel/development/rails/app-01 RailsEnv development RailsBaseURI / <Directory /home/rails-devel/development/rails/app-01/public> # Relax Apache security settings AllowOverride all # MultiViews must be turned off Options -MultiViews +FollowSymLinks Require all granted </Directory> </VirtualHost> Passenger Crash Log: [root@devel-01 tmp]# more passenger-crash-log.1481303229 [ pid=6802, timestamp=1481303229 ] Process aborted! signo=SIGSEGV(11), reason=SEGV_MAPERR, si_addr=0x400, randomSeed=1481303214 [ pid=6802 ] Crash log dumped to /var/tmp/passenger-crash-log.1481303229 [ pid=6802 ] Date, uname and ulimits: Fri Dec 9 10:07:09 MST 2016 Linux 4.8.11-300.fc25.x86_64 #1 SMP Mon Nov 28 18:24:51 UTC 2016 x86_64 x86_64 core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 7924 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 7924 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited [ pid=6802 ] Phusion Passenger version: 5.0.30 [ pid=6802 ] libc backtrace available! -------------------------------------- [ pid=6802 ] Backtrace with 27 frames: Using backtrace sanitizer. Passenger core(+0x61a7b)[0x55925ba43a7b] Passenger core(+0x28d09)[0x55925ba0ad09] Passenger core(+0x63bee)[0x55925ba45bee] /lib64/libpthread.so.0(?? at ??:0; +0x115c0) [0x7f65235925c0] Passenger core(+0x13fd82)[0x55925bb21d82] Passenger core(+0x14051d)[0x55925bb2251d] Passenger core(+0x143893)[0x55925bb25893] Passenger core(+0x157161)[0x55925bb39161] Passenger core(+0x158597)[0x55925bb3a597] Passenger core(+0x187dd0)[0x55925bb69dd0] Passenger core(+0x1a24f6)[0x55925bb844f6] Passenger core(+0x1a3d24)[0x55925bb85d24] Passenger core(+0x1c1e29)[0x55925bba3e29] Passenger core(+0x1c2878)[0x55925bba4878] Passenger core(+0x119a96)[0x55925bafba96] Passenger core(+0x89a33)[0x55925ba6ba33] Passenger core(+0x8a3b5)[0x55925ba6c3b5] Passenger core(+0x93c8c)[0x55925ba75c8c] Passenger core(+0x11a045)[0x55925bafc045] Passenger core(+0x1142ff)[0x55925baf62ff] /lib64/libev.so.4(?? at ??:0; ev_invoke_pending+0x53) [0x7f6524091113] /lib64/libev.so.4(?? at ??:0; ev_run+0x968) [0x7f6524094708] Passenger core(+0x2513b5)[0x55925bc333b5] Passenger core(+0x7d020)[0x55925ba5f020] Passenger core(+0x220246)[0x55925bc02246] /lib64/libpthread.so.0(?? at ??:0; +0x76ca) [0x7f65235886ca] /lib64/libc.so.6(?? at ??:0; clone+0x5f) [0x7f652260ef6f] -------------------------------------- [ pid=6802 ] Dumping additional diagnostical information... -------------------------------------- ### Backtraces Thread 'Main thread' (0x7f652449b840, LWP 6802): in 'void waitForExitEvent()' (CoreMain.cpp:875) in 'void mainLoop()' (CoreMain.cpp:768) in 'int runCore()' (CoreMain.cpp:995) Thread 'Pool garbage collector' (0x7f6524438700, LWP 6802): in 'static void Passenger::ApplicationPool2::Pool::garbageCollect(Passenger::ApplicationPool2::PoolPtr)' (GarbageCollection.cpp:62) Thread 'Main event loop: thread 1: libuv poller' (0x7f65243ad700, LWP 6802): (empty) Thread 'Main event loop: thread 1' (0x7f651d95c700, LWP 6802): in 'Passenger::ServerKit::Channel::Result Passenger::ServerKit::HttpServer<DerivedServer, Client>::onClientDataReceived(Client*, const Passenger::MemoryKit::mbuf&, int) [with DerivedServer = Pas senger::Core::Controller; Client = Passenger::Core::Client]' (HttpServer.h:708) -- Client 1-1 in 'void Passenger::ServerKit::BaseServer<DerivedServer, Client>::onAcceptable(ev_io*, int) [with DerivedServer = Passenger::Core::Controller; Client = Passenger::Core::Client; ev_io = ev_io]' ( Server.h:240) Thread 'Pool analytics collector' (0x7f6524479700, LWP 6802): in 'static void Passenger::ApplicationPool2::Pool::collectAnalytics(Passenger::ApplicationPool2::PoolPtr)' (AnalyticsCollection.cpp:64) Thread 'API event loop: libuv poller' (0x7f651c95a700, LWP 6802): (empty) Thread 'API event loop' (0x7f651d15b700, LWP 6802): (empty) ### Request handler state (thread 1) { "active_client_count" : 1, "active_clients" : { "1-1" : { "connected_at" : { "local" : "Fri Dec 9 10:07:10 2016", "relative" : "0s ago", "relative_timestamp" : 0, "timestamp" : 1481303230.1186349 }, "connection_state" : "ACTIVE", "current_request" : { "app_sink_state" : { "callback_in_progress" : true, "end_acked" : true, "ended" : true, "initialized" : false, "io_watcher_active" : false }, "app_source_state" : { "callback_in_progress" : true, "end_acked" : true, "ended" : true, "initialized" : false, "io_watcher_active" : false }, "flags" : { "dechunk_response" : true, "https" : false, "request_body_buffering" : false }, "host" : "ala-editor-devel.alocalagent.com", "http_major" : 1, "http_minor" : 1, "http_state" : "COMPLETE", "last_data_receive_time" : { "local" : "Fri Dec 9 10:07:10 2016", "relative" : "0s ago", "relative_timestamp" : 0, "timestamp" : 1481303230.1184249 }, "last_data_send_time" : null, "method" : "GET", "path" : "/", "refcount" : 3, "request_body_already_read" : 0, "request_body_fully_read" : true, "request_body_type" : "NO_BODY", "response_begun" : false, "session_checkout_try" : 0, "started_at" : { "local" : "Fri Dec 9 10:07:10 2016", "relative" : "0s ago", "relative_timestamp" : 0, "timestamp" : 1481303230.118566 }, "state" : "CHECKING_OUT_SESSION", "sticky_session" : false, "want_keep_alive" : false }, "lingering_request_count" : 0, "name" : "1-1", "number" : 1, "output_channel_state" : { "bytes_buffered" : { "bytes" : 0, "human_readable" : "0 bytes" }, "callback_in_progress" : false, "mode" : "IN_MEMORY_MODE", "nbuffers" : 0, "reader_state" : "RS_INACTIVE" }, "refcount" : 3, "requests_begun" : 1 } }, "client_accept_speed" : { "1h" : { "averaged_over" : "1 hour", "per" : "minute", "value" : 0 }, "1m" : { "averaged_over" : "1 minute", "per" : "minute", "value" : 0 } }, "disconnected_client_count" : 0, "disconnected_clients" : {}, "free_client_count" : 127, "free_request_count" : 0, "mbuf_pool" : { "active_blocks" : 1, "active_memory" : { "bytes" : 4096, "human_readable" : "4.0 KB" }, "chunk_size" : 4096, "free_blocks" : 0, "offset" : 4048, "spare_memory" : { "bytes" : 0, "human_readable" : "0 bytes" } }, "peak_active_client_count" : 1, "pid" : 6802, "request_begin_speed" : { "1h" : { "averaged_over" : "1 hour", "per" : "minute", "value" : 0 }, "1m" : { "averaged_over" : "1 minute", "per" : "minute", "value" : 0 } }, "server_state" : "ACTIVE", "total_bytes_consumed" : 0, "total_clients_accepted" : 1, "total_requests_begun" : 1, "turbocaching" : { "fetches" : 1, "hit_ratio" : 0, "hits" : 0, "store_success_ratio" : null, "store_successes" : 0, "stores" : 1 } } ### Request handler config (thread 1) { "accept_burst_count" : 32, "client_freelist_limit" : 1024, "data_buffer_dir" : "/tmp", "min_spare_clients" : 128, "request_freelist_limit" : 1024, "show_version_in_header" : true, "single_app_mode" : false, "start_reading_after_accept" : true, "stat_throttle_rate" : 10 } ### Pool state (simple) ----------- General information ----------- Max pool size : 6 App groups : 0 Processes : 0 Requests in top-level queue : 0 ----------- Application groups ----------- ### mbuf stats nfree_mbuf_blockq : 0 nactive_mbuf_blockq: 1 mbuf_block_chunk_size: 4096 ### Pool state (XML) <?xml version="1.0" encoding="iso8859-1" ?> <info version="3"><passenger_version>5.0.30</passenger_version><group_count>0</group_count><process_count>0</process_count><max>6</max><capacity_used>0</capacity_used><get_wait_list_size>0</get_wait_ list_size><get_wait_list></get_wait_list><supergroups></supergroups></info> -------------------------------------- [ pid=6802 ] Open files and file descriptors: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME Passenger 6802 root cwd DIR 252,2 4096 2 / Passenger 6802 root rtd DIR 252,2 4096 2 / Passenger 6802 root txt REG 252,2 3193584 2359357 /usr/lib64/passenger/support-binaries/PassengerAgent Passenger 6802 root mem REG 252,2 11368 1311316 /usr/lib64/libfreebl3.so Passenger 6802 root mem REG 252,2 471584 1316143 /usr/lib64/libpcre.so.1.2.7 Passenger 6802 root mem REG 252,2 37208 1318165 /usr/lib64/libcrypt-nss-2.24.so Passenger 6802 root mem REG 252,2 153184 1312417 /usr/lib64/libselinux.so.1 Passenger 6802 root mem REG 252,2 120136 1315298 /usr/lib64/libsasl2.so.3.0.0 Passenger 6802 root mem REG 252,2 114680 1315384 /usr/lib64/libresolv-2.24.so Passenger 6802 root mem REG 252,2 15128 1314993 /usr/lib64/libkeyutils.so.1.5 Passenger 6802 root mem REG 252,2 61232 1318208 /usr/lib64/libkrb5support.so.0.1 Passenger 6802 root mem REG 252,2 1240184 1311925 /usr/lib64/libunistring.so.2.0.0 Passenger 6802 root mem REG 252,2 2485224 1318202 /usr/lib64/libcrypto.so.1.0.2j Passenger 6802 root mem REG 252,2 467696 1318203 /usr/lib64/libssl.so.1.0.2j Passenger 6802 root mem REG 252,2 333488 1318330 /usr/lib64/libldap-2.4.so.2.10.7 Passenger 6802 root mem REG 252,2 60808 1313405 /usr/lib64/liblber-2.4.so.2.10.7 Passenger 6802 root mem REG 252,2 15416 1311353 /usr/lib64/libcom_err.so.2.1 Passenger 6802 root mem REG 252,2 201296 1318206 /usr/lib64/libk5crypto.so.3.1 Passenger 6802 root mem REG 252,2 951440 1313562 /usr/lib64/libkrb5.so.3.3 Passenger 6802 root mem REG 252,2 320832 1312745 /usr/lib64/libgssapi_krb5.so.2.2 Passenger 6802 root mem REG 252,2 253136 1314285 /usr/lib64/libnspr4.so Passenger 6802 root mem REG 252,2 19720 1316714 /usr/lib64/libplc4.so Passenger 6802 root mem REG 252,2 15576 1316894 /usr/lib64/libplds4.so Passenger 6802 root mem REG 252,2 188424 1316951 /usr/lib64/libnssutil3.so Passenger 6802 root mem REG 252,2 1229696 1317516 /usr/lib64/libnss3.so Passenger 6802 root mem REG 252,2 164040 1318322 /usr/lib64/libsmime3.so Passenger 6802 root mem REG 252,2 314456 1318325 /usr/lib64/libssl3.so Passenger 6802 root mem REG 252,2 51984 1318170 /usr/lib64/libpsl.so.5.0.1 Passenger 6802 root mem REG 252,2 185360 1314874 /usr/lib64/libssh2.so.1.0.1 Passenger 6802 root mem REG 252,2 225208 1315028 /usr/lib64/libidn2.so.0.0.11 Passenger 6802 root mem REG 252,2 157416 1313991 /usr/lib64/libnghttp2.so.14.9.0 Passenger 6802 root mem REG 252,2 112432 1312467 /usr/lib64/libnsl-2.24.so Passenger 6802 root mem REG 252,2 2115832 1312027 /usr/lib64/libc-2.24.so Passenger 6802 root mem REG 252,2 92872 1311913 /usr/lib64/libgcc_s-6.2.1-20160916.so.1 Passenger 6802 root mem REG 252,2 1169416 1314541 /usr/lib64/libm-2.24.so Passenger 6802 root mem REG 252,2 1590720 1316312 /usr/lib64/libstdc++.so.6.0.22 Passenger 6802 root mem REG 252,2 19736 1312079 /usr/lib64/libdl-2.24.so Passenger 6802 root mem REG 252,2 44056 1315510 /usr/lib64/librt-2.24.so Passenger 6802 root mem REG 252,2 151112 1315382 /usr/lib64/libpthread-2.24.so Passenger 6802 root mem REG 252,2 89520 1313654 /usr/lib64/libz.so.1.2.8 Passenger 6802 root mem REG 252,2 523896 1316429 /usr/lib64/libcurl.so.4.4.0 Passenger 6802 root mem REG 252,2 212376 1316730 /usr/lib64/libjsoncpp.so.1.7.7 Passenger 6802 root mem REG 252,2 155344 1313591 /usr/lib64/libuv.so.1.0.0 Passenger 6802 root mem REG 252,2 56584 1315286 /usr/lib64/libev.so.4.0.0 Passenger 6802 root mem REG 252,2 182608 1311273 /usr/lib64/ld-2.24.so Passenger 6802 root 0r CHR 1,3 0t0 7146 /dev/null Passenger 6802 root 1w FIFO 0,10 0t0 374604 pipe Passenger 6802 root 2w FIFO 0,10 0t0 374604 pipe Passenger 6802 root 3u unix 0xffff9fe4bb305c00 0t0 374480 type=STREAM Passenger 6802 root 5w FIFO 0,10 0t0 374604 pipe Passenger 6802 root 8r FIFO 0,10 0t0 374517 pipe Passenger 6802 root 9w FIFO 0,10 0t0 374517 pipe Passenger 6802 root 10r FIFO 0,10 0t0 374518 pipe Passenger 6802 root 11w FIFO 0,10 0t0 374518 pipe Passenger 6802 root 12r FIFO 0,10 0t0 374519 pipe Passenger 6802 root 13w FIFO 0,10 0t0 374519 pipe Passenger 6802 root 14u unix 0xffff9fe4bb304800 0t0 374520 /tmp/passenger.t1IrYVR/agents.s/core type=STREAM Passenger 6802 root 15u unix 0xffff9fe4bb305400 0t0 374522 /tmp/passenger.t1IrYVR/agents.s/core_api type=STREAM Passenger 6802 root 16r CHR 1,9 0t0 7151 /dev/urandom Passenger 6802 root 17u a_inode 0,11 0 7141 [eventpoll] Passenger 6802 root 18u a_inode 0,11 0 7141 [eventfd] Passenger 6802 root 19r FIFO 0,10 0t0 374525 pipe Passenger 6802 root 20w FIFO 0,10 0t0 374525 pipe Passenger 6802 root 21u a_inode 0,11 0 7141 [eventpoll] Passenger 6802 root 22r FIFO 0,10 0t0 374526 pipe Passenger 6802 root 23w FIFO 0,10 0t0 374526 pipe Passenger 6802 root 24u a_inode 0,11 0 7141 [eventfd] Passenger 6802 root 25u a_inode 0,11 0 7141 [eventpoll] Passenger 6802 root 26u a_inode 0,11 0 7141 [eventfd] Passenger 6802 root 27u a_inode 0,11 0 7141 [eventpoll] Passenger 6802 root 28u a_inode 0,11 0 7141 [eventfd] Passenger 6802 root 29u a_inode 0,11 0 7141 [eventpoll] Passenger 6802 root 30r FIFO 0,10 0t0 374527 pipe Passenger 6802 root 31w FIFO 0,10 0t0 374527 pipe Passenger 6802 root 32u a_inode 0,11 0 7141 [eventfd] Passenger 6802 root 33u unix 0xffff9fe4ba13d400 0t0 374602 /tmp/passenger.t1IrYVR/agents.s/core type=STREAM -------------------------------------- [ pid=6802 ] Dumping a more detailed backtrace with crash-watch... Found gdb at: /usr/bin/gdb ******************************************************* * * Current thread (1) backtrace * ******************************************************* #0 0x00007f6522604d63 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x000055925bc362d3 in oxt::syscalls::select(int, fd_set*, fd_set*, fd_set*, timeval*) () No symbol table info available. #2 0x000055925baacc6d in waitForExitEvent() () No symbol table info available. #3 0x000055925baaf07c in runCore() () No symbol table info available. #4 0x000055925bab1162 in coreMain(int, char**) () No symbol table info available. #5 0x000055925ba0baf5 in main () No symbol table info available. ******************************************************* * * All thread backtraces * ******************************************************* ########### Thread 8 (Thread 0x7f652432c700 (LWP 6853)) ########### #0 0x00007f652260ef41 in clone () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f6523588600 in ?? () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f652432c700 in ?? () No symbol table info available. #3 0x0000000000000000 in ?? () No symbol table info available. ########### Thread 7 (Thread 0x7f651c95a700 (LWP 6812)) ########### #0 0x00007f652260f563 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x000055925baa1863 in Passenger::pollLibuv(Passenger::BackgroundEventLoop*) () No symbol table info available. #2 0x000055925bc333b5 in oxt::thread::thread_main(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>) () No symbol table info available. #3 0x000055925ba5f020 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>), boost::_bi::list2<boost::_bi::value <boost::function<void ()> >, boost::_bi::value<boost::shared_ptr<oxt::thread_local_context> > > > >::run() () No symbol table info available. #4 0x000055925bc02246 in thread_proxy () No symbol table info available. #5 0x00007f65235886ca in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #6 0x00007f652260ef6f in clone () from /lib64/libc.so.6 No symbol table info available. ########### Thread 6 (Thread 0x7f651d15b700 (LWP 6811)) ########### #0 0x00007f652260f563 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f6524091ac5 in epoll_poll () from /lib64/libev.so.4 No symbol table info available. #2 0x00007f6524094089 in ev_run () from /lib64/libev.so.4 No symbol table info available. #3 0x000055925bc333b5 in oxt::thread::thread_main(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>) () No symbol table info available. #4 0x000055925ba5f020 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>), boost::_bi::list2<boost::_bi::value <boost::function<void ()> >, boost::_bi::value<boost::shared_ptr<oxt::thread_local_context> > > > >::run() () No symbol table info available. #5 0x000055925bc02246 in thread_proxy () No symbol table info available. #6 0x00007f65235886ca in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #7 0x00007f652260ef6f in clone () from /lib64/libc.so.6 No symbol table info available. ########### Thread 5 (Thread 0x7f65243ad700 (LWP 6809)) ########### #0 0x00007f652260f563 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x000055925baa1863 in Passenger::pollLibuv(Passenger::BackgroundEventLoop*) () No symbol table info available. #2 0x000055925bc333b5 in oxt::thread::thread_main(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>) () No symbol table info available. #3 0x000055925ba5f020 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>), boost::_bi::list2<boost::_bi::value <boost::function<void ()> >, boost::_bi::value<boost::shared_ptr<oxt::thread_local_context> > > > >::run() () No symbol table info available. #4 0x000055925bc02246 in thread_proxy () No symbol table info available. #5 0x00007f65235886ca in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #6 0x00007f652260ef6f in clone () from /lib64/libc.so.6 No symbol table info available. ########### Thread 4 (Thread 0x7f651d95c700 (LWP 6808)) ########### #0 0x00007f652359246d in raise () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000055925ba453ea in Passenger::abortHandler(int, siginfo_t*, void*) () No symbol table info available. #2 <signal handler called> No symbol table info available. #3 0x000055925bb21d82 in Passenger::ApplicationPool2::Group::createProcessObject(Json::Value const&) () No symbol table info available. #4 0x000055925bb2251d in Passenger::ApplicationPool2::Group::initialize() () No symbol table info available. #5 0x000055925bb25893 in Passenger::ApplicationPool2::Pool::createGroup(Passenger::ApplicationPool2::Options const&) () No symbol table info available. #6 0x000055925bb39161 in Passenger::ApplicationPool2::Pool::createGroupAndAsyncGetFromIt(Passenger::ApplicationPool2::Options const&, Passenger::ApplicationPool2::GetCallback const&, boost::cont ainer::vector<boost::function<void ()>, boost::container::new_allocator<boost::function<void ()> > >&) () No symbol table info available. #7 0x000055925bb3a597 in Passenger::ApplicationPool2::Pool::asyncGet(Passenger::ApplicationPool2::Options const&, Passenger::ApplicationPool2::GetCallback const&, bool, Passenger::UnionStation:: StopwatchLog**) () No symbol table info available. #8 0x000055925bb69dd0 in Passenger::Core::Controller::asyncGetFromApplicationPool(Passenger::Core::Request*, Passenger::ApplicationPool2::GetCallback) () No symbol table info available. #9 0x000055925bb844f6 in Passenger::Core::Controller::checkoutSession(Passenger::Core::Client*, Passenger::Core::Request*) () No symbol table info available. #10 0x000055925bb85d24 in Passenger::Core::Controller::onRequestBegin(Passenger::Core::Client*, Passenger::Core::Request*) () No symbol table info available. #11 0x000055925bba3e29 in Passenger::ServerKit::HttpServer<Passenger::Core::Controller, Passenger::Core::Client>::processClientDataWhenParsingHeaders(Passenger::Core::Client*, Passenger::Core::Re quest*, Passenger::MemoryKit::mbuf const&, int) () No symbol table info available. #12 0x000055925bba4878 in Passenger::ServerKit::HttpServer<Passenger::Core::Controller, Passenger::Core::Client>::onClientDataReceived(Passenger::Core::Client*, Passenger::MemoryKit::mbuf const&, int) () No symbol table info available. #13 0x000055925bafba96 in Passenger::ServerKit::BaseServer<Passenger::Core::Controller, Passenger::Core::Client>::_onClientDataReceived(Passenger::ServerKit::Channel*, Passenger::MemoryKit::mbuf const&, int) () No symbol table info available. #14 0x000055925ba6ba33 in Passenger::ServerKit::Channel::callDataCallbackWithoutRefGuard() () No symbol table info available. #15 0x000055925ba6c3b5 in Passenger::ServerKit::Channel::feedWithoutRefGuard(Passenger::MemoryKit::mbuf&&) () No symbol table info available. #16 0x000055925ba75c8c in Passenger::ServerKit::FdSourceChannel::onReadableWithoutRefGuard() () No symbol table info available. #17 0x000055925bafc045 in Passenger::ServerKit::BaseServer<Passenger::Core::Controller, Passenger::Core::Client>::onClientsAccepted(Passenger::Core::Client**, unsigned int) () No symbol table info available. #18 0x000055925baf62ff in Passenger::ServerKit::BaseServer<Passenger::Core::Controller, Passenger::Core::Client>::onAcceptable(ev_io*, int) () No symbol table info available. #19 0x00007f6524091113 in ev_invoke_pending () from /lib64/libev.so.4 No symbol table info available. #20 0x00007f6524094708 in ev_run () from /lib64/libev.so.4 No symbol table info available. #21 0x000055925bc333b5 in oxt::thread::thread_main(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>) () No symbol table info available. #22 0x000055925ba5f020 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>), boost::_bi::list2<boost::_bi::value <boost::function<void ()> >, boost::_bi::value<boost::shared_ptr<oxt::thread_local_context> > > > >::run() () No symbol table info available. #23 0x000055925bc02246 in thread_proxy () No symbol table info available. #24 0x00007f65235886ca in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #25 0x00007f652260ef6f in clone () from /lib64/libc.so.6 No symbol table info available. ########### Thread 3 (Thread 0x7f6524438700 (LWP 6805)) ########### #0 0x00007f652358e809 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000055925bb36f15 in Passenger::ApplicationPool2::Pool::garbageCollect(boost::shared_ptr<Passenger::ApplicationPool2::Pool>) () No symbol table info available. #2 0x000055925bb45527 in boost::detail::function::void_function_obj_invoker0<boost::_bi::bind_t<void, void (*)(boost::shared_ptr<Passenger::ApplicationPool2::Pool>), boost::_bi::list1<boost::_bi ::value<boost::shared_ptr<Passenger::ApplicationPool2::Pool> > > >, void>::invoke(boost::detail::function::function_buffer&) () No symbol table info available. #3 0x000055925bb549fb in boost::function0<void>::operator()() const () No symbol table info available. #4 0x000055925bb58c39 in oxt::dynamic_thread_group::thread_main(oxt::dynamic_thread_group::thread_func_data*) () No symbol table info available. #5 0x000055925bc333b5 in oxt::thread::thread_main(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>) () No symbol table info available. #6 0x000055925ba5f020 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>), boost::_bi::list2<boost::_bi::value <boost::function<void ()> >, boost::_bi::value<boost::shared_ptr<oxt::thread_local_context> > > > >::run() () No symbol table info available. #7 0x000055925bc02246 in thread_proxy () No symbol table info available. #8 0x00007f65235886ca in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #9 0x00007f652260ef6f in clone () from /lib64/libc.so.6 No symbol table info available. ########### Thread 2 (Thread 0x7f6524479700 (LWP 6804)) ########### #0 0x00007f6523591c7d in nanosleep () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000055925bc36ecb in oxt::syscalls::nanosleep(timespec const*, timespec*) () No symbol table info available. #2 0x000055925bc37123 in oxt::syscalls::usleep(unsigned int) () No symbol table info available. #3 0x000055925bb3dbf7 in Passenger::ApplicationPool2::Pool::collectAnalytics(boost::shared_ptr<Passenger::ApplicationPool2::Pool>) () No symbol table info available. #4 0x000055925bb45527 in boost::detail::function::void_function_obj_invoker0<boost::_bi::bind_t<void, void (*)(boost::shared_ptr<Passenger::ApplicationPool2::Pool>), boost::_bi::list1<boost::_bi ::value<boost::shared_ptr<Passenger::ApplicationPool2::Pool> > > >, void>::invoke(boost::detail::function::function_buffer&) () No symbol table info available. #5 0x000055925bb549fb in boost::function0<void>::operator()() const () No symbol table info available. #6 0x000055925bb58c39 in oxt::dynamic_thread_group::thread_main(oxt::dynamic_thread_group::thread_func_data*) () No symbol table info available. #7 0x000055925bc333b5 in oxt::thread::thread_main(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>) () No symbol table info available. #8 0x000055925ba5f020 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>), boost::_bi::list2<boost::_bi::value <boost::function<void ()> >, boost::_bi::value<boost::shared_ptr<oxt::thread_local_context> > > > >::run() () No symbol table info available. #9 0x000055925bc02246 in thread_proxy () No symbol table info available. #10 0x00007f65235886ca in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #11 0x00007f652260ef6f in clone () from /lib64/libc.so.6 No symbol table info available. ########### Thread 1 (Thread 0x7f652449b840 (LWP 6802)) ########### #0 0x00007f6522604d63 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x000055925bc362d3 in oxt::syscalls::select(int, fd_set*, fd_set*, fd_set*, timeval*) () No symbol table info available. #2 0x000055925baacc6d in waitForExitEvent() () No symbol table info available. #3 0x000055925baaf07c in runCore() () No symbol table info available. #4 0x000055925bab1162 in coreMain(int, char**) () No symbol table info available. #5 0x000055925ba0baf5 in main () No symbol table info available. [ 2016-12-09 10:07:11.5232 6802/7f652432c700 age/Cor/Spa/PipeWatcher.h:95 ]: Cannot read from process 0 stdout: Bad file descriptor (errno=9) [root@devel-01 tmp]#
GitHub - Phusion - Passenger - Support Ticket in regards to this challenge. https://github.com/phusion/passenger/issues/1900 It also has shows this crash happening to another user after an upgrade from Fedora 24 to 25. I also did manage to find that one of the Ruby Gem RPMS rubygem-action* or rubygem-active* requires rubygem-listen to function, however it is not in the list of that rpm's required files so it is not resolved as a dependency.
Part of the problem is a missing dependency: Passenger now requires [root@devel-01 tmp]# cd /usr/lib64/passenger/ [root@devel-01 passenger]# ls -l total 24 drwxr-xr-x 3 root root 4096 Dec 10 03:09 nginx_dynamic -rwxr-xr-x 1 root root 15176 Oct 17 07:51 passenger_native_support.so lrwxrwxrwx 1 root root 15 Oct 17 07:50 PassengerWebHelper -> /usr/sbin/nginx drwxr-xr-x 2 root root 4096 Dec 10 03:09 support-binaries /usr/sbin/ngix Yet it is not a dependency of the rpm. We have a new crash now. [root@devel-01 tmp]# cat passenger-crash-log.1481364617 [ pid=4432, timestamp=1481364617 ] Process aborted! signo=SIGSEGV(11), reason=SEGV_MAPERR, si_addr=0x400, randomSeed=1481364613 [ pid=4432 ] Crash log dumped to /var/tmp/passenger-crash-log.1481364617 [ pid=4432 ] Date, uname and ulimits: Sat Dec 10 03:10:17 MST 2016 Linux 4.8.12-300.fc25.x86_64 #1 SMP Fri Dec 2 17:52:11 UTC 2016 x86_64 x86_64 core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 7924 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 7924 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited [ pid=4432 ] Phusion Passenger version: 5.0.30 [ pid=4432 ] libc backtrace available! -------------------------------------- [ pid=4432 ] Backtrace with 26 frames: Using backtrace sanitizer. Passenger core(+0x61a7b)[0x5646419b9a7b] Passenger core(+0x28d09)[0x564641980d09] Passenger core(+0x63bee)[0x5646419bbbee] /lib64/libpthread.so.0(?? at ??:0; +0x115c0) [0x7fa7095015c0] Passenger core(+0x13fd82)[0x564641a97d82] Passenger core(+0x14051d)[0x564641a9851d] Passenger core(+0x143893)[0x564641a9b893] Passenger core(+0x157161)[0x564641aaf161] Passenger core(+0x158597)[0x564641ab0597] Passenger core(+0x187dd0)[0x564641adfdd0] Passenger core(+0x1a24f6)[0x564641afa4f6] Passenger core(+0x1a3d24)[0x564641afbd24] Passenger core(+0x1c1e29)[0x564641b19e29] Passenger core(+0x1c2878)[0x564641b1a878] Passenger core(+0x119a96)[0x564641a71a96] Passenger core(+0x89a33)[0x5646419e1a33] Passenger core(+0x8a3b5)[0x5646419e23b5] Passenger core(+0x93c8c)[0x5646419ebc8c] Passenger core(+0x9406e)[0x5646419ec06e] /lib64/libev.so.4(?? at ??:0; ev_invoke_pending+0x53) [0x7fa70a000113] /lib64/libev.so.4(?? at ??:0; ev_run+0x968) [0x7fa70a003708] Passenger core(+0x2513b5)[0x564641ba93b5] Passenger core(+0x7d020)[0x5646419d5020] Passenger core(+0x220246)[0x564641b78246] /lib64/libpthread.so.0(?? at ??:0; +0x76ca) [0x7fa7094f76ca] /lib64/libc.so.6(?? at ??:0; clone+0x5f) [0x7fa70857df6f] -------------------------------------- [ pid=4432 ] Dumping additional diagnostical information... -------------------------------------- ### Backtraces Thread 'Main thread' (0x7fa70a40a840, LWP 4432): in 'void waitForExitEvent()' (CoreMain.cpp:875) in 'void mainLoop()' (CoreMain.cpp:768) in 'int runCore()' (CoreMain.cpp:995) Thread 'Pool garbage collector' (0x7fa70a3a7700, LWP 4432): in 'static void Passenger::ApplicationPool2::Pool::garbageCollect(Passenger::ApplicationPool2::PoolPtr)' (GarbageCollection.cpp:52) Thread 'Main event loop: thread 1: libuv poller' (0x7fa70a31c700, LWP 4432): (empty) Thread 'Main event loop: thread 1' (0x7fa7038cb700, LWP 4432): in 'Passenger::ServerKit::Channel::Result Passenger::ServerKit::HttpServer<DerivedServer, Client>::onClientDataReceived(Client*, const Passenger::MemoryKit::mbuf&, int) [with DerivedServer = Passenger::Core::Controller; Client = Passenger::Core::Client]' (HttpServer.h:708) -- Client 1-1 Thread 'Pool analytics collector' (0x7fa70a3e8700, LWP 4432): in 'static void Passenger::ApplicationPool2::Pool::collectAnalytics(Passenger::ApplicationPool2::PoolPtr)' (AnalyticsCollection.cpp:64) Thread 'API event loop: libuv poller' (0x7fa7028c9700, LWP 4432): (empty) Thread 'API event loop' (0x7fa7030ca700, LWP 4432): (empty) ### Request handler state (thread 1) { "active_client_count" : 1, "active_clients" : { "1-1" : { "connected_at" : { "local" : "Sat Dec 10 03:10:18 2016", "relative" : "0s ago", "relative_timestamp" : -0.00048351287841796875, "timestamp" : 1481364618.0082071 }, "connection_state" : "ACTIVE", "current_request" : { "app_sink_state" : { "callback_in_progress" : true, "end_acked" : true, "ended" : true, "initialized" : false, "io_watcher_active" : false }, "app_source_state" : { "callback_in_progress" : true, "end_acked" : true, "ended" : true, "initialized" : false, "io_watcher_active" : false }, "flags" : { "dechunk_response" : true, "https" : false, "request_body_buffering" : false }, "host" : "sales-manager-devel.atmymarket.com", "http_major" : 1, "http_minor" : 1, "http_state" : "COMPLETE", "last_data_receive_time" : { "local" : "Sat Dec 10 03:10:18 2016", "relative" : "0s ago", "relative_timestamp" : 0, "timestamp" : 1481364618.0084851 }, "last_data_send_time" : null, "method" : "GET", "path" : "/door/login", "refcount" : 3, "request_body_already_read" : 0, "request_body_fully_read" : true, "request_body_type" : "NO_BODY", "response_begun" : false, "session_checkout_try" : 0, "started_at" : { "local" : "Sat Dec 10 03:10:18 2016", "relative" : "0s ago", "relative_timestamp" : 0, "timestamp" : 1481364618.0086379 }, "state" : "CHECKING_OUT_SESSION", "sticky_session" : false, "want_keep_alive" : false }, "lingering_request_count" : 0, "name" : "1-1", "number" : 1, "output_channel_state" : { "bytes_buffered" : { "bytes" : 0, "human_readable" : "0 bytes" }, "callback_in_progress" : false, "mode" : "IN_MEMORY_MODE", "nbuffers" : 0, "reader_state" : "RS_INACTIVE" }, "refcount" : 3, "requests_begun" : 1 } }, "client_accept_speed" : { "1h" : { "averaged_over" : "1 hour", "per" : "minute", "value" : -60 }, "1m" : { "averaged_over" : "1 minute", "per" : "minute", "value" : -60 } }, "disconnected_client_count" : 0, "disconnected_clients" : {}, "free_client_count" : 127, "free_request_count" : 0, "mbuf_pool" : { "active_blocks" : 1, "active_memory" : { "bytes" : 4096, "human_readable" : "4.0 KB" }, "chunk_size" : 4096, "free_blocks" : 0, "offset" : 4048, "spare_memory" : { "bytes" : 0, "human_readable" : "0 bytes" } }, "peak_active_client_count" : 1, "pid" : 4432, "request_begin_speed" : { "1h" : { "averaged_over" : "1 hour", "per" : "minute", "value" : -60 }, "1m" : { "averaged_over" : "1 minute", "per" : "minute", "value" : -60 } }, "server_state" : "ACTIVE", "total_bytes_consumed" : 0, "total_clients_accepted" : 1, "total_requests_begun" : 1, "turbocaching" : { "fetches" : 1, "hit_ratio" : 0, "hits" : 0, "store_success_ratio" : null, "store_successes" : 0, "stores" : 1 } } ### Request handler config (thread 1) { "accept_burst_count" : 32, "client_freelist_limit" : 1024, "data_buffer_dir" : "/tmp", "min_spare_clients" : 128, "request_freelist_limit" : 1024, "show_version_in_header" : true, "single_app_mode" : false, "start_reading_after_accept" : true, "stat_throttle_rate" : 10 } ### Pool state (simple) ----------- General information ----------- Max pool size : 6 App groups : 0 Processes : 0 Requests in top-level queue : 0 ----------- Application groups ----------- ### mbuf stats nfree_mbuf_blockq : 0 nactive_mbuf_blockq: 1 mbuf_block_chunk_size: 4096 ### Pool state (XML) <?xml version="1.0" encoding="iso8859-1" ?> <info version="3"><passenger_version>5.0.30</passenger_version><group_count>0</group_count><process_count>0</process_count><max>6</max><capacity_used>0</capacity_used><get_wait_list_size>0</get_wait_list_size><get_wait_list></get_wait_list><supergroups></supergroups></info> -------------------------------------- [ pid=4432 ] Open files and file descriptors: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME Passenger 4432 root cwd DIR 252,2 4096 2 / Passenger 4432 root rtd DIR 252,2 4096 2 / Passenger 4432 root txt REG 252,2 3193584 2360154 /usr/lib64/passenger/support-binaries/PassengerAgent Passenger 4432 root mem REG 252,2 11368 1311316 /usr/lib64/libfreebl3.so Passenger 4432 root mem REG 252,2 471584 1316143 /usr/lib64/libpcre.so.1.2.7 Passenger 4432 root mem REG 252,2 37208 1318165 /usr/lib64/libcrypt-nss-2.24.so Passenger 4432 root mem REG 252,2 153184 1312417 /usr/lib64/libselinux.so.1 Passenger 4432 root mem REG 252,2 120136 1315298 /usr/lib64/libsasl2.so.3.0.0 Passenger 4432 root mem REG 252,2 114680 1315384 /usr/lib64/libresolv-2.24.so Passenger 4432 root mem REG 252,2 15128 1314993 /usr/lib64/libkeyutils.so.1.5 Passenger 4432 root mem REG 252,2 61232 1318208 /usr/lib64/libkrb5support.so.0.1 Passenger 4432 root mem REG 252,2 1240184 1311925 /usr/lib64/libunistring.so.2.0.0 Passenger 4432 root mem REG 252,2 2485224 1318202 /usr/lib64/libcrypto.so.1.0.2j Passenger 4432 root mem REG 252,2 467696 1318203 /usr/lib64/libssl.so.1.0.2j Passenger 4432 root mem REG 252,2 333488 1318330 /usr/lib64/libldap-2.4.so.2.10.7 Passenger 4432 root mem REG 252,2 60808 1313405 /usr/lib64/liblber-2.4.so.2.10.7 Passenger 4432 root mem REG 252,2 15416 1311353 /usr/lib64/libcom_err.so.2.1 Passenger 4432 root mem REG 252,2 201296 1318206 /usr/lib64/libk5crypto.so.3.1 Passenger 4432 root mem REG 252,2 951440 1313562 /usr/lib64/libkrb5.so.3.3 Passenger 4432 root mem REG 252,2 320832 1312745 /usr/lib64/libgssapi_krb5.so.2.2 Passenger 4432 root mem REG 252,2 253136 1314285 /usr/lib64/libnspr4.so Passenger 4432 root mem REG 252,2 19720 1316714 /usr/lib64/libplc4.so Passenger 4432 root mem REG 252,2 15576 1316894 /usr/lib64/libplds4.so Passenger 4432 root mem REG 252,2 188424 1316951 /usr/lib64/libnssutil3.so Passenger 4432 root mem REG 252,2 1229696 1317516 /usr/lib64/libnss3.so Passenger 4432 root mem REG 252,2 164040 1318322 /usr/lib64/libsmime3.so Passenger 4432 root mem REG 252,2 314456 1318325 /usr/lib64/libssl3.so Passenger 4432 root mem REG 252,2 51984 1318170 /usr/lib64/libpsl.so.5.0.1 Passenger 4432 root mem REG 252,2 185360 1314874 /usr/lib64/libssh2.so.1.0.1 Passenger 4432 root mem REG 252,2 225208 1315028 /usr/lib64/libidn2.so.0.0.11 Passenger 4432 root mem REG 252,2 157416 1313991 /usr/lib64/libnghttp2.so.14.9.0 Passenger 4432 root mem REG 252,2 112432 1312467 /usr/lib64/libnsl-2.24.so Passenger 4432 root mem REG 252,2 2115832 1312027 /usr/lib64/libc-2.24.so Passenger 4432 root mem REG 252,2 92872 1311913 /usr/lib64/libgcc_s-6.2.1-20160916.so.1 Passenger 4432 root mem REG 252,2 1169416 1314541 /usr/lib64/libm-2.24.so Passenger 4432 root mem REG 252,2 1590720 1316312 /usr/lib64/libstdc++.so.6.0.22 Passenger 4432 root mem REG 252,2 19736 1312079 /usr/lib64/libdl-2.24.so Passenger 4432 root mem REG 252,2 44056 1315510 /usr/lib64/librt-2.24.so Passenger 4432 root mem REG 252,2 151112 1315382 /usr/lib64/libpthread-2.24.so Passenger 4432 root mem REG 252,2 89520 1313654 /usr/lib64/libz.so.1.2.8 Passenger 4432 root mem REG 252,2 523896 1316429 /usr/lib64/libcurl.so.4.4.0 Passenger 4432 root mem REG 252,2 212376 1316730 /usr/lib64/libjsoncpp.so.1.7.7 Passenger 4432 root mem REG 252,2 155344 1313591 /usr/lib64/libuv.so.1.0.0 Passenger 4432 root mem REG 252,2 56584 1315286 /usr/lib64/libev.so.4.0.0 Passenger 4432 root mem REG 252,2 182608 1311273 /usr/lib64/ld-2.24.so Passenger 4432 root 0r CHR 1,3 0t0 7146 /dev/null Passenger 4432 root 1w FIFO 0,10 0t0 43794 pipe Passenger 4432 root 2w FIFO 0,10 0t0 43794 pipe Passenger 4432 root 3u unix 0xffff953bba4fe400 0t0 43728 type=STREAM Passenger 4432 root 5w FIFO 0,10 0t0 43794 pipe Passenger 4432 root 8r FIFO 0,10 0t0 43768 pipe Passenger 4432 root 9w FIFO 0,10 0t0 43768 pipe Passenger 4432 root 10r FIFO 0,10 0t0 43769 pipe Passenger 4432 root 11w FIFO 0,10 0t0 43769 pipe Passenger 4432 root 12r FIFO 0,10 0t0 43770 pipe Passenger 4432 root 13w FIFO 0,10 0t0 43770 pipe Passenger 4432 root 14u unix 0xffff953bba313000 0t0 43771 /tmp/passenger.ajfjHDe/agents.s/core type=STREAM Passenger 4432 root 15u unix 0xffff953bbbf0f400 0t0 43773 /tmp/passenger.ajfjHDe/agents.s/core_api type=STREAM Passenger 4432 root 16r CHR 1,9 0t0 7151 /dev/urandom Passenger 4432 root 17u a_inode 0,11 0 7141 [eventpoll] Passenger 4432 root 18u a_inode 0,11 0 7141 [eventfd] Passenger 4432 root 19r FIFO 0,10 0t0 43775 pipe Passenger 4432 root 20w FIFO 0,10 0t0 43775 pipe Passenger 4432 root 21u a_inode 0,11 0 7141 [eventpoll] Passenger 4432 root 22r FIFO 0,10 0t0 43776 pipe Passenger 4432 root 23w FIFO 0,10 0t0 43776 pipe Passenger 4432 root 24u a_inode 0,11 0 7141 [eventfd] Passenger 4432 root 25u a_inode 0,11 0 7141 [eventpoll] Passenger 4432 root 26u a_inode 0,11 0 7141 [eventfd] Passenger 4432 root 27u a_inode 0,11 0 7141 [eventpoll] Passenger 4432 root 28u a_inode 0,11 0 7141 [eventfd] Passenger 4432 root 29u a_inode 0,11 0 7141 [eventpoll] Passenger 4432 root 30r FIFO 0,10 0t0 43777 pipe Passenger 4432 root 31w FIFO 0,10 0t0 43777 pipe Passenger 4432 root 32u a_inode 0,11 0 7141 [eventfd] Passenger 4432 root 33u unix 0xffff953bb9ff6400 0t0 43792 /tmp/passenger.ajfjHDe/agents.s/core type=STREAM -------------------------------------- [ pid=4432 ] Dumping a more detailed backtrace with crash-watch... Found gdb at: /usr/bin/gdb ******************************************************* * * Current thread (1) backtrace * ******************************************************* #0 0x00007fa708573d63 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x0000564641bac2d3 in oxt::syscalls::select(int, fd_set*, fd_set*, fd_set*, timeval*) () No symbol table info available. #2 0x0000564641a22c6d in waitForExitEvent() () No symbol table info available. #3 0x0000564641a2507c in runCore() () No symbol table info available. #4 0x0000564641a27162 in coreMain(int, char**) () No symbol table info available. #5 0x0000564641981af5 in main () No symbol table info available. ******************************************************* * * All thread backtraces * ******************************************************* ########### Thread 7 (Thread 0x7fa7028c9700 (LWP 4440)) ########### #0 0x00007fa70857e563 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x0000564641a17863 in Passenger::pollLibuv(Passenger::BackgroundEventLoop*) () No symbol table info available. #2 0x0000564641ba93b5 in oxt::thread::thread_main(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>) () No symbol table info available. #3 0x00005646419d5020 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>), boost::_bi::list2<boost::_bi::value<boost::function<void ()> >, boost::_bi::value<boost::shared_ptr<oxt::thread_local_context> > > > >::run() () No symbol table info available. #4 0x0000564641b78246 in thread_proxy () No symbol table info available. #5 0x00007fa7094f76ca in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #6 0x00007fa70857df6f in clone () from /lib64/libc.so.6 No symbol table info available. ########### Thread 6 (Thread 0x7fa7030ca700 (LWP 4439)) ########### #0 0x00007fa70857e563 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fa70a000ac5 in epoll_poll () from /lib64/libev.so.4 No symbol table info available. #2 0x00007fa70a003089 in ev_run () from /lib64/libev.so.4 No symbol table info available. #3 0x0000564641ba93b5 in oxt::thread::thread_main(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>) () No symbol table info available. #4 0x00005646419d5020 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>), boost::_bi::list2<boost::_bi::value<boost::function<void ()> >, boost::_bi::value<boost::shared_ptr<oxt::thread_local_context> > > > >::run() () No symbol table info available. #5 0x0000564641b78246 in thread_proxy () No symbol table info available. #6 0x00007fa7094f76ca in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #7 0x00007fa70857df6f in clone () from /lib64/libc.so.6 No symbol table info available. ########### Thread 5 (Thread 0x7fa70a31c700 (LWP 4438)) ########### #0 0x00007fa70857e563 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x0000564641a17863 in Passenger::pollLibuv(Passenger::BackgroundEventLoop*) () No symbol table info available. #2 0x0000564641ba93b5 in oxt::thread::thread_main(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>) () No symbol table info available. #3 0x00005646419d5020 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>), boost::_bi::list2<boost::_bi::value<boost::function<void ()> >, boost::_bi::value<boost::shared_ptr<oxt::thread_local_context> > > > >::run() () No symbol table info available. #4 0x0000564641b78246 in thread_proxy () No symbol table info available. #5 0x00007fa7094f76ca in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #6 0x00007fa70857df6f in clone () from /lib64/libc.so.6 No symbol table info available. ########### Thread 4 (Thread 0x7fa7038cb700 (LWP 4437)) ########### #0 0x00007fa70950146d in raise () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00005646419bb3ea in Passenger::abortHandler(int, siginfo_t*, void*) () No symbol table info available. #2 <signal handler called> No symbol table info available. #3 0x0000564641a97d82 in Passenger::ApplicationPool2::Group::createProcessObject(Json::Value const&) () No symbol table info available. #4 0x0000564641a9851d in Passenger::ApplicationPool2::Group::initialize() () No symbol table info available. #5 0x0000564641a9b893 in Passenger::ApplicationPool2::Pool::createGroup(Passenger::ApplicationPool2::Options const&) () No symbol table info available. #6 0x0000564641aaf161 in Passenger::ApplicationPool2::Pool::createGroupAndAsyncGetFromIt(Passenger::ApplicationPool2::Options const&, Passenger::ApplicationPool2::GetCallback const&, boost::container::vector<boost::function<void ()>, boost::container::new_allocator<boost::function<void ()> > >&) () No symbol table info available. #7 0x0000564641ab0597 in Passenger::ApplicationPool2::Pool::asyncGet(Passenger::ApplicationPool2::Options const&, Passenger::ApplicationPool2::GetCallback const&, bool, Passenger::UnionStation::StopwatchLog**) () No symbol table info available. #8 0x0000564641adfdd0 in Passenger::Core::Controller::asyncGetFromApplicationPool(Passenger::Core::Request*, Passenger::ApplicationPool2::GetCallback) () No symbol table info available. #9 0x0000564641afa4f6 in Passenger::Core::Controller::checkoutSession(Passenger::Core::Client*, Passenger::Core::Request*) () No symbol table info available. #10 0x0000564641afbd24 in Passenger::Core::Controller::onRequestBegin(Passenger::Core::Client*, Passenger::Core::Request*) () No symbol table info available. #11 0x0000564641b19e29 in Passenger::ServerKit::HttpServer<Passenger::Core::Controller, Passenger::Core::Client>::processClientDataWhenParsingHeaders(Passenger::Core::Client*, Passenger::Core::Request*, Passenger::MemoryKit::mbuf const&, int) () No symbol table info available. #12 0x0000564641b1a878 in Passenger::ServerKit::HttpServer<Passenger::Core::Controller, Passenger::Core::Client>::onClientDataReceived(Passenger::Core::Client*, Passenger::MemoryKit::mbuf const&, int) () No symbol table info available. #13 0x0000564641a71a96 in Passenger::ServerKit::BaseServer<Passenger::Core::Controller, Passenger::Core::Client>::_onClientDataReceived(Passenger::ServerKit::Channel*, Passenger::MemoryKit::mbuf const&, int) () No symbol table info available. #14 0x00005646419e1a33 in Passenger::ServerKit::Channel::callDataCallbackWithoutRefGuard() () No symbol table info available. #15 0x00005646419e23b5 in Passenger::ServerKit::Channel::feedWithoutRefGuard(Passenger::MemoryKit::mbuf&&) () No symbol table info available. #16 0x00005646419ebc8c in Passenger::ServerKit::FdSourceChannel::onReadableWithoutRefGuard() () No symbol table info available. #17 0x00005646419ec06e in Passenger::ServerKit::FdSourceChannel::_onReadable(ev_loop*, ev_io*, int) () No symbol table info available. #18 0x00007fa70a000113 in ev_invoke_pending () from /lib64/libev.so.4 No symbol table info available. #19 0x00007fa70a003708 in ev_run () from /lib64/libev.so.4 No symbol table info available. #20 0x0000564641ba93b5 in oxt::thread::thread_main(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>) () No symbol table info available. #21 0x00005646419d5020 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>), boost::_bi::list2<boost::_bi::value<boost::function<void ()> >, boost::_bi::value<boost::shared_ptr<oxt::thread_local_context> > > > >::run() () No symbol table info available. #22 0x0000564641b78246 in thread_proxy () No symbol table info available. #23 0x00007fa7094f76ca in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #24 0x00007fa70857df6f in clone () from /lib64/libc.so.6 No symbol table info available. ########### Thread 3 (Thread 0x7fa70a3a7700 (LWP 4435)) ########### #0 0x00007fa7094fd809 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x0000564641aca7ac in boost::condition_variable::do_wait_until(boost::unique_lock<boost::mutex>&, timespec const&) () No symbol table info available. #2 0x0000564641aacc61 in Passenger::ApplicationPool2::Pool::garbageCollect(boost::shared_ptr<Passenger::ApplicationPool2::Pool>) () No symbol table info available. #3 0x0000564641abb527 in boost::detail::function::void_function_obj_invoker0<boost::_bi::bind_t<void, void (*)(boost::shared_ptr<Passenger::ApplicationPool2::Pool>), boost::_bi::list1<boost::_bi::value<boost::shared_ptr<Passenger::ApplicationPool2::Pool> > > >, void>::invoke(boost::detail::function::function_buffer&) () No symbol table info available. #4 0x0000564641aca9fb in boost::function0<void>::operator()() const () No symbol table info available. #5 0x0000564641acec39 in oxt::dynamic_thread_group::thread_main(oxt::dynamic_thread_group::thread_func_data*) () No symbol table info available. #6 0x0000564641ba93b5 in oxt::thread::thread_main(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>) () No symbol table info available. #7 0x00005646419d5020 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>), boost::_bi::list2<boost::_bi::value<boost::function<void ()> >, boost::_bi::value<boost::shared_ptr<oxt::thread_local_context> > > > >::run() () No symbol table info available. #8 0x0000564641b78246 in thread_proxy () No symbol table info available. #9 0x00007fa7094f76ca in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #10 0x00007fa70857df6f in clone () from /lib64/libc.so.6 No symbol table info available. ########### Thread 2 (Thread 0x7fa70a3e8700 (LWP 4434)) ########### #0 0x00007fa709500c7d in nanosleep () from /lib64/libpthread.so.0 No symbol table info available. #1 0x0000564641bacecb in oxt::syscalls::nanosleep(timespec const*, timespec*) () No symbol table info available. #2 0x0000564641bad123 in oxt::syscalls::usleep(unsigned int) () No symbol table info available. #3 0x0000564641ab3bf7 in Passenger::ApplicationPool2::Pool::collectAnalytics(boost::shared_ptr<Passenger::ApplicationPool2::Pool>) () No symbol table info available. #4 0x0000564641abb527 in boost::detail::function::void_function_obj_invoker0<boost::_bi::bind_t<void, void (*)(boost::shared_ptr<Passenger::ApplicationPool2::Pool>), boost::_bi::list1<boost::_bi::value<boost::shared_ptr<Passenger::ApplicationPool2::Pool> > > >, void>::invoke(boost::detail::function::function_buffer&) () No symbol table info available. #5 0x0000564641aca9fb in boost::function0<void>::operator()() const () No symbol table info available. #6 0x0000564641acec39 in oxt::dynamic_thread_group::thread_main(oxt::dynamic_thread_group::thread_func_data*) () No symbol table info available. #7 0x0000564641ba93b5 in oxt::thread::thread_main(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>) () No symbol table info available. #8 0x00005646419d5020 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(boost::function<void ()>, boost::shared_ptr<oxt::thread_local_context>), boost::_bi::list2<boost::_bi::value<boost::function<void ()> >, boost::_bi::value<boost::shared_ptr<oxt::thread_local_context> > > > >::run() () No symbol table info available. #9 0x0000564641b78246 in thread_proxy () No symbol table info available. #10 0x00007fa7094f76ca in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #11 0x00007fa70857df6f in clone () from /lib64/libc.so.6 No symbol table info available. ########### Thread 1 (Thread 0x7fa70a40a840 (LWP 4432)) ########### #0 0x00007fa708573d63 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x0000564641bac2d3 in oxt::syscalls::select(int, fd_set*, fd_set*, fd_set*, timeval*) () No symbol table info available. #2 0x0000564641a22c6d in waitForExitEvent() () No symbol table info available. #3 0x0000564641a2507c in runCore() () No symbol table info available. #4 0x0000564641a27162 in coreMain(int, char**) () No symbol table info available. #5 0x0000564641981af5 in main () No symbol table info available.
I have isolated and confirmed where this bug is. If you download the source tarball of Passenger from here: https://www.phusionpassenger.com/latest_stable_tarball The untar it and do the following: 01) cd passenger-5.0.30 02) ./bin/passenger-install-apache2-module 03) cp buildout/support-binaries/PassengerAgent /usr/lib64/passenger/support-binaries 04) systemnctl restart|start httpd Passenger then works fine. This one file is broken. There might be more but this at least brings all of the offline down systems back online. NOTES: When running passenger-install-apache2-module select only Ruby when your asked about the 4 languages. Unless you want the other 3. Seems pointless for a Rails server. I am unaware of what the default choices are for Fedora.
*** Bug 1403569 has been marked as a duplicate of this bug. ***
The rebuild procedure don't work any more (passenger latest is now 5.1), I used successfully these steps: dnf download --source passenger rpm -i passenger-5.0.30-1.fc25.src.rpm tar xzf rpmbuild/SOURCES/passenger-5.0.30.tar.gz cd passenger-5.0.30/ ./bin/passenger-install-apache2-module systemctl stop httpd cp buildout/support-binaries/PassengerAgent /usr/lib64/passenger/support-binaries systemctl start httpd
This message is a reminder that Fedora 25 is nearing its end of life. Approximately 4 (four) weeks from now Fedora will stop maintaining and issuing updates for Fedora 25. It is Fedora's policy to close all bug reports from releases that are no longer maintained. At that time this bug will be closed as EOL if it remains open with a Fedora 'version' of '25'. Package Maintainer: If you wish for this bug to remain open because you plan to fix it in a currently maintained version, simply change the 'version' to a later Fedora version. Thank you for reporting this issue and we are sorry that we were not able to fix it before Fedora 25 is end of life. If you would still like to see this bug fixed and are able to reproduce it against a later version of Fedora, you are encouraged change the 'version' to a later Fedora version prior this bug is closed as described in the policy above. Although we aim to fix as many bugs as possible during every release's lifetime, sometimes those efforts are overtaken by events. Often a more recent Fedora release includes newer upstream software that fixes bugs or makes them obsolete.
Fedora 25 changed to end-of-life (EOL) status on 2017-12-12. Fedora 25 is no longer maintained, which means that it will not receive any further security or bug fix updates. As a result we are closing this bug. If you can reproduce this bug against a currently maintained version of Fedora please feel free to reopen this bug against that version. If you are unable to reopen this bug, please file a new report against the current release. If you experience problems, please add a comment to this bug. Thank you for reporting this bug and we are sorry it could not be fixed.