Red Hat Bugzilla – Bug 49342
htdig crasches while refreshing database
Last modified: 2015-03-04 20:09:17 EST
From Bugzilla Helper: User-Agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Description of problem: htdig crashes with the following messages while rebuilding the database. Same error both in RH 7.1-version and Rawhide. FATAL ERROR:Compressor::get_vals invalid comptype FATAL ERROR at file:WordBitCompress.cc line:827 !!! How reproducible: Always Steps to Reproduce: 1. htdig 2. Wait 3. htdig Actual Results: FATAL ERROR:Compressor::get_vals invalid comptype FATAL ERROR at file:WordBitCompress.cc line:827 !!! Expected Results: A refresh of the database. Additional info:
The minimum run that crashes it: [root@w01 /root]# htdig -v -v ht://dig Start Time: Wed Jul 18 16:06:56 2001 New server: w01.osys.se, 80 - Persistent connections: enabled - HEAD before GET: disabled - Timeout: 30 - Connection space: 0 - Max Documents: -1 - TCP retries: 1 - TCP wait time: 5 Trying to retrieve robots.txt file pick: w01.osys.se, # servers = 1 0:161706:4:http://w01.osys.se/manual/content-negotiation.html: (changed) title: Apache Content Negotiation url rejected: (level 1)http://w01.osys.se/manual/mod/mod_negotiation.html url rejected: (level 1)http://w01.osys.se/manual/mod/mod_mime.html url rejected: (level 1)http://w01.osys.se/manual/mod/mod_mime.html url rejected: (level 1)http://w01.osys.se/manual/ size = 22663 1:161748:3:http://w01.osys.se/Archives/Software/Sun/?D=A: (changed) title: Index of /Archives/Software/Sun **** url rejected: (level 1)http://w01.osys.se/Archives/Software/ url rejected: (level 1)http://w01.osys.se/Archives/Software/Sun/108303-03.tar.Z url rejected: (level 1)http://w01.osys.se/Archives/Software/Sun/StarOffice-5.1a-linux-i386.tar.gz *FATAL ERROR:Compressor::get_vals invalid comptype FATAL ERROR at file:WordBitCompress.cc line:827 !!! Segmentation fault
The contents of the directory: [root@w01 /root]# ll /Archives/Software/Sun/ total 357160 drwxrwxr-x 2 root archive 4096 May 27 20:38 ./ drwxrwxr-x 48 root archive 4096 Jul 18 15:58 ../ -rw-rw-r-- 1 ola ola 1330793 Feb 28 2000 108303-03.tar.Z -r--r--r-- 1 ola ola 55787520 Dec 31 2000 j2sdk-1.3.0-FCS-linux-i386.tar -rw-rw-r-- 1 root archive 22485129 Jan 29 2000 jdk-1.2.2-RC4-linux-i386-glibc-2.1.2.sh -rw-rw-r-- 1 ola ola 799676 Feb 28 2000 libforms.so.0.88 -rw-rw-r-- 1 ola ola 962560 Feb 28 2000 mtv-1.1.0.2-XIL.tar -rwxr-xr-x 1 ola ola 97621364 May 26 22:09 so-5_2-ga-bin-linux-en.bin* -rwxr-x--x 1 ola ola 97869654 May 27 20:38 so-5_2-ga-bin-linux-sv.bin* -rwxr-x--x 1 ola ola 16327461 May 26 23:39 soa-5_2-ga-bin-linux-en.bin* -rwxrwxr-x 1 root archive 68169700 Jan 5 2000 StarOffice-5.1a-linux-i386.tar.gz* -rw-rw-r-- 1 ola ola 3528529 Feb 28 2000 Sunray admguide.pdf -rw-rw-r-- 1 ola ola 212669 Feb 28 2000 Sunray Product notes.pdf -rw-rw-r-- 1 ola ola 197230 Feb 28 2000 Sunray quickref.pdf
I am not able to reproduce this bug. I have tried it with various setups and files, but it always worked... Have you tried to delete the original htdig database first: rm /var/lib/htdig/* and then ran the htdig command again twice? Maybe there was/is some strange leftover from an old version. Otherwise i would really need a reproducible setup as i can't track down bug without it... Read ya, Phil
I'm managed to get the same error just trying to build the KDE help search database, but it is not reproducible. I'm running stock 7.1 with current updates. The rebuild progress indicator went to 67% and then just went away; the following was logged to .xsession-errors: [lots of the following two] WordType::WordType: reading bad words from /usr/share/apps/khelpcenter/en/bad_words found an, ignored because TOOSHORT WordType::WordType: reading bad words from /usr/share/apps/khelpcenter/en/bad_words found of, ignored because TOOSHORT FATAL ERROR:Compressor::get_vals invalid comptype FATAL ERROR at file:WordBitCompress.cc line:827 !!! It failed this way several times, but now it doesn't. I still don't get a useful index, but that's probably a topic for another bug report. rpm -q htdig gives: htdig-3.2.0-0.b3.4
Yes, I've tried deleting all of the htdig database. Same result. Also, a similar error is reported in the bug database on the htdig homepage (without any workaround or comments last time I checked).
From my /etc/htdig.conf: # SIMOS: The following has to be false, otherwise htdig coredumps badly. wordlist_compress: false Source: htdig mailling lists. I do not have handy a complete reference.
I've updated htdig to the latest snapshop from CVS in rawhide. If you could give that version (3.2.0-2.011302) a try and report if the problem is gone i'd greately appreciate it. Thanks, Read ya, Phil
No response in 1 month, closing now as RAWHIDE as it works for me now. Read ya, Phil