Description of problem: I have a 475mb text file with 40,532,676 lines. I am trying to only get lines with more than eight characters. With en_US.UTF-8 "grep .......... large-file.txt" took about 2 hours and 27 minutes to process to the point of 162mb of results. If I change it from en_US.UTF-8 to C it takes 9 seconds to produce all 420mb. Which by my rough calculations means it is about 2538x slower. Version-Release number of selected component (if applicable): grep-2.5.3-4.fc11.x86_64 How reproducible: Everytime Steps to Reproduce: 1. time grep ......... large-file.txt Actual results: Extremely slow Expected results: Extremely fast Additional info:
I found another bug report that sounded like mine, and it suggested that LC_ALL=C would help, even if LANG=en_US.UTF-8. It did help, though is still slower than LANG=C. With LC_ALL=C and LANG=en_US.UTF-8 it took 19 seconds.
*** Bug 522125 has been marked as a duplicate of this bug. ***
This is a regression against grep-2.5.1a-61.fc10.
Fixed in grep-2.6.1 in rawhide, I am going to also build it for F11. I generated wordlist with 44957781 lines, 440M in size, running grep: $ time LC_ALL=en_US.UTF-8 grep 1master1 list.txt real 0m10.368s user 0m0.609s sys 0m0.508s $ time LC_ALL=C grep 1master1 list.txt real 0m9.454s user 0m0.500s sys 0m0.458s Looks good.
(In reply to comment #4) > Fixed in grep-2.6.1 in rawhide, I am going to also build it for F11. > > I generated wordlist with 44957781 lines, 440M in size, running grep: > > Please also build for F12. Thanks.
Sorry I didn't mention it, but for F12, F13 it was recently pushed through Bodhi.
grep-2.6.1-1.fc11 has been submitted as an update for Fedora 11. http://admin.fedoraproject.org/updates/grep-2.6.1-1.fc11
grep-2.6.1-1.fc11 has been pushed to the Fedora 11 testing repository. If problems still persist, please make note of it in this bug report. If you want to test the update, you can install it with su -c 'yum --enablerepo=updates-testing update grep'. You can provide feedback for this update here: http://admin.fedoraproject.org/updates/grep-2.6.1-1.fc11
grep-2.6.3-1.fc11 has been submitted as an update for Fedora 11. http://admin.fedoraproject.org/updates/grep-2.6.3-1.fc11
grep-2.6.3-1.fc11 has been pushed to the Fedora 11 testing repository. If problems still persist, please make note of it in this bug report. If you want to test the update, you can install it with su -c 'yum --enablerepo=updates-testing update grep'. You can provide feedback for this update here: http://admin.fedoraproject.org/updates/grep-2.6.3-1.fc11
This message is a reminder that Fedora 11 is nearing its end of life. Approximately 30 (thirty) days from now Fedora will stop maintaining and issuing updates for Fedora 11. It is Fedora's policy to close all bug reports from releases that are no longer maintained. At that time this bug will be closed as WONTFIX if it remains open with a Fedora 'version' of '11'. Package Maintainer: If you wish for this bug to remain open because you plan to fix it in a currently maintained version, simply change the 'version' to a later Fedora version prior to Fedora 11's end of life. Bug Reporter: Thank you for reporting this issue and we are sorry that we may not be able to fix it before Fedora 11 is end of life. If you would still like to see this bug fixed and are able to reproduce it against a later version of Fedora please change the 'version' of this bug to the applicable version. If you are unable to change the version, please add a comment here and someone will do it for you. Although we aim to fix as many bugs as possible during every release's lifetime, sometimes those efforts are overtaken by events. Often a more recent Fedora release includes newer upstream software that fixes bugs or makes them obsolete. The process we are following is described here: http://fedoraproject.org/wiki/BugZappers/HouseKeeping
grep-2.6.3-1.fc11 has been pushed to the Fedora 11 stable repository. If problems still persist, please make note of it in this bug report.