Bug 172792

Summary: use of study() with utf8 support enabled breaks regexps
Product: [Fedora] Fedora Reporter: Jason Vas Dias <jvdias>
Component: perlAssignee: Marcela Mašláňová <mmaslano>
Status: CLOSED RAWHIDE QA Contact: David Lawrence <dkl>
Severity: medium Docs Contact:
Priority: medium    
Version: rawhideCC: loganej935, perl-devel, ppisar
Target Milestone: ---   
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2008-03-06 15:45:26 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 135975    

Description Jason Vas Dias 2005-11-09 20:32:14 UTC
Description of problem:

Use of study() with utf8 support enabled breaks perl-5.8.7's
regular expressions :

OK without UTF:
$  echo 'ABDCEFGHIJK' | 
   perl -pe 'study; s/HIJK/1234/;'
ABDCEFG1234

$ echo 'ABCDEFGHIJK' |
  perl -e '$_=<>; study; print /HIJK/,"\n";'
1

FAILS with UTF:
$ echo 'ABDCEFGHIJK' |
  PERL_UNICODE=31 perl -pe 'study; s/HIJK/1234/;'
ABDCEFGHIJK

$ echo 'ABCDEFGHIJK' | 
  PERL_UNICODE=31 perl -e '$_=<>; study; print /HIJK/,"\n";'

(re did not match)

Seems to be study() that is the culprit:
$ echo 'ABDCEFGHIJK' | 
  PERL_UNICODE=31 perl -pe 's/HIJK/1234/;'
ABDCEFG1234

And it is because $_ gets utf8-ness from STDIN:

$ echo 'ABDCEFGHIJK' |
  PERL_UNICODE=63 perl -e '$_=<>; study; print /HIJK/ ? "OK" : "FAIL","\n";'
FAIL

$ PERL_UNICODE=63 perl -e '$_="ABDCEFGHIJK"; study; print /HIJK/ ? "OK" :
"FAIL","\n";'
OK

This was in the 'en_US.UTF-8' locale. If I make utf-8 support
conditional on locale, the problem goes away for the C locale:

$ echo 'ABDCEFGHIJK' |
  PERL_UNICODE=127 LC_ALL=C perl -e '$_=<>; study; print /HIJK/ ? "OK" :
"FAIL","\n";'
OK

Version-Release number of selected component (if applicable):
ALL perl versions

How reproducible:
100%

Additional Information:

This is upstream perl bug 37646 ( http://rt.perl.org/rt3/index.html?q=37646 )

Comment 1 Robin Norwood 2006-10-01 23:34:26 UTC
assigning to rnorwood

Comment 2 Marcela Mašláňová 2008-03-06 15:45:26 UTC
The perl bug tracker was closed. It should be fixed in perl-5.10 soon.