Bug 1303781

Summary: libreoffice calc and math appears to translate csv to some other Asian in appearance (to me) language
Product: [Fedora] Fedora Reporter: morgan read <mstuff>
Component: libreofficeAssignee: Caolan McNamara <caolanm>
Status: CLOSED NOTABUG QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 22CC: caolanm, dtardon, erack, ltinkl, mstahl, sbergman
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-02-02 08:33:40 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
csv file imported into libreoffice Calc or Math
none
libreoffice Calc/ Math csv import window
none
csv imported into libreoffce Calc
none
ods file created by csv import none

Description morgan read 2016-02-01 23:56:42 UTC
Created attachment 1120260 [details]
csv file imported into libreoffice Calc or Math

Description of problem:
Import CSV and get Chinese/ Japanese (Asian looking, my apologies for any misplaced assumptions) characters!!!

Version-Release number of selected component (if applicable):
$ rpm -qa libreoffice
libreoffice-4.4.7.2-1.fc22.x86_64

How reproducible:
Always since I started using f22 from f20 about the New Year

Steps to Reproduce:
1. Have CSV
2. Import into Calc or Math
3. Get really weird stuff

Actual results:
Really weird stuff - Asian appearing characters all in cell A:1

Expected results:
Sensible spreadsheet

Additional info:
Attached screen shots and original csv

Comment 1 morgan read 2016-02-01 23:58:35 UTC
Created attachment 1120273 [details]
libreoffice Calc/ Math csv import window

Comment 2 morgan read 2016-02-01 23:59:28 UTC
Created attachment 1120274 [details]
csv imported into libreoffce Calc

Comment 3 morgan read 2016-02-02 00:03:34 UTC
Created attachment 1120275 [details]
ods file created by csv import

Comment 4 Stephan Bergmann 2016-02-02 08:33:40 UTC
attachment 1120273 [details] shows that you chose "Unicode (UTF-16)" as character set, you should switch that to a single-byte ASCII superset that actually matches your input file's encoding, "Unicode (UTF-8)"

Comment 5 morgan read 2016-02-04 22:29:09 UTC
Oops - buy why isn't libreoffice adopting the system/ user character coding - is that the bug?  Never had to think about that before.

Comment 6 Stephan Bergmann 2016-02-05 08:07:21 UTC
(In reply to morgan read from comment #5)
> Oops - buy why isn't libreoffice adopting the system/ user character coding
> - is that the bug?  Never had to think about that before.

I very much assume that you accidentally happened to switch that setting in the dialog once to UTF-16 (from UTF-8, presumably), by some unintentional keyboard or mouse interaction.  I'm not aware how we would ever preselect UTF-16 here.

Comment 7 Eike Rathke 2016-02-05 11:37:38 UTC
It might had happened when opening a file with a UTF-16 BOM, or if content starts with 16-bit values where the high byte represents a control character other than CR,LF,TAB, in which case Unicode UTF-16 is assumed and selected. And the settings are remembered and preselected for the next file to be opened.

Comment 8 morgan read 2016-03-28 11:38:34 UTC
Thanks Eike, sounds plausible :)
M