MATLAB: How to read an UCS-2 encoded file in MATLAB

encodingfopenleMATLABucs-2ucs2utfutf-16

How it is possible to read an UCS-2 encoded file in MATLAB with the function 'fopen'?

Best Answer

To load an UCS-2 encoded file with fopen, one has to set the encoding parameter of fopen.

This works like the following for the file 'example.txt':

myfid = fopen('example.txt','r', 'ieee-le', 'UCS-2' )

Specifying UCS-2 does not specify how characters beyond 255 are encoded.

The only supported encoding is UTF-8.

UCS-2 is essentially only a character list that is kept fairly synchronized with Unicode, but Unicode gets updated more often. If the difference between UCS-2 and Unicode is important to you then you are likely to be disappointed, as the MATLAB implementation of both is not kept up freshly to date.

Related Solutions

MATLAB: Generate a checksum compliant with ISO 13239 using the General CRC Generator block

In order to generate a checksum compliant with ISO 13239 using the 'General CRC Generator' block, ensure the 'General CRC Generator' dialog parameters are set as follows:

- Initial states: 1

- Direct method: checked

- Reflect Input Bytes: checked

- Reflect checksums before final XOR: checked

- Final XOR: 1

- Checksums per frame: 1

Additionally, ensure the most significant bit of the input signal corresponds to the first element of the input binary column vector.

The output binary column vector consists of the the original word with the cyclic redundancy code bits appended to the end. The first element of the output binary vector corresponds to the most significant bit of the input signal.

MATLAB: Is it possible to read Japanese characters with datastore function

The function datastore doesn't support files encoded with Shift_JIS character code.

As a workarond, please use csv file of ASCII or UTF-8.

If Japanese characters are included, conversion to character code UTF-8 is possible using the following function (convertEncoding.m).

convertEncoding('ja_sjis.csv', 'Shift_JIS', 'UTF-8');
ds = datastore('ja_sjis.csv') 
ds.read

% convertEncoding.m
%----------------------------------------------------------------------

%CONVERTENCODING Change the character encoding of a file
% CONVERTENCODING(FILENAME, CURRENTENCODING, NEWENCODING) converts the
% file FILENAME from character encoding CURRENTENCODING to a new
% encoding specified by NEWENCODING. A copy of the original version of
% FILENAME is placed at FILENAME.old.
%
% INPUT PARAMETERS:
% FILENAME: The name of the file to be converted.
% CURRENTENCODING: The encoding currently be used by FILENAME.
% NEWENCODING: The encoding to rewrite FILENAME in.
function convertEncoding(filename, currentEncoding, newEncoding)
bakFile = [filename, '.old'];
movefile(filename, bakFile);
fpIn = fopen(bakFile, 'r', 'n', currentEncoding);
fpOut = fopen(filename, 'w', 'n', newEncoding);
while feof(fpIn) == 0
    lineIn = fgets(fpIn);
    fwrite(fpOut, lineIn, 'char');
end
fclose(fpIn);
fclose(fpOut);
end
%----------------------------------------------------------------------

Best Answer

Related Solutions

MATLAB: Generate a checksum compliant with ISO 13239 using the General CRC Generator block

MATLAB: Is it possible to read Japanese characters with datastore function

Related Question