MATLAB: How to convert CP1252 to UTF-8 inside Matlab

MATLABunknown

I'm pulling some text information from Excel spreadsheets into Matlab. Some of the special characters are encoded as CP1252.

How do I convert them into UTF-8 encoded special characters?

Best Answer

as_unicode = native2unicode( uint8(TheVectorOfCP1252), 'CP1252');
as_utf8 = unicode2native( as_unicode, 'UTF-8');

as_utf8 will now be a uint8 array that can be fwrite()

Related Solutions

MATLAB: Using mex – get error “Unknown encoding ‘cp1252”

Hi there,

my colleague and me just figured out how to "hard code" a workaround for this. As Martin already mentioned, the error occurs in the perl script "mexutilx.pm". It tries to use the perl function "decode" to decode with the "cp1252" codepage. Unfortunately this fails. Aftwerwards we thought: "Who needs decoding?", and disabled it. And it acutally works in my case.

So without any warranty:

Just place

    $encoding = 0;

at line 148 in the mexutilx.pm file to make sure that the following

    if ($encoding) 
    {
      ...
    } else {
      ...
    }

is not "true"! It worked in my case, although it might break if some c/c++ functions use things like ä,ö,ü....

And make sure that you copy the "mexutilx.pm" just to be able to restore to the old state.

Just one question: Can it be that both of use mex at work and is this workplace by any chance at a big german company?

Best regards, Martin

MATLAB: How to batch convert windows-1252 encoded MATLAB files to UTF-8 encoding or vice versa

There is no built-in feature in MATLAB to do this, nor is there any MathWorks provided tool which would perform this conversion. There are many third-party command line tools available however which can perform these conversions. On Linux you for example have the iconv tool, based on which you could write a shell script like the following:

#!/bin/bash
find $1 -name "*.m" -exec bash -c 'mkdir -p "$0/`dirname "{}"`"; iconv -f windows-1252 -t utf-8 "{}" > "$0/{}"' "$2" \;

Which takes two directories as input: the directory containing the original files and an output directory in which to recreate the directory structure with M-files converted from windows-1252 to UTF-8 encoding. To perform conversion in the opposite directory swap the 'windows-1252' and 'utf-8' parameters.

You may even also be able to run this script on Windows if you have these "Unix Tools" installed on Windows (for example as part of cygwin or Git Bash).

Doing an online search on 'batch converting file encoding' will give you many more options/variants on this topic.

Best Answer

Related Solutions

MATLAB: Using mex – get error “Unknown encoding ‘cp1252”

MATLAB: How to batch convert windows-1252 encoded MATLAB files to UTF-8 encoding or vice versa

Related Question