MATLAB: Remove quotes in last column of the table

MATLABquotesreadtable

Hi,

Atm, I'm reading a big dataset in ML by:

DATA = readtable('data_log_gyro.csv');

Example below

Now I want the third column also in numerical values (so one column split into three columns) instead of in between quotes, I reached out to

opts = detectImportOptions('data_log_gyro.csv');

I tried changing the 'Variable type' to double, but then it's output is NaN

varTypes = {'categorical','datetime','double'}; 
opts = setvartype(opts,varTypes);

But was unable to find the correct options for this. Anyone who has a clue?

Best Answer

You can use the Format option in readtable with a format of

"%{yyyy-MM-dd}D %{dd-MMM-yyyy}D %{hh:mm}T ('%f', '%f', '%f')"

Note that I used double-quotes for the format, so that I would not have to escape the ' characters which are to appear literally.

There are other approaches, using the detected import options and modifying the Prefix and Suffix properties.

Related Solutions

MATLAB: How import data and change data and time format

%{....}D is a date specification. %{MM-dd-yyyy HH:mm:ss}D is equivalent to asking to

datetime(TheInputString, 'Format', 'MM-dd-yyyy HH:mm:ss')

which is numeric month, numeric day of month, four digit year, 24-hour type hour, two digit minute, two digits seconds.

and %{MM-dd-yyyy HH:mm:ss.SSSSSS}D is equivalent to asking to

datetime(TheInputString, 'Format', 'MM-dd-yyyy HH:mm:ss.SSSSSS')

which is numeric month, numeric day of month, four digit year, 24-hour type hour, two digit minute, two digits seconds, 6 digit fractions of a second.

Note: if you are using textscan then the %{}D formats given that way can have difficulty if the Whitespace parameter includes space: MATLAB would generally see the space as indicating the end of the field before trying to parse it as a date. readtable() is better at handling that.

MATLAB: Issue with data format when using textscan()

The format should be all lower case for duration.

%{hh:mm:ss}T

However, the data appears to be delimited as semicolon. You'd have more luck with readtable:

opts = detectImportOptions('D:\SI010118.txt')
opts = setvartype(opts,1,'datetime')
opts = setvaropts(opts,1,'InputFormat','dd.MM.uuuu HH:mm:ss')
readtable('D:\SI010118.txt',opts)

Best Answer

Related Solutions

MATLAB: How import data and change data and time format

MATLAB: Issue with data format when using textscan()

Related Question