[Tex/LaTex] UTF8 for listings

fontslistingslistingsutf8unicode

With German umlauts I have to define these characters (Typesetting UTF8 listings with German Umlaute) and the following MWE is working:

\documentclass{article}
\usepackage[utf8]{inputenc}
\usepackage[T1]{fontenc}
\usepackage{listingsutf8}
\lstdefinelanguage{rawtext}{}
\begin{document}
\lstset{extendedchars=true,language=rawtext,basicstyle=\ttfamily,literate=%
    {Ä}{{\"A}}1%
    {Ö}{{\"O}}1%
    {Ü}{{\"U}}1%
    {ä}{{\"a}}1%
    {ö}{{\"o}}1%
    {ü}{{\"u}}1%
    {ß}{{\ss}}1%
} 

\lstinputlisting{test.txt} 
\end{document}

With content of test.txt like:

ÄÖÜäöüß
abcd-1234

However, what can I do for real UTF8 support. I've created a directory with some international UTF8 filenames. They were displayed with a GUI

enter image description here

and also within a UTF8 compatible shell (bash):

logo.jpg
الجزيرة.نت.html
חדשות, ידיעות מהארץ והעולם - עיתון הארץ.html
Βικιπαίδεια.html
Администрация Президента Грузии.html
საქართველოს პრეზიდენტის ადმინისტრაცია.html
深圳航空有限责任公司 官网订票享受票价直减！.html
航空券 予約・空席照会・運賃案内・国内線｜ANA.html

But if the output of the ls command is in the file test.txt, the document can not be compiled, because I get errors like 

! Package inputenc Error: Unicode char \u8:�\lst@FillFixed@ not set up for use 
with LaTeX.

I'm looking for a rock solid solution to input generated files. As there is no definition, what kind of characters in the source file is used, all kind of UTF8 characters should be possible to use.

Best Answer

listings is an 8-bit package. So if you want to use it you will have to add long lists of literate-declarations (for pdflatex) or char lists (for lualatex/xelatex see eg The 'listings' package and UTF-8). Also you will need fonts for all the glyphs (which means imho that pdflatex isn't really an option).

Without highlighting you could use xelatex/lualatex + the verbatim environment together with some font which covers unicode see e.g. https://stackoverflow.com/questions/1938639/monospace-unicode-font for such a font.

Related Question