Python GDAL Configuration – Using `–config` Flag with Python GDAL `gdal.Translate()`

gdalpython

So I've recently learned that GDAL and OGR command line utilities can be used as functions now. See this site for more info. For example:

from osgeo import gdal
tmp_ds = gdal.Warp('temp', 'in.tif', format = 'MEM', dstSRS = 'EPSG:3857')
gdal.Translate('out.png', tmp_ds, format = 'PNG')

This works amazing! But one thing I can't figure out is how to pass in the –config flag. In my case, I am using gdal_translate to convert a US Topo GeoPDF to GeoTiff, exporting out certain PDF layers:

gdal_translate -of “GTiff” --config GDAL_PDF_LAYER “Map_Collar,Map_Frame.Terrain” ustopo.pdf ustopo_terrain.tif

I've tried adding to the gdal.Translate in 2 ways:

gdal.Translate('out.tif', tmp_ds, format = 'GTiff',options='--config GDAL_PDF_LAYER “Map_Collar,Map_Frame.Terrain”')

and

gdal.Translate('out.tif', tmp_ds, format = 'GTiff',config='GDAL_PDF_LAYER “Map_Collar,Map_Frame.Terrain”')

Neither work. I am totally stumped.

Best Answer

I would post it in comment, but can't yet. Anyway, when I am working with GDAL i usually use this:

gdal.SetConfigOption('COMPRESS_OVERVIEW', 'LZW')

which basically is

gdal.SetConfigOption(option, settings)

or when you are creating a file driver you can set options like this:

        format = "GTiff"
        driver = gdal.GetDriverByName(format)
        dst_ds = driver.Create(out_file, xsize, ysize, 1, gdal.GDT_Int32, creationOptions=['COMPRESS=LZW', 'TFW=YES'])

another thing could be this (i am not really sure about the correct syntax for GDAL PDF LAYER:

co = ['GDAL_PDF_LAYER']
gdal.Translate('out.tif', tmp_ds, format = 'GTiff',options=co)

Related Solutions

[GIS] Set default GDAL/OGR config options

To answer your question directly - no, I don't think it's possible.

To workaround, use the *nix alias concept...

On Windows:

You can make your current method permanent by using setx or the Windows user environment variables GUI.
You can fake an alias by setting an env var to the command + config options (note need to open a new cmd prompt to use the env var set by setx, note lack of "=" and entire command must be on one line):

setx gdaljpgo "gdaladdo -r gauss --config PHOTOMETRIC_OVERVIEW=YCBCR --config INTERLEAVE_OVERVIEW PIXEL --config COMPRESS_OVERVIEW=JPEG --config JPEG_QUALITY_OVERVIEW=85"

C:\> %gdaljpgo% input.tif 2 4 8 16 32

You can use a shell that directly supports aliases, such as Windows Powershell or (my fave) the Git for Windows Bash prompt.
You can use the doskey command to set an alias/macro (note limitations in this answer)

On Linux:

set an alias in your shell startup, i.e. ~/.bashrc.

alias gdaljpgo='gdaladdo -r gauss \
                         --config PHOTOMETRIC_OVERVIEW=YCBCR \
                         --config INTERLEAVE_OVERVIEW PIXEL \
                         --config COMPRESS_OVERVIEW=JPEG \
                         --config JPEG_QUALITY_OVERVIEW=85'

[GIS] Read files with Python GDAL using VSIGS

Rasterio added support for gcs urls in version 1.0.15. If you're working with a recent version you can now use the following:

import rasterio
import os

#can also set these as a normal env var outside of python
os.environ['GS_SECRET_ACCESS_KEY'] = ''
os.environ['GS_ACCESS_KEY_ID'] = ''

#url should look like gs://...
with rasterio.open(url) as src:
    print(src.width, src.height)

This is convenient, as you no longer need to wrap rasterio requests in the env.

You can also authenticate through other gcs methods (e.g. set GOOGLE_APPLICATION_CREDENTIALS variable to service account credentials json), however, these methods currently don't work unless you've installed rasterio from a source distribution (pip install rasterio --no-binary rasterio) due to gdal version incompatibilities.

Best Answer

Related Solutions

[GIS] Set default GDAL/OGR config options

[GIS] Read files with Python GDAL using VSIGS

Related Question