[GIS] Creating Coveragestore GeoTIFF using REST API

geoservergeoserver-rest-api

I need to create a layer by uploading a GeoTIFF file.

After reading Adding a new Coveragestore in a certain Workspace by REST and Programming Geoserver 2.0.2 to add a raster data store and layer without the UI I create a method to do this using Java.

My problem is after creating the workspace and when trying to create the store (using PUT) my server returns error 500. The Geoserver Log:

        Version = 1.3.0
        Request = GetMap
        Get = true
        RawKvp = {REQUEST=GetMap, FORMAT=image/png, CRS=EPSG:3857, BBOX=-4852834.05176927,-2661231.576776698,-4696291.017841228,-2504688.5428486574, VERSION=1.3.0, STYLES=, SERVICE=WMS, WIDTH=256, HEIGHT=256, TRANSPARENT=true, LAYERS=osm:AA_OpenStreetMap}
        BaseUrl = http://10.5.115.122:80/geoserver/
        RequestCharset = UTF-8
2016-11-17 11:21:41,742 ERROR [geoserver.rest] - No such layer: Carta_puntarenas
2016-11-17 11:21:41,742 ERROR [geoserver.rest] -
org.geoserver.rest.RestletException
        at org.geoserver.catalog.rest.LayerFinder.findTarget(LayerFinder.java:39)
        at org.restlet.Finder.handle(Finder.java:268)
        at org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:38)
        at org.restlet.Filter.doHandle(Filter.java:105)
        at org.restlet.Filter.handle(Filter.java:134)
        at org.restlet.Router.handle(Router.java:444)
        at org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:205)
        at com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)

The 3 steps method in second post is more convenient but I have no way to send the file to the server and can't fill the URL store attribute.

The 2 steps of first post is what I'm doing since I can send a PUT and hope the Geoserver can resolve the URL itself (don't know where the file will be stored) but the create layer part was not shown.

The ported Java code to PUT is like this:

public int doPutFile( File file, String contentType, String url, String content, String geoUser, String geoPassword ) throws Exception {
    int code = 0;

    String geoCreds = geoUser + ":" + geoPassword;
    String encodedAuth = new String( Base64.encodeBase64( geoCreds.getBytes() ) );
    HttpURLConnection con = (HttpURLConnection) new URL( url ).openConnection();
    con.setRequestMethod( "PUT" );
    con.setRequestProperty("Authorization", "Basic " + encodedAuth );
    con.setRequestProperty("User-Agent", USER_AGENT);
    con.setRequestProperty("Content-type", contentType);
    con.setConnectTimeout( 120000 );

    con.setDoOutput(true);
    OutputStream outputStream = con.getOutputStream();
    FileInputStream streamFileInputStream = new FileInputStream( file );
    BufferedInputStream streamFileBufferedInputStream = new BufferedInputStream(streamFileInputStream);     

    byte[] streamFileBytes = new byte[ 512 ];
    int bytesRead = 0;

    while ((bytesRead = streamFileBufferedInputStream.read(streamFileBytes)) > 0) {
        outputStream.write(streamFileBytes, 0, bytesRead);
    }       
    outputStream.flush();

    code = con.getResponseCode();

    try {
        InputStream inputStream = con.getInputStream();
        StringWriter writer = new StringWriter();
        IOUtils.copy(inputStream, writer, "UTF-8");
        String theString = writer.toString();
        inputStream.close();

        System.out.println( theString );

    } catch ( Exception e ) {
        e.printStackTrace();
    }       

    con.disconnect();
    streamFileBufferedInputStream.close();
    return code;        
}

and the code to POST:

public int doRESTRequest( String requestMethod, String url, String content, String geoUser, String geoPassword ) throws Exception {
    int code = 0;

    String geoCreds = geoUser + ":" + geoPassword;
    String encodedAuth = new String( Base64.encodeBase64( geoCreds.getBytes() ) );
    HttpURLConnection con = (HttpURLConnection) new URL( url ).openConnection();
    con.setRequestMethod( requestMethod );
    con.setRequestProperty("Authorization", "Basic " + encodedAuth );
    con.setRequestProperty("User-Agent", USER_AGENT);
    con.setRequestProperty("Content-type", "text/xml");

    con.setDoOutput(true);
    con.getOutputStream().write( content.getBytes("UTF-8") );
    code = con.getResponseCode();

    // To use with GET method
    try {
        InputStream inputStream = con.getInputStream();
        StringWriter writer = new StringWriter();
        IOUtils.copy(inputStream, writer, "UTF-8");
        String theString = writer.toString();
        inputStream.close();
        //System.out.println( "WebClient:doPostStream >>> " + theString );
    } catch ( Exception e ) {
        //e.printStackTrace();
    }

    con.disconnect();
    return code;

}

… and to upload and create the TIFF Layer:

StringBuilder postData = new StringBuilder();
postData.append("<coverageStore>");
postData.append("<name>" + storeName + "</name>");
postData.append("<workspace>" + workspaceName + "</workspace>");
postData.append("<enabled>true</enabled>");
postData.append("<description>Some description</description>");
postData.append("<type>GeoTIFF</type>");
postData.append("<srs>EPSG:4326</srs><projectionPolicy>REPROJECT_TO_DECLARED</projectionPolicy>");
postData.append("</coverageStore>");

String serverRESTAPIStore = geoserverURL + "rest/workspaces/" + workspaceName + "/coveragestores";
WebClient wc = new WebClient();
resp = wc.doRESTRequest( "POST", serverRESTAPIStore, postData.toString(), geoUser, geoPassword );           



String serverRESTAPI = geoserverURL + "rest/workspaces/" + workspaceName + "/coveragestores/" + storeName + "/external.geotiff?configure=first&coverageName=" + storeName;
int result = wc.doPutFile( file, "geotif/geotiff", serverRESTAPI, "", geoUser, geoPassword );

The tiff file is named Carta_puntarenas.tif and have 75MB.

Best Answer

2020 update,

Using geoserver-rest library(pip install geoserver-rest). The example case is below,

#import and initialize library
from geo.Geoserver import Geoserver
geo = Geoserver('http://localhost:8080/geoserver', username='admin', password='geoserver')


#Create/upload coveragestore (raster data)
geo.create_coveragestore(lyr_name='layer1' path=r'path\to\raster\file.tif', workspace='demo')

Related Solutions

[GIS] Geowebcache REST Truncate

Some ideas but no definitive answer

If you read CURL below

curl -v -u geowebcache:secured -XPOST -H "Content-type: text/xml" -d '<seedRequest><name>nurc:Arc_Sample</name><srs><number>4326</number></srs><zoomStart>1</zoomStart><zoomStop>12</zoomStop><format>image/png</format><type>truncate</type><threadCount>2</threadCount></seedRequest>'  "http://localhost:8080/geowebcache/rest/seed/nurc:Arc_Sample.xml"

You must use POST because of "-XPOST" in CURL call
You don't have to use a FormData because your content is xml e.g CURL "Content-type: text/xml"
You have to send an XML so to build it, you do something like

var my_xml_string = "<seedRequest><name>nurc:Arc_Sample</name><srs><number>4326</number></srs><zoomStart>1</zoomStart><zoomStop>12</zoomStop><format>image/png</format><type>truncate</type><threadCount>2</threadCount></seedRequest>";

You need authentication and because of this a base64 encoder, go at http://www.webtoolkit.info/javascript-base64.html

The result (tested)

// Function for sending authentication (to put in a separated js file in fact)
// From http://www.webtoolkit.info/javascript-base64.html

/**
*
*  Base64 encode / decode
*  http://www.webtoolkit.info/
*
**/

var Base64 = {

    // private property
    _keyStr : "ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789+/=",

    // public method for encoding
    encode : function (input) {
        var output = "";
        var chr1, chr2, chr3, enc1, enc2, enc3, enc4;
        var i = 0;

        input = Base64._utf8_encode(input);

        while (i < input.length) {

            chr1 = input.charCodeAt(i++);
            chr2 = input.charCodeAt(i++);
            chr3 = input.charCodeAt(i++);

            enc1 = chr1 >> 2;
            enc2 = ((chr1 & 3) << 4) | (chr2 >> 4);
            enc3 = ((chr2 & 15) << 2) | (chr3 >> 6);
            enc4 = chr3 & 63;

            if (isNaN(chr2)) {
                enc3 = enc4 = 64;
            } else if (isNaN(chr3)) {
                enc4 = 64;
            }

            output = output +
            this._keyStr.charAt(enc1) + this._keyStr.charAt(enc2) +
            this._keyStr.charAt(enc3) + this._keyStr.charAt(enc4);

        }

        return output;
    },

    // public method for decoding
    decode : function (input) {
        var output = "";
        var chr1, chr2, chr3;
        var enc1, enc2, enc3, enc4;
        var i = 0;

        input = input.replace(/[^A-Za-z0-9\+\/\=]/g, "");

        while (i < input.length) {

            enc1 = this._keyStr.indexOf(input.charAt(i++));
            enc2 = this._keyStr.indexOf(input.charAt(i++));
            enc3 = this._keyStr.indexOf(input.charAt(i++));
            enc4 = this._keyStr.indexOf(input.charAt(i++));

            chr1 = (enc1 << 2) | (enc2 >> 4);
            chr2 = ((enc2 & 15) << 4) | (enc3 >> 2);
            chr3 = ((enc3 & 3) << 6) | enc4;

            output = output + String.fromCharCode(chr1);

            if (enc3 != 64) {
                output = output + String.fromCharCode(chr2);
            }
            if (enc4 != 64) {
                output = output + String.fromCharCode(chr3);
            }

        }

        output = Base64._utf8_decode(output);

        return output;

    },

    // private method for UTF-8 encoding
    _utf8_encode : function (string) {
        string = string.replace(/\r\n/g,"\n");
        var utftext = "";

        for (var n = 0; n < string.length; n++) {

            var c = string.charCodeAt(n);

            if (c < 128) {
                utftext += String.fromCharCode(c);
            }
            else if((c > 127) && (c < 2048)) {
                utftext += String.fromCharCode((c >> 6) | 192);
                utftext += String.fromCharCode((c & 63) | 128);
            }
            else {
                utftext += String.fromCharCode((c >> 12) | 224);
                utftext += String.fromCharCode(((c >> 6) & 63) | 128);
                utftext += String.fromCharCode((c & 63) | 128);
            }

        }

        return utftext;
    },

    // private method for UTF-8 decoding
    _utf8_decode : function (utftext) {
        var string = "";
        var i = 0;
        var c = c1 = c2 = 0;

        while ( i < utftext.length ) {

            c = utftext.charCodeAt(i);

            if (c < 128) {
                string += String.fromCharCode(c);
                i++;
            }
            else if((c > 191) && (c < 224)) {
                c2 = utftext.charCodeAt(i+1);
                string += String.fromCharCode(((c & 31) << 6) | (c2 & 63));
                i += 2;
            }
            else {
                c2 = utftext.charCodeAt(i+1);
                c3 = utftext.charCodeAt(i+2);
                string += String.fromCharCode(((c & 15) << 12) | ((c2 & 63) << 6) | (c3 & 63));
                i += 3;
            }

        }

        return string;
    }

}


var my_xml_string = "<seedRequest><name>nurc:Arc_Sample</name><srs><number>4326</number></srs><zoomStart>1</zoomStart><zoomStop>12</zoomStop><format>image/png</format><type>truncate</type><threadCount>2</threadCount></seedRequest>";

//Need some cleaning
$.ajax({
    url: "http://localhost/geowebcache/rest/seed/nurc:Arc_Sample.xml",
    data: my_xml_string, 
    type: 'POST',
    contentType: "text/xml",
    dataType: "xml",
    beforeSend : function(xhr) {
        xhr.setRequestHeader("Authorization", "Basic " + Base64.encode("admin:geoserver"));
    },
    success : function (data, textStatus, jqXHR) {
       console.log(textStatus);
    },
    error : function (xhr, ajaxOptions, thrownError){  
        console.log(xhr.status);          
        console.log(thrownError);
    } 
});

Deal with cross origin policy in Ajax: when you are doing a call from a web browser, if the domain is not the same, it will not work. You will have to use a proxy to deal with this e.g http://geoserver.org/display/GEOS/GeoServer+Proxy+Extension (try it yourself)

[GIS] Add external WFS layer to geoserver using REST API

You have to create a FeatureType before you can create a Layer (i.e. publish it). If you have already created a test layer then fetch the feature type of that one (like http://geoserver.ianturton.com/rest/workspaces/topp/datastores/bgs/featuretypes/test_uk_625k_mapped_feature.xml) but you should be able to delete quite a lot of that and leave it for GeoServer to fill in.

<featureType>
  <name>test_uk_625k_mapped_feature</name>
  <nativeName>test_uk_625k_mapped_feature</nativeName>
  <namespace>
    <name>topp</name>
    <atom:link xmlns:atom="http://www.w3.org/2005/Atom" rel="alternate" href="http://geoserver.ianturton.com/rest/namespaces/topp.xml" type="application/xml"/>
  </namespace>
  <title>uk_625k_mapped_feature</title>
  <description>net.opengis.wfs20.impl.AbstractTypeImpl@1f89241 (value: Just for testing, lang: &lt;unset&gt;)</description>
  <keywords>
    <string>uk_625k_mapped_feature</string>
    <string>features</string>
  </keywords>
  <nativeCRS class="projected">PROJCS[&quot;OSGB 1936 / British National Grid&quot;, 
  GEOGCS[&quot;OSGB 1936&quot;, 
    DATUM[&quot;OSGB 1936&quot;, 
      SPHEROID[&quot;Airy 1830&quot;, 6377563.396, 299.3249646, AUTHORITY[&quot;EPSG&quot;,&quot;7001&quot;]], 
      TOWGS84[446.448, -125.157, 542.06, 0.15, 0.247, 0.842, -20.489], 
      AUTHORITY[&quot;EPSG&quot;,&quot;6277&quot;]], 
    PRIMEM[&quot;Greenwich&quot;, 0.0, AUTHORITY[&quot;EPSG&quot;,&quot;8901&quot;]], 
    UNIT[&quot;degree&quot;, 0.017453292519943295], 
    AXIS[&quot;Geodetic longitude&quot;, EAST], 
    AXIS[&quot;Geodetic latitude&quot;, NORTH], 
    AUTHORITY[&quot;EPSG&quot;,&quot;4277&quot;]], 
  PROJECTION[&quot;Transverse_Mercator&quot;, AUTHORITY[&quot;EPSG&quot;,&quot;9807&quot;]], 
  PARAMETER[&quot;central_meridian&quot;, -2.0], 
  PARAMETER[&quot;latitude_of_origin&quot;, 49.0], 
  PARAMETER[&quot;scale_factor&quot;, 0.9996012717], 
  PARAMETER[&quot;false_easting&quot;, 400000.0], 
  PARAMETER[&quot;false_northing&quot;, -100000.0], 
  UNIT[&quot;m&quot;, 1.0], 
  AXIS[&quot;Easting&quot;, EAST], 
  AXIS[&quot;Northing&quot;, NORTH], 
  AUTHORITY[&quot;EPSG&quot;,&quot;27700&quot;]]</nativeCRS>
  <srs>EPSG:27700</srs>
  <nativeBoundingBox>
    <minx>-132576.78915711527</minx>
    <maxx>743466.6249987332</maxx>
    <miny>-15669.960592884949</miny>
    <maxy>1248847.1762802668</maxy>
    <crs class="projected">EPSG:27700</crs>
  </nativeBoundingBox>
  <latLonBoundingBox>
    <minx>-11.801005644638966</minx>
    <maxx>4.349696858682689</maxx>
    <miny>49.5245056714837</miny>
    <maxy>61.11839723246307</maxy>
    <crs>GEOGCS[&quot;WGS84(DD)&quot;, 
  DATUM[&quot;WGS84&quot;, 
    SPHEROID[&quot;WGS84&quot;, 6378137.0, 298.257223563]], 
  PRIMEM[&quot;Greenwich&quot;, 0.0], 
  UNIT[&quot;degree&quot;, 0.017453292519943295], 
  AXIS[&quot;Geodetic longitude&quot;, EAST], 
  AXIS[&quot;Geodetic latitude&quot;, NORTH]]</crs>
  </latLonBoundingBox>
  <projectionPolicy>FORCE_DECLARED</projectionPolicy>
  <enabled>true</enabled>
  <store class="dataStore">
    <name>bgs</name>
    <atom:link xmlns:atom="http://www.w3.org/2005/Atom" rel="alternate" href="http://geoserver.ianturton.com/rest/workspaces/topp/datastores/bgs.xml" type="application/xml"/>
  </store>
  <maxFeatures>0</maxFeatures>
  <numDecimals>0</numDecimals>
  <overridingServiceSRS>false</overridingServiceSRS>
  <skipNumberMatched>false</skipNumberMatched>
  <circularArcPresent>false</circularArcPresent>
  <attributes>
    <attribute>
      <name>uuid</name>
      <minOccurs>1</minOccurs>
      <maxOccurs>1</maxOccurs>
      <nillable>true</nillable>
      <binding>java.lang.String</binding>
    </attribute>
    <attribute>
      <name>lex</name>
      <minOccurs>1</minOccurs>
      <maxOccurs>1</maxOccurs>
      <nillable>true</nillable>
      <binding>java.lang.String</binding>
    </attribute>
    <attribute>
      <name>rcs</name>
      <minOccurs>1</minOccurs>
      <maxOccurs>1</maxOccurs>
      <nillable>true</nillable>
      <binding>java.lang.String</binding>
    </attribute>
    <attribute>
      <name>lex_rcs</name>
      <minOccurs>1</minOccurs>
      <maxOccurs>1</maxOccurs>
      <nillable>true</nillable>
      <binding>java.lang.String</binding>
    </attribute>
    <attribute>
      <name>the_geom</name>
      <minOccurs>0</minOccurs>
      <maxOccurs>1</maxOccurs>
      <nillable>true</nillable>
      <binding>com.vividsolutions.jts.geom.Geometry</binding>
    </attribute>
  </attributes>
</featureType>

Experiment and when it works update the documentation for the next person along.

Best Answer

Related Solutions

[GIS] Geowebcache REST Truncate

[GIS] Add external WFS layer to geoserver using REST API

Related Question