load_wfs_to_postgres

Upload gebieden into PostgreSQL from the WFS service of api.data.amsterdam.nl with use of ogr2ogr.

Add ogr2ogr path ENV if running locally in a virtual environment:

export PATH=/Library/Frameworks/GDAL.framework/Programs:$PATH

Example command line:

load_wfs_to_postgres config.ini dev

usage: load_wfs_to_postgres [-h] config_path db_config

Positional Arguments

config_path	Type the relative path + name of the config file, for example: auth/config.ini
db_config	Type ‘dev’ or ‘docker’ to load the proper port and ip settings in the config file

functions

exception load.load_wfs_to_postgres.NonZeroReturnCode

Used for subprocess error messages.

load.load_wfs_to_postgres.load_layers(pg_str)

Load layers into Postgres using a list of titles of each layer within the WFS service.

Args:

pg_str: psycopg2 connection string:

'PG:host= port= user= dbname= password='

Returns:

Loaded layers into postgres using ogr2ogr.

load.load_wfs_to_postgres.parser()

Parser function to run arguments from commandline and to add description to sphinx.

load.load_wfs_to_postgres.run_command_sync(cmd, allow_fail=False)

Run a string in the command line.

Args:

1. cmd: command line code formatted as a list:

   ['ogr2ogr', '-overwrite', '-t_srs', 'EPSG:28992','-nln',layer_name,'-F' ,'PostgreSQL' ,pg_str ,url]
   

2. Optional: allow_fail: True or false to return error code

Returns:

Excuted program or error message.

load.load_wfs_to_postgres.scrub(line)

Hide the login credentials of Postgres in the console.

load.load_wfs_to_postgres.wfs2psql(url, pg_str, layer_name, **kwargs)

Command line ogr2ogr string to load a WFS into PostGres.