wiki:WKTRaster

Version 189 (modified by robe, 13 years ago) ( diff )

PostGIS Raster Home Page (formerly WKT Raster)

What's new about PostGIS Raster?

March 24, 2011
A great Code Sprint and... ...a new contributor!
David Zwarg from Avencia and Pierre Racine from the CFR met for the first time at the Montréal Code Sprint last week. They came out with a very innovative MapAlgebra function based on a user defined PL/pgSQL function. This code should be committed soon with another version involving neighbour pixels. On another side, students are already showing interest for our Google Summer of Code Ideas and Bborie Park, an experienced programmer from the Center for Vectorborne Diseases at the University of California will join the team. He will work on a series of SQL function converting PostGIS rasters to the different formats supported by GDAL and on resampling. Welcome Bbories!

February 14, 2011
Two plugins to display PostGIS rasters!
Thanks to Maurício de Paulo, there is now a plugin to display PostGIS rasters in QGIS. Look for "wktraster" in the QGIS plugin page and Mauricio's article (if you can decrypt portuguese!). Samething on the side of gvSIG, the popular spanish open source GIS! Nacho Brodin has developed a plugin to display raster stored in PostGIS. See the page of the project. On our side, we are working fixing bugs and implementing ST_MapAlgebra. See you at the Code Sprint 2011 in Montréal (march 15-18)!

September 15, 2010
WKT Raster becomes THE new PostGIS raster type!
It's official! The WKT Raster extension will become the new PostGIS RASTER type in PostGIS 2.0 planned for next april. The PostGIS and the WKT Raster team met at the FOSS4G friday's code sprint and decided that WKT Raster was mature enough to bring interesting new functionalities to PostGIS. A new MapAlgebra function should be added for this release. Congratulation to the whole team for all the work accomplished!

August 11, 2010
PostGIS WKT Raster at FOSS4G
There should be a lot of discussion about PostGIS WKT Raster at FOSS4G, the most important conference for free and open source software for geomatics, as both Pierre Racine and Jorge Arévalo presentations have been selected by the attendees. Pierre will first introduce the project in a presentation entitled “Introducing PostGIS WKT Raster: Seamless raster/vector operations in a spatial database” and Jorge will present the result of its meticulous study of the difference between PostGIS WKT Raster and Oracle GeoRaster in a presention entitled “PostGIS WKT Raster. An Open Source alternative to Oracle GeoRaster”. You can already read Jorge’s first impression in his first article in a series. CU September 6th 2010 in Barcelona!

June 11, 2010
A tutorial and a book!
The PostGIS in Action chapter on PostGIS WKT Raster is out! Thanks to Regina Obe and Leo Hsu, there is already a good amount of literature on WKT Raster and this makes WKT Raster to be a little bit more in the PostGIS family. Pierre Racine has also written a tutorial on how to import and intersect a huge raster coverage with a vector coverage. Your raster coverage is huge and you can't work with it in your favorite GIS platform? Read the tutorial! You will be amazed by the simplicity and the speed of the intersection functions. Good reading!

February 22, 2010
A third company join the WKT Raster team!
The award-winning GIS software development firm, Avencia, specializing in web-based geographic analysis, visualization and modeling applications, decided to invest in WKT Raster development. The company sent David Zwarg and Jeff Adams to the Code Sprint 2010 in NY. Jeff worked on PostGIS and David helped with many WKT Raster base functions. David committed himself to work on many other WKT Raster functions in the near future. His main task will be to design and implement the ST_MapAlgebra() and the ST_Resample() functions. Welcome David!

December 10, 2009
Tyler Erickson speaks about his need for PostGIS WKT Raster at FOSS4G 2009
Tyler Erickson, Research Scientist at the Michigan Tech Research Institute presented his research project at FOSS4G 2009 in Sydney, Australia. Tyler uses GeoDjango and PostGIS to visualise the results of CO2 simulation models directly in Google Earth. WKT Raster would enable him to easily do raster/vecter spatial analysis from his web application. Tyler's project was selected as one of the professional winners in Google’s 2009 KML in Research Competition.

December 4, 2009
Jorge Arevalo full time on WKT Raster!
Jorge Arevalo who developped the first version of the GDAL WKT Raster driver during the summer of 2009 will be working for at least one year on WKT Raster. Jorge is working for DEIMOS Space, a Spanish aerospace company leading the Espana virtual project. Jorge's superior, Miguel Lizondo, confirmed that Jorge would be devoting most of his time to WKT Raster in the coming year. This commitment should normally be extended for a second year afterward.

Jorge will follow the planned roadmap and will be the main developper for the coming year. Mateuzs Loskot will continue contribute his spare time to the project and Pierre Racine will help Jorge with the specifications and the general management of the project.

Welcome (back) Jorge!

October 16, 2009
PostGIS WKT Raster at Geomatique 2009 in Montréal!
Pierre Racine will present WKT Raster at Geomatique 2009 in Montréal on October 20. We hope we can get more people interested by the project! See the presentation (PDF)!

June 04, 2009
A prototype GDAL driver to WKT Raster implemented this summer!
Thanks to Mateusz Loskot, who proposed the Google Summer of Code project and Jorge Arevalo the student who was selected to implement it.

Welcome to the PostGIS Raster project home page!

PostGIS Raster is an ongoing project aiming at developing raster support in PostGIS. It is a new project very different from the previous PGRaster project and also very different from Oracle Spatial GeoRaster.

The goal of PostGIS Raster is to implement the RASTER type as much as possible like the GEOMETRY type is implemented in PostGIS and to offer a single set of overlay SQL functions (like ST_Intersects) operating seamlessly on vector and raster coverages.

PostGIS Raster Google Summer of Code 2011 Ideas

This year again every projects submitted by OSGeo to the Google Summer of Code will be financed by Google. This means 5000 USD$ for a programming student summer job! See our project list or propose your own one! Every details here and here. Deadline to apply: April 8.

Installation

  • Linux - You will have to compile PostGIS Raster following the instructions in the Development Info section below.
  • Windows Binaries - If you are running PostGIS on Windows, you can find fairly recent binaries of PostGIS 2.0 (including raster support) in the Windows Experimental Builds section. These are for PostgreSQL 8.4,9.0, and upcoming 9.1. Note that development on the standalone wktraster project deployable on PostGIS 1.3-1.5 has stopped and all future versions and bug fixes of raster support will be packaged in the PostGIS 2.0 builds. The last set of binaries for the wktraster stand-alone are also available on Windows experimental page for PostgreSQL 8.3,8.4,9.0 running for PostGIS 1.4-1.5.
  • Mac OSX Binaries - If you are running PostGIS on Mac OSX leopard or Snow Leopard, you can find fairly recent binaries of PostGIS and PostGIS Raster at KyngChaos PostgreSQL GIS packages include PostgreSQL 8.4, PostGIS 1.5, PostGIS Raster, and pgRouting.

Documentation

  • Presentations

    • PostGIS 2.0 Raster and 3D Support Enhancements North Carolina GIS Conference 2011 (NCGIS 2011)
    • Introducing PostGIS WKT Raster: Seamless Raster/Vector Operations in a Spatial Database - FOSS4G 2010, Barcelona, Spain, September 2010. PDF
    • PostGIS WKT Raster. An Open Source alternative to Oracle GeoRaster - FOSS4G 2010, Barcelona, Spain, September 2010. PDF
    • Introduction to WKT Raster - Geomatique 2009, Montréal, October 2009. PDF
    • Original Project Presentation - rationale, examples and preliminary specifications: PPT, PDF (v1.0)

Development Info

  • Planning

    • With PostGIS 2.0: Spring 2011.
    • Look at the planning page for a detailed schedule and to know how to contribute.

Displaying PostGIS rasters

There are some options to display rasters stored in PostGIS.

  • OpenJump - OpenJump will not display raster directly but a vectorization of the raster. Use a query like the following in the "Layer→Execute Query" dialog:
SELECT ST_AsBinary((ST_DumpAsPolygons(rast)).geom), (ST_DumpAsPolygons(rast)).val
FROM rastertable
  • ArcGIS 10 - Same idea as with OpenJump: You can not display rasters directly but a vectorization of them. See What is a query layer? in the ArcGIS 10 documentation. With ArcGIS you don't have to convert the geometries to WKB with ST_AsBinary().
  • MapServer - Some test were done to display PostGIS rasters with MapServer… and it works! See this post. More details in chapter 13 of PostGIS in Action.

More Info

For more details and examples of application using PostGIS Raster:

  • PostGIS Raster has been designed following a thorough analysis of the numerous discussions about raster integration in PostGIS over the recent years. You can find most of the post to the PostGIS-users group related to raster integration in this page.

Overview of Planned PostGIS Raster Features

PostGIS Raster…

…is as simple as PostGIS…

  • one table = one raster coverage (like a vector coverage)
  • one row = one tile or one raster object (like a vector coverage where one row = one geometry)
  • only one new type: RASTER (like the PostGIS GEOMETRY type)
  • each raster tile has a pixel size, a width and a height, a variable number of band, a pixel type per band and a nodata value per band. Everything essential to do base raster GIS operations.

…is an extension of PostGIS to be installed separately

  • merge with PostGIS might occur in the future…

…has an import/export mechanism similar to shp2pgsql

  • raster2pgsql and pgsql2raster utilities allowing import/export of a single raster or a batch of raster into a tiled coverage.

…allows easy conversion from/to geometry/raster…

  • ST_DumpToPolygons(raster) → geometry set
  • ST_AsRaster(geometry, pixelsize) → raster

…implements base GIS raster operations available in most GIS…

  • ST_Resample(raster, pixelsize, method) → raster
  • ST_Clip(raster|geometry,geometry) → same type as first argument
  • ST_Reclass(raster|geometry,string) → same type as first argument
  • ST_MapAlgebra(raster|geometry, raster), mathematical expression, "raster"|"geometry") → raster/geometry
  • etc…)

…introduces raster/geometry seamless geometry constructors…

  • so you don't have to bother whether the layers are in raster or vector form when using analysis functions.
  • ST_Intersection(raster|geometry, raster|geometry, "raster"|"geometry") → raster/geometry
  • ST_Union(raster|geometry, raster|geometry, "raster"|"geometry") → raster/geometry
  • ST_Accum(raster set|geometry set, "raster"|"geometry") → raster/geometry
  • ST_Transform(raster|geometry, SRID) → same type as input
  • etc…

…and seamless geometry operators…

  • ST_Intersects(raster|geometry, raster|geometry) → boolean
  • ST_Contains(raster|geometry A, raster|geometry B) → boolean
  • etc…

…allows raster storage INSIDE the database (as WKB)…

  • for efficient overlay analysis operations between vector and raster layers…

…or OUTSIDE the database (as JPEG or TIFF)…

  • so desktop and web applications can quickly access and load raster tiles and nevertheless benefits from the powerful PostGIS GiST spatial index. Every PostGIS Raster SQL functions working with in-db raster tiles work seamlessly with out-db raster tiles.

…introduces the concept of raster objects…

  • geographic features are stored as variable size raster tiles instead of polygons.
  • allows vector to raster conversion without lost of information.

…is much more simple than PGRaster and Oracle GeoRaster! PostGIS Raster supports…

  • only one type (instead of two in Oracle Spatial: SDO_GEORASTER & SDO_RASTER). In PostGIS Raster there are no differences between rasters and tiles: a tile is a raster and a raster is a tile. i.e. one row = one tile = one raster; one table = one raster coverage.
  • no metadata (like PostGIS)
  • no masks (you can create a mask as a band)
  • no multiple dimensions (only two: x, y). Not to be confused with bands; PostGIS Raster DO supports multiband raster…
  • no pyramids (reduced resolution coverages can be stored as a separate layer)

What do people think about PostGIS Raster?

Paul Ramsey (founder of PostGIS):

This proposal is better than any I have seen, addresses solving problems that if solved will provide actual new functionality and benefit to users, and clearly you've thought this through over some time

Regina Obe (coauthor of PostGIS in Action):

The functions PostGIS raster proposes look pretty cool actually and my vision of the benefits of storing raster in the database are covered in it

Open Tickets

#828
[raster] Loader generates wrong SQL when NODATA for a band is NaN
#1002
[raster] Add geometry filtered variations for various statistics functions
#1048
[raster] Coverage version of stats functions should be aggregates
#1058
[raster] Two-raster spatial operations framework proposal
#1092
[raster] Ability to autogenerate images for postgis documentation using raster
#1138
[raster] Add an option to raster2pgsql to change the pixeltype when loading
#1168
[raster] ST_AsRaster ability to render more complex types
#1193
[raster] Add the possibility to aggregate values when rescaling with ST_Rescale()
#1267
[raster] Add manual height/width support to ST_Resample
#1379
[raster] raster2pgsql: load a raster as a band(s) of an existing raster
#1554
[raster] ST_SetRotation does not preserve the angle between basis vectors
#1582
[raster] Rewrite ST_CreateIndexRaster as a wrapper around ST_MapAlgebraExpr
#1583
[raster] Optimize ST_Intersection(raster, geometry) with ST_Clip()
#1648
[raster] ST_AsRaster unexpected result
#1662
[raster] Make a ST_Extent(raster) aggregate taking rotation into account
#1764
[raster] overviews not marked as same alignment though main table is
#1858
[raster] Raster dataset functionality
#2058
[raster] Add a ST_SetValues variant copying values from another raster band
#2111
[raster] External band numbers are capped to 1 - 256
#2113
[raster] Add flag to select resampling algorithm for creating overviews from source rasters
#2116
[raster] ST_Value(rast, point) should have an option for when the geometry is at the edge of a pixel.
#2127
[raster] raster2pgsql support for projection
#2133
[raster] possible performance issue with ST_MapAlgebra
#2136
[raster] ST_AsGDALRaster ability to take set of rasters
#2137
[raster] Add handling for overviews present in source rasters
#2189
[raster] Ability to import EXIF data as part of raster2pgsql load
#2281
multiband raster burning (braindump)
#2299
revise raster garden test to handle new types
#2310
[raster] st_wedge
#2311
[raster] st_annulus
#2312
[raster] st_circle
#2325
[raster]: ST_SetBandNoDataValue support setting multiple bands
#2353
[raster] GDAL's GDALFPolygonize() function
#2373
[raster] Performance test suite
#2386
[raster] raster2pgsql misses man page
#2474
[raster]: ST_Union that takes 2 rasters
#2526
[raster] Dynamic Background Workers
#2566
[raster] ST_ValueCountAgg()
#2596
[raster] St_isVisible
#2598
[raster] ST_Blur
#2599
[raster] ST_Sharpen
#2600
[raster] ST_EdgeDetect
#2601
[raster] ST_Convolution
#2617
[raster] Enhanced mask object for raster map algebra
#2629
[raster] Masks as POI lists
#2728
[raster] ST_Values (plural form of ST_Value)
#2733
[raster] Make test_util_gdal_open standalone (drop requirement of internet access)
#2798
raster2pgsql spins CPU on statement timeout
#2800
[raster] Coverage topology broken by ST_Rescale
#2804
[raster] ST_MapAlgebra support for user callbacks without userarg parameter
#2807
[raster] ST_MapAlgebra injecting a default NODATA value of 0
#2821
[raster] Raster import fails if "raster_columns" is not readable by the user
#2823
[raster] upgrade drops privileges on the raster_columns view
#2832
[raster] raster2pgsql pads overviews with single tiles
#2843
[raster] Support reprojection on import
#2894
Kernel density estimation with PostGIS raster
#2914
[raster] ST_Rescale: Could not create GDAL transformation object for output dataset creation
#2919
Include GDAL error message in raster failure messages
#2924
[raster] bogus handling of identity matrix by _st_gdalwarp
#2986
[raster] raster2pgqsql option for defining a grouping ID (like filename but integer)
#3044
[raster] raster2pgsql should have an option to align tiles
#3077
[raster] Explore usage of GDAL's RasterIO improvements for resampling
#3111
Support for binary input/output for raster
#3148
Another GUC for PROJSO or can we just figure out the PROJSO?
#3318
ST_MapAlgebra with mask seems to hard-code distance 1 instead of inferring distance from mask matrix
#3555
Parallelization of PostGIS raster ST_Union aggregate
#3743
raster2pgsql correctly support the -s from_srid:to_srid
#3776
[raster] ST_DumpAsPolygons() stop differenciate values when they are higher than 1048576
#4009
ST_Clip with multiple geometries
#4315
PG12: Optimize FunctionCall parameter size in rtpg_mapalgebra.c
#4385
[raster2pgsql] -I option recreates index for each insertion
#4402
raster2pgsql debug methods needed, GEOTIFF stalling for hours on addrasterconstraints
#4463
PostGIS raster ST_Intersects regression with pg12
#4502
[raster] ST_SameAlignment() gives differing results based on which argument comes first
#4658
add --long-options to raster2pgsql
#4659
raster2pgsql option to create or append
#4678
Rewrite all raster callback functions in C
#5176
no data check in raster2pgsql and also ST_BandIsNoData are slow
#5228
ST_MakeEmptyCoverage creates a bad tiling
#5295
raster2pgsql should support spatial reprojection
#5317
ST_Union(rast, uniontype) treat bands with different classes as the same as first band
#5386
ST_MapAlgebra not respecting NULL nodatavalues
#5498
ERROR: function st_approxquantile(raster, double precision) is not unique
#5648
postgis_raster upgrade fails on PG16

Attachments (5)

Note: See TracWiki for help on using the wiki.