Opened 4 years ago

Closed 3 years ago

#2724 closed enhancement (invalid)

PostGIS specific dynamic background workers

Reported by: robe Owned by: pramsey
Priority: medium Milestone: PostGIS 2.2.0
Component: postgis Version: trunk
Keywords: postgresql 9.4 Cc:

Description (last modified by robe)

Snooping on pgadvocacy http://www.postgresql.org/message-id/CAFj8pRA8+J17PxmmL1B8b-4bfbHvpQPcp7g7rG7Skune=BuY8Q@mail.gmail.com got me thinking.

I admit to not having looked at the background API in PostgreSQL 9.4+. So this is more of a placeholder to investigate, see how useful it is, and if useful add to PostGIS 2.2 additional extensions only installed for those folks running PostgreSQL 9.4+.

Areas I see where background workers might be useful are in obviously long running processes where running in a single transaction is bloody slow and the work needs to be broken up into separate runs.

1) raster processing 2) topology processing 3) tiger geocoder processing

I suspect we'd probably need separate background workers for each tailored to the unique needs of each, but perhaps not.

Thoughts?

Change History (6)

comment:1 Changed 4 years ago by robe

Description: modified (diff)

comment:2 Changed 4 years ago by dustymugs

Heh. I have a ticket for rasters... #2526. I have yet to check out the API as I don't think the API has stabilized. Nor have I looked at the contrib package that demos it....

http://www.postgresql.org/docs/0.0/static/test-shm-mq.html

comment:3 Changed 4 years ago by robe

Description: modified (diff)
Summary: PostGIS specific background workersPostGIS specific dynamic background workers

Oh cool :)

comment:4 Changed 4 years ago by robe

Keywords: postgresql 9.4 added

comment:5 Changed 4 years ago by dustymugs

My wish list for DBWs...

  1. on-demand: workers are forked as needed
  1. generic: workers aren't specific to a particular task but are given instructions which are then acted upon.
  1. user-defined: a GUC to specify how many workers per operation. this does have a problem with overloading a machine.

comment:6 Changed 3 years ago by pramsey

Resolution: invalid
Status: newclosed

Ticket looks suspiciously like an email. No action item here.

Note: See TracTickets for help on using tickets.