Opened 9 years ago

Closed 3 years ago

#1236 closed enhancement (worksforme)

r.in.wms sleep parameter

Reported by: frankie Owned by: grass-dev@…
Priority: normal Milestone: 7.0.5
Component: Raster Version: unspecified
Keywords: r.in.wms Cc:
CPU: Unspecified Platform: All

Description

Some WMS servers have severe limitations about number of tiles downloadable per time units, and ban too much aggressive downloaders. It would be nice having a parameter to add a delay in seconds before downloading each tile. That would be useful for grabbing bots and to be more nice with such servers.

Change History (6)

comment:1 Changed 9 years ago by hamish

Keywords: r.in.wms added

wget has some nice command line options here, you can pass those along from the r.in.wms command parameters. Try --wait=num_seconds or --random-wait I'm not sure if curl does or not.

I assume the .py version does not use wget or curl at all and needs something else?

Hamish

comment:2 in reply to:  1 Changed 9 years ago by frankie

Replying to hamish:

wget has some nice command line options here, you can pass those along from the r.in.wms command parameters. Try --wait=num_seconds or --random-wait I'm not sure if curl does or not.

Good idea, but curl has not a delaying option and I'm not sure if wget has a minimal version to be considered to present those options, so a backend independent implementation is more viable.

comment:3 Changed 6 years ago by hamish

Component: DefaultRaster
Milestone: 6.4.17.0.0

new development is in r.in.wms2(.py). bumping there.

comment:4 Changed 6 years ago by turek

Some time ago I implemented feature in r56554 which repeats request if server returns 104 error (I came across this error on a server, which sent it if certain number of requests within time limit had been exceeded). If so, request is repeated after 5 seconds then after 30 seconds. Probably the r.in.wms module should repeat requests for another errors returned form a server.

I do not thing that adding new delay parameter into r.in.wms is good idea because this issue should be addressed internally as it is now (too low level for a user).

comment:5 Changed 3 years ago by martinl

Milestone: 7.0.07.0.5

comment:6 Changed 3 years ago by martinl

Resolution: worksforme
Status: newclosed

No activity last 2 years, closing. Feel free to reopen if needed.

Note: See TracTickets for help on using tickets.