Opened 12 years ago

Closed 6 years ago

#1236 closed enhancement (worksforme)

r.in.wms sleep parameter

Reported by: frankie Owned by: grass-dev@…
Priority: normal Milestone: 7.0.5
Component: Raster Version: unspecified
Keywords: r.in.wms Cc:
CPU: Unspecified Platform: All

Description

Some WMS servers have severe limitations about number of tiles downloadable per time units, and ban too much aggressive downloaders. It would be nice having a parameter to add a delay in seconds before downloading each tile. That would be useful for grabbing bots and to be more nice with such servers.

Change History (6)

comment:1 by hamish, 12 years ago

Keywords: r.in.wms added

wget has some nice command line options here, you can pass those along from the r.in.wms command parameters. Try --wait=num_seconds or --random-wait I'm not sure if curl does or not.

I assume the .py version does not use wget or curl at all and needs something else?

Hamish

in reply to:  1 comment:2 by frankie, 12 years ago

Replying to hamish:

wget has some nice command line options here, you can pass those along from the r.in.wms command parameters. Try --wait=num_seconds or --random-wait I'm not sure if curl does or not.

Good idea, but curl has not a delaying option and I'm not sure if wget has a minimal version to be considered to present those options, so a backend independent implementation is more viable.

comment:3 by hamish, 10 years ago

Component: DefaultRaster
Milestone: 6.4.17.0.0

new development is in r.in.wms2(.py). bumping there.

comment:4 by turek, 9 years ago

Some time ago I implemented feature in r56554 which repeats request if server returns 104 error (I came across this error on a server, which sent it if certain number of requests within time limit had been exceeded). If so, request is repeated after 5 seconds then after 30 seconds. Probably the r.in.wms module should repeat requests for another errors returned form a server.

I do not thing that adding new delay parameter into r.in.wms is good idea because this issue should be addressed internally as it is now (too low level for a user).

comment:5 by martinl, 7 years ago

Milestone: 7.0.07.0.5

comment:6 by martinl, 6 years ago

Resolution: worksforme
Status: newclosed

No activity last 2 years, closing. Feel free to reopen if needed.

Note: See TracTickets for help on using tickets.