Opened 7 years ago

Closed 3 years ago

#2171 closed enhancement (fixed)

rfe r.in.gdal: auto-calc memory= value

Reported by: hamish Owned by: grass-dev@…
Priority: normal Milestone: 7.4.0
Component: Raster Version: svn-trunk
Keywords: r.in.gdal, GDAL_CACHEMAX Cc:
CPU: All Platform: All

Description

Hi, a r.in.gdal wish refined with hints from EvenR,

it would be nice if the r.in.gdal memory= option allowed the user to specify memory=auto, in which case the value was automatically calculated from "tile_height * raster_width * band_count * sizeof_datatype" rounded up to the next megabyte or so for good luck.

This will require changing the parser check to manual testing, but that shouldn't be too difficult. The default should remain at the current gdal-internal 40MB for low-resource users who want to import very large files.

for now I've put a hint in the wiki:

http://grasswiki.osgeo.org/wiki/Importing_data#Large_data

thanks, Hamish (back soon)

Attachments (1)

r.out.gdal.memparm.diff (1.8 KB) - added by neteler 6 years ago.
patch to add memory parameter to r.out.gdal

Download all attachments as: .zip

Change History (8)

comment:1 in reply to:  description Changed 7 years ago by mlennert

Replying to hamish:

Hi, a r.in.gdal wish refined with hints from EvenR,

it would be nice if the r.in.gdal memory= option allowed the user to specify memory=auto, in which case the value was automatically calculated from "tile_height * raster_width * band_count * sizeof_datatype" rounded up to the next megabyte or so for good luck.

This will require changing the parser check to manual testing, but that shouldn't be too difficult. The default should remain at the current gdal-internal 40MB for low-resource users who want to import very large files.

for now I've put a hint in the wiki:

http://grasswiki.osgeo.org/wiki/Importing_data#Large_data

As a side note: wouldn't a memory parameter also be beneficial for r.out.gdal ?

Moritz

comment:2 in reply to:  description Changed 6 years ago by neteler

r.in.gdal: "memory" (cache) parameter added in trunk r61362/r61364 and in relbr7 r61363/r61458. Leads to notable (!) speed-up. Ticket could be closed.

Concerning extra wish:

Attached a patch for r.out.gdal. For smaller files no improvement, perhaps useless? Needs to be tested with large file export.

Changed 6 years ago by neteler

Attachment: r.out.gdal.memparm.diff added

patch to add memory parameter to r.out.gdal

comment:3 Changed 5 years ago by martinl

Milestone: 7.0.07.0.5

comment:4 Changed 4 years ago by martinl

Still an issue?

comment:5 Changed 4 years ago by martinl

Milestone: 7.0.57.3.0

comment:6 Changed 4 years ago by martinl

Milestone: 7.3.07.4.0

Milestone renamed

comment:7 Changed 3 years ago by martinl

Resolution: fixed
Status: newclosed

No activity last 3 years, closing. Feel free to reopen if needed.

Note: See TracTickets for help on using tickets.