Opened 11 years ago

Last modified 11 years ago

#2591 closed defect

NetCDF Driver should read/write data in stripes instead of the whole array — at Initial Version

Reported by: rsignell Owned by: warmerdam
Priority: normal Milestone: 1.5.3
Component: GDAL_Raster Version: 1.5.0
Severity: normal Keywords: netcdf
Cc: dnadeau

Description

When I tried to convert a 20000x15000 file using the GMT driver (which writes NetCDF with Z as a 1D variable) it works fine, but the NetCDF driver gives an "Out of memory" error:

gdal_translate psdem_2005_geo.tif -of netcdf psdem_2005.nc Input file size is 20000, 15000 0ERROR 2: CPLMalloc(): Out of memory allocating 1200000000 bytes.

It looks like the NetCDF driver is trying to allocate memory for the entire data grid being processed instead of reading/writing by column, row or chunk. This should be fixed, to allow processing of much larger grids on machines with limited memory.

Change History (0)

Note: See TracTickets for help on using tickets.