Changes between Initial Version and Version 1 of Ticket #2591


Ignore:
Timestamp:
Oct 7, 2008, 2:26:08 PM (11 years ago)
Author:
warmerdam
Comment:

Denis,

Any thoughts on this issue? Skimming the CreateCopy? code in the netcdf driver, it looks like things are done one scanline at a time which should be OK.

I'll try and reproduce ...

Legend:

Unmodified
Added
Removed
Modified
  • Ticket #2591

    • Property Status changed from new to assigned
    • Property Cc dnadeau added
    • Property Component changed from default to GDAL_Raster
    • Property Priority changed from high to normal
    • Property Keywords netcdf added
  • Ticket #2591 – Description

    initial v1  
    11When I tried to convert a 20000x15000 file using the GMT driver (which writes NetCDF with Z as a 1D variable) it works fine, but the NetCDF driver gives an "Out of memory" error:
    22
     3{{{
    34gdal_translate psdem_2005_geo.tif -of netcdf psdem_2005.nc
    45Input file size is 20000, 15000
    560ERROR 2: CPLMalloc(): Out of memory allocating 1200000000 bytes.
     7}}}
    68
    79It looks like the NetCDF driver is trying to allocate memory for the entire data grid being processed instead of reading/writing by column, row or chunk.  This should be fixed, to allow processing of much larger grids on machines with limited memory.