gdalinfo/ gdalwarp (build from source on Ubuntu 7.10, 64-bit) fail to work with HDF5 on a MOD09 product acquired on 2007

[nikos]

OS: Ubuntu 7.10, 64-bit

Already installed: proj, libtiff, libgeotiff, expat, sqlite (from Ubuntu repositories), grass (build from source with 64-bit support), qgis 0.9.1 (build from source with 64-bit support)

• gdalinfo/ gdalwarp fail WORK fine with a MOD09 product acquired on 2006. However they fail with a MOD09 acquired on 2007

Question: Is it a bug or is it a mis-configuration of HDF5?

1. svn checkout ​https://svn.osgeo.org/gdal/branches/1.5/gdal gdal

2. CFLAGS="-g -Wall" LDFLAGS="-s" ./configure  
   --with-grass=/usr/local/grass-6.3.svn/ 
   --with-libgrass=/usr/lib/gdalplugins/gdal_GRASS.so
   --with-png=internal  --with-libtiff=/usr/lib 
   --with-geotiff=/usr/lib/libtiff  --with-jpeg=internal 
   --with-gif=internal  --with-ecw=yes  --with-expat=yes 
   --with-expat-inc=/usr/include/  --with-expat-lib=/usr/lib 
   --with-sqlite3=yes  --with-geos=yes  --with-python
   

Ends up with no errors (various WARNINGS during configuration process)

3. Build

   make
   

4. Install

   sudo make install
   

5. gdalinfo --version

   GDAL 1.5.1, released 2008/03/14
   

5.1. which gdalinfo

/usr/local/bin/gdalinfo

5.2. gdalinfo --formats | grep HDF

  HDF4 (ro): Hierarchical Data Format Release 4
  HDF4Image (rw+): HDF4 Dataset
  HDF5 (ro): Hierarchical Data Format Release 5
  HDF5Image (ro): HDF5 Dataset

6. gdalinfo MOD09GQK.A2006239.h19v05.004.2006241155630.hdf

This is successful - note: it's a 2006 MOD09 product

Driver: HDF4/Hierarchical Data Format Release 4
Files: MOD09GQK.A2006239.h19v05.004.2006241155630.hdf
Size is 512, 512
Coordinate System is `'
Subdatasets:
  SUBDATASET_1_NAME=HDF4_EOS:EOS_GRID:"MOD09GQK.A2006239.h19v05.004.2006241155630.hdf":MOD_Grid_L2g_2d:sur_refl_b01_1
  SUBDATASET_1_DESC=[4800x4800] sur_refl_b01_1 MOD_Grid_L2g_2d (16-bit integer)
  SUBDATASET_2_NAME=HDF4_EOS:EOS_GRID:"MOD09GQK.A2006239.h19v05.004.2006241155630.hdf":MOD_Grid_L2g_2d:sur_refl_b02_1
  SUBDATASET_2_DESC=[4800x4800] sur_refl_b02_1 MOD_Grid_L2g_2d (16-bit integer)
  SUBDATASET_3_NAME=HDF4_EOS:EOS_GRID:"MOD09GQK.A2006239.h19v05.004.2006241155630.hdf":MOD_Grid_L2g_2d:QC_250m_1
  SUBDATASET_3_DESC=[4800x4800] QC_250m_1 MOD_Grid_L2g_2d (16-bit unsigned integer)
  SUBDATASET_4_NAME=HDF4_EOS:EOS_GRID:"MOD09GQK.A2006239.h19v05.004.2006241155630.hdf":MOD_Grid_L2g_2d:orb_cov_1
  SUBDATASET_4_DESC=[4800x4800] orb_cov_1 MOD_Grid_L2g_2d (8-bit unsigned integer)
  SUBDATASET_5_NAME=HDF4_EOS:EOS_GRID:"MOD09GQK.A2006239.h19v05.004.2006241155630.hdf":MOD_Grid_L2g_2d:num_observations
  SUBDATASET_5_DESC=[4800x4800] num_observations MOD_Grid_L2g_2d (8-bit integer)
Corner Coordinates:
Upper Left  (    0.0,    0.0)
Lower Left  (    0.0,  512.0)
Upper Right (  512.0,    0.0)
Lower Right (  512.0,  512.0)
Center      (  256.0,  256.0)

7. gdalinfo MOD09GQ.A2007242.h19v05.005.2007244231200.hdf

Fails - note: this is a 2007 MOD09 product

Segmentation fault (core dumped)

8. ~/FWTools-2.0.6/bin$ ./gdalinfo --formats | grep HDF

   HDF4 (ro): Hierarchical Data Format Release 4
     HDF4Image (rw+): HDF4 Dataset
   

8.1. ~/FWTools-2.0.6/bin$ ./gdalinfo /home/nik/grassdb/tmp/30.08.2007/250m/MOD09GQ.A2007242.h19v05.005.2007244231200.hdf -nomd

Driver: HDF4/Hierarchical Data Format Release 4
Files: /home/nik/grassdb/tmp/30.08.2007/250m/MOD09GQ.A2007242.h19v05.005.2007244231200.hdf
Size is 512, 512
Coordinate System is `'
Subdatasets:
  SUBDATASET_1_NAME=HDF4_EOS:EOS_GRID:"/home/nik/grassdb/tmp/30.08.2007/250m/MOD09GQ.A2007242.h19v05.005.2007244231200.hdf":MODIS_Grid_2D:num_observations
  SUBDATASET_1_DESC=[4800x4800] num_observations MODIS_Grid_2D (8-bit integer)
  SUBDATASET_2_NAME=HDF4_EOS:EOS_GRID:"/home/nik/grassdb/tmp/30.08.2007/250m/MOD09GQ.A2007242.h19v05.005.2007244231200.hdf":MODIS_Grid_2D:sur_refl_b01_1
  SUBDATASET_2_DESC=[4800x4800] sur_refl_b01_1 MODIS_Grid_2D (16-bit integer)
  SUBDATASET_3_NAME=HDF4_EOS:EOS_GRID:"/home/nik/grassdb/tmp/30.08.2007/250m/MOD09GQ.A2007242.h19v05.005.2007244231200.hdf":MODIS_Grid_2D:sur_refl_b02_1
  SUBDATASET_3_DESC=[4800x4800] sur_refl_b02_1 MODIS_Grid_2D (16-bit integer)
  SUBDATASET_4_NAME=HDF4_EOS:EOS_GRID:"/home/nik/grassdb/tmp/30.08.2007/250m/MOD09GQ.A2007242.h19v05.005.2007244231200.hdf":MODIS_Grid_2D:QC_250m_1
  SUBDATASET_4_DESC=[4800x4800] QC_250m_1 MODIS_Grid_2D (16-bit unsigned integer)
  SUBDATASET_5_NAME=HDF4_EOS:EOS_GRID:"/home/nik/grassdb/tmp/30.08.2007/250m/MOD09GQ.A2007242.h19v05.005.2007244231200.hdf":MODIS_Grid_2D:obscov_1
  SUBDATASET_5_DESC=[4800x4800] obscov_1 MODIS_Grid_2D (8-bit integer)
Corner Coordinates:
Upper Left  (    0.0,    0.0)
Lower Left  (    0.0,  512.0)
Upper Right (  512.0,    0.0)
Lower Right (  512.0,  512.0)
Center      (  256.0,  256.0)

9. The same with behaviour with:

   gdalinfo --version
   GDAL 1.5.0, released 2007/12/18
   

[nowakpl]

If I remember correctly this is a libhdf5 problem, building latest version from sources should fix the problem.

[Even Rouault]

Might be a bug in libhdf5 as suggested, and no way to reproduce without the dataset or a link to it. Closing. Reopen if it still happens with newer GDAL and libhdf5