Opened 17 years ago

Closed 17 years ago

#1353 closed defect (worksforme)

HDF MOD09Q1 and MYD13AQ1 250m/500m import looses georef information

Reported by: Juergen.bayer@… Owned by: warmerdam
Priority: normal Milestone: 1.4.1
Component: GDAL_Raster Version: 1.3.2
Severity: normal Keywords:
Cc: Markus Neteler

Description (last modified by warmerdam)

Some of the hdf formats appear to be not supported from the current GDAL HDF.

while the fwtools 1.07/1.08 gdal_translate worked fine for 

 mcd43b3
 MCD43B4
 MYD11A2
 MYD13A1
 MYD15A2

(import and georef/projection info) 

 MOD09Q1
 MYD13Q1

datasets imported but lost any georef information (file reports raw pixel coordinates).

Looks as if these datasets are in some hdf flavour not known to the compiled hdf libraries

(SUBDATASET_3_NAME=HDF4_SDS:UNKNOWN:"MOD09Q1.A2005169.h18v04.004.2005179041252.hdf":2)

HEGTOOLS convert fine including georef/projectin info

HEGVIEW reports this dataset to be in HDF4

Thanks Juergen 

MODIS/Terra Surface Reflectance 8-Day L3 Global 250m SIN Grid MOD09Q1 

GDALINFO output

Driver: HDF4/Hierarchical Data Format Release 4
Size is 512, 512
Coordinate System is `'
Metadata:
  LOCALGRANULEID=MOD09Q1.A2005169.h18v04.004.2005179041252.hdf
  PRODUCTIONDATETIME=2005-06-28T04:12:52.000Z
  DAYNIGHTFLAG=Day
  REPROCESSINGACTUAL=reprocessed
  LOCALVERSIONID=4.0.13
  REPROCESSINGPLANNED=further update is anticipated
  SCIENCEQUALITYFLAG=Not Investigated
  AUTOMATICQUALITYFLAGEXPLANATION=Always Passed
  AUTOMATICQUALITYFLAG=Passed
  SCIENCEQUALITYFLAGEXPLANATION=See http://landdb1.nascom.nasa.gov/QA_WWW/release.cgi for the Science QA status of this product.
  QAPERCENTMISSINGDATA=18
  QAPERCENTOUTOFBOUNDSDATA=0
  QAPERCENTINTERPOLATEDDATA=0
  PARAMETERNAME=MOD09A1
  EQUATORCROSSINGDATE=2005-06-18
  EQUATORCROSSINGTIME=10:27:46.269623
  ORBITNUMBER=29257
  EQUATORCROSSINGLONGITUDE=0.374091
  EQUATORCROSSINGDATE=2005-06-18
  EQUATORCROSSINGTIME=12:06:39.302002
  ORBITNUMBER=29258
  EQUATORCROSSINGLONGITUDE=-24.347114
  EQUATORCROSSINGDATE=2005-06-19
  EQUATORCROSSINGTIME=09:32:09.545090
  ORBITNUMBER=29271
  EQUATORCROSSINGLONGITUDE=14.276943
  EQUATORCROSSINGDATE=2005-06-19
  EQUATORCROSSINGTIME=11:11:02.610552
  ORBITNUMBER=29272
  EQUATORCROSSINGLONGITUDE=-10.444694
  EQUATORCROSSINGDATE=2005-06-20
  EQUATORCROSSINGTIME=10:15:25.868531
  ORBITNUMBER=29286
  EQUATORCROSSINGLONGITUDE=3.458196
  EQUATORCROSSINGDATE=2005-06-20
  EQUATORCROSSINGTIME=11:54:18.906734
  ORBITNUMBER=29287
  EQUATORCROSSINGLONGITUDE=-21.263090
  EQUATORCROSSINGDATE=2005-06-21
  EQUATORCROSSINGTIME=09:19:49.128654
  ORBITNUMBER=29300
  EQUATORCROSSINGLONGITUDE=17.361189
  EQUATORCROSSINGDATE=2005-06-21
  EQUATORCROSSINGTIME=10:58:42.198518
  ORBITNUMBER=29301
  EQUATORCROSSINGLONGITUDE=-7.360491
  EQUATORCROSSINGDATE=2005-06-22
  EQUATORCROSSINGTIME=10:03:05.411124
  ORBITNUMBER=29315
  EQUATORCROSSINGLONGITUDE=6.542751
  EQUATORCROSSINGDATE=2005-06-22
  EQUATORCROSSINGTIME=11:41:58.455649
  ORBITNUMBER=29316
  EQUATORCROSSINGLONGITUDE=-18.178626
  EQUATORCROSSINGDATE=2005-06-23
  EQUATORCROSSINGTIME=10:46:21.714187
  ORBITNUMBER=29330
  EQUATORCROSSINGLONGITUDE=-4.275616
  EQUATORCROSSINGDATE=2005-06-23
  EQUATORCROSSINGTIME=12:25:14.732820
  ORBITNUMBER=29331
  EQUATORCROSSINGLONGITUDE=-28.996697
  EQUATORCROSSINGDATE=2005-06-24
  EQUATORCROSSINGTIME=09:50:44.888755
  ORBITNUMBER=29344
  EQUATORCROSSINGLONGITUDE=9.627725
  EQUATORCROSSINGDATE=2005-06-24
  EQUATORCROSSINGTIME=11:29:37.937796
  ORBITNUMBER=29345
  EQUATORCROSSINGLONGITUDE=-15.093730
  EQUATORCROSSINGDATE=2005-06-25
  EQUATORCROSSINGTIME=10:34:01.144159
  ORBITNUMBER=29359
  EQUATORCROSSINGLONGITUDE=-1.190488
  EQUATORCROSSINGDATE=2005-06-25
  EQUATORCROSSINGTIME=12:12:54.164685
  ORBITNUMBER=29360
  EQUATORCROSSINGLONGITUDE=-25.911598
  VERSIONID=4
  SHORTNAME=MOD09Q1
  INPUTPOINTER=MOD09GQK.A2005169.h18v04.004.2005171205652.hdf, MOD09GQK.A2005170.h18v04.004.2005172215342.hdf, MOD09GQK.A2005171.h18v04.004.2005173130241.hdf, MOD09GQK.A2005172.h18v04.004.2005174130739.hdf, MOD09GQK.A2005173.h18v04.004.2005176200345.hdf, MOD09GQK.A2005174.h18v04.004.2005176111625.hdf, MOD09GQK.A2005175.h18v04.004.2005177101944.hdf, MOD09GQK.A2005176.h18v04.004.2005178110309.hdf, MODPTQKM.A2005169.h18v04.004.2005171203156.hdf, MODPTQKM.A2005170.h18v04.004.2005172213009.hdf, MODPTQKM.A2005171.h18v04.004.2005173125113.hdf, MODPTQKM.A2005172.h18v04.004.2005174123509.hdf, MODPTQKM.A2005173.h18v04.004.2005176193802.hdf, MODPTQKM.A2005174.h18v04.004.2005176110721.hdf, MODPTQKM.A2005175.h18v04.004.2005177100920.hdf, MODPTQKM.A2005176.h18v04.004.2005178105008.hdf, MOD09GHK.A2005169.h18v04.004.2005171205811.hdf, MOD09GHK.A2005170.h18v04.004.2005172215613.hdf, MOD09GHK.A2005171.h18v04.004.2005173130355.hdf, MOD09GHK.A2005172.h18v04.004.2005174131110.hdf, MOD09GHK.A2005173.h18v04.004.2005176200555.hdf, MOD09GHK.A2005174.h18v04.004.2005176111734.hdf, MOD09GHK.A2005175.h18v04.004.2005177102129.hdf, MOD09GHK.A2005176.h18v04.004.2005178110514.hdf, MODPTHKM.A2005169.h18v04.004.2005171203156.hdf, MODPTHKM.A2005170.h18v04.004.2005172213009.hdf, MODPTHKM.A2005171.h18v04.004.2005173125113.hdf, MODPTHKM.A2005172.h18v04.004.2005174123509.hdf, MODPTHKM.A2005173.h18v04.004.2005176193802.hdf, MODPTHKM.A2005174.h18v04.004.2005176110721.hdf, MODPTHKM.A2005175.h18v04.004.2005177100920.hdf, MODPTHKM.A2005176.h18v04.004.2005178105008.hdf, MOD09GST.A2005169.h18v04.004.2005171205446.hdf, MOD09GST.A2005170.h18v04.004.2005172214530.hdf, MOD09GST.A2005171.h18v04.004.2005173130105.hdf, MOD09GST.A2005172.h18v04.004.2005174130552.hdf, MOD09GST.A2005173.h18v04.004.2005176200133.hdf, MOD09GST.A2005174.h18v04.004.2005176111328.hdf, MOD09GST.A2005175.h18v04.004.2005177101735.hdf, MOD09GST.A2005176.h18v04.004.2005178105936.hdf, MODMGGAD.A2005169.h18v04.004.2005171203221.hdf, MODMGGAD.A2005170.h18v04.004.2005172213029.hdf, MODMGGAD.A2005171.h18v04.004.2005173125125.hdf, MODMGGAD.A2005172.h18v04.004.2005174123524.hdf, MODMGGAD.A2005173.h18v04.004.2005176193816.hdf, MODMGGAD.A2005174.h18v04.004.2005176110732.hdf, MODMGGAD.A2005175.h18v04.004.2005177100935.hdf, MODMGGAD.A2005176.h18v04.004.2005178105021.hdf
  GRINGPOINTLONGITUDE=0.000131, -0.008675, 15.572393, 13.037903
  GRINGPOINTLATITUDE=39.819771, 50.006969, 49.998972, 39.814415
  GRINGPOINTSEQUENCENO=1, 2, 3, 4
  EXCLUSIONGRINGFLAG=N
  RANGEENDINGDATE=2005-06-25
  RANGEENDINGTIME=23:59:59.000000
  RANGEBEGINNINGDATE=2005-06-18
  RANGEBEGINNINGTIME=00:00:00.000000
  PGEVERSION=4.3.1
  ASSOCIATEDSENSORSHORTNAME=MODIS
  ASSOCIATEDPLATFORMSHORTNAME=Terra
  ASSOCIATEDINSTRUMENTSHORTNAME=MODIS
  QAPERCENTGOODQUALITY=81
  QAPERCENTOTHERQUALITY=1
  QAPERCENTNOTPRODUCEDCLOUD=0
  QAPERCENTNOTPRODUCEDOTHER=18
  HORIZONTALTILENUMBER=18
  VERTICALTILENUMBER=4
  TileID=51018004
  PROCESSVERSION=4.0.13
  QAPERCENTPOOROUTPUT250MBAND1=1
  QAPERCENTPOOROUTPUT250MBAND2=1
  QAPERCENTPOOROUTPUT500MBAND3=0
  QAPERCENTPOOROUTPUT500MBAND4=0
  QAPERCENTPOOROUTPUT500MBAND5=2
  QAPERCENTPOOROUTPUT500MBAND6=0
  QAPERCENTPOOROUTPUT500MBAND7=0
  RESOLUTIONBANDS1AND2=500
  SPSOPARAMETERS=2015
  NORTHBOUNDINGCOORDINATE=50.000000
  SOUTHBOUNDINGCOORDINATE=40.000000
  EASTBOUNDINGCOORDINATE=15.570203
  WESTBOUNDINGCOORDINATE=0.000000
  ALGORITHMPACKAGEACCEPTANCEDATE=1998-01-01
  ALGORITHMPACKAGEMATURITYCODE=LAUNCH
  ALGORITHMPACKAGENAME=MOD09L3
  ALGORITHMPACKAGEVERSION=2
  GEOANYABNORMAL=False
  GEOESTMAXRMSERROR=50.000000
  LONGNAME=MODIS/Terra Surface Reflectance 8-Day L3 Global 250m SIN Grid
  PROCESSINGCENTER=MODAPS
  SYSTEMFILENAME=MOD09GQK.A2005169.h18v04.004.2005171205652.hdf, MOD09GQK.A2005170.h18v04.004.2005172215342.hdf, MOD09GQK.A2005171.h18v04.004.2005173130241.hdf, MOD09GQK.A2005172.h18v04.004.2005174130739.hdf, MOD09GQK.A2005173.h18v04.004.2005176200345.hdf, MOD09GQK.A2005174.h18v04.004.2005176111625.hdf, MOD09GQK.A2005175.h18v04.004.2005177101944.hdf, MOD09GQK.A2005176.h18v04.004.2005178110309.hdf, MODPTQKM.A2005169.h18v04.004.2005171203156.hdf, MODPTQKM.A2005170.h18v04.004.2005172213009.hdf, MODPTQKM.A2005171.h18v04.004.2005173125113.hdf, MODPTQKM.A2005172.h18v04.004.2005174123509.hdf, MODPTQKM.A2005173.h18v04.004.2005176193802.hdf, MODPTQKM.A2005174.h18v04.004.2005176110721.hdf, MODPTQKM.A2005175.h18v04.004.2005177100920.hdf, MODPTQKM.A2005176.h18v04.004.2005178105008.hdf, MOD09GHK.A2005169.h18v04.004.2005171205811.hdf, MOD09GHK.A2005170.h18v04.004.2005172215613.hdf, MOD09GHK.A2005171.h18v04.004.2005173130355.hdf, MOD09GHK.A2005172.h18v04.004.2005174131110.hdf, MOD09GHK.A2005173.h18v04.004.2005176200555.hdf, MOD09GHK.A2005174.h18v04.004.2005176111734.hdf, MOD09GHK.A2005175.h18v04.004.2005177102129.hdf, MOD09GHK.A2005176.h18v04.004.2005178110514.hdf, MODPTHKM.A2005169.h18v04.004.2005171203156.hdf, MODPTHKM.A2005170.h18v04.004.2005172213009.hdf, MODPTHKM.A2005171.h18v04.004.2005173125113.hdf, MODPTHKM.A2005172.h18v04.004.2005174123509.hdf, MODPTHKM.A2005173.h18v04.004.2005176193802.hdf, MODPTHKM.A2005174.h18v04.004.2005176110721.hdf, MODPTHKM.A2005175.h18v04.004.2005177100920.hdf, MODPTHKM.A2005176.h18v04.004.2005178105008.hdf, MOD09GST.A2005169.h18v04.004.2005171205446.hdf, MOD09GST.A2005170.h18v04.004.2005172214530.hdf, MOD09GST.A2005171.h18v04.004.2005173130105.hdf, MOD09GST.A2005172.h18v04.004.2005174130552.hdf, MOD09GST.A2005173.h18v04.004.2005176200133.hdf, MOD09GST.A2005174.h18v04.004.2005176111328.hdf, MOD09GST.A2005175.h18v04.004.2005177101735.hdf, MOD09GST.A2005176.h18v04.004.2005178105936.hdf, MODMGGAD.A2005169.h18v04.004.2005171203221.hdf, MODMGGAD.A2005170.h18v04.004.2005172213029.hdf, MODMGGAD.A2005171.h18v04.004.2005173125125.hdf, MODMGGAD.A2005172.h18v04.004.2005174123524.hdf, MODMGGAD.A2005173.h18v04.004.2005176193816.hdf, MODMGGAD.A2005174.h18v04.004.2005176110732.hdf, MODMGGAD.A2005175.h18v04.004.2005177100935.hdf, MODMGGAD.A2005176.h18v04.004.2005178105021.hdf
  NUMBEROFGRANULES=8
  GRANULEDAYNIGHTFLAG=Day, Day, Day, Day, Day, Day, Day, Day
  GRANULEDAYOFYEAR=169, 170, 171, 172, 173, 174, 175, 176
  GRANULEBEGINNINGDATETIME=2005-06-18T10:10:00.000000Z, 2005-06-19T09:15:00.000000Z, 2005-06-20T10:00:00.000000Z, 2005-06-21T09:05:00.000000Z, 2005-06-22T09:45:00.000000Z, 2005-06-23T10:30:00.000000Z, 2005-06-24T09:35:00.000000Z, 2005-06-25T10:15:00.000000Z
  GRANULEENDINGDATETIME=2005-06-18T11:55:00.000000Z, 2005-06-19T11:00:00.000000Z, 2005-06-20T11:45:00.000000Z, 2005-06-21T10:50:00.000000Z, 2005-06-22T11:35:00.000000Z, 2005-06-23T12:15:00.000000Z, 2005-06-24T11:20:00.000000Z, 2005-06-25T12:05:00.000000Z
  NUMBEROFORBITS=16
  CHARACTERISTICBINANGULARSIZE250M=7.500000
  CHARACTERISTICBINSIZE250M=231.656358
  DATACOLUMNS250M=4800
  DATAROWS250M=4800
  GLOBALGRIDCOLUMNS250M=172800
  GLOBALGRIDROWS250M=86400
  NADIRDATARESOLUTION250M=250m
  CHARACTERISTICBINANGULARSIZE500M=15.000000
  CHARACTERISTICBINSIZE500M=463.312717
  DATACOLUMNS500M=2400
  DATAROWS500M=2400
  GLOBALGRIDCOLUMNS500M=86400
  GLOBALGRIDROWS500M=43200
  NADIRDATARESOLUTION500M=500m
  QUALITYCLASSPERCENTAGE250MBAND1=81, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 18
  QUALITYCLASSPERCENTAGE250MBAND2=81, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 18
  QUALITYCLASSPERCENTAGE500MBAND3=82, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18
  QUALITYCLASSPERCENTAGE500MBAND4=82, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18
  QUALITYCLASSPERCENTAGE500MBAND5=76, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 4, 18
  QUALITYCLASSPERCENTAGE500MBAND6=82, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18
  QUALITYCLASSPERCENTAGE500MBAND7=82, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18
  PERCENTDIFFERENTORBIT250M=9
  PERCENTPROCESSED=100
  PERCENTLAND=72
  PERCENTCLOUDY=0
  PERCENTSHADOW=2
  PERCENTLOWSUN=0
  PERCENTLANDSEAMASKCLASS=5, 72, 2, 0, 0, 0, 3, 18
  PROCESSINGENVIRONMENT=IRIX64 mtvs1 6.5 10070055 IP35
  DESCRREVISION=4.0
Subdatasets:
  SUBDATASET_1_NAME=HDF4_SDS:UNKNOWN:"MOD09Q1.A2005169.h18v04.004.2005179041252.hdf":0
  SUBDATASET_1_DESC=[4800x4800] sur_refl_b01 (16-bit integer)
  SUBDATASET_2_NAME=HDF4_SDS:UNKNOWN:"MOD09Q1.A2005169.h18v04.004.2005179041252.hdf":1
  SUBDATASET_2_DESC=[4800x4800] sur_refl_b02 (16-bit integer)
  SUBDATASET_3_NAME=HDF4_SDS:UNKNOWN:"MOD09Q1.A2005169.h18v04.004.2005179041252.hdf":2
  SUBDATASET_3_DESC=[4800x4800] sur_refl_qc_250m (16-bit unsigned integer)
Corner Coordinates:
Upper Left  (    0.0,    0.0)
Lower Left  (    0.0,  512.0)
Upper Right (  512.0,    0.0)
Lower Right (  512.0,  512.0)
Center      (  256.0,  256.0)


Info from HegTool

STATUS_VALUE=0

FILE_NAME=X:\proc\x\PullDir\0300682042tdpfSc\MOD09Q1.A2005169.h18v04.004.2005179041252.hdf

NUM_OBJECTS=1

NUM_GRIDS=1

NUM_SWATHS=0

GRID_NAMES=MOD_Grid_250m_Surface_Reflectance,

GRID_PROJECTION_TYPE=16 

GRID_PROJECTION_PARAMETERS= \
       6371007.181000000             0.000000000             0.000000000 \
             0.000000000             0.000000000             0.000000000 \
             0.000000000             0.000000000             0.000000000 \
             0.000000000             0.000000000             0.000000000 \
             0.000000000             0.000000000             0.000000000

GRID_UL_CORNER_LATLON=49.999999996 0.000000000 

GRID_UR_CORNER_LATLON=49.999999996 15.557238266 

GRID_LL_CORNER_LATLON=39.999999996 0.000000000 

GRID_LR_CORNER_LATLON=39.999999996 13.054072891 

GRID_NCOLUMNS=4800 

GRID_NROWS=4800 

GRID_PIXEL_SIZE=231.656358 

GRID_PIXEL_SIZE_X=231.656358 

GRID_PIXEL_SIZE_Y=231.656358 

GRID_NFIELDS=3 

GRID_FIELD_NAMES=sur_refl_b01,sur_refl_b02,sur_refl_qc_250m,

GRID_DATA_TYPES=22 22 23 

GRID_NUM_DIMS=2 2 2 

GRID_NUM_BANDS=0 0 0 

GRID_4TH_DIM=0 0 0 

GRID_BAND_NAME=-99,-99,-99,

GRID_4TH_DIMNAME=-99,-99,-99,

Change History (4)

comment:5 by warmerdam, 17 years ago

Description: modified (diff)
Milestone: → 1.4.1
Priority: high → normal
Severity: major → normal
Status: new → assigned

I will try and look into this before GDAL 1.4.1 release.

comment:6 by warmerdam, 17 years ago

Description: modified (diff)

Jurgen,

I will need an http pointer to a dataset I can download and try this for.

comment:8 by warmerdam, 17 years ago

Resolution: → worksforme
Status: assigned → closed

Juergen,

Sorry for the long delay in addressing this. I have downloaded the test data Markus provided the pointer for. There is no coordinate system or georeferencing for the base file, but that is intentional. If you do a gdalinfo on a subdataset you should get information. For instance: 

gdalinfo HDF4_EOS:EOS_GRID:"MOD09Q1.A2001161.h18v04.004.2003124160510.hdf":MOD_Grid_250m_Surface_Reflectance:sur_refl_b01
Driver: HDF4Image/HDF4 Dataset
Size is 4800, 4800
Coordinate System is:
PROJCS["unnamed",
    GEOGCS["Unknown datum based upon the custom spheroid",
        DATUM["Not specified (based on custom spheroid)",
            SPHEROID["Custom spheroid",6371007.181,0]],
        PRIMEM["Greenwich",0],
        UNIT["degree",0.0174532925199433]],
    PROJECTION["Sinusoidal"],
    PARAMETER["longitude_of_center",0],
    PARAMETER["false_easting",0],
    PARAMETER["false_northing",0],
    UNIT["Meter",1]]
Origin = (0.000000000000000,5559752.598333000205457)
Pixel Size = (231.656358263958339,-231.656358263750064)
Metadata:
  LOCALGRANULEID=MOD09Q1.A2001161.h18v04.004.2003124160510.hdf
  PRODUCTIONDATETIME=2003-05-04T16:05:10.000Z
...
  PROCESSINGENVIRONMENT=IRIX64 mtvs2 6.5 07121149 IP35
  DESCRREVISION=4.0
Corner Coordinates:
Upper Left  (       0.000, 5559752.598) (  0d 0'0.01"E, 50d 0'0.00"N)
Lower Left  (       0.000, 4447802.079) (  0d 0'0.01"E, 40d 0'0.00"N)
Upper Right ( 1111950.520, 5559752.598) ( 15d33'26.06"E, 50d 0'0.00"N)
Lower Right ( 1111950.520, 4447802.079) ( 13d 3'14.66"E, 40d 0'0.00"N)
Center      (  555975.260, 5003777.339) (  7d 4'15.84"E, 45d 0'0.00"N)
Band 1 Block=4800x1 Type=Int16, ColorInterp=Gray

I tested with the 1.4 branch code, and trunk and both were fine. I'm closing this as I think things are working properly. Please feel free to reopen if you aren't seeing the same thing, or believe it is broken.

Note: See TracTickets for help on using tickets.