Add GDAL_DOWNLOAD_TEST_DATA=yes when running autotest from the buildbot slaves

[Even Rouault]

It could be interesting to define the environment variable GDAL_DOWNLOAD_TEST_DATA=yes before running the autotest, so that the tests relying on data available on web server can run.

Note : this should probably only be set on full buildbot slaves, not incremental ones.

The total size currently downloaded is 38 MB.

[Even Rouault]

I'm not so sure about my first comment. It could probably be defined for incremental builds too IF the gdrivers/tmp/cache directory doesn't get cleaned at each time. There's a cache mechanism that avoids downloading the data when it's already in the cache.

[Mateusz Łoskot]

Configured for telascience-quick slave only. Even has confirmed it works.

[tamas]

I've added this option to the windows slaves however it doesn't appear to cache the downloaded data, which have been deleted right after the particular tests were competed.

I'd require this caching behaviour to work since the lack of this option slows down the test process and requires extra bandwith at the server.

[Even Rouault]

Tamas

Hum, strange that the files are not cached. Are you sure that it isn't something in your windows slaves configuration that erases the whole autotest directory before a new test cycles occurs ?

For example, right now, I can see that ​http://vbkto.dyndns.org:1080/gdal/szekerest-vc80-full/autotest/gcore/tmp/cache and ​http://vbkto.dyndns.org:1080/gdal/szekerest-vc80-full/autotest/gdrivers/tmp/cache contains a lot of cached files

If you run twice autotest/gcore/bmp_read.py, does the caching works ?

[tamas]

Replying to rouault:

Tamas

Hum, strange that the files are not cached. Are you sure that it isn't something in your windows slaves configuration that erases the whole autotest directory before a new test cycles occurs ?

For example, right now, I can see that ​http://vbkto.dyndns.org:1080/gdal/szekerest-vc80-full/autotest/gcore/tmp/cache and ​http://vbkto.dyndns.org:1080/gdal/szekerest-vc80-full/autotest/gdrivers/tmp/cache contains a lot of cached files

If you run twice autotest/gcore/bmp_read.py, does the caching works ?

Yes, it seems to be a buildbot issue. The SVN update is happening in a separate directory and the build directory is overwritten with that. Therefore all of the modification in the build directory is lost. Therefore I've added to copy the cache to the SVN checkout dir in the last step of the build process so as to have these files preserved.