[PATCH] Add VSISafeMul2, etc. functions to detect overflows

Use of new API in gdal/gcore

root@r0:~# cat malloc_test.cpp #include <stdio.h> #include <stdlib.h>

int main() {

printf("%p\n", malloc(0)); return 0;

} root@r0:~# ./malloc_test 0x804a008

So if you use VSIMalloc(VSISafeMul2(x, y)), VSISafeMul2 will return 0, VSIMalloc will allocate 0 bytes and the code that used it will think everything is ok.

VSISafeSizetCastToInt has hardcoded int size + returns correct int value on error.

gdal_svn_trunk_vsi_safe_mul.patch updated so that VSIMalloc/Calloc/Realloc return NULL when size is 0.

Use of new API in gdal/frmts

I'm wondering if the change in VSIMalloc/Calloc/Realloc is not a bit too disruptive... I had to change hfa_band.cpp line 891 in order not to break hfa_write.py.

Even,

I'd be more comfortable holding this change to 1.6 at this point. Feel free to apply the patch once we have branched off a 1.5 branch.

A revised proposal of the patches is described in RFC 19.

Changes commited in trunk in r13498, r13499 and r13500