Opened 11 years ago

Closed 8 years ago

Last modified 8 years ago

#2295 closed defect (wontfix)

import of large shapefile in GRASS-db crashes 6.4.3 + 7.0 beta2

Reported by: janhuizinga Owned by: grass-dev@…
Priority: major Milestone: 6.4.6
Component: LibVector Version: 6.4.3
Keywords: v.in.ogr Cc:
CPU: x86-64 Platform: MSWindows 7

Description (last modified by neteler)

OS: Windows 7 GRASS versions: 6.4 + 7.0 beta2

I'm trying to import a shapefile containing 9,354,125 point of type 2.5D in a GRASS-db. Size of this shapefile: 328MB for shp-file + 301MB for dbf-file. If I try to import it WITH creating an attribute table it only loads half of the points and then exits with an error message (message attached below). Size of coor-file in GRASS is then 173MB.

If I try to import the shapefile WITHOUT creating an attribute table it fully converts the points, but reports an memory error during "Registering primitives ..." Size of coor-file in GRASS is then 337MB (message attached below)

Error messages in command console below:

++++++++++++++++++++++
error 1:
++++++++++++++++++++++
(Fri May 16 13:20:20 2014)                                                      
v.in.ogr dsn=D:\Users\HKV2\PR2820_Mego\JanH\Gebouwen3\adreslocatie.shp layer=adreslocatie output=adreslocatie
Check if OGR layer <adreslocatie> contains polygons...
Importing 9354125 features (OGR layer <adreslocatie>)...
WARNING: System not initialized. Programmer forgot to call G_gisinit().
dbmi: Protocol error
dbmi: Protocol error
dbmi: Protocol error
ERROR: Cannot insert new row: insert into adreslocatie values ( 4802001, '0363200000223289', '1011LH', 3, 300 )
(Fri May 16 13:28:58 2014) Command finished (8 min 38 sec)
++++++++++++++++++++++
error 2:
++++++++++++++++++++++  
                   
(Fri May 16 14:58:19 2014)                                                      
v.in.ogr dsn=D:\Users\HKV2\PR2820_Mego\JanH\Gebouwen3\adreslocatie.shp layer=adreslocatie output=adreslocatie --overwrite -t
Check if OGR layer <adreslocatie> contains polygons...
WARNING: Vector map <adreslocatie> already exists and will be overwritten
WARNING: Table <adreslocatie> linked to vector map <adreslocatie> does not exist
Importing 9354125 features (OGR layer <adreslocatie>)...
-----------------------------------------------------
Building topology for vector map <adreslocatie@calc>...
Registering primitives...
Current region rows: 516, cols: 790
ERROR: G_realloc: unable to allocate 81480000 bytes of memory at cindex.c:113
(Fri May 16 15:08:04 2014) Command finished (9 min 44 sec)

Change History (6)

comment:1 by janhuizinga, 11 years ago

CPU: Unspecifiedx86-64

comment:2 by neteler, 11 years ago

Component: DefaultLibVector
Description: modified (diff)
Keywords: v.in.ogr added

Did you use GRASS 6 in both cases or does GRASS 7 generate the same errors?

comment:3 by neteler, 9 years ago

Milestone: 6.4.46.4.6

comment:4 by neteler, 8 years ago

I suggest "wontfix" since GRASS GIS 7 addresses large vector file support.

comment:5 by martinl, 8 years ago

Resolution: wontfix
Status: newclosed

in reply to:  4 comment:6 by wenzeslaus, 8 years ago

Replying to neteler:

GRASS GIS 7 addresses large vector file support.

So, isn't this "fixed" (for 7.0) or at least "worksforme"?

Note: See TracTickets for help on using tickets.