Unix/Linux sh bash version of tiger2010 geocoder loader does not work

[donh]

ctrl-m's in the file and/or generated by psql would crash psql. Missing command line parameters would also crash it. I would generate my load_tiger script by running psql as: \a \o load_tiger \i states \o \q I would them remove the control-m's from load_tiger. tr "\r" "\n" < load_tiger > load_tiger2 I then would edit load_tiger2 putting a #!bin/bash at the top and removing the line numbers at the end. I had already downloaded the tiger database files so I would replace wget with #wget in the file. shp2pgsql does not really convert latin1 to utf-8 all the time so I added a "| iconv -f latin1 -t UTF8 | $PGBIN/psql" after the shp2pgsql command. That did away with the aborted transactions from postgresql.

[donh]

diff to fix the problem

[donh]

generated file that I used to load the tiger database

[donh]

file that lists states to process; some territories are missing

[mcayland]

shp2pgsql does not really convert latin1 to utf-8 all the time so I added a "| iconv -f latin1 -t UTF8 | $PGBIN/psql" after the shp2pgsql command. That did away with the aborted transactions from postgresql.

If this is true, then you've found a bug. Can it be reproduced using the files attached to this ticket?

[donh]

my tiger_loader.sql file

[donh]

geocode/reverse_geocode.sql original had embedded character code which crashed the program

[robe]

Mark,

What he discovered is a known and closed bug #808. I confirmed already he is running a version of shp2pgsql before the fix (he's running a version from December 2010 and the fixed version should be dated after March 18, 2011

Refer to:  http://www.postgis.org/pipermail/postgis-users/2011-April/029406.html

[robe]

Most if not all these issues have been fixed peacemeal. I'm hoping last fix at r7278 will cover what commpatibility issues are left.

Will know once done testing on my CentOS box.

[robe]

I was successful in loading California data on a CentOS with the revised changes in r7278 so consider this a done deal.