GeoNetwork Z39.50 harvest stops half way through

[murrayh]

We are attempting to harvest BRS using GeoNetwork's Z39.50 harvester and it stops half way through.

We suspect that the harvester breaks when it encounters a duplicate record. Debug log extract is below.

We can retrieve all of the records using GeoNetwork's own Remote Search feature, so we don't think there is an issue with BRS's server.

Cheers, Murray

2012-07-13 00:19:38,117 DEBUG [geonetwork.harvester] - Processing record from server BRS and Australian Natural Resources Data Library (ANRDL)

2012-07-13 00:19:38,119 INFO [geonetwork.harvester] - - Adding metadata with ​http://adl.brs.gov.au/anrdl/metadata_files/pe_brs90000004212.xml

2012-07-13 00:19:38,162 DEBUG [geonetwork.harvester] - Processing record from server BRS and Australian Natural Resources Data Library (ANRDL)

2012-07-13 00:19:38,164 INFO [geonetwork.harvester] - - Adding metadata with ​http://adl.brs.gov.au/anrdl/metadata_files/pe_abares99001806.xml

2012-07-13 00:19:58,227 DEBUG [geonetwork.harvester] - There are 10 children in the results (1011 to 1020)

2012-07-13 00:19:58,227 DEBUG [geonetwork.harvester] - Processing record from server BRS and Australian Natural Resources Data Library (ANRDL)

2012-07-13 00:19:58,231 INFO [geonetwork.harvester] - - Adding metadata with ​http://adl.brs.gov.au/anrdl/metadata_files/pe_abares99001791.xml

2012-07-13 00:19:58,514 DEBUG [geonetwork.harvester] - Processing record from server BRS and Australian Natural Resources Data Library (ANRDL)

2012-07-13 00:19:58,518 INFO [geonetwork.harvester] - - Adding metadata with ​http://adl.brs.gov.au/anrdl/metadata_files/pe_brs90000004213.xml

2012-07-13 00:19:58,571 DEBUG [geonetwork.harvester] - Processing record from server null

2012-07-13 00:19:58,571 ERROR [geonetwork.harvester] - JZKit could not retrieve record - returned <error message="Unable to retrieve record 1013" />

2012-07-13 00:19:58,571 DEBUG [geonetwork.harvester] - Processing record from server null

2012-07-13 00:19:58,571 ERROR [geonetwork.harvester] - JZKit could not retrieve record - returned <error message="Unable to retrieve record 1014" />

2012-07-13 00:19:58,572 DEBUG [geonetwork.harvester] - Processing record from server null

2012-07-13 00:19:58,572 ERROR [geonetwork.harvester] - JZKit could not retrieve record - returned <error message="Unable to retrieve record 1015" />

2012-07-13 00:19:58,572 DEBUG [geonetwork.harvester] - Processing record from server null

2012-07-13 00:19:58,572 ERROR [geonetwork.harvester] - JZKit could not retrieve record - returned <error message="Unable to retrieve record 1016" />