Opened 11 years ago

Closed 11 years ago

#1191 closed defect (fixed)

Harvester / Harvest URI column too small

Reported by: fxp Owned by: geonetwork-devel@…
Priority: major Milestone: v2.10.0 RC0
Component: General Version: v2.8.0RC2
Keywords: Cc:

Description

When harvesting (eg. http://xyz.ifremer.fr:8080/thredds/local/METEOFRANCE-EUR-SST_L3MONOSENSOR_NRT-OBS/METEOFRANCE-EUR-SST_L3MONOSENSOR_NRT-OBS.xml), the process sometimes fails due to harvestUri column size:

  dataset EUROPE SEA SURFACE TEMPERATURE L3 MONO SENSOR NEAR REAL TIME valid = true
2012-12-13 15:46:28,428 ERROR [geonetwork.harvester] - Thrown Exception org.postgresql.util.PSQLException: ERROR: value too long for type character varying(255) during dataset processing
org.postgresql.util.PSQLException: ERROR: value too long for type character varying(255)
    at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2103)
    at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1836)
    at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
    at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:512)
    at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:388)
    at org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:334)
    at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)
    at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)
    at jeeves.resources.dbms.Dbms.execute(Dbms.java:266)
    at org.fao.geonet.kernel.DataManager.setHarvestedExt(DataManager.java:1309)
    at org.fao.geonet.kernel.harvest.harvester.fragment.FragmentHarvester.createMetadata(FragmentHarvester.java:611)
    at org.fao.geonet.kernel.harvest.harvester.fragment.FragmentHarvester.addRecord(FragmentHarvester.java:232)
    at org.fao.geonet.kernel.harvest.harvester.fragment.FragmentHarvester.harvest(FragmentHarvester.java:139)
    at org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.createMetadataUsingFragments(Harvester.java:667)
    at org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.harvest(Harvester.java:476)
    at org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.crawlDatasets(Harvester.java:405)
    at org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.crawlDatasets(Harvester.java:399)
    at org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.crawlDatasets(Harvester.java:399)
    at org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.crawlDatasets(Harvester.java:399)
    at org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.harvestCatalog(Harvester.java:335)
    at org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.harvest(Harvester.java:252)
    at org.fao.geonet.kernel.harvest.harvester.thredds.ThreddsHarvester.doHarvest(ThreddsHarvester.java:245)
    at org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor.process(AbstractHarvester.java:399)
    at org.fao.geonet.kernel.MetadataIndexerProcessor.processWithFastIndexing(MetadataIndexerProcessor.java:39)
    at org.fao.geonet.kernel.harvest.harvester.AbstractHarvester.harvest(AbstractHarvester.java:429)
    at org.fao.geonet.kernel.harvest.harvester.HarvesterJob.execute(HarvesterJob.java:29)
    at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)

Proposal: increase to 512 characters.

Change History (2)

comment:1 by fxp, 11 years ago

Summary: Harvester /Harvester / Harvest URI column too small

comment:2 by fxp, 11 years ago

Resolution: fixed
Status: newclosed

master commit 8545e8b74645d72e0ab7b19f0a409b83b9b9d55b

Note: See TracTickets for help on using tickets.