Enhanced Harvesting Capabilities

Date	2009/12/20
Contact(s)	A. Warnock (A/WWW Enterprises), D. Nebert (USGS/FGDC), L. Miao (GMU), Z. Li (GMU), H. Wu (GMU)
Last edited	Timestamp
Status	Proposed for voting
Assigned to release	2.5
Resources	Indicate if the required resources are available to complete the proposal

Overview

We propose to add the ability to harvest from both Z39.50 and WAF (web-accessible folders) and to modify/enhance the harvest administrative interface.

Proposal Type

• Type: Module Change (Harvesting)
• App: GeoNetwork
• Module: Harvester

Links

• Documents:
• Email discussions: See thread on Proposal: Enhanced harvesting capabilities on geonetwork-devel list
• Other wiki discussions:

Voting History

• Vote proposed by A. Warnock on 2009-12-20.

---

Motivations

GEOSS has a strong need to be able to harvest metadata from both Z39.50 sources and from simple web-accessible folders. These capabilities are not currently present in GeoNetwork but are straight-forward additions to the existing harvesting module.

Proposal

We propose to add the ability to harvest from both Z39.50 and WAF (web-accessible folders) and to modify/enhance the harvest administrative interface. WAF is quite simple - it's like WebDAV only easier. A simple wget-like function would suffice.

Experience in GEOSS indicates that not all desirable sources respond correctly to blank queries, so we additionally propose that both Z39.50 and CSW ought to include the capability to specify a query as part of the harvest process.

Backwards Compatibility Issues

None forseen.

Risks

None forseen. Development will take place on a separate branch so that testing can take place before merging into the trunk.

Participants

• A. Warnock (A/WWW Enterprises)
• D. Nebert (USGS/FGDC)
• L. Miao (GMU)
• Z. Li (GMU)
• H. Wu (GMU)