Lucene-Only search mode

Date	2011-10-31
Contact(s)	François Prunayre
Last edited	2011-10-31T18:25:00
Status	Being discussed, in progress, initial implementation in progress
Assigned to release	2.7.x
Resources	Available
Ticket #	#XYZ

Overview

Current search rely on the following steps:

• Lucene Search
• Retrieve Metadata from Database (according to search criteria and paging)
• XSL presentation.

The aim of this proposal is to add a new search mode relying only on Lucene. This mode requires to structure and/or add all information required for results presentation in the index.

Proposal Type

• Type: Lucene, Core Change
• App: GeoNetwork
• Module: LuceneSearcher

Links

• Documents:
  • ​http://trac.osgeo.org/geonetwork/ticket/485

Voting History

• Vote not yet proposed.

Motivations

• Performance improvements.

Proposal

The main requirement is to store all information available in the "brief" format in the index in order to retrieve those information at search time. Brief format is the pivot format used by GeoNetwork to display search results via xml.search or main.search.embeded services. Brief format fields are the following:

• id
• uuid
• title
• abstract
• keyword
• parentId
• datasetcreationdate
• geoBox
  • westBL
  • eastBL
  • southBL
  • northBL
• Constraints (not supported/used in widget GUI, complex XML or as CData ?)
• SecurityConstraints (not supported/used in widget GUI, complex XML or as CData ?)
• LegalConstraints (not supported/used in widget GUI, complex XML or as CData ?)
• temporalExtent (not supported/used in widget GUI)
  • begin
  • end
• image type="unknown|thumbnail|overview"
• responsibleParty role="{$role}" appliesTo="resource" logo=""
• link title="" href="" name="" protocol="" type=""
• category
• + geonet:info/*

The q service (#485) requires to retrieve those information from the index directly instead of dumping all index fields. Some of them are already available:

• id=_id
• schema=_schema
• createDate=_createDate
• changeDate=_changeDate
• isTemplate=_isTemplate
• isHarvested=_isHarvested
• popularity=_popularity
• rating=_rating
• displayOrder=_displayOrder
• view=_view
• notify=_notify
• download=_download
• dynamic=_dynamic
• featured=_featured
• owner=_owner
• isPublishedToAll=_isPublishedToAll
• ownername=_ownername
• category=_category
• valid=_valid
• baseUrl=?
• locService=?
• selected=selected
• source=_source
• edit=_edit
• uuid=_uuid
• title=title
• abstract=abstract
• keyword=keyword
• parentId=parentUuid
• datasetcreationdate=createDate
• changeDate=changeDate

Re-worked field:

• image=image (| separated)
• link=link (| separated)
• geoBox (| separated)
• responsibleParty (| separated)
• Constraints=accessConstr (Codelist value only)
• Constraints=otherConstr
• SecurityConstraints=classif (Codelist value only)
• Constraints=conditionApplyingToAccessAndUse

New field added:

• datasetLang=datasetLang
• language=language
• spatialRepresentationType=spatialRepresentationType
• serviceType=serviceType

Backwards Compatibility Issues

None.

New libraries added

None.

Risks

Participants

• François Prunayre
• Others?