Changes between Initial Version and Version 1 of PerformanceEnhancements


Ignore:
Timestamp:
Mar 5, 2010, 7:02:38 AM (14 years ago)
Author:
simonp
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PerformanceEnhancements

    v1 v1  
     1= Proposal title =
     2
     3|| '''Date''' || 2010/03/06 ||
     4|| '''Contact(s)''' || simonp ||
     5|| '''Last edited''' || [[Timestamp]] ||
     6|| '''Status''' || in progress, complete ||
     7|| '''Assigned to release''' || 2.5 ||
     8|| '''Resources''' || Not applicable ||
     9
     10== Overview ==
     11
     12A number of performance issues have been found when GN is applied to catalogs containing 10s of thousands of records:
     13
     14- search speed: search speed appears to degrade badly with the size of the result set, ie. searches with large result sets were taking much longer than expected to process than searches with small result sets
     15- indexing speed: importing 10s of thousands of records via batch import, harvesters, massive operations and CSW transactions was taking too long eg. local file system harvest of 20k records was taking 10-12 hours...
     16
     17=== Proposal Type ===
     18 * '''Type''': Core Change
     19 * '''App''': !GeoNetwork
     20 * '''Module''': Harvester, Kernel, Data Manager, Metadata Import, Lucene Index, Search results, Massive Operations and CSW Transaction support
     21
     22=== Links ===
     23 * '''Documents''':
     24 * '''Email discussions''':
     25 * '''Other wiki discussions''':
     26
     27=== Voting History ===
     28 * Vote proposed by X on Y, result was +/-n (m non-voting members).
     29
     30----
     31
     32== Motivations ==
     33Make GN perform better for catalogs with 10s of thousands of records.
     34
     35== Proposal ==
     36
     37Address the search speed issue:
     38
     39=== Backwards Compatibility Issues ===
     40
     41== Risks ==
     42
     43== Participants ==
     44 * List of participants and role (if necessary) in current GIP
     45