Opened 16 years ago
Closed 16 years ago
#431 closed enhancement (fixed)
Make SDF Cache size tunable
Reported by: | brentrobinson | Owned by: | brentrobinson |
---|---|---|---|
Priority: | major | Milestone: | 3.4.0 |
Component: | SDF Provider | Version: | 3.4.0 |
Severity: | 2 | Keywords: | SDF insert performance cache |
Cc: | External ID: |
Description
The SDF provider has an in-memory cache of inserted and updated features. The cache limit is 500 features. When the cache size is exceeded, the features are flushed to the SDF file.
For some data sets, a larger cache limit leads to better feature insertion performance, which can speed up the initial population of these SDF files. However, the amount of improvement varies greatly by data set.
This ticket proposes a couple of modifications to make the SDF cache size adjustable:
- Add a new environment variable called SDF_MAXCACHESIZE. When set, the SDF provider sets the cache size to the number specified. If the variable is a non-positive number, not numeric, or not set then the cache size defaults to 500 features.
- Add a new SDF Provider connection parameter, called MaxCacheSize, which behaves the same way as the above environment variable. This allows the tuning of the cache size for individual SDF connections. If the environment variable is also set, the connection parameter takes precedence.
The above provides the opportunity to try different cache sizes to arrive at the optimal sizes for particular data sets.
Change History (3)
comment:1 by , 16 years ago
Status: | new → assigned |
---|
comment:2 by , 16 years ago
Component: | FDO API → SDF Provider |
---|
comment:3 by , 16 years ago
Resolution: | → fixed |
---|---|
Status: | assigned → closed |