| 59 | | * Create 2 documents from metadata xml |
| 60 | | * a document only containing fields with stored data |
| 61 | | * a document containing fields only with non-stored data |
| 62 | | * Insert both documents into index |
| 63 | | |
| 64 | | Now the document with stored fields can be updated without losing any data. |
| 65 | | |
| 66 | | Obviously this impacts how searching is done. First it means that searches that involve both stored and non-stored fields need to be split and recombined. |
| 67 | | |
| 68 | | For example &(any:water title:salt) |
| 69 | | |
| 70 | | if title is stored and any is not then two searches have to be combined and documents that are in both searches (based on metadata id) are the true results. Ordering of results will be very difficult. |
| 71 | | |
| | 59 | Lucene 4 has the concept of flexible indexing (http://java.dzone.com/videos/heavy-committing-flexible) |
