Our engineers have developed new REINDEXing algorithms for Valentina that could increase reindexing speed by over a multiple of 100.
On a G 5 Dual Processor, 2 Ghz Mac, a five million record reindexing takes over 10 minutes. With the new algorithms, the same reindexing takes between 6-9 seconds.
A secondary benefit is that the size of the index file is reduced in half. A reduced index size means not only making better use of available space on read only media (CDROM, DVDROM) but also an increase in indexing speed since the kernel has to spend less time working with the index file.
An example - a customer database with tables that have 10 and 20 million records each. For ULONG fields:
10M records table
- old index = 240MB
- new index = 120MB
20M records table
- old index = 480MB
- new index = 240MB
The advancements can be demonstrated on numeric fields <=4 bytes. i.e. Byte, Short, Ushort, Medium, Medium, Long, ULong, Float, Date, Time.
The Paradigma R&D team is researching the creation of a similar algorithm for string fields. You can test the new reindexing algorithms in the next beta release of Valentina 2.4.