Consolidate Block-Compressed Index: Purpose
Consolidate Block-Compressed Index: Purpose
Consolidate Block-Compressed Index: Purpose
COMPRESSED INDEX
Purpose
CONSOLIDATE BLOCK-COMPRESSED INDEX consolidates the many index generations contained in an ICFF index file. It does not affect the
block-compressed data itself.
The component produces a master index for all the generations of input ICFF data.
Requirements
CONSOLIDATE BLOCK-COMPRESSED INDEX has two input ports:
Recommendations
Information stored in compressed data blocks and their associated indexes can be concatenated as successive generations are added.
Performance decreases as the number of concatenated index generations grows.
Therefore, you should use CONSOLIDATE BLOCK-COMPRESSED INDEX on block-compressed files only when you can safely assume that
the data is already sorted not only within generations but from each generation to the next. This is the case when the lookup key has
been sequentially assigned.
In the general case, where you cannot assume data is sorted from each generation to the next, use MERGE BLOCK-COMPRESSED
DATA instead.
key
(key specifier, required)
Describes how the input records are indexed for later use as a lookup file.
additional_options
(unquoted string, optional)
1. Reads a number of index generations from the index file at its indexfile input port.
2. Reads the data record format from the file at its datafile input port.
NOTE: For sake of efficiency, the consolidated index produced by the CONSOLIDATE BLOCK-COMPRESSED INDEX component does not
retain any of the bitmap information that might have been present in the separate index generations.
Related topics