In-Memory Compression, Columnar Compression Techniques: Difference between revisions
Jump to navigation
Jump to search
(Created page with "The following compression techniques are implemented: * Sparse Storage for columns with lots of NULL values * Float Storage for scientific data * Integer Compression with a bit-size approach * Sequence Compression for sequences of integers like IDs (1, 2, 3, 4, 5 ...) * Dictionary Compression for short strings * BLOB Zipping and Deduplication for strings longer than 1KiB") |
No edit summary |
||
| Line 1: | Line 1: | ||
| − | The following compression techniques are implemented: |
+ | The following columnar compression techniques are implemented: |
* [[Sparse Storage]] for columns with lots of NULL values |
* [[Sparse Storage]] for columns with lots of NULL values |
||
| Line 7: | Line 7: | ||
* [[Dictionary Compression]] for short strings |
* [[Dictionary Compression]] for short strings |
||
* [[BLOB Zipping and Deduplication]] for strings longer than 1KiB |
* [[BLOB Zipping and Deduplication]] for strings longer than 1KiB |
||
| + | |||
| + | |||
| + | Also, MemCP is able to [[Index Compression|compress indexes]]. |
||
Revision as of 19:04, 17 May 2024
The following columnar compression techniques are implemented:
- Sparse Storage for columns with lots of NULL values
- Float Storage for scientific data
- Integer Compression with a bit-size approach
- Sequence Compression for sequences of integers like IDs (1, 2, 3, 4, 5 ...)
- Dictionary Compression for short strings
- BLOB Zipping and Deduplication for strings longer than 1KiB
Also, MemCP is able to compress indexes.