All public logs
Jump to navigation
Jump to search
Combined display of all available logs of MemCP. You can narrow down the view by selecting a log type, the username (case-sensitive), or the affected page (also case-sensitive).
- 14:01, 17 May 2024 Carli talk contribs created page In-Memory Compression, Columnar Compression Techniques (Created page with "The following compression techniques are implemented: * Sparse Storage for columns with lots of NULL values * Float Storage for scientific data * Integer Compression with a bit-size approach * Sequence Compression for sequences of integers like IDs (1, 2, 3, 4, 5 ...) * Dictionary Compression for short strings * BLOB Zipping and Deduplication for strings longer than 1KiB") Tag: Visual edit
- 13:57, 17 May 2024 Carli talk contribs created page Columnar Storage (Created page with "The advantages for columnar storages over row based storages are the ability for good in-memory compression '''(low memory usage)''' and cache locality when accessing only few columns '''(performance)'''. == How we designed the Interface == When designing an interface for a storage engine for an in-memory database, a lot of considerations have to be made. Here are the design goals: * The interface must be simple so that using it does not require implementing all kinds...") Tag: Visual edit
- 13:52, 17 May 2024 Carli talk contribs created page Hardware Requirements (Created page with "MemCP can run on any hardware that is supported by the <code>go</code> compiler. To find the right hardware dimensions, you need to consider the following: * The process itself needs at least 8 MiB of RAM * The size of a 5 GiB MySQL database fits into ~1 GiB of RAM * To have a decent working set, take the RAM requirements x3, so a 5 GiB MySQL database should run on 3 GiB RAM * MemCP needs at least 1 CPU core, more is better ;)") Tag: Visual edit
- 12:51, 17 May 2024 Carli talk contribs created page Parallel Computing (Created page with "Almost 99% of all newly invented are imperative programming languages. But imperative languages have one drawback: their parallelization is hard. == Drawbacks of Imperative Programming Languages == Imperative programming languages do have one mayor drawback: state. The concept of an imperative language is that commands are executed which change the content of variables or complex objects in the memory. When trying to create an optimizing compiler that from itself finds...") Tag: Visual edit
- 08:24, 17 May 2024 Carli talk contribs created page History of the MemCP project (Created page with "* On the beforehand, a lot of research was done at the HAEC project * MemCPs predecessor is the [https://wwwdb.inf.tu-dresden.de/research-projects/eris/ Eris] project at TU Dresden * The first commit on MemCP was done on 24th of December 2022 at 12:13:37 * MemCP was originally written in go * The first SQL query on MemCP was successfuly executed on 12.02.2023 source: https://launix.de/launix/memcp-first-sql-query-is-correctly-executed/") Tag: Visual edit
- 08:20, 17 May 2024 Carli talk contribs created page Databases, Tables and Columns (Created page with "* MemCP has a data folder which defaults to "./data". Every subdirectory of that folder is a database. * Databases consist of tables * Tables consist of columns and shards") Tag: Visual edit
- 08:18, 17 May 2024 Carli talk contribs created page Shards, RecordIDs, Main Storage, Delta Storage (Created page with "* Datasets of a table are organized in shards of roughly 60,000 items * Inside a shard with n items, the datasets are numbered from 0..n-1 * The first few datasets of each shard are organized in a column store * The rest of the datasets are organized in a row store * The delta store consists of the insert list as well as the deletion mask") Tag: Visual edit
- 08:14, 17 May 2024 Carli talk contribs created page What is OLTP and OLAP (Created page with "There are basically two types database workloads leading to different database designs: {| class="wikitable" |+ ! !OLTP !OLAP |- |abbr. |Online Transaction Processing |Online ''Analytical'' Processing |- |Example applications |ERP, Ticket System |BI suite, Statistical programs |- |Typical SQL Queries |large amounts of small UPDATE, INSERT |few SELECT with big computation demand |- |Best Storage Format |Row Store |Columnar store |- |Database Engines |MySQL, Postgres |Mone...") Tag: Visual edit
- 14:04, 16 May 2024 Bnet talk contribs uploaded File:JBL 2022 fhd 97974.jpg
- 14:04, 16 May 2024 Bnet talk contribs created page File:JBL 2022 fhd 97974.jpg
- 13:46, 16 May 2024 Bnet talk contribs deleted page File:Nextcloud 02.png (Test-Upload)
- 13:46, 16 May 2024 Bnet talk contribs deleted page File:JBL 2022 fhd 97974.jpg (Test-Upload)
- 13:45, 16 May 2024 Bnet talk contribs deleted page File:JBL 2022 fhd 97973.jpg (Test-Upload)
- 13:45, 16 May 2024 Bnet talk contribs deleted page File:JBL 2022 fhd 97972.jpg (Test-Upload)
- 16:23, 15 May 2024 Bnet talk contribs created page File:JBL 2022 fhd 97972.jpg
- 16:23, 15 May 2024 Bnet talk contribs uploaded File:JBL 2022 fhd 97972.jpg
- 16:20, 15 May 2024 Bnet talk contribs uploaded File:JBL 2022 fhd 97973.jpg
- 16:20, 15 May 2024 Bnet talk contribs created page File:JBL 2022 fhd 97973.jpg
- 15:50, 15 May 2024 Bnet talk contribs created page File:JBL 2022 fhd 97974.jpg
- 15:50, 15 May 2024 Bnet talk contribs uploaded File:JBL 2022 fhd 97974.jpg
- 15:19, 15 May 2024 Bnet talk contribs created page File:Nextcloud 02.png
- 15:19, 15 May 2024 Bnet talk contribs uploaded File:Nextcloud 02.png
- 13:26, 15 May 2024 Bnet talk contribs uploaded File:Backofen-defekt-7.jpg
- 13:26, 15 May 2024 Bnet talk contribs created page File:Backofen-defekt-7.jpg
- 13:26, 15 May 2024 Bnet talk contribs deleted page File:Backofen-defekt-7.jpg (Test-Upload)
- 13:26, 15 May 2024 Bnet talk contribs deleted page File:Nextcloud 01.png (Test-Upload)
- 13:26, 15 May 2024 Bnet talk contribs created page File:B-net.png
- 13:26, 15 May 2024 Bnet talk contribs uploaded File:B-net.png
- 13:20, 15 May 2024 Bnet talk contribs created page File:Nextcloud 01.png
- 13:20, 15 May 2024 Bnet talk contribs uploaded File:Nextcloud 01.png
- 11:49, 15 May 2024 Carli talk contribs created page File:Screenshot from htop.png
- 11:49, 15 May 2024 Carli talk contribs uploaded File:Screenshot from htop.png
- 11:49, 15 May 2024 Carli talk contribs deleted page File:Screenshot from htop.png
- 04:36, 15 May 2024 Carli talk contribs created page File:Screenshot from htop.png
- 04:36, 15 May 2024 Carli talk contribs uploaded File:Screenshot from htop.png
- 04:34, 15 May 2024 Carli talk contribs deleted page File:Screenshot from htop.png
- 22:40, 14 May 2024 Carli talk contribs created page File:Screenshot from htop.png
- 22:40, 14 May 2024 Carli talk contribs uploaded File:Screenshot from htop.png
- 22:34, 14 May 2024 Carli talk contribs deleted page File:Screenshot from htop.png
- 22:31, 14 May 2024 Carli talk contribs uploaded File:Screenshot from htop.png
- 22:31, 14 May 2024 Carli talk contribs created page File:Screenshot from htop.png
- 22:30, 14 May 2024 Carli talk contribs deleted page File:Screenshot from htop.png
- 21:37, 14 May 2024 Carli talk contribs uploaded File:Screenshot from htop.png
- 21:37, 14 May 2024 Carli talk contribs created page File:Screenshot from htop.png
- 21:05, 14 May 2024 User account Netbreaker talk contribs was created
- 17:48, 14 May 2024 Carli talk contribs created page MediaWiki:Common.css (Created page with "CSS placed here will be applied to all skins: #p-logo a { background-size: contain; }")
- 17:31, 14 May 2024 User account Dj9oh talk contribs was created
- 17:24, 14 May 2024 Bnet talk contribs changed group membership for Bnet from bureaucrat, interface administrator and administrator to bureaucrat, interface administrator, administrator and emailconfirmed
- 17:24, 14 May 2024 Bnet talk contribs changed group membership for Carli from bureaucrat, interface administrator and administrator to bureaucrat, interface administrator, administrator and emailconfirmed
- 17:17, 14 May 2024 Carli talk contribs created page Main Page (Created page with " === What is memcp? === memcp is an open-source, high-performance, columnar in-memory database that can handle both OLAP and OLTP workloads. It provides an alternative to proprietary analytical databases and aims to bring the benefits of columnar storage to the open-source world. memcp is written in Golang and is designed to be portable and extensible, allowing developers to embed the database into their applications with ease. It is also designed with a focus on scalab...") Tag: Visual edit