https://www.memcp.org/index.php?action=history&feed=atom&title=Storage
Storage - Revision history
2026-04-24T16:47:05Z
Revision history for this page on the wiki
MediaWiki 1.39.1
https://www.memcp.org/index.php?title=Storage&diff=232&oldid=prev
Carli: Created page with "= Storage = The '''Storage''' module provides functions to manage databases, tables, columns, keys, partitions, and large data operations in SCM. ← Back to Full SCM API documentation == scan == Performs an unordered parallel filter-map-reduce on a table '''Allowed number of parameters:''' 6–10 '''Parameters:''' * '''schema''' (<code>string|nil</code>): database name * '''table''' (<code>string|list</code>): table name(s) * '''filterColumns''' (<code>list</c..."
2025-08-25T18:10:16Z
<p>Created page with "= Storage = The '''Storage''' module provides functions to manage databases, tables, columns, keys, partitions, and large data operations in SCM. ← Back to <a href="/wiki/Full_SCM_API_documentation" title="Full SCM API documentation">Full SCM API documentation</a> == scan == Performs an unordered parallel filter-map-reduce on a table '''Allowed number of parameters:''' 6–10 '''Parameters:''' * '''schema''' (<code>string|nil</code>): database name * '''table''' (<code>string|list</code>): table name(s) * '''filterColumns''' (<code>list</c..."</p>
<p><b>New page</b></p><div>= Storage =<br />
<br />
The '''Storage''' module provides functions to manage databases, tables, columns, keys, partitions, and large data operations in SCM.<br />
<br />
← Back to [[Full SCM API documentation]]<br />
<br />
== scan ==<br />
<br />
Performs an unordered parallel filter-map-reduce on a table<br />
<br />
'''Allowed number of parameters:''' 6–10<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string|nil</code>): database name<br />
* '''table''' (<code>string|list</code>): table name(s)<br />
* '''filterColumns''' (<code>list</code>): filter columns<br />
* '''filter''' (<code>func</code>): lambda deciding dataset inclusion<br />
* '''mapColumns''' (<code>list</code>): map columns<br />
* '''map''' (<code>func</code>): lambda extracting/processing data<br />
* '''reduce''' (<code>func</code>): optional aggregator<br />
* '''neutral''' (<code>any</code>): neutral element<br />
* '''reduce2''' (<code>func</code>): optional second reducer<br />
* '''isOuter''' (<code>bool</code>): outer join–like behavior<br />
<br />
'''Returns:''' <code>any</code><br />
<br />
== scan_order ==<br />
<br />
Performs an ordered parallel filter with serial map-reduce<br />
<br />
'''Allowed number of parameters:''' 10–13<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database<br />
* '''table''' (<code>string</code>): table name<br />
* '''filterColumns''' (<code>list</code>): filter columns<br />
* '''filter''' (<code>func</code>): filter lambda<br />
* '''sortcols''' (<code>list</code>): sorting columns<br />
* '''sortdirs''' (<code>list</code>): sorting directions<br />
* '''offset''' (<code>number</code>): skip count<br />
* '''limit''' (<code>number</code>): max items<br />
* '''mapColumns''' (<code>list</code>): map columns<br />
* '''map''' (<code>func</code>): map lambda<br />
* '''reduce''' (<code>func</code>): optional reducer<br />
* '''neutral''' (<code>any</code>): neutral element<br />
* '''isOuter''' (<code>bool</code>): outer behavior<br />
<br />
'''Returns:''' <code>any</code><br />
<br />
== createdatabase ==<br />
<br />
Creates a new database<br />
<br />
'''Allowed number of parameters:''' 1–2<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database name<br />
* '''ignoreexists''' (<code>bool</code>): ignore if exists<br />
<br />
'''Returns:''' <code>bool</code><br />
<br />
== dropdatabase ==<br />
<br />
Drops a database<br />
<br />
'''Allowed number of parameters:''' 1–1<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database name<br />
<br />
'''Returns:''' <code>bool</code><br />
<br />
== createtable ==<br />
<br />
Creates a new table<br />
<br />
'''Allowed number of parameters:''' 4–5<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database<br />
* '''table''' (<code>string</code>): table name<br />
* '''cols''' (<code>list</code>): column definitions<br />
* '''options''' (<code>list</code>): table options<br />
* '''ifnotexists''' (<code>bool</code>): safe creation<br />
<br />
'''Returns:''' <code>bool</code><br />
<br />
== createcolumn ==<br />
<br />
Creates a new column in a table<br />
<br />
'''Allowed number of parameters:''' 6–8<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database<br />
* '''table''' (<code>string</code>): table name<br />
* '''colname''' (<code>string</code>): column name<br />
* '''type''' (<code>string</code>): base type<br />
* '''dimensions''' (<code>list</code>): type dimensions<br />
* '''options''' (<code>list</code>): column options<br />
* '''computorCols''' (<code>list</code>): columns for computed value<br />
* '''computor''' (<code>func</code>): compute lambda<br />
<br />
'''Returns:''' <code>bool</code><br />
<br />
== createkey ==<br />
<br />
Creates a new key<br />
<br />
'''Allowed number of parameters:''' 5–5<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database<br />
* '''table''' (<code>string</code>): table<br />
* '''keyname''' (<code>string</code>): key name<br />
* '''unique''' (<code>bool</code>): uniqueness flag<br />
* '''columns''' (<code>list</code>): key columns<br />
<br />
'''Returns:''' <code>bool</code><br />
<br />
== createforeignkey ==<br />
<br />
Creates a new foreign key<br />
<br />
'''Allowed number of parameters:''' 8–8<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database<br />
* '''keyname''' (<code>string</code>): key name<br />
* '''table1''' (<code>string</code>): first table<br />
* '''columns1''' (<code>list</code>): first columns<br />
* '''table2''' (<code>string</code>): second table<br />
* '''columns2''' (<code>list</code>): second columns<br />
* '''updatemode''' (<code>string</code>): action on update<br />
* '''deletemode''' (<code>string</code>): action on delete<br />
<br />
'''Returns:''' <code>bool</code><br />
<br />
== shardcolumn ==<br />
<br />
Suggests partitions for a column<br />
<br />
'''Allowed number of parameters:''' 3–4<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database<br />
* '''table''' (<code>string</code>): table<br />
* '''colname''' (<code>string</code>): column<br />
* '''numpartitions''' (<code>number</code>): partitions<br />
<br />
'''Returns:''' <code>list</code><br />
<br />
== partitiontable ==<br />
<br />
Applies or adjusts a partition scheme<br />
<br />
'''Allowed number of parameters:''' 3–3<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database<br />
* '''table''' (<code>string</code>): table<br />
* '''columns''' (<code>list</code>): column pivots<br />
<br />
'''Returns:''' <code>bool</code><br />
<br />
== altertable ==<br />
<br />
Alters a table<br />
<br />
'''Allowed number of parameters:''' 4–4<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database<br />
* '''table''' (<code>string</code>): table<br />
* '''operation''' (<code>string</code>): alteration<br />
* '''parameter''' (<code>any</code>): parameter<br />
<br />
'''Returns:''' <code>bool</code><br />
<br />
== altercolumn ==<br />
<br />
Alters a column<br />
<br />
'''Allowed number of parameters:''' 5–5<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database<br />
* '''table''' (<code>string</code>): table<br />
* '''column''' (<code>string</code>): column<br />
* '''operation''' (<code>string</code>): alteration<br />
* '''parameter''' (<code>any</code>): parameter<br />
<br />
'''Returns:''' <code>bool</code><br />
<br />
== droptable ==<br />
<br />
Removes a table<br />
<br />
'''Allowed number of parameters:''' 2–3<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database<br />
* '''table''' (<code>string</code>): table<br />
* '''ifexists''' (<code>bool</code>): safe drop<br />
<br />
'''Returns:''' <code>bool</code><br />
<br />
== insert ==<br />
<br />
Inserts a dataset into a table<br />
<br />
'''Allowed number of parameters:''' 4–7<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database<br />
* '''table''' (<code>string</code>): table<br />
* '''columns''' (<code>list</code>): column names<br />
* '''datasets''' (<code>list</code>): row values<br />
* '''onCollisionCols''' (<code>list</code>): collision columns<br />
* '''onCollision''' (<code>func</code>): collision handler<br />
* '''mergeNull''' (<code>bool</code>): handle null as equal<br />
<br />
'''Returns:''' <code>number</code><br />
<br />
== stat ==<br />
<br />
Returns memory statistics<br />
<br />
'''Allowed number of parameters:''' 0–2<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database (optional)<br />
* '''table''' (<code>string</code>): table (optional)<br />
<br />
'''Returns:''' <code>string</code><br />
<br />
== show ==<br />
<br />
Shows databases, tables, or columns<br />
<br />
'''Allowed number of parameters:''' 0–2<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): optional database<br />
* '''table''' (<code>string</code>): optional table<br />
<br />
'''Returns:''' <code>any</code><br />
<br />
== rebuild ==<br />
<br />
Rebuilds storages<br />
<br />
'''Allowed number of parameters:''' 0–2<br />
<br />
'''Parameters:'''<br />
* '''all''' (<code>bool</code>): rebuild all<br />
* '''repartition''' (<code>bool</code>): repartition<br />
<br />
'''Returns:''' <code>string</code><br />
<br />
== loadCSV ==<br />
<br />
Loads CSV into a table<br />
<br />
'''Allowed number of parameters:''' 3–5<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database<br />
* '''table''' (<code>string</code>): table<br />
* '''stream''' (<code>stream</code>): CSV stream<br />
* '''delimiter''' (<code>string</code>): delimiter<br />
* '''firstline''' (<code>bool</code>): use header<br />
<br />
'''Returns:''' <code>string</code><br />
<br />
== loadJSON ==<br />
<br />
Loads JSONL into a database<br />
<br />
'''Allowed number of parameters:''' 2–2<br />
<br />
'''Parameters:'''<br />
* '''schema''' (<code>string</code>): database<br />
* '''stream''' (<code>stream</code>): JSONL stream<br />
<br />
'''Returns:''' <code>string</code><br />
<br />
== settings ==<br />
<br />
Reads or writes global settings<br />
<br />
'''Allowed number of parameters:''' 1–2<br />
<br />
'''Parameters:'''<br />
* '''key''' (<code>string</code>): setting key<br />
* '''value''' (<code>any</code>): new value<br />
<br />
'''Returns:''' <code>any</code></div>
Carli