Fri, 11 Apr 2025 14:49:23 +0200
remove warning regarding destruction order, because it is actually not a problem
relates to #640
1143
0559812df10c
assign proper names to the documentation topics
Mike Becker <universe@uap-core.de>
parents:
1142
diff
changeset
|
1 | # Memory Pool |
1141 | 2 | |
3 | A memory pool is providing an allocator implementation that automatically deallocates the memory upon its destruction. | |
4 | It also allows you to register destructor functions for the allocated memory, which are automatically called before | |
5 | the memory is deallocated. | |
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
6 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
7 | Additionally, you may also register _independent_ destructor functions. |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
8 | This can be useful, for example, when some library allocates memory that you wish to destroy when the memory pool gets destroyed. |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
9 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
10 | A memory pool can be used with all UCX features that support the use of an [allocator](allocator.h.md). |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
11 | For example, the UCX [string](string.h.md) functions provide several variants suffixed with `_a` for that purpose. |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
12 | |
1281
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
13 | ## Basic Memory Management |
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
14 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
15 | ```C |
1174
ee473780cc0d
add missing documentation about what header to include
Mike Becker <universe@uap-core.de>
parents:
1168
diff
changeset
|
16 | #include <cx/mempool.h> |
ee473780cc0d
add missing documentation about what header to include
Mike Becker <universe@uap-core.de>
parents:
1168
diff
changeset
|
17 | |
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
18 | CxMempool *cxMempoolCreate(size_t capacity, cx_destructor_func fnc); |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
19 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
20 | CxMempool *cxMempoolCreateSimple(size_t capacity); |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
21 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
22 | void cxMempoolFree(CxMempool *pool); |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
23 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
24 | void cxMempoolSetDestructor(void *memory, cx_destructor_func fnc); |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
25 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
26 | void cxMempoolRemoveDestructor(void *memory); |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
27 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
28 | int cxMempoolRegister(CxMempool *pool, void *memory, |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
29 | cx_destructor_func fnc); |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
30 | ``` |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
31 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
32 | A memory pool is created with the `cxMempoolCreate()` function with a default `capacity` |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
33 | and an optional default destructor function `fnc`. |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
34 | If specified, the default destructor function is registered for all freshly allocated memory within the pool, |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
35 | as if `cxMempoolSetDestructor()` was called immediately after allocation. |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
36 | When you set `fnc` is to `NULL` during pool creation, or use `cxMempoolCreateSimple`, no default destructor is registered. |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
37 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
38 | After creating a memory pool `CxMempool *mpool`, you can access the provided allocator via `mpool->allocator`. |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
39 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
40 | The functions `cxMempoolSetDestructor()` and `cxMempoolRemoveDestructor()` can be used to assign a specific destructor |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
41 | function to an allocated object or remove any assigned destructor function, respectively. |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
42 | The `memory` pointer points to the allocated object, which must have been allocated by any `CxMempool`'s provided allocator. |
1141 | 43 | |
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
44 | The `cxMempoolRegister()` function allocates a new wrapper object for `memory` with `pool`'s allocator that |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
45 | will call the specified destructor function when destroyed. |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
46 | Usually this function returns zero except for platforms where memory allocations are likely to fail, |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
47 | in which case a non-zero value is returned. |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
48 | |
1281
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
49 | ### Order of Destruction |
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
50 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
51 | When you call `cxMempoolFree()` the following actions are performed: |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
52 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
53 | 1. In any order, for each object in the pool |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
54 | 1. the destructor function assigned to that object is called |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
55 | 2. the object's memory is deallocated |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
56 | 2. The pool memory is deallocated |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
57 | 3. The pool structure is deallocated |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
58 | |
1281
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
59 | ## Transfer Memory |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
60 | |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
61 | ```C |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
62 | #include <cx/mempool.h> |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
63 | |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
64 | int cxMempoolTransfer(CxMempool *source, CxMempool *dest); |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
65 | ``` |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
66 | |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
67 | Memory managed by a pool can be transferred to another pool. |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
68 | |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
69 | The function `cxMempoolTransfer()` transfers all memory managed and/or registered with the `source` pool to the `dest` pool. |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
70 | It also registers its allocator with the `dest` pool and creates a new allocator for the `source` pool. |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
71 | That means, that all references to the allocator of the `source` pool remain valid and continue to work with the `dest` pool. |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
72 | The transferred allocator will be destroyed when the `dest` pool gets destroyed. |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
73 | |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
74 | The function returns zero when the transfer was successful and non-zero if a necessary memory allocation was not possible, |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
75 | or the `source` and `dest` pointers point to the same pool. |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
76 | In case of an error, no memory is transferred and both pools are in a valid state. |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
77 | |
45746a08c59e
add cxMempoolTransfer() - partially resolves #640
Mike Becker <universe@uap-core.de>
parents:
1174
diff
changeset
|
78 | |
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
79 | ## Example |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
80 | |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
81 | The following code illustrates how the contents of a CSV file are read into pooled memory. |
1141 | 82 | ```C |
83 | #include <stdio.h> | |
84 | #include <cx/mempool.h> | |
85 | #include <cx/linked_list.h> | |
86 | #include <cx/string.h> | |
87 | #include <cx/buffer.h> | |
88 | #include <cx/utils.h> | |
89 | ||
90 | typedef struct { | |
91 | cxstring column_a; | |
92 | cxstring column_b; | |
93 | cxstring column_c; | |
94 | } CSVData; | |
95 | ||
96 | int main(void) { | |
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
97 | // create a simple pool for various different objects |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
98 | CxMempool* pool = cxMempoolCreateSimple(128); |
1141 | 99 | |
100 | FILE *f = fopen("test.csv", "r"); | |
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
101 | if (f == NULL) { |
1141 | 102 | perror("Cannot open file"); |
103 | return 1; | |
104 | } | |
105 | // close the file automatically at pool destruction | |
106 | cxMempoolRegister(pool, f, (cx_destructor_func) fclose); | |
107 | ||
108 | // create a buffer using the memory pool for destruction | |
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
109 | CxBuffer *content = cxBufferCreate( |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
110 | NULL, 256, pool->allocator, CX_BUFFER_AUTO_EXTEND |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
111 | ); |
1141 | 112 | |
113 | // read the file into the buffer and turn it into a string | |
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
114 | cx_stream_copy( |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
115 | f, content, (cx_read_func) fread, cxBufferWriteFunc |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
116 | ); |
1141 | 117 | fclose(f); |
118 | cxstring contentstr = cx_strn(content->space, content->size); | |
119 | ||
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
120 | // split the string into lines |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
121 | // use the memory pool to allocate the target array |
1141 | 122 | cxstring* lines; |
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
123 | size_t lc = cx_strsplit_a( |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
124 | pool->allocator, contentstr, cx_str("\n"), SIZE_MAX, &lines |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
125 | ); |
1141 | 126 | |
127 | // skip the header and parse the remaining data into a linked list | |
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
128 | // the nodes of the list shall also be allocated by the pool |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
129 | CxList* datalist = cxLinkedListCreate( |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
130 | pool->allocator, NULL, sizeof(CSVData) |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
131 | ); |
1141 | 132 | for (size_t i = 1 ; i < lc ; i++) { |
133 | if (lines[i].length == 0) continue; | |
134 | cxstring fields[3]; | |
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
135 | size_t fc = cx_strsplit(lines[i], cx_str(";"), 3, fields); |
1141 | 136 | if (fc != 3) { |
137 | fprintf(stderr, "Syntax error in line %zu.\n", i); | |
138 | cxMempoolFree(pool); | |
139 | return 1; | |
140 | } | |
141 | CSVData data; | |
142 | data.column_a = fields[0]; | |
143 | data.column_b = fields[1]; | |
144 | data.column_c = fields[2]; | |
145 | cxListAdd(datalist, &data); | |
146 | } | |
147 | ||
148 | // iterate through the list and output the data | |
149 | CxIterator iter = cxListIterator(datalist); | |
150 | cx_foreach(CSVData*, data, iter) { | |
151 | printf("Column A: %.*s | " | |
152 | "Column B: %.*s | " | |
153 | "Column C: %.*s\n", | |
154 | (int)data->column_a.length, data->column_a.ptr, | |
155 | (int)data->column_b.length, data->column_b.ptr, | |
156 | (int)data->column_c.length, data->column_c.ptr | |
157 | ); | |
158 | } | |
159 | ||
160 | // cleanup everything, no manual free() needed | |
161 | cxMempoolFree(pool); | |
162 | ||
163 | return 0; | |
164 | } | |
165 | ``` | |
166 | ||
1168
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
167 | <seealso> |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
168 | <category ref="apidoc"> |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
169 | <a href="https://ucx.sourceforge.io/api/mempool_8h.html">mempool.h</a> |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
170 | </category> |
d92124c8db73
add mempool documentation
Mike Becker <universe@uap-core.de>
parents:
1146
diff
changeset
|
171 | </seealso> |