diff options
| author | Martin Czygan <martin.czygan@gmail.com> | 2021-07-10 12:41:00 +0200 |
|---|---|---|
| committer | Martin Czygan <martin.czygan@gmail.com> | 2021-07-10 12:41:00 +0200 |
| commit | ad8a18332a0bd32a3bf7dd1e045c31dcd99ba237 (patch) | |
| tree | 311bed35e6cfd0ab656c70bbb94e10f801d7dab1 /skate/cmd/skate-conv | |
| parent | 09fe6b8b63cb16e71a05b7b9480ef46d34009456 (diff) | |
| download | refcat-ad8a18332a0bd32a3bf7dd1e045c31dcd99ba237.tar.gz refcat-ad8a18332a0bd32a3bf7dd1e045c31dcd99ba237.zip | |
reduce: short circuit large groups
we saw a jump in memory usage, and it may be related to groups with
thousands of elements; e.g. maybe some weird string, that appears too
many times as key, e.g. 123/test; as a first measure, we sort circuit
further batching; other mitigiation may to be limit groups size
completely
Diffstat (limited to 'skate/cmd/skate-conv')
0 files changed, 0 insertions, 0 deletions