diff options
author | Martin Czygan <martin.czygan@gmail.com> | 2021-07-10 12:41:00 +0200 |
---|---|---|
committer | Martin Czygan <martin.czygan@gmail.com> | 2021-07-10 12:41:00 +0200 |
commit | ad8a18332a0bd32a3bf7dd1e045c31dcd99ba237 (patch) | |
tree | 311bed35e6cfd0ab656c70bbb94e10f801d7dab1 /notes/misc.md | |
parent | 09fe6b8b63cb16e71a05b7b9480ef46d34009456 (diff) | |
download | refcat-ad8a18332a0bd32a3bf7dd1e045c31dcd99ba237.tar.gz refcat-ad8a18332a0bd32a3bf7dd1e045c31dcd99ba237.zip |
reduce: short circuit large groups
we saw a jump in memory usage, and it may be related to groups with
thousands of elements; e.g. maybe some weird string, that appears too
many times as key, e.g. 123/test; as a first measure, we sort circuit
further batching; other mitigiation may to be limit groups size
completely
Diffstat (limited to 'notes/misc.md')
0 files changed, 0 insertions, 0 deletions