aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
...
* note on timingsMartin Czygan2021-07-082-1/+9
|
* update docsMartin Czygan2021-07-081-3/+3
|
* reduce: set default batch sizeMartin Czygan2021-07-081-6/+8
|
* simplify importsMartin Czygan2021-07-089-9/+9
|
* reduce: separate batch callsMartin Czygan2021-07-082-20/+25
|
* fix merge conflictMartin Czygan2021-07-078-82/+136
|\
| * update docsMartin Czygan2021-07-071-3/+8
| |
| * skate: no need for aliasMartin Czygan2021-07-071-1/+1
| |
| * add WikipediaDOIMartin Czygan2021-07-071-0/+43
| |
| * do not compress sort tmp filesMartin Czygan2021-07-061-21/+21
| |
| * run a parity derivationMartin Czygan2021-07-061-2/+2
| |
| * util: cleanup encoderMartin Czygan2021-07-061-19/+0
| |
| * reduce: remove log lineMartin Czygan2021-07-061-1/+0
| |
| * reduce: move to threaded versionsMartin Czygan2021-07-061-25/+30
| |
| * add resource usage noteMartin Czygan2021-07-061-1/+1
| |
| * wip: improve reduce performanceMartin Czygan2021-07-061-50/+8
| |
| * batcher: do not pass struct fieldsMartin Czygan2021-07-051-4/+4
| |
| * wip: debug with stdlib jsonMartin Czygan2021-07-051-1/+3
| |
| * we need a safe encoder, not just a safe writerMartin Czygan2021-07-052-1/+20
| |
| * v0.1.37Martin Czygan2021-07-051-1/+1
| |
| * reduce: hard-code batch size for testingMartin Czygan2021-07-051-0/+1
| |
| * test-run: batch reduce processing for performanceMartin Czygan2021-07-051-4/+6
| |
| * add thread safe writerMartin Czygan2021-07-051-0/+20
| |
| * use canonical variable namesMartin Czygan2021-07-051-11/+11
| |
| * reduce: reduce allocationsMartin Czygan2021-07-051-5/+24
| |
| * use most sensible file nameMartin Czygan2021-07-052-0/+0
| | | | | | | | * we have map, so we should have reduce
* | tasks: get rid of compress program for nowMartin Czygan2021-07-051-21/+21
|/ | | | | | | * we'd need the -T0 flag, something we cannot pass directly to --compress-program * unexpectedly, as is, this did not yield the usual cpu/io performance benefits
* update docsMartin Czygan2021-07-041-1/+8
|
* zipkey: add batch testMartin Czygan2021-07-042-3/+64
|
* Merge branch 'master' of git.archive.org:martin/cgraphMartin Czygan2021-07-042-0/+101
|\ | | | | | | | | * 'master' of git.archive.org:martin/cgraph: wip: batch reducers
| * wip: batch reducersMartin Czygan2021-07-042-0/+101
| |
* | set: no extra slice requiredMartin Czygan2021-07-031-3/+3
| |
* | refcat: remove unused codeMartin Czygan2021-07-032-288/+0
|/
* update docsMartin Czygan2021-07-032-23/+44
|
* remove obsolete fileMartin Czygan2021-07-031-21/+0
|
* refcat v0.1.3Martin Czygan2021-07-031-1/+1
|
* tasks: compress tmp filesMartin Czygan2021-07-031-21/+21
|
* update on data issuesMartin Czygan2021-07-031-0/+8
|
* cleanup obsolete dirMartin Czygan2021-07-031-3/+0
|
* update OL READMEMartin Czygan2021-07-031-2/+5
|
* cleanup link lookup filesMartin Czygan2021-07-033-5367/+0
|
* update READMEMartin Czygan2021-07-031-2/+4
|
* update notes on dotMartin Czygan2021-07-033-61/+80
|
* update extra READMEMartin Czygan2021-07-031-3/+27
|
* parallel is set to min(num cpus, 8) by defaultMartin Czygan2021-07-031-21/+21
| | | | | | | | | > Set the number of sorts run in parallel to n. By default, n is set to the number of available processors, but limited to 8, as there are diminishing performance gains after that. Note also that using n threads increases the memory usage by a factor of log n. http://www.gnu.org/software/coreutils/manual/html_node/sort-invocation.html
* reduce allocations during bref encodingMartin Czygan2021-07-032-5/+48
|
* Merge branch 'bnewbold-readme' into 'master'Martin Czygan2021-07-022-67/+82
|\ | | | | | | | | updates to README for public sharing See merge request martin/cgraph!2
| * updates to README for public sharingBryan Newbold2021-07-012-67/+82
| |
* | update ignoresMartin Czygan2021-07-021-0/+1
|/
* wip: shorter ol namesMartin Czygan2021-07-011-0/+14
|
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-26 01:25:47 +0000