diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2019-10-04 15:23:24 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2019-10-04 15:23:26 -0700 |
| commit | 055c51a6c4f3a920c4a7eecb5093ffa6e4b64f72 (patch) | |
| tree | a493781d308244836f24b1d085923c743f91fbf9 /python_hadoop/grobid2json.py | |
| parent | ab1f3fe806e40122a93c975d2253f2c14035952e (diff) | |
| download | sandcrawler-055c51a6c4f3a920c4a7eecb5093ffa6e4b64f72.tar.gz sandcrawler-055c51a6c4f3a920c4a7eecb5093ffa6e4b64f72.zip | |
disable citation consolidation by default
with this consolidation enabled, the glutton_fatcat elasticsearch server
was totally pegged over 90% CPU with only 10 PDF worker threads; the
glutton load seemed to be the bottleneck even for this low degree of
parallelism. Disabled for now, will debug with GROBID/glutton folks.
Diffstat (limited to 'python_hadoop/grobid2json.py')
0 files changed, 0 insertions, 0 deletions