aboutsummaryrefslogtreecommitdiffstats
path: root/python/grobid_tool.py
diff options
context:
space:
mode:
authorBryan Newbold <bnewbold@archive.org>2019-10-04 15:23:24 -0700
committerBryan Newbold <bnewbold@archive.org>2019-10-04 15:23:26 -0700
commit055c51a6c4f3a920c4a7eecb5093ffa6e4b64f72 (patch)
treea493781d308244836f24b1d085923c743f91fbf9 /python/grobid_tool.py
parentab1f3fe806e40122a93c975d2253f2c14035952e (diff)
downloadsandcrawler-055c51a6c4f3a920c4a7eecb5093ffa6e4b64f72.tar.gz
sandcrawler-055c51a6c4f3a920c4a7eecb5093ffa6e4b64f72.zip
disable citation consolidation by default
with this consolidation enabled, the glutton_fatcat elasticsearch server was totally pegged over 90% CPU with only 10 PDF worker threads; the glutton load seemed to be the bottleneck even for this low degree of parallelism. Disabled for now, will debug with GROBID/glutton folks.
Diffstat (limited to 'python/grobid_tool.py')
0 files changed, 0 insertions, 0 deletions