aboutsummaryrefslogtreecommitdiffstats
path: root/python
Commit message (Collapse)AuthorAgeFilesLines
...
* small fixes to confluent-kafka importers/workersBryan Newbold2019-09-208-26/+69
| | | | | | | | - decrease default changelog pipeline to 5.0sec - fix missing KafkaException harvester imports - more confluent-kafka tweaks - updates to kafka consumer configs - bump elastic updates consumergroup (again)
* update Pipfile.lock after confluent-kafka rebaseBryan Newbold2019-09-201-1/+33
|
* convert pipeline workers from pykafka to confluent-kafkaBryan Newbold2019-09-203-125/+230
|
* small kafka tweaks for robustnessBryan Newbold2019-09-202-0/+5
|
* convert importers to confluent-kafka libraryBryan Newbold2019-09-202-21/+74
|
* bump max message size to ~20 MBytesBryan Newbold2019-09-202-0/+2
|
* fixes to confluent-kafka harvestersBryan Newbold2019-09-203-20/+21
|
* first draft harvesters using confluent-kafkaBryan Newbold2019-09-203-48/+104
|
* make default kafka env 'dev', not 'qa'Bryan Newbold2019-09-202-4/+4
|
* add confluent-kafka library (to replace pykafka)Bryan Newbold2019-09-201-0/+1
|
* handle more external identifiers in pythonBryan Newbold2019-09-182-14/+101
| | | | | This makes it possible to, eg, past an arxiv identifier or SHA-1 hash in the general search box and do a quick lookup.
* webface: fix duration_seconds parsingBryan Newbold2019-09-181-1/+1
|
* add guide editing links to edit forms and signup messageBryan Newbold2019-09-185-5/+26
|
* python webface impl token generationBryan Newbold2019-09-184-1/+85
|
* slightly less annoying 'flash' message headerBryan Newbold2019-09-181-1/+1
|
* remove '@' from archive.org identBryan Newbold2019-09-171-1/+1
|
* IA auth: use itemname not screenname for usernameBryan Newbold2019-09-171-1/+1
| | | | | | | Have run in to several issues with IA screenname being invalid fatcat usernames (eg, containing whitespace). This probably won't catch all such issues, but hopefully most of them.
* skip test_crossref_importer_huge() by defaultBryan Newbold2019-09-131-0/+1
|
* fix coverage of python client libraryBryan Newbold2019-09-131-1/+1
|
* small tweaks to coverage pagesBryan Newbold2019-09-062-1/+2
|
* add python README ref to .env fileBryan Newbold2019-09-051-0/+1
| | | | | For running tests. Perhaps a better solution is setting sane defaults in code? But want to require, eg, secret salts.
* update all other mentions of python client libBryan Newbold2019-09-054-8/+8
|
* refactor all python source for client lib nameBryan Newbold2019-09-0558-229/+229
|
* small fixes to release viewBryan Newbold2019-09-051-14/+24
| | | | | - full width container metadata table accordion - fix "Published in by blah" cases
* fix Importer editgroup_extra pass-throughBryan Newbold2019-09-051-2/+1
|
* container type: journal display as 'Scholarly Journal'Bryan Newbold2019-09-051-1/+1
|
* very conservative Pipfile.lock to fix import bugBryan Newbold2019-09-041-141/+143
| | | | | | | | | | | | When pipenv upgraded all dependencies after installing pygal, tests failed due to errors like: NotImplementedError: Can't perform this operation for unregistered loader type coming from citeproc style code, via `pkg_resource`. Still not sure what the root cause is, as that package itself wasn't upgraded. I tried a bit of bisecting dependency upgrades but nothing obvious was the cause, and a full bisection would take forever.
* remove coverage debug statementsBryan Newbold2019-09-041-10/+0
|
* finish container coverage pageBryan Newbold2019-09-045-29/+110
| | | | Also re-worked container view sidebar a bit more.
* import pygalBryan Newbold2019-09-043-148/+190
|
* start container coverage pageBryan Newbold2019-09-044-2/+104
|
* webface: improve container sidebar styleBryan Newbold2019-09-041-41/+84
|
* clarify default blank form fieldsBryan Newbold2019-09-031-3/+3
|
* include example releases on container landing pageBryan Newbold2019-09-035-81/+137
| | | | | Included making release search results an entity macro (in webface templates).
* do release search by container_id, not issnlBryan Newbold2019-09-032-2/+5
|
* update front-page stats (for containers number)Bryan Newbold2019-09-031-3/+3
|
* comment clarifying container.ident in ES release transformBryan Newbold2019-09-031-0/+2
|
* additional container webface edit fieldsBryan Newbold2019-09-032-9/+36
|
* file rel: social -> academicsocialBryan Newbold2019-09-031-2/+2
|
* fix previous fix (need tests)Bryan Newbold2019-09-031-2/+2
|
* fix typo bug in container ES transformBryan Newbold2019-09-031-2/+2
|
* last chocula import behavior tweaksBryan Newbold2019-09-031-3/+21
|
* webface include webarchive_urls for containersBryan Newbold2019-09-032-1/+6
|
* more careful chocula import counts; don't re-update empty URLsBryan Newbold2019-09-031-2/+6
|
* better importer 'total' countingBryan Newbold2019-09-031-4/+2
|
* chocula importer: include DOAJ updatesBryan Newbold2019-09-031-2/+2
|
* use EZB and szczepanski as OA signals (ES)Bryan Newbold2019-09-031-0/+12
|
* improvements to chocula importerBryan Newbold2019-09-031-1/+7
|
* implement ChoculaImporterBryan Newbold2019-09-032-0/+137
|
* start chocula importerBryan Newbold2019-09-031-0/+14
|