summaryrefslogtreecommitdiffstats
path: root/python/fatcat_tools
Commit message (Expand)AuthorAgeFilesLines
* mergers: fmt, lint, refactorsBryan Newbold2021-11-233-96/+200
* first iteration of mergersBryan Newbold2021-11-233-0/+243
* content_scope: include in file ES schema and transformBryan Newbold2021-11-171-0/+1
* Merge branch 'bnewbold-import-refactors' into 'master'bnewbold2021-11-1118-1462/+811
|\
| * improve lookup_license_slug helper and lookup tableBryan Newbold2021-11-102-56/+62
| * refactor importer metadata tables into separate file; move some helpers aroundBryan Newbold2021-11-1010-702/+682
| * importers: refactor imports of clean() and other normalization helpersBryan Newbold2021-11-1012-95/+104
| * remove cdl_dash_dat and wayback_static importersBryan Newbold2021-11-103-510/+0
| * datacite import: store less subject metadataBryan Newbold2021-11-101-1/+7
| * importers: use clean_doi() in many more (all?) importersBryan Newbold2021-11-096-12/+29
| * clean_doi: stop mutating double-slash DOIs, except for 10.1037 prefixBryan Newbold2021-11-091-1/+2
| * remove deprecated extid sqlite3 lookup table feature from importersBryan Newbold2021-11-093-160/+0
* | Merge branch 'bnewbold-cleanups-nov2021' into 'master'bnewbold2021-11-114-0/+748
|\ \
| * | file/release bugfix: handle files with multiple editsBryan Newbold2021-11-091-6/+6
| * | cleanups: add more state=active checksBryan Newbold2021-11-092-0/+8
| * | update link source filters in file/release bugfixBryan Newbold2021-11-091-2/+8
| * | initial file/release bugfix cleanup worker and notesBryan Newbold2021-11-091-0/+231
| * | updates to lowercase DOI cleanupBryan Newbold2021-11-091-7/+15
| * | lowercase DOI lint and check entity statusBryan Newbold2021-11-091-4/+5
| * | more iteration on short wayback timestamp cleanupBryan Newbold2021-11-091-1/+1
| * | cleanups: tweaks to wayback CDX cleanup scriptsBryan Newbold2021-11-091-5/+13
| * | cleanups: initial lowercase DOI cleanup scriptBryan Newbold2021-11-091-0/+145
| * | wayback short ts: another regression test, and some small fmt/tweaksBryan Newbold2021-11-091-3/+38
| * | wayback cleanup: actually update entityBryan Newbold2021-11-091-2/+4
| * | imports: generic file cleanup removes exact duplicate URLsBryan Newbold2021-11-091-0/+9
| * | wayback short ts: add regression test for dupe URLsBryan Newbold2021-11-091-0/+44
| * | short wayback ts: initial cleanup script implementationBryan Newbold2021-11-091-0/+251
| |/
* / pubmed: allow updates if PMCID does not exist yetBryan Newbold2021-11-101-1/+6
|/
* cleanups: create a separate JsonLinePusher for cleanup workers (distinct base...Bryan Newbold2021-11-032-2/+19
* datacite importer: remove unused 'year_only' variableBryan Newbold2021-11-031-2/+3
* pubmed harvester: remove unused variablesBryan Newbold2021-11-031-2/+2
* pubmed harvester: explicit assertions to mark unreachable code pathsBryan Newbold2021-11-031-0/+2
* typing: add assertions to fatcat_tool code to make type assumptions explicitBryan Newbold2021-11-033-0/+3
* typing: add annotations to remaining fatcat_tools codeBryan Newbold2021-11-039-122/+186
* datacite: add comment about potential date parsing bugBryan Newbold2021-11-031-0/+1
* datacite importer: dateparser.date.DateDataParser()Bryan Newbold2021-11-031-1/+1
* more involved type wrangling and fixes for importersBryan Newbold2021-11-033-12/+14
* typing: relatively simple type check fixesBryan Newbold2021-11-0314-87/+82
* typing: initial annotations on importersBryan Newbold2021-11-0322-274/+443
* typing: first batch of python bulk type annotationsBryan Newbold2021-11-039-69/+129
* importers: remove unused __main__ routineBryan Newbold2021-11-034-19/+0
* lint: resolve existing mypy type errorsBryan Newbold2021-11-028-50/+86
* re-fix some lint issues after big 'fmt'Bryan Newbold2021-11-022-4/+5
* fmt (black): fatcat_tools/Bryan Newbold2021-11-0243-3194/+4020
* python: isort everythingBryan Newbold2021-11-0232-71/+116
* arabesque import 'hit' field is 1/0, not true/falseBryan Newbold2021-11-021-2/+2
* lint: simple, safe inline lint fixesBryan Newbold2021-11-0218-83/+82
* lint/fmt: remove all 'import *'Bryan Newbold2021-11-025-21/+41
* entity transforms: add basic type annotationsBryan Newbold2021-11-021-7/+19
* ftfy 'fix_entities' argument has been renamedBryan Newbold2021-11-021-4/+4
generated by cgit v1.2.3 (git 2.39.1) at 2024-12-17 21:46:31 +0000