aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* update todo notesMartin Czygan2021-07-271-2/+22
|
* reuse timestampsMartin Czygan2021-07-271-6/+14
| | | | | | | | | | while time.Now is not really slow, thanks to vDSO (cf. https://git.io/J4SOH), it will be even faster to just call it once at the start of the processing; also: https://twitter.com/davidcrawshaw/status/1414243408936280073 > Turns out http://time.Now was taking its usual amount of time on linux, ~50 nanoseconds [...]
* reduce: explicitly name magic numbersMartin Czygan2021-07-271-3/+8
|
* schema: add note regarding field nameMartin Czygan2021-07-271-1/+1
|
* v0.2.1Martin Czygan2021-07-271-1/+1
|
* schema: tweaksMartin Czygan2021-07-272-5/+112
| | | | add String() to CSLDate; we only cover a few typical cases
* cleanup and docsMartin Czygan2021-07-271-25/+4
|
* reduce: use pascal caseMartin Czygan2021-07-261-2/+2
|
* v0.2.0Martin Czygan2021-07-261-1/+1
| | | | | | | | | | | | lots of tweaks * normalize (eg, lower-case) DOIs in all (or at least most?) situations, especially for equality comparisons * don't try to parse DOI from ref_key (which may contain a source DOI, but not a target DOI) * switch to using date-parts for year in target_csl output * switch from author.name to author.raw_name in target_csl output (neither are standard; raw_name indicates this better) * pass through match_provenance in unmatched case * in target_csl output, don't always include issued and accessed dates as * empty objects (could save significant ES index disk space?)
* switch to sligthly more performance string builderMartin Czygan2021-07-263-43/+41
|
* reduce: mention upcoming change to indexingMartin Czygan2021-07-261-1/+1
| | | | see: scholar:528804ad2e55983cf3e5e6659d8f46db0cab02b7
* Merge branch 'bnewbold-skate-tweaks' into 'master'Martin Czygan2021-07-269-54/+116
|\ | | | | | | | | proposed changes and fixes to skate matching See merge request martin/cgraph!3
| * skate: use SanitizeDOI in all inputsBryan Newbold2021-07-254-22/+9
| |
| * skate: fast SanitizeDOI helper for normalizing DOIsBryan Newbold2021-07-252-0/+71
| |
| * skate unstructured: don't parse DOI out of keyBryan Newbold2021-07-251-16/+0
| | | | | | | | | | | | DOIs in keys, usually from Crossref, are the DOI of the *source* of the reference, not the *target* of the reference. Thus, they should not be parsed and copied to the ref.biblio.doi field.
| * skate: pass-through match_provenance in more situationsBryan Newbold2021-07-251-0/+2
| |
| * schema: switch from '.name' to '.raw_name' for un-parsed CSL name fieldBryan Newbold2021-07-253-6/+6
| |
| * skate: use date-parts for year, not 'raw'Bryan Newbold2021-07-252-8/+9
| |
| * schema: have issued+accessed (CSLDate) actually omitemptyBryan Newbold2021-07-243-5/+5
| | | | | | | | | | Similar to TargetCSL, these should be pointer types so they don't get encoded as empty objects when not set.
| * add test for issued,accessed not being included in output JSONBryan Newbold2021-07-241-0/+17
| |
* | ci: show coverageMartin Czygan2021-07-261-2/+1
| |
* | add ci scriptMartin Czygan2021-07-261-0/+6
|/
* tasks: simplify url list taskMartin Czygan2021-07-231-4/+1
|
* tasks: update docsMartin Czygan2021-07-231-64/+15
|
* fix typo in ref schemaMartin Czygan2021-07-231-1/+1
|
* start mag notesMartin Czygan2021-07-221-0/+21
|
* v0.1.4Martin Czygan2021-07-221-1/+1
|
* update docsMartin Czygan2021-07-221-4/+1
|
* update makefileMartin Czygan2021-07-221-3/+0
|
* apply style fixesMartin Czygan2021-07-222-0/+4
|
* update READMEMartin Czygan2021-07-225-4/+39
|
* cli: show full pathMartin Czygan2021-07-221-1/+1
|
* cli: display TAG directoryMartin Czygan2021-07-221-0/+1
|
* add missing importMartin Czygan2021-07-221-0/+1
|
* add luigi as dependencyMartin Czygan2021-07-221-0/+1
|
* remove reference to gluishMartin Czygan2021-07-221-1/+1
|
* cleanup currently unused dependenciesMartin Czygan2021-07-224-18/+344
| | | | code from gluish copied into base.py
* v0.1.40Martin Czygan2021-07-221-1/+1
|
* cleanup (old) clustering related codeMartin Czygan2021-07-223-177/+39
|
* minor doc fixesMartin Czygan2021-07-212-4/+7
|
* xio: improve namingMartin Czygan2021-07-213-33/+30
|
* reduce: use fixed length sha1 for url id partMartin Czygan2021-07-201-3/+5
| | | | | base32 would occassionally exceed elasticsearch id field limit ("must be no longer than 512 bytes but was: 649")
* tasks: increase default limit for cdxMartin Czygan2021-07-201-1/+1
|
* reduce: fix wb idMartin Czygan2021-07-201-1/+1
|
* reduce: a preliminary id for wb linksMartin Czygan2021-07-201-0/+5
|
* es indexing: update notesMartin Czygan2021-07-201-1/+2
|
* reduce: temp fix 0 source release yearMartin Czygan2021-07-191-1/+4
|
* update notes on es indexingMartin Czygan2021-07-191-0/+11
|
* cleanup another scriptMartin Czygan2021-07-175-311/+72
|
* cleanup skate-bref-idMartin Czygan2021-07-172-42/+1
|
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-24 22:12:08 +0000