fatcat-scholar/tests, branch x-attic-rescore Unnamed repository; edit this file 'description' to name the repository. https://git.bnewbold.net/fatcat-scholar/atom?h=x-attic-rescore 2020-08-12T20:23:57+00:00 another clean_str() test case 2020-08-12T20:23:57+00:00 Bryan Newbold bnewbold@archive.org 2020-08-12T20:23:57+00:00 urn:sha1:cfdea6c069d2a97139ddcbb08efa4aea43230f0f transform: more string cleaning 2020-08-12T19:27:34+00:00 Bryan Newbold bnewbold@archive.org 2020-08-12T19:27:34+00:00 urn:sha1:3260b880c0003b7d55bd026b9f1d259256648b0e scrub_text: single-token strings skipped 2020-08-07T02:01:12+00:00 Bryan Newbold bnewbold@archive.org 2020-08-06T22:35:09+00:00 urn:sha1:8b51716fa6bb66f1ac3cf75ce5b64b4138e5935e start some annotaition fixes for pytype 2020-06-04T06:58:38+00:00 Bryan Newbold bnewbold@archive.org 2020-06-04T06:58:38+00:00 urn:sha1:649913ba9fbab8e9b7b428dec6526797c5b1c532 flake8-annotation linting 2020-06-04T06:30:46+00:00 Bryan Newbold bnewbold@archive.org 2020-06-04T06:30:44+00:00 urn:sha1:4c90b94c24e9e78382d12947fb27c203318d6c9c Added some new annotations; need to finish more. flake8 fixes (partial) 2020-06-04T06:16:07+00:00 Bryan Newbold bnewbold@archive.org 2020-06-04T06:16:07+00:00 urn:sha1:62fde540ef9c38d403ea89a6fb1db51bfba23da8 reformat python code with black 2020-06-04T05:46:16+00:00 Bryan Newbold bnewbold@archive.org 2020-06-04T05:46:16+00:00 urn:sha1:62d3299471b7b4229ae63e21e9d45ef7efde4348 improve text scrubbing 2020-06-04T02:32:50+00:00 Bryan Newbold bnewbold@archive.org 2020-06-04T02:30:15+00:00 urn:sha1:f9035c7ca9637668911afa7e9345138563aad33e Was going to use textpipe, but dependency was too large and failed to install with halfway modern GCC (due to CLD2 issue): https://github.com/GregBowyer/cld2-cffi/issues/12 So instead basically pulled out the clean_text function, which is quite short. first pass transform from pipelines to ES schema 2020-05-20T20:27:55+00:00 Bryan Newbold bnewbold@archive.org 2020-05-20T20:27:55+00:00 urn:sha1:f2c465fffc76ca752249e11d32673db43efc35f1 initial progress on work pipeline 2020-05-17T02:55:17+00:00 Bryan Newbold bnewbold@archive.org 2020-05-17T02:52:17+00:00 urn:sha1:0abb779be2cd6fc913f3c57d891b040b40baf6c3