summaryrefslogtreecommitdiffstats
path: root/tests/test_scrub.py
Commit message (Collapse)AuthorAgeFilesLines
* another clean_str() test caseBryan Newbold2020-08-121-0/+4
|
* transform: more string cleaningBryan Newbold2020-08-121-1/+19
|
* scrub_text: single-token strings skippedBryan Newbold2020-08-061-1/+1
|
* start some annotaition fixes for pytypeBryan Newbold2020-06-031-1/+1
|
* flake8-annotation lintingBryan Newbold2020-06-031-1/+1
| | | | Added some new annotations; need to finish more.
* flake8 fixes (partial)Bryan Newbold2020-06-031-2/+0
|
* reformat python code with blackBryan Newbold2020-06-031-3/+4
|
* improve text scrubbingBryan Newbold2020-06-031-0/+15
Was going to use textpipe, but dependency was too large and failed to install with halfway modern GCC (due to CLD2 issue): https://github.com/GregBowyer/cld2-cffi/issues/12 So instead basically pulled out the clean_text function, which is quite short.