diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2018-08-24 12:19:09 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2018-08-24 12:19:09 -0700 |
| commit | f50d4e081f7994a167c4974ee9d3f6e1f8eae478 (patch) | |
| tree | 00cf69ffe345f7766e7477cb9b1f5f7448b4e4fb /match_test_data/NOTES.txt | |
| parent | 344531eb6a5cdd4ea15e4d82050368c5af0eafee (diff) | |
| parent | 5340caad7b39ad29bba77d2a3e486db7a6b1977b (diff) | |
| download | sandcrawler-f50d4e081f7994a167c4974ee9d3f6e1f8eae478.tar.gz sandcrawler-f50d4e081f7994a167c4974ee9d3f6e1f8eae478.zip | |
Merge branch 'bnewbold-match-quality'
Manually resolved merge conflict in:
please
Diffstat (limited to 'match_test_data/NOTES.txt')
| -rw-r--r-- | match_test_data/NOTES.txt | 13 |
1 files changed, 13 insertions, 0 deletions
diff --git a/match_test_data/NOTES.txt b/match_test_data/NOTES.txt new file mode 100644 index 0000000..c72f60a --- /dev/null +++ b/match_test_data/NOTES.txt @@ -0,0 +1,13 @@ + +Converted older .tsv from pdf-extraction comparison work with: + + cat 1k_random_identified_combined.tsv | jq -c --slurp --raw-input --raw-output 'split("\n") | .[:-1] | map(split("\t")) | map({"doi": .[0], "title": .[1], "authors": ( .[2] | split(";") ), "year": .[3], "journal": .[4], "publisher": .[5], "subject": .[6], "type": .[7], "sha": .[8]}) | .[]' > crossref_sample.bibjson + +Note that neither bibjson file is a superset of the either: + + 944 unique SHA1 which exist in both lists + 964 in crossref_sample.sha1 + 979 in grobid_sample.sha1 + +So scoring should be on a basis of "out of 944 lines". If this is confusing we +can trim the files down. |