blob: 2d0c7e3b144aea811df9804e5ed28c4c5df5ac2d (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
|
## Chocula
priorities:
x fraction/which are pointing to wayback
- coverage stats, particularly for longtail
x wikidata linkage (prep for wikimania)
- "still in print" flag
- clean out invalid ISSN-L from fatcat
- don't list dead URLs in fatcat
- summary report of some of above
- update all fatcat (wikidata QID, urls, fixed ISSN-L, etc)
- when updating fatcat:
if title is "blah, Proceedings of the", set type to proceedings and re-write title
if title like "Workshop on", set type
source improvements:
- entrez: "NLM Unique Id"
- JUFO: finish
- crossref: empty string identifiers?
- public scopus list (?)
- scrape/munge public clarivate dumps
- import JURN into fatcat (one way or another)
=> try to title match and get ISSN-L
=> manual lookups for remainders?
- dump json
- "GOLD" importer (for scopus/WoS)
- check that all fields actually getting imported reasonably
- homepage crawl/status script
- could poll portal.issn.org like:
https://portal.issn.org/resource/ISSN/1561-7645?format=json
would require a good deal of munging (eg, MARC region -> ISO)
- KBART imports (with JSON, so only a single row per slug)
- imprint/publisher distinction (publisher is big group)
- summary table should be superset of fatcat table
- add timestamp columns to enable updates?
- fatcat export (filters for changes to make, writes out as JSON)
- update_url_status (needs re-write)
- log out index issues (duplicate ISSN-L, etc) to a file
- validate against GOLD OA list
- decide what to do with JURN... match? fuzzy match? create missing fatcat?
- lots of bogus ISSN-L, like 9999-9999 or 0000-0000. should both validate
check digit and require an ISSN-L to actually exist.
|
