blob: 09dee4f30a598aae7d7f471f48e913623154c5ae (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
|
File Ingest Mode: 'component'
=============================
A new ingest type for downloading individual files which are a subset of a
complete work.
Some publishers now assign DOIs to individual figures, supplements, and other
"components" of an over release or document.
Initial mimetypes to allow:
- image/jpeg
- image/tiff
- image/png
- image/gif
- audio/mpeg
- video/mp4
- video/mpeg
- text/plain
- text/csv
- application/json
- application/xml
- application/pdf
- application/gzip
- application/x-bzip
- application/x-bzip2
- application/zip
- application/x-rar
- application/x-7z-compressed
- application/x-tar
- application/vnd.ms-powerpoint
- application/vnd.ms-excel
- application/msword
- application/vnd.openxmlformats-officedocument.wordprocessingml.document
- application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Intentionally not supporting:
- text/html
## Fatcat Changes
In the file importer, allow the additional mimetypes for 'component' ingest.
## Ingest Changes
Allow additional terminal mimetypes for 'component' crawls.
## Examples
Hundreds of thousands: <https://fatcat.wiki/release/search?q=type%3Acomponent+in_ia%3Afalse>
#### ACS Supplement File
<https://doi.org/10.1021/acscatal.0c02627.s002>
Redirects directly to .zip in browser. SPN is blocked by cookie check.
#### Frontiers .docx Supplement
<https://doi.org/10.3389/fpls.2019.01642.s001>
Redirects to full article page. There is a pop-up for figshare, seems hard to process.
#### Figshare Single FIle
<https://doi.org/10.6084/m9.figshare.13646972.v1>
As 'component' type in fatcat.
Redirects to a landing page. Dataset ingest seems more appropriate for this entire domain.
#### PeerJ supplement file
<https://doi.org/10.7717/peerj.10257/supp-7>
PeerJ is hard because it redirects to a single HTML page, which has links to
supplements in the HTML. Perhaps a custom extractor will work.
#### eLife
<https://doi.org/10.7554/elife.38407.010>
The current crawl mechanism makes it seemingly impossible to extract a specific
supplement from the document as a whole.
#### Zookeys
<https://doi.org/10.3897/zookeys.895.38576.figure53>
These are extract-able.
#### OECD PDF Supplement
<https://doi.org/10.1787/f08c6324-en>
<https://www.oecd-ilibrary.org/trade/imports-of-services-billions-of-us-dollars_f08c6324-en>
Has an Excel (.xls) link, great, but then paywall.
#### Direct File Link
<https://doi.org/10.1787/888934207500>
This one is also OECD, but is a simple direct download.
#### Protein Data Base (PDB) Entry
<https://doi.org/10.2210/pdb6ls2/pdb>
Multiple files; dataset/fileset more appropriate for these.
|
