diff options
Diffstat (limited to 'reports')
| -rw-r--r-- | reports/report.2020-07-09.html | 1226 | ||||
| -rw-r--r-- | reports/report_template.md | 25 |
2 files changed, 1245 insertions, 6 deletions
diff --git a/reports/report.2020-07-09.html b/reports/report.2020-07-09.html new file mode 100644 index 0000000..629b5bf --- /dev/null +++ b/reports/report.2020-07-09.html @@ -0,0 +1,1226 @@ +<h1>Fatcat "Chocula" Journal Metadata Summary</h1> +<p>This report is auto-generated from a sqlite database file, which should be available/included.</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>datetime('now')</th> +</tr></thead> +<tr> + <td>2020-07-09 02:41:48</td> +</tr> +</table><pre><b>QUERY:</b> SELECT datetime('now');</pre> +<br></code></div><p>Note that pretty much all of the fatcat release stats are on a <em>release</em>, not +<em>work</em> basis, so there may be over-counting. Also, as of July 2019 there were +over 1.5 million OA longtail releases which are <em>not</em> linked to a container +(journal).</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>seq</th> + <th>name</th> + <th>file</th> +</tr></thead> +<tr> + <td>0</td> + <td>main</td> + <td>/home/bnewbold/code/chocula/chocula.sqlite</td> +</tr> +</table><pre><b>QUERY:</b> PRAGMA database_list;</pre> +<br></code></div><h2>Overview</h2> +<p>Top publishers by journal count:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>publisher</th> + <th>COUNT(*)</th> +</tr></thead> +<tr> + <td></td> + <td>50321</td> +</tr> +<tr> + <td>Elsevier</td> + <td>4909</td> +</tr> +<tr> + <td>Springer</td> + <td>3180</td> +</tr> +<tr> + <td>Taylor & Francis</td> + <td>3049</td> +</tr> +<tr> + <td>John Wiley & Sons, Inc</td> + <td>2325</td> +</tr> +<tr> + <td>SAGE Publications</td> + <td>1442</td> +</tr> +<tr> + <td>J-STAGE</td> + <td>1406</td> +</tr> +<tr> + <td>Peter Lang International Academic Publishers</td> + <td>1356</td> +</tr> +<tr> + <td>SciELO</td> + <td>1188</td> +</tr> +<tr> + <td>Informa UK (Taylor & Francis)</td> + <td>738</td> +</tr> +<tr> + <td>Springer-Verlag</td> + <td>707</td> +</tr> +<tr> + <td>Cambridge University Press</td> + <td>598</td> +</tr> +<tr> + <td>Walter de Gruyter GmbH</td> + <td>553</td> +</tr> +<tr> + <td>Georg Thieme Verlag KG</td> + <td>515</td> +</tr> +<tr> + <td>OMICS Publishing Group</td> + <td>497</td> +</tr> +<tr> + <td>IEEE, Inc</td> + <td>483</td> +</tr> +<tr> + <td>Medknow Publications</td> + <td>473</td> +</tr> +<tr> + <td>JSTOR</td> + <td>469</td> +</tr> +<tr> + <td>Oxford University Press</td> + <td>461</td> +</tr> +<tr> + <td>Hindawi</td> + <td>456</td> +</tr> +<tr> + <td>Bentham Science</td> + <td>445</td> +</tr> +<tr> + <td>De Gruyter Open Sp. z o.o.</td> + <td>442</td> +</tr> +<tr> + <td>Wolters Kluwer Health</td> + <td>427</td> +</tr> +<tr> + <td>CAIRN</td> + <td>416</td> +</tr> +<tr> + <td>Egypts Presidential Specialized Council for Education and Scientific Research</td> + <td>402</td> +</tr> +</table><pre><b>QUERY:</b> SELECT publisher, COUNT(*) +FROM journal +GROUP BY publisher +ORDER BY COUNT(*) DESC +LIMIT 25;</pre> +<br></code></div><p>Top countries by number of journals:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>country</th> + <th>COUNT(*)</th> +</tr></thead> +<tr> + <td>us</td> + <td>31066</td> +</tr> +<tr> + <td></td> + <td>12064</td> +</tr> +<tr> + <td>id</td> + <td>10204</td> +</tr> +<tr> + <td>de</td> + <td>8220</td> +</tr> +<tr> + <td>in</td> + <td>7491</td> +</tr> +<tr> + <td>gb</td> + <td>7358</td> +</tr> +<tr> + <td>fr</td> + <td>6947</td> +</tr> +<tr> + <td>uk</td> + <td>5988</td> +</tr> +<tr> + <td>nl</td> + <td>5579</td> +</tr> +<tr> + <td>br</td> + <td>4783</td> +</tr> +</table><pre><b>QUERY:</b> SELECT country, +COUNT(*) +FROM journal +GROUP BY country +ORDER BY COUNT(*) DESC +LIMIT 10;</pre> +<br></code></div><p>.. by number of papers:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>country</th> + <th>COUNT(*)</th> + <th>SUM(release_count)</th> +</tr></thead> +<tr> + <td>us</td> + <td>31066</td> + <td>32295341</td> +</tr> +<tr> + <td>gb</td> + <td>7358</td> + <td>13562766</td> +</tr> +<tr> + <td>nl</td> + <td>5579</td> + <td>11027952</td> +</tr> +<tr> + <td>de</td> + <td>8220</td> + <td>7555626</td> +</tr> +<tr> + <td>jp</td> + <td>3924</td> + <td>5538593</td> +</tr> +<tr> + <td>uk</td> + <td>5988</td> + <td>4672277</td> +</tr> +<tr> + <td>fr</td> + <td>6947</td> + <td>2211672</td> +</tr> +<tr> + <td>ch</td> + <td>2184</td> + <td>1973488</td> +</tr> +<tr> + <td>ru</td> + <td>3322</td> + <td>1447208</td> +</tr> +<tr> + <td>in</td> + <td>7491</td> + <td>1206194</td> +</tr> +</table><pre><b>QUERY:</b> SELECT country, +COUNT(*), +SUM(release_count) +FROM journal +GROUP BY country +ORDER BY SUM(release_count) DESC +LIMIT 10;</pre> +<br></code></div><p>Top languages by number of journals:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>lang</th> + <th>COUNT(*)</th> +</tr></thead> +<tr> + <td></td> + <td>119624</td> +</tr> +<tr> + <td>en</td> + <td>33516</td> +</tr> +<tr> + <td>fr</td> + <td>2545</td> +</tr> +<tr> + <td>es</td> + <td>1986</td> +</tr> +<tr> + <td>pt</td> + <td>1278</td> +</tr> +<tr> + <td>id</td> + <td>810</td> +</tr> +<tr> + <td>fa</td> + <td>705</td> +</tr> +<tr> + <td>de</td> + <td>687</td> +</tr> +<tr> + <td>ja</td> + <td>627</td> +</tr> +<tr> + <td>ru</td> + <td>455</td> +</tr> +</table><pre><b>QUERY:</b> SELECT lang, +COUNT(*) +FROM journal +GROUP BY lang +ORDER BY COUNT(*) DESC +LIMIT 10;</pre> +<br></code></div><p>... by number of papers:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>lang</th> + <th>COUNT(*)</th> + <th>SUM(release_count)</th> +</tr></thead> +<tr> + <td>en</td> + <td>33516</td> + <td>52300274</td> +</tr> +<tr> + <td></td> + <td>119624</td> + <td>39741739</td> +</tr> +<tr> + <td>de</td> + <td>687</td> + <td>1081202</td> +</tr> +<tr> + <td>ja</td> + <td>627</td> + <td>701129</td> +</tr> +<tr> + <td>fr</td> + <td>2545</td> + <td>460774</td> +</tr> +<tr> + <td>es</td> + <td>1986</td> + <td>328252</td> +</tr> +<tr> + <td>pt</td> + <td>1278</td> + <td>265893</td> +</tr> +<tr> + <td>ru</td> + <td>455</td> + <td>236151</td> +</tr> +<tr> + <td>it</td> + <td>365</td> + <td>107943</td> +</tr> +<tr> + <td>id</td> + <td>810</td> + <td>64503</td> +</tr> +</table><pre><b>QUERY:</b> SELECT lang, +COUNT(*), +SUM(release_count) +FROM journal +GROUP BY lang +ORDER BY SUM(release_count) DESC +LIMIT 10;</pre> +<br></code></div><h2>Fatcat Fulltext Coverage</h2> +<p>Fulltext coverage by publisher type:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>publisher_type</th> + <th>AVG(ia_frac)</th> + <th>AVG(preserved_frac)</th> + <th>journal_count</th> + <th>paper_count</th> +</tr></thead> +<tr> + <td>big5</td> + <td>0.20272243401354267</td> + <td>0.7452170162730414</td> + <td>14358</td> + <td>39085852</td> +</tr> +<tr> + <td>society</td> + <td>0.3794377091020545</td> + <td>0.5217607884865395</td> + <td>11622</td> + <td>17531161</td> +</tr> +<tr> + <td></td> + <td>0.28508193524461156</td> + <td>0.39013178488749245</td> + <td>76634</td> + <td>17473701</td> +</tr> +<tr> + <td>unipress</td> + <td>0.5255733733184424</td> + <td>0.710093694843418</td> + <td>8238</td> + <td>6014361</td> +</tr> +<tr> + <td>commercial</td> + <td>0.3310478193432686</td> + <td>0.6774676406235399</td> + <td>5908</td> + <td>5794436</td> +</tr> +<tr> + <td>longtail</td> + <td>0.6956529253337449</td> + <td>0.7448822575700694</td> + <td>42814</td> + <td>5612002</td> +</tr> +<tr> + <td>repository</td> + <td>0.12340474682980347</td> + <td>0.24038109564241453</td> + <td>765</td> + <td>1037428</td> +</tr> +<tr> + <td>scielo</td> + <td>0.8187897515991598</td> + <td>0.8475283307664541</td> + <td>1589</td> + <td>935919</td> +</tr> +<tr> + <td>other</td> + <td>0.1772382118883935</td> + <td>0.629416843982798</td> + <td>956</td> + <td>852087</td> +</tr> +<tr> + <td>archive</td> + <td>0.32858477978955963</td> + <td>0.9868821710035494</td> + <td>543</td> + <td>727385</td> +</tr> +<tr> + <td>oa</td> + <td>0.7674000144839934</td> + <td>0.8021162061188577</td> + <td>1854</td> + <td>669492</td> +</tr> +</table><pre><b>QUERY:</b> SELECT publisher_type, +AVG(ia_frac), +AVG(preserved_frac), +COUNT(*) AS journal_count, +SUM(release_count) AS paper_count +FROM journal +GROUP BY publisher_type +ORDER BY SUM(release_count) DESC;</pre> +<br></code></div><p>Top publishers with very little coverage:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>publisher</th> + <th>journal_count</th> + <th>AVG(ia_frac)</th> +</tr></thead> +<tr> + <td></td> + <td>9641</td> + <td>0.0017593496094944628</td> +</tr> +<tr> + <td>Elsevier</td> + <td>1891</td> + <td>0.017255730382637596</td> +</tr> +<tr> + <td>Taylor & Francis</td> + <td>1041</td> + <td>0.026388684277766576</td> +</tr> +<tr> + <td>J-STAGE</td> + <td>1000</td> + <td>0.008786544945748286</td> +</tr> +<tr> + <td>John Wiley & Sons, Inc</td> + <td>763</td> + <td>0.021697556560790764</td> +</tr> +<tr> + <td>Informa UK (Taylor & Francis)</td> + <td>586</td> + <td>0.01002503920645208</td> +</tr> +<tr> + <td>SAGE Publications</td> + <td>568</td> + <td>0.018712710467758988</td> +</tr> +<tr> + <td>Springer-Verlag</td> + <td>385</td> + <td>0.015267708054728164</td> +</tr> +<tr> + <td>Springer</td> + <td>359</td> + <td>0.025752583122217714</td> +</tr> +<tr> + <td>JSTOR</td> + <td>270</td> + <td>0.010432032891517822</td> +</tr> +</table><pre><b>QUERY:</b> SELECT publisher, +COUNT(*) AS journal_count, +AVG(ia_frac) +FROM journal +WHERE ia_frac < 0.05 +GROUP BY publisher +ORDER BY journal_count DESC +LIMIT 10;</pre> +<br></code></div><p>Amount of fulltext by SHERPA/ROMEO journal color::</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>sherpa_color</th> + <th>SUM(ia_count)</th> +</tr></thead> +<tr> + <td></td> + <td>8203410</td> +</tr> +<tr> + <td>blue</td> + <td>1071423</td> +</tr> +<tr> + <td>green</td> + <td>10304362</td> +</tr> +<tr> + <td>white</td> + <td>732457</td> +</tr> +<tr> + <td>yellow</td> + <td>2490476</td> +</tr> +</table><pre><b>QUERY:</b> SELECT sherpa_color, +SUM(ia_count) +FROM journal +GROUP BY sherpa_color;</pre> +<br></code></div><h2>Journal Homepages</h2> +<p>Homepage URL counts:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>unique_urls</th> + <th>journals_with_hompages</th> +</tr></thead> +<tr> + <td>188588</td> + <td>118879</td> +</tr> +</table><pre><b>QUERY:</b> SELECT COUNT(DISTINCT surt) as unique_urls, COUNT(DISTINCT issnl) as journals_with_hompages FROM homepage;</pre> +<br></code></div><p>Journal counts by homepage status:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>any_homepage</th> + <th>any_live_homepage</th> + <th>any_gwb_homepage</th> + <th>COUNT(*)</th> + <th>frac</th> +</tr></thead> +<tr> + <td>0</td> + <td>0</td> + <td>0</td> + <td>46402</td> + <td>0.28</td> +</tr> +<tr> + <td>1</td> + <td>0</td> + <td>0</td> + <td>12882</td> + <td>0.08</td> +</tr> +<tr> + <td>1</td> + <td>0</td> + <td>1</td> + <td>10266</td> + <td>0.06</td> +</tr> +<tr> + <td>1</td> + <td>1</td> + <td>0</td> + <td>8721</td> + <td>0.05</td> +</tr> +<tr> + <td>1</td> + <td>1</td> + <td>1</td> + <td>87010</td> + <td>0.53</td> +</tr> +</table><pre><b>QUERY:</b> SELECT any_homepage, any_live_homepage, any_gwb_homepage, COUNT(*), ROUND(1.0 * COUNT(*) / (SELECT COUNT(*) FROM journal), 2) AS frac FROM journal GROUP BY any_homepage, any_live_homepage, any_gwb_homepage;</pre> +<br></code></div><p>Number of unique journals that have a homepage pointing to wayback or archive.org:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>COUNT(DISTINCT issnl)</th> +</tr></thead> +<tr> + <td>1453</td> +</tr> +</table><pre><b>QUERY:</b> SELECT COUNT(DISTINCT issnl) FROM homepage WHERE domain = 'archive.org';</pre> +<br></code></div><p>Journals with the most homepage URLs:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>issnl</th> + <th>COUNT(*)</th> +</tr></thead> +<tr> + <td>0036-6439</td> + <td>21</td> +</tr> +<tr> + <td>1487-0614</td> + <td>16</td> +</tr> +<tr> + <td>2375-0383</td> + <td>16</td> +</tr> +<tr> + <td>2374-4030</td> + <td>15</td> +</tr> +<tr> + <td>0097-6326</td> + <td>14</td> +</tr> +<tr> + <td>0749-405X</td> + <td>13</td> +</tr> +<tr> + <td>1521-9097</td> + <td>13</td> +</tr> +<tr> + <td>0009-7004</td> + <td>12</td> +</tr> +<tr> + <td>0030-7076</td> + <td>12</td> +</tr> +<tr> + <td>0717-554X</td> + <td>12</td> +</tr> +</table><pre><b>QUERY:</b> SELECT issnl, +COUNT(*) +FROM homepage +GROUP BY issnl +ORDER BY COUNT(*) DESC +LIMIT 10;</pre> +<br></code></div><p>Top/redundant URLs and SURTs:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>surt</th> + <th>COUNT(*)</th> +</tr></thead> +<tr> + <td>com,indianjournals)/</td> + <td>80</td> +</tr> +<tr> + <td>com,hindawi)/</td> + <td>71</td> +</tr> +<tr> + <td>au,com,informit,search)/search;res=apaft</td> + <td>64</td> +</tr> +<tr> + <td>com,umi)/pqdauto</td> + <td>51</td> +</tr> +<tr> + <td>org,rsc,pubs)/en/ebooks</td> + <td>50</td> +</tr> +<tr> + <td>com,umi)/proquest</td> + <td>48</td> +</tr> +<tr> + <td>org,ieee,ieeexplore)/xplore/conferences.jsp</td> + <td>40</td> +</tr> +<tr> + <td>org,omicsonline)/</td> + <td>37</td> +</tr> +<tr> + <td>com,idealibrary)/</td> + <td>36</td> +</tr> +<tr> + <td>com,wiley,interscience)/</td> + <td>31</td> +</tr> +</table><pre><b>QUERY:</b> SELECT surt, +COUNT(*) +FROM homepage +GROUP BY surt +ORDER BY COUNT(*) DESC +LIMIT 10;</pre> +<br></code></div><p>What is the deal with all those "benjamins" URLs?</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>publisher</th> + <th>name</th> +</tr></thead> +<tr> + <td>John Benjamins Publishing Company</td> + <td>NOWELE</td> +</tr> +<tr> + <td></td> + <td>Studia Uralo-Altaica</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Language Problems and Language Planning</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Lingvisticæ investigationes</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Linguistics of the TIbeto-Burman Area</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Pragmatics & Cognition</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Terminology</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Written Language & Literacy</td> +</tr> +<tr> + <td></td> + <td>FORUM: Revue internationale d?interprétation et de traduction / International Journal of Interpretation and Translation</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>English Text Construction</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Constructions and Frames</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Pragmatics and Society</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Translation and Interpreting Studies</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Language and Dialogue</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Metaphor in Language, Cognition, and Communication</td> +</tr> +<tr> + <td></td> + <td>Hamburg Studies on Linguistic Diversity</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Translation Spaces</td> +</tr> +<tr> + <td></td> + <td>Studies in Arabic Linguistics</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Journal of Immersion and Content-Based Language Education (JICB)</td> +</tr> +<tr> + <td></td> + <td>Children's Literature, Culture, and Cognition</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Journal of Language Aggression and Conflict</td> +</tr> +<tr> + <td></td> + <td>FILLM Studies in Languages and Literatures</td> +</tr> +<tr> + <td></td> + <td>Advances in Historical Sociolinguistics</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Linguistic Landscape</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>International Journal of Learner Corpus Research</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Journal of Second Language Pronunciation</td> +</tr> +<tr> + <td></td> + <td>ITL - International Journal of Applied Linguistics</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Cognitive Individual Differences in Second Language Processing and Acquisition</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>FORUM</td> +</tr> +<tr> + <td>John Benjamins Publishing Company</td> + <td>Studies in Germanic Linguistics</td> +</tr> +</table><pre><b>QUERY:</b> SELECT publisher, +name +FROM journal +LEFT JOIN homepage ON journal.issnl = homepage.issnl +WHERE homepage.surt = 'com,benjamins)/';</pre> +<br></code></div><p>Domains that block us:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>domain</th> + <th>journal_homepages</th> + <th>SUM(blocked)</th> +</tr></thead> +<tr> + <td>jstor.org</td> + <td>7674</td> + <td>7507</td> +</tr> +<tr> + <td>tandfonline.com</td> + <td>4568</td> + <td>4505</td> +</tr> +<tr> + <td>wiley.com</td> + <td>4289</td> + <td>721</td> +</tr> +<tr> + <td>informahealthcare.com</td> + <td>221</td> + <td>220</td> +</tr> +<tr> + <td>brill.nl</td> + <td>234</td> + <td>164</td> +</tr> +<tr> + <td>bentham.org</td> + <td>152</td> + <td>149</td> +</tr> +<tr> + <td>computer.org</td> + <td>143</td> + <td>64</td> +</tr> +<tr> + <td>ucpress.edu</td> + <td>64</td> + <td>59</td> +</tr> +<tr> + <td>dekker.com</td> + <td>48</td> + <td>47</td> +</tr> +<tr> + <td>uem.br</td> + <td>49</td> + <td>42</td> +</tr> +<tr> + <td>maney.co.uk</td> + <td>41</td> + <td>41</td> +</tr> +<tr> + <td>ingentaconnect.com</td> + <td>417</td> + <td>31</td> +</tr> +<tr> + <td>heldref.org</td> + <td>25</td> + <td>25</td> +</tr> +<tr> + <td>amcity.com</td> + <td>23</td> + <td>23</td> +</tr> +<tr> + <td>managementjournals.com</td> + <td>19</td> + <td>19</td> +</tr> +<tr> + <td>ucpressjournals.com</td> + <td>19</td> + <td>19</td> +</tr> +<tr> + <td>ametsoc.org</td> + <td>32</td> + <td>18</td> +</tr> +<tr> + <td>mdconsult.com</td> + <td>27</td> + <td>17</td> +</tr> +<tr> + <td>ikpress.org</td> + <td>18</td> + <td>16</td> +</tr> +<tr> + <td>rodopi.nl</td> + <td>20</td> + <td>16</td> +</tr> +</table><pre><b>QUERY:</b> SELECT domain, +COUNT(*) as journal_homepages, +SUM(blocked) +FROM homepage +GROUP BY domain +ORDER BY SUM(blocked) DESC +LIMIT 20;</pre> +<br></code></div><p>Top duplicated domains:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>url</th> + <th>COUNT(*)</th> +</tr></thead> +<tr> + <td><a href="http://www.indianjournals.com/">http://www.indianjournals.com/</a></td> + <td>73</td> +</tr> +<tr> + <td><a href="http://www.hindawi.com/">http://www.hindawi.com/</a></td> + <td>70</td> +</tr> +<tr> + <td><a href="http://search.informit.com.au/search;res=APAFT">http://search.informit.com.au/search;res=APAFT</a></td> + <td>60</td> +</tr> +<tr> + <td><a href="http://www.umi.com/proquest">http://www.umi.com/proquest</a></td> + <td>46</td> +</tr> +<tr> + <td><a href="http://www.umi.com/pqdauto/">http://www.umi.com/pqdauto/</a></td> + <td>45</td> +</tr> +<tr> + <td><a href="http://ieeexplore.ieee.org/Xplore/conferences.jsp">http://ieeexplore.ieee.org/Xplore/conferences.jsp</a></td> + <td>40</td> +</tr> +<tr> + <td><a href="http://omicsonline.org/">http://omicsonline.org/</a></td> + <td>36</td> +</tr> +<tr> + <td><a href="http://www.idealibrary.com/">http://www.idealibrary.com/</a></td> + <td>36</td> +</tr> +<tr> + <td><a href="http://ieeexplore.ieee.org/xpl/conferences.jsp">http://ieeexplore.ieee.org/xpl/conferences.jsp</a></td> + <td>24</td> +</tr> +<tr> + <td><a href="http://www.metapress.com/">http://www.metapress.com/</a></td> + <td>24</td> +</tr> +<tr> + <td><a href="http://www.randspublications.org/">http://www.randspublications.org/</a></td> + <td>22</td> +</tr> +<tr> + <td><a href="http://www.studia.ubbcluj.ro/serii/index_en.html">http://www.studia.ubbcluj.ro/serii/index_en.html</a></td> + <td>22</td> +</tr> +<tr> + <td><a href="http://find.galegroup.com/ips/publicationSearch.do">http://find.galegroup.com/ips/publicationSearch.do</a></td> + <td>21</td> +</tr> +<tr> + <td><a href="http://jurnal.unimed.ac.id/">http://jurnal.unimed.ac.id/</a></td> + <td>21</td> +</tr> +<tr> + <td><a href="http://www.bioinfo.in/journals.php">http://www.bioinfo.in/journals.php</a></td> + <td>20</td> +</tr> +<tr> + <td><a href="http://www.interscience.wiley.com/">http://www.interscience.wiley.com/</a></td> + <td>20</td> +</tr> +<tr> + <td><a href="http://www.commongroundpublishing.com/">http://www.commongroundpublishing.com/</a></td> + <td>19</td> +</tr> +<tr> + <td><a href="http://www.haworthpress.com/">http://www.haworthpress.com/</a></td> + <td>19</td> +</tr> +<tr> + <td><a href="http://www.heinonline.org/">http://www.heinonline.org/</a></td> + <td>19</td> +</tr> +<tr> + <td><a href="http://www.infosci-journals.com/">http://www.infosci-journals.com/</a></td> + <td>19</td> +</tr> +</table><pre><b>QUERY:</b> SELECT url, +COUNT(*) +FROM homepage +GROUP BY url +ORDER BY COUNT(*) DESC +LIMIT 20;</pre> +<br></code></div><p>Number of journals with a homepage that points to web.archive.org or archive.org:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>COUNT(DISTINCT issnl)</th> +</tr></thead> +<tr> + <td>1453</td> +</tr> +</table><pre><b>QUERY:</b> SELECT COUNT(DISTINCT issnl) +FROM homepage +WHERE domain = 'archive.org';</pre> +<br></code></div><p>Top publishers that have journals in wayback:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>publisher</th> + <th>COUNT(*)</th> +</tr></thead> +<tr> + <td></td> + <td>653</td> +</tr> +<tr> + <td>EDP Sciences</td> + <td>23</td> +</tr> +<tr> + <td>CAIRN</td> + <td>18</td> +</tr> +<tr> + <td>OpenEdition</td> + <td>18</td> +</tr> +<tr> + <td>Elsevier</td> + <td>6</td> +</tr> +<tr> + <td>Springer</td> + <td>6</td> +</tr> +<tr> + <td>PERSEE Program</td> + <td>5</td> +</tr> +<tr> + <td>Peer Community In</td> + <td>5</td> +</tr> +<tr> + <td>Institut de recherche et d'histoire des textes (France)</td> + <td>4</td> +</tr> +<tr> + <td>San Lucas Medical</td> + <td>4</td> +</tr> +</table><pre><b>QUERY:</b> SELECT publisher, +COUNT(*) +FROM journal +LEFT JOIN homepage ON journal.issnl = homepage.issnl +WHERE homepage.domain = 'archive.org' +GROUP BY journal.publisher +ORDER BY COUNT(*) DESC +LIMIT 10;</pre> +<br></code></div><p>Top publishers by number of journals missing a homepage:</p> +<div style="margin: 1em 3em 1em 3em; "><code><table> + <thead><tr> + <th>publisher</th> + <th>COUNT(*)</th> +</tr></thead> +<tr> + <td></td> + <td>21460</td> +</tr> +<tr> + <td>Peter Lang International Academic Publishers</td> + <td>1270</td> +</tr> +<tr> + <td>Elsevier</td> + <td>876</td> +</tr> +<tr> + <td>J-STAGE</td> + <td>864</td> +</tr> +<tr> + <td>Egypts Presidential Specialized Council for Education and Scientific Research</td> + <td>354</td> +</tr> +<tr> + <td>Georg Thieme Verlag KG</td> + <td>288</td> +</tr> +<tr> + <td>Al Manhal FZ, LLC</td> + <td>216</td> +</tr> +<tr> + <td>Informa UK (Taylor & Francis)</td> + <td>202</td> +</tr> +<tr> + <td>Springer-Verlag</td> + <td>156</td> +</tr> +<tr> + <td>ELSEVIER LTD</td> + <td>145</td> +</tr> +<tr> + <td>Inderscience</td> + <td>122</td> +</tr> +<tr> + <td>African Journals Online</td> + <td>121</td> +</tr> +<tr> + <td>Diva Enterprises Private Limited</td> + <td>119</td> +</tr> +<tr> + <td>PERSEE Program</td> + <td>118</td> +</tr> +<tr> + <td>Sabinet</td> + <td>109</td> +</tr> +<tr> + <td>SAGE Publications</td> + <td>103</td> +</tr> +<tr> + <td>Brill</td> + <td>99</td> +</tr> +<tr> + <td>Superintendent of Government Documents</td> + <td>99</td> +</tr> +<tr> + <td>Taylor & Francis</td> + <td>98</td> +</tr> +<tr> + <td>Bentham Science</td> + <td>94</td> +</tr> +</table><pre><b>QUERY:</b> SELECT publisher, +COUNT(*) +FROM journal +WHERE any_homepage=0 +GROUP BY publisher +ORDER BY COUNT(*) DESC +LIMIT 20;</pre> +<br></code></div> diff --git a/reports/report_template.md b/reports/report_template.md index ac98649..ad64c5d 100644 --- a/reports/report_template.md +++ b/reports/report_template.md @@ -1,16 +1,17 @@ -<!-- -This template can be "executed" to generate an HTML report page using the -`sqlite-notebook` tool. ---> - -# Chocula Journal Aggregate Stats +# Fatcat "Chocula" Journal Metadata Summary +This report is auto-generated from a sqlite database file, which should be available/included. ```sql SELECT datetime('now'); ``` +Note that pretty much all of the fatcat release stats are on a *release*, not +*work* basis, so there may be over-counting. Also, as of July 2019 there were +over 1.5 million OA longtail releases which are *not* linked to a container +(journal). + ```sql PRAGMA database_list; ``` @@ -118,6 +119,18 @@ Homepage URL counts: SELECT COUNT(DISTINCT surt) as unique_urls, COUNT(DISTINCT issnl) as journals_with_hompages FROM homepage; ``` +Journal counts by homepage status: + +```sql +SELECT any_homepage, any_live_homepage, any_gwb_homepage, COUNT(*), ROUND(1.0 * COUNT(*) / (SELECT COUNT(*) FROM journal), 2) AS frac FROM journal GROUP BY any_homepage, any_live_homepage, any_gwb_homepage; +``` + +Number of unique journals that have a homepage pointing to wayback or archive.org: + +```sql +SELECT COUNT(DISTINCT issnl) FROM homepage WHERE domain = 'archive.org'; +``` + Journals with the most homepage URLs: ```sql |