aboutsummaryrefslogtreecommitdiffstats
path: root/notes/ingest
Commit message (Collapse)AuthorAgeFilesLines
* daily OA crawl improvements/notesBryan Newbold2021-09-081-0/+1021
|
* OAI-PMH patch and ingest improvement notesBryan Newbold2021-09-032-204/+1578
|
* commit old patch crawl notes (dec 2020)Bryan Newbold2021-09-031-0/+1
|
* commit old arxiv ingest notesBryan Newbold2021-09-031-0/+12
|
* commit old patch notes (will rework)Bryan Newbold2021-09-031-0/+110
|
* MAG post-crawl stats (5m+ new PDFs crawled successfully)Bryan Newbold2021-09-021-0/+124
|
* MAG and OAI-PMH crawl/processing notesBryan Newbold2021-08-132-0/+480
|
* 2021-07 unpaywall crawl wrap-up notesBryan Newbold2021-07-301-12/+108
|
* unpaywall 2021-07 crawl partial notesBryan Newbold2021-07-141-0/+224
|
* notes on large-domain ingest tweaksBryan Newbold2021-05-271-0/+480
|
* 2021-04 unpaywall crawl notesBryan Newbold2021-05-271-0/+368
|
* late-2020 OA DOI crawl ingest notesBryan Newbold2021-01-041-3/+46
|
* DOAJ crawl ingest statsBryan Newbold2020-12-311-0/+295
|
* progress notes on OA DOI ingest (still running)Bryan Newbold2020-12-281-11/+102
|
* unpaywall crawl/ingest update (from Oct 2020)Bryan Newbold2020-12-081-0/+134
|
* commit sept 2020 scielo ingest notesBryan Newbold2020-12-081-0/+21
|
* unpaywall oct 2020 crawl notesBryan Newbold2020-11-021-45/+82
|
* more notes on unpaywall ingest from last weekBryan Newbold2020-10-271-0/+73
|
* notes on 2020-09 re-ingest passesBryan Newbold2020-10-171-0/+197
|
* OA DOIs: partial notesBryan Newbold2020-10-171-0/+218
|
* notes/status on daily ingestBryan Newbold2020-10-171-0/+193
|
* start 2020-10 ingest notesBryan Newbold2020-10-111-0/+42
|
* update unpaywall 2020-04 notesBryan Newbold2020-10-111-0/+32
|
* OAI-PMH ingest progress timestampsBryan Newbold2020-10-111-0/+13
|
* OAI-PMH ingest notesBryan Newbold2020-09-031-0/+232
|
* daily ingest notesBryan Newbold2020-09-021-0/+202
|
* unpaywall ingest follow-upBryan Newbold2020-09-021-0/+115
|
* MAG ingest follow-up notesBryan Newbold2020-08-051-0/+194
|
* MAG 2020-07 ingest notesBryan Newbold2020-07-081-0/+159
|
* 2020-05_pubmed ingest notes (short)Bryan Newbold2020-06-251-0/+10
|
* ingest: OAI-PMH count tableBryan Newbold2020-05-281-0/+24
|
* ingest notesBryan Newbold2020-05-262-6/+76
|
* potential future backfill ingestsBryan Newbold2020-05-261-0/+52
|
* ingests: normalize file names; commit updatesBryan Newbold2020-05-2610-63/+279
|
* summarize datacite and MAG 2020 crawlsBryan Newbold2020-05-052-0/+200
|
* update MAG crawl notesBryan Newbold2020-04-281-0/+71
|
* COVID-19 chinese paper ingestBryan Newbold2020-04-151-0/+73
|
* 2020-04 unpaywall ingest (in progress)Bryan Newbold2020-04-151-0/+63
|
* 2020-04 datacite ingest (in progress)Bryan Newbold2020-04-151-0/+18
|
* partial notes on S2 crawl ingestBryan Newbold2020-04-151-0/+35
|
* MAG import notesBryan Newbold2020-04-131-0/+13
|
* MAG 2020-03-04 ingest notes to dateBryan Newbold2020-04-061-0/+395
|
* unpaywall ingest notes updateBryan Newbold2020-03-301-0/+138
|
* unpaywall large ingest notesBryan Newbold2020-03-171-0/+10
|
* more unpaywall ingest notesBryan Newbold2020-03-051-0/+416
|
* update (and move) ingest notesBryan Newbold2020-03-036-0/+774
|
* jan 2020 bulk ingest notesBryan Newbold2020-02-121-0/+26
|
* ingest/backfill notesBryan Newbold2019-11-133-0/+47