index
:
fatcat-scholar
bnewbold-jammy
debug-no-i18n
master
x-attic-gitlab-a11y
x-attic-rescore
Unnamed repository; edit this file 'description' to name the repository.
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
fatcat_scholar
/
schema.py
Commit message (
Expand
)
Author
Age
Files
Lines
*
refs transform: 1-index refs.index, not 0-index
Bryan Newbold
2021-07-25
1
-1
/
+1
*
refs: include (source) release_stage in output
Bryan Newbold
2021-06-30
1
-0
/
+1
*
schema: add 'crossref' to bundle schema, and add from_json() helper
Bryan Newbold
2021-06-02
1
-1
/
+20
*
indexing: defer to creator.display_name over contrib.raw_name
Bryan Newbold
2021-04-12
1
-1
/
+3
*
catch HTML parsing error from withing html (via bs4)
Bryan Newbold
2021-02-01
1
-2
/
+9
*
bugfix: container_sherpa_color not defined
Bryan Newbold
2021-01-29
1
-1
/
+1
*
make fmt
Bryan Newbold
2021-01-25
1
-1
/
+3
*
basic support for excluding web content from index
Bryan Newbold
2021-01-22
1
-0
/
+14
*
add container_sherpa_color field, and populate it
Bryan Newbold
2021-01-22
1
-18
/
+18
*
refactor DOI domain lookup into python code; expand table
Bryan Newbold
2021-01-21
1
-0
/
+14
*
citation: fixes to generic hack; remove bibtex hack
Bryan Newbold
2021-01-21
1
-31
/
+6
*
fixup: check for container.extra in indexing pipeline
Bryan Newbold
2021-01-21
1
-1
/
+3
*
fix indexing bug (false-y publisher_type?)
Bryan Newbold
2021-01-18
1
-0
/
+2
*
lint: fix small bugs and type annotations
Bryan Newbold
2021-01-18
1
-1
/
+2
*
small corrections to schema/transform
Bryan Newbold
2021-01-16
1
-1
/
+4
*
make fmt
Bryan Newbold
2021-01-15
1
-6
/
+6
*
crude bibtex and citation formatting, as a demo
Bryan Newbold
2021-01-14
1
-0
/
+49
*
schema: make fulltext body optional (eg, for search results)
Bryan Newbold
2021-01-14
1
-1
/
+1
*
add support for new identifiers and size_bytes schema fields
Bryan Newbold
2021-01-14
1
-4
/
+13
*
add basic html fulltext support to fetch pipeline
Bryan Newbold
2020-11-18
1
-0
/
+1
*
schema: optional 'fetched' field on bundles
Bryan Newbold
2020-10-16
1
-0
/
+2
*
make fmt
Bryan Newbold
2020-09-13
1
-6
/
+12
*
ref transform: support more GROBID fields
Bryan Newbold
2020-09-13
1
-1
/
+4
*
URL cleanup helper
Bryan Newbold
2020-09-13
1
-0
/
+28
*
heavy to refs command
Bryan Newbold
2020-09-04
1
-0
/
+36
*
handle small ints better (signed/unsigned abs size)
Bryan Newbold
2020-08-12
1
-1
/
+2
*
transform: more string cleaning
Bryan Newbold
2020-08-12
1
-12
/
+59
*
volume_int/issue_int as actual ints
Bryan Newbold
2020-08-06
1
-2
/
+2
*
handle integer conversion and bounding for ES schema
Bryan Newbold
2020-08-06
1
-9
/
+22
*
scrub_text: single-token strings skipped
Bryan Newbold
2020-08-06
1
-0
/
+4
*
strip ACKNOWLEDGEMENTS prefix
Bryan Newbold
2020-08-06
1
-0
/
+1
*
transform: catch more cases of null extra
Bryan Newbold
2020-07-30
1
-10
/
+10
*
abstracts: more prefixes to ignore
Bryan Newbold
2020-07-27
1
-0
/
+3
*
strip <em> tags explicitly
Bryan Newbold
2020-07-21
1
-0
/
+1
*
handle large/bad 'first_page' metadata
Bryan Newbold
2020-06-29
1
-0
/
+3
*
more conservative container_original_name
Bryan Newbold
2020-06-29
1
-0
/
+2
*
fix lint errors (and some small bugs)
Bryan Newbold
2020-06-29
1
-2
/
+1
*
fixes to schema parsing from prod
Bryan Newbold
2020-06-29
1
-9
/
+13
*
include GROBID-extracted abstracts in search documents
Bryan Newbold
2020-06-29
1
-0
/
+8
*
fetch pdftotext and pdf_meta from blobs, postgrest
Bryan Newbold
2020-06-29
1
-4
/
+5
*
commit production work-around (temporarily)
Bryan Newbold
2020-06-04
1
-1
/
+2
*
collapse pages by SIM issue
Bryan Newbold
2020-06-04
1
-0
/
+1
*
fmt
Bryan Newbold
2020-06-04
1
-0
/
+2
*
start some annotaition fixes for pytype
Bryan Newbold
2020-06-03
1
-1
/
+3
*
more flake8
Bryan Newbold
2020-06-03
1
-1
/
+1
*
flake8 fixes (partial)
Bryan Newbold
2020-06-03
1
-1
/
+1
*
reformat python code with black
Bryan Newbold
2020-06-03
1
-38
/
+64
*
improve text scrubbing
Bryan Newbold
2020-06-03
1
-13
/
+21
*
add prefix scrubing (esp. for abstracts)
Bryan Newbold
2020-05-21
1
-0
/
+18
*
use beautiful soup for XML scrubing
Bryan Newbold
2020-05-21
1
-7
/
+6
[next]