fatcat-scholar - Unnamed repository; edit this file 'description' to name the repository.

	Commit message (Collapse)	Author	Age	Files	Lines
*	strip <em> tags explicitly	Bryan Newbold	2020-07-21	1	-0/+1
\|
*	handle large/bad 'first_page' metadata	Bryan Newbold	2020-06-29	1	-0/+3
\| \| \| \|	This was causing elasticsearch indexing errors
*	more conservative container_original_name	Bryan Newbold	2020-06-29	1	-0/+2
\|
*	fix lint errors (and some small bugs)	Bryan Newbold	2020-06-29	1	-2/+1
\|
*	fixes to schema parsing from prod	Bryan Newbold	2020-06-29	1	-9/+13
\|
*	include GROBID-extracted abstracts in search documents	Bryan Newbold	2020-06-29	1	-0/+8
\|
*	fetch pdftotext and pdf_meta from blobs, postgrest	Bryan Newbold	2020-06-29	1	-4/+5
\| \| \| \| \|	This replaces the temporary COVID-19 content hack with production content (text, thumbnail URLs) stored in postgrest and seaweedfs.
*	commit production work-around (temporarily)	Bryan Newbold	2020-06-04	1	-1/+2
\|
*	collapse pages by SIM issue	Bryan Newbold	2020-06-04	1	-0/+1
\|
*	fmt	Bryan Newbold	2020-06-04	1	-0/+2
\|
*	start some annotaition fixes for pytype	Bryan Newbold	2020-06-03	1	-1/+3
\|
*	more flake8	Bryan Newbold	2020-06-03	1	-1/+1
\|
*	flake8 fixes (partial)	Bryan Newbold	2020-06-03	1	-1/+1
\|
*	reformat python code with black	Bryan Newbold	2020-06-03	1	-38/+64
\|
*	improve text scrubbing	Bryan Newbold	2020-06-03	1	-13/+21
\| \| \| \| \| \| \| \| \| \|	Was going to use textpipe, but dependency was too large and failed to install with halfway modern GCC (due to CLD2 issue): https://github.com/GregBowyer/cld2-cffi/issues/12 So instead basically pulled out the clean_text function, which is quite short.
*	add prefix scrubing (esp. for abstracts)	Bryan Newbold	2020-05-21	1	-0/+18
\|
*	use beautiful soup for XML scrubing	Bryan Newbold	2020-05-21	1	-7/+6
\|
*	be more inclusive of author names	Bryan Newbold	2020-05-21	1	-4/+4
\|
*	fixes from manual testing	Bryan Newbold	2020-05-20	1	-7/+11
\|
*	first pass transform from pipelines to ES schema	Bryan Newbold	2020-05-20	1	-0/+334