| Commit message (Collapse) | Author | Age | Files | Lines |
|
|
|
|
| |
- don't start kafka image until zookeeper is running
- set very liberal "watermarks" for elasticsearch disk monitoring
|
| |
|
|
|
|
|
|
| |
This was causing 5xx errors in production and qa. Eg, at:
https://qa.fatcat.wiki/release/aaaaaaaaaaaaarceaaaaaaaaai/history
|
| |
|
| |
|
|\
| |
| |
| |
| | |
Basic mocked test for crossref harvester
See merge request webgroup/fatcat!7
|
| | |
|
| |
| |
| |
| |
| |
| |
| |
| | |
producer creation/configuration should be happening in __init__() time,
not 'daily' call.
This specific refactor motivated by mocking out the producer in unit
tests.
|
| | |
|
|\ \
| |/
|/|
| |
| | |
increase max.message.bytes in container
See merge request webgroup/fatcat!5
|
|/
|
|
|
| |
While working on datacite, some message were larger than the default of
1000012 bytes.
|
| |
|
|
|
|
|
|
| |
The more complete fix is to actually render the JATS to HTML and display
that. This is just to fix a nit with the most common case of XML tags in
abstracts.
|
|
|
|
|
| |
- allow overriding source filter whitelist (common case for CLI use)
- fix editgroup description env variable pass-through
|
|
|
|
|
|
|
|
| |
I thought this would filter for metadata updates to an existing DOI, but
actually "updates" are a type of DOI (eg, a retraction).
TODO: handle 'updates' field. Should both do a lookup and set work_ident
appropriately, and store in crossref-specific metadata.
|
|
|
|
|
|
|
|
|
|
|
|
| |
This isn't a fatcat rust requirement, but instead a diesel requirement,
via rust-smallvec, which in v1.0 uses the alloc crate:
https://github.com/servo/rust-smallvec/issues/73
I think the reason this came up now is that diesel-cli is an
application and doesn't have a Cargo.lock file, and the build was
updated. Using some binary mechanism to install these dependencies would
be more robust, but feels like a yak shave right now.
|
|
|
|
|
| |
Apparently the rust:1.34-stretch image is gone from docker hub, and this
was causing CI errors.
|
|
|
|
|
|
|
| |
Test in previous commit.
This fixes a user-reported 500 error when creating a file with
SHA1/SHA256/MD5 hashes in upper-case.
|
| |
|
| |
|
| |
|
|
|
|
| |
As opposed to sandcrawler-bot
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Initially was going to create a new worker to consume from the release
update channel, but couldn't get the edit context ("is this a new
release, or update to an existing") from that context.
Currently there is a flag in source code to control whether we only do
OA releases or all releases. Starting with OA only to start slow, but
should probably default to all, and make this a config flag. Should
probably also have a config flag to control this entire feature.
Tested locally in dev.
|
| |
|
| |
|
|\
| |
| |
| |
| | |
Add basic pagination to search results
See merge request webgroup/fatcat!4
|
| | |
|
| |
| |
| |
| | |
> "Showing top " -> "Showing first "
|
| |
| |
| |
| |
| |
| |
| |
| | |
As per [this
issue](https://github.com/Semantic-Org/Semantic-UI/issues/1885#issuecomment-77619519),
text colors are not supported in semantic ui.
To not move text too much, gray out inactive links.
|
| |
| |
| |
| |
| |
| |
| |
| |
| | |
Two new macros:
* top_results(found)
* bottom_results(found)
wip: move pagination into macro
|
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| | |
The "deep paging problem" imposes some limit, which currently is a
hardcoded default value, `deep_page_limit=2000` in `do_search`.
Elasticsearch can be configured, too:
> Note that from + size can not be more than the index.max_result_window
index setting, which defaults to 10,000.
-- https://www.elastic.co/guide/en/elasticsearch/reference/current/search-request-body.html#request-body-search-from-size
|
| |
| |
| |
| |
| | |
Caught one of these in sentry. Probably due to a crawler? Or typing
gibberish in the token form.
|
| | |
|
| | |
|
| | |
|
|\ \
| | |
| | |
| | |
| | | |
mention elasticsearch empty index setup
See merge request webgroup/fatcat!3
|
| |/
| |
| |
| |
| |
| | |
When setting up with the defaults, all works fine, except that the web
search will try to access a local elasticsearch. Mention in README, how
to create empty indices.
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| |
| |
| |
| |
| |
| | |
Might skip based on release type (eg container, not a paper/release), or
missing title, or other reasons. Over 7 million DOIs are getting
skipped, curious why.
|