aboutsummaryrefslogtreecommitdiffstats
path: root/notes/hadoop_job_log.md
diff options
context:
space:
mode:
authorBryan Newbold <bnewbold@archive.org>2021-09-30 18:47:17 -0700
committerBryan Newbold <bnewbold@archive.org>2021-09-30 18:47:23 -0700
commit1b5ee74818da93fd80201a60a18632ff28692d91 (patch)
tree515438e78d1f066d659afba11accae43cef41983 /notes/hadoop_job_log.md
parent3247dca63af8fecc07e7dfb79063e9c881490d88 (diff)
downloadsandcrawler-1b5ee74818da93fd80201a60a18632ff28692d91.tar.gz
sandcrawler-1b5ee74818da93fd80201a60a18632ff28692d91.zip
ingest CDX lookup: weigh year+month of capture against in-petabox-or-not
This is to try working around an issue where ingests fail because an SPN capture is much newer, but the old sorting preference ignored that. Note that the sorting logic is pretty busted anyways, and we should probably allow returning multiple matching files to try.
Diffstat (limited to 'notes/hadoop_job_log.md')
0 files changed, 0 insertions, 0 deletions