diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2019-08-26 23:25:28 +0200 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2019-08-26 23:25:34 +0200 |
| commit | d2d545675b3c85c3e1b41fd4bda23230d995bf47 (patch) | |
| tree | e46a93f62de8924e00025d2470136f474792d5fe /scalding/src/main/scala/example | |
| parent | 5cf94a887d8edbeb811ea440c6b8eef90e34f7a2 (diff) | |
| download | sandcrawler-d2d545675b3c85c3e1b41fd4bda23230d995bf47.tar.gz sandcrawler-d2d545675b3c85c3e1b41fd4bda23230d995bf47.zip | |
GroupFatcatWorksSubsetJob
This is a hack-y variant of GroupFatcatWorksSubsetJob which allows
setting different left and right sides of the join. The initial
application is to re-run work merging with only longtail-oa works on the
"left", with the goal of hard-merging these releases into existing
releases with actual identifiers (instead of just grouping into works).
As a refactor, the normal GroupFatcatWorksJob could just be this with
the same file passed as both left and right, though that requires twice
as much JSON parsing/filtering.
Diffstat (limited to 'scalding/src/main/scala/example')
0 files changed, 0 insertions, 0 deletions