aboutsummaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
authorBryan Newbold <bnewbold@archive.org>2018-04-04 11:48:00 -0700
committerBryan Newbold <bnewbold@archive.org>2018-04-04 11:48:00 -0700
commit9186783c632b63e7d7c3cd8168139718fba378e9 (patch)
tree69a6db5b2cde92de4b50df9c8c73c44eb6206524
parente8eb959fbdd5d13cd53421ddf2487811d049c4e8 (diff)
downloadsandcrawler-9186783c632b63e7d7c3cd8168139718fba378e9.tar.gz
sandcrawler-9186783c632b63e7d7c3cd8168139718fba378e9.zip
more TODO
-rw-r--r--TODO12
-rw-r--r--backfill/TODO5
2 files changed, 17 insertions, 0 deletions
diff --git a/TODO b/TODO
new file mode 100644
index 0000000..a1cf98d
--- /dev/null
+++ b/TODO
@@ -0,0 +1,12 @@
+
+https://github.com/getsentry/raven-python
+
+potential helpers:
+- https://github.com/martinblech/xmltodict
+- https://github.com/trananhkma/fucking-awesome-python#text-processing
+- https://github.com/blaze/blaze (for catalog/analytics)
+- validation: https://github.com/pyeve/cerberus
+- testing (to replace nose):
+ - https://github.com/CleanCut/green
+ - pytest
+ - mamba ("behavior driven")
diff --git a/backfill/TODO b/backfill/TODO
new file mode 100644
index 0000000..e4023de
--- /dev/null
+++ b/backfill/TODO
@@ -0,0 +1,5 @@
+- better test coverage (actually check coverage!)
+- use pre-mapper command to filter down, eg, by status type?
+- automation/docs for bundling virtualenv along
+- think about speedups
+- refactor into extraction folder