Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | note on optimization: marisa-trie | Martin Czygan | 2020-08-12 | 1 | -0/+1 |
| | | | | | | | | | | Currently, the JSON mapping is 172M, turning this into a dict takes a bit, plus consumes GBs of memory. For exact lookups, we might want to use marisa-trie: > String data in a MARISA-trie may take up to 50x-100x less memory than in a standard Python dict; the raw lookup speed is comparable; trie also provides fast advanced methods like prefix search. | ||||
* | add notes/todo | Martin Czygan | 2020-08-12 | 1 | -0/+17 |