aboutsummaryrefslogtreecommitdiffstats
path: root/prototyping.md
blob: 915a485f7b8f0827c24395f952f9913d5b2826a7 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140

## ia-onion1 (NUC) bionic

An Intel NUC running Ubuntu 18.04, following `device_setup.md` notes.

    mkdir -p /private/eotk
    cd /private/eotk
    screen -S eotk

    git clone https://github.com/alecmuffett/eotk.git src
    cd src
    ./opt.d/install-everything-on-ubuntu-18.04.sh
    ./eotk make-scripts

    cat archive_org.tconf 
    #set project archive_org
    #hardmap %NEW_V3_ONION% archive.org us

    ./eotk config archive_org.tconf

    cat archive_org.conf
    # example, not actual results
    #set project archive_org
    #hardmap c6srwspz6764tcyn archive.org us

    # edit file to remove comments and add...
    #
    #   set x_from_onion_value 1
    #   set preserve_csv tld-ao,archive\\.org,i,archive.org
    #   set ssl_mkcert 1

    ./eotk config archive_org.conf

    ./eotk start archive_org

Set up scripts:

    sudo cp eotk-init.sh /etc/init.d && sudo update-rc.d eotk-init.sh defaults

    # copy line from head of eotk-housekeeping.sh
    crontab -e

After all this, needed to re-enable default tor (for SSH service):

    sudo systemctl enable tor
    sudo service tor start

## wbgrp-svc206.us.archive.org Log

A cluster VM, running Ubuntu 16.04.

    sudo mkdir -p /srv/eotk
    sudo chown bnewbold:bnewbold /srv/eotk
    cd /srv/eotk
    screen -S eotk

    git clone https://github.com/alecmuffett/eotk.git src
    cd src
    ./opt.d/install-everything-on-ubuntu-16.04.sh

This initially failed on:

    gpgkeys: key A3C4F0F979CAA22CDBA8F512EE8CBC9E886DDD89 can't be retrieved

"yav"   Following random internet things and trying:

    # FAIL
    gpg --keyserver pool.sks-keyservers.net --recv A3C4F0F979CAA22CDBA8F512EE8CBC9E886DDD89

I instead commented out the gpg key recv line from the script and did:

    curl https://deb.torproject.org/torproject.org/A3C4F0F979CAA22CDBA8F512EE8CBC9E886DDD89.asc | gpg --import

Got a bunch of python `bdist_wheel` issues.

    sudo apt install build-essential python3-dev python-dev

This probably shouldn't be done on cluster machines with NFS home by regular
(staff) user accounts; python/pip and system/user/local is a big mess.

Moving on:

    ./eotk make-scripts

Going to ignore those for now.

    cat archive_org.tconf 
    #set project archive_org
    #hardmap %NEW_ONION% archive.org us
    ./eotk config archive_org.tconf

    cat archive_org.conf
    #set project archive_org
    #hardmap c6srwspz6764tcyn archive.org us

    # edit file to remove comments...
    ./eotk config archive_org.conf

    ./eotk start archive_org

Set up scripts:

    sudo cp eotk-init.sh /etc/init.d && sudo update-rc.d eotk-init.sh defaults

    # copy line from head of eotk-housekeeping.sh
    crontab -e

Browse to <https://www.c6srwspz6764tcyn.onion> in tor browser, accept a bunch
of self-signed SSL errors and... it just works ?!?!?

For wayback, <https://web.c6srwspz6764tcyn.onion>, or an example reply page
<https://web.c6srwspz6764tcyn.onion/web/20151231235712/http://web.mit.edu/>.

Blog: <https://blog.c6srwspz6764tcyn.onion>

Quick checks of things that work (some need cert accept digging):

- archive.org/download/.../...
- general search and catalog view
- audio playback
- tv news archive
- archive.org login (email/pass)
- video playback
- book reader
- wayback replay (at least the basics)

## Bugs / Issues

Rewriting of "archive.org" in plain text. Eg, blog post title: "Official EU
Agencies Falsely Report More Than 550 c6srwspz6764tcyn.onion URLs as Terrorist
Content" and "A blog from the team at c6srwspz6764tcyn.onion".

At least audio /details/ pages ask for canvas access; probably ok?

Audio playback initially: "This video file cannot be played.(Error Code:
224003)"; but this was just a cert exception thing. Worked after downloading an
MP3 (to make exception).

Streaming large files (video) is slow to start, but no surprise there.