Difference between revisions of "BitTorrent (B. Cohen's version)"
From HCL
| (7 intermediate revisions by the same user not shown) | |||
| Line 3: | Line 3: | ||
svn co https://hcl.ucd.ie/repos/CPM/trunk/MPIBlib/tests/bittorrent/bittorrent.tar.gz | svn co https://hcl.ucd.ie/repos/CPM/trunk/MPIBlib/tests/bittorrent/bittorrent.tar.gz | ||
| + | * Extract this under your home directory | ||
| + | ** You might need | ||
| + | mv $HOME/lib/python $HOME/lib/python2.6 | ||
| + | * export following variables to tweak the way Python paths are searched: | ||
| + | export PYTHONPATH=/usr/lib/python2.6/:<local-installation-path-of-Python-libs> | ||
| + | * Modify logfile path in /home/kdichev/lib/python2.6/BitTorrent/StorageWrapper.py and create according directory structure | ||
* Create a file of any size consisting of "s" characters only. | * Create a file of any size consisting of "s" characters only. | ||
* Create torrent file: | * Create torrent file: | ||
| Line 13: | Line 19: | ||
* Book nodes interactively: | * Book nodes interactively: | ||
qsub -I -lnodes=... | qsub -I -lnodes=... | ||
| − | * Start one client that has the full copy | + | * Start one client that has the full copy |
| − | btdownloadheadless | + | ssh <one-node> btdownloadheadless --url http://public.lille.grid5000.fr/~kdichev/{torrent file} & |
| + | |||
* On all other nodes, launch the client at the same time: | * On all other nodes, launch the client at the same time: | ||
| + | script-per-process.sh | ||
| + | #!/bin/bash | ||
| + | cd /tmp ; btdownloadheadless --display_interval 100 --url http://public.lille.grid5000.fr/~kdichev/{torrent file} | ||
| + | run.sh | ||
| + | mpirun -n 14 --machinefile hostfile $PWD/script-per-process.sh | ||
Latest revision as of 12:27, 14 September 2012
The modified bittorrent tarball is currently under the MPIBlib repository:
svn co https://hcl.ucd.ie/repos/CPM/trunk/MPIBlib/tests/bittorrent/bittorrent.tar.gz
- Extract this under your home directory
- You might need
mv $HOME/lib/python $HOME/lib/python2.6
- export following variables to tweak the way Python paths are searched:
export PYTHONPATH=/usr/lib/python2.6/:<local-installation-path-of-Python-libs>
- Modify logfile path in /home/kdichev/lib/python2.6/BitTorrent/StorageWrapper.py and create according directory structure
- Create a file of any size consisting of "s" characters only.
- Create torrent file:
btmakemetafile myfile.ext http://<frontend on G5K>:6969/announce
- Stick the torrent file into $HOME/public at the frontend.
- It is then available from within G5K under http://public.lille.grid5000.fr/~kdichev/{torrent file}
- Start the tracker on the frontend:
bttrack --port 6969 --dfile dstate
- Book nodes interactively:
qsub -I -lnodes=...
- Start one client that has the full copy
ssh <one-node> btdownloadheadless --url http://public.lille.grid5000.fr/~kdichev/{torrent file} &
- On all other nodes, launch the client at the same time:
script-per-process.sh
#!/bin/bash cd /tmp ; btdownloadheadless --display_interval 100 --url http://public.lille.grid5000.fr/~kdichev/{torrent file}
run.sh
mpirun -n 14 --machinefile hostfile $PWD/script-per-process.sh
