Difference between revisions of "BitTorrent (B. Cohen's version)"
From HCL
Line 10: | Line 10: | ||
export PYTHONHOME=$HOME | export PYTHONHOME=$HOME | ||
export PYTHONPATH=/usr/lib/python2.6/ | export PYTHONPATH=/usr/lib/python2.6/ | ||
− | * Modify logfile path in /home/kdichev/lib/python2.6/BitTorrent/StorageWrapper.py | + | * Modify logfile path in /home/kdichev/lib/python2.6/BitTorrent/StorageWrapper.py and create according directory structure |
* Create a file of any size consisting of "s" characters only. | * Create a file of any size consisting of "s" characters only. | ||
* Create torrent file: | * Create torrent file: |
Revision as of 12:27, 13 December 2011
The modified bittorrent tarball is currently under the MPIBlib repository:
svn co https://hcl.ucd.ie/repos/CPM/trunk/MPIBlib/tests/bittorrent/bittorrent.tar.gz
- Extract this under your home directory
- You might need
mv $HOME/lib/python $HOME/lib/python2.6
- export following variables to tweak the way Python paths are searched:
export PYTHONHOME=$HOME export PYTHONPATH=/usr/lib/python2.6/
- Modify logfile path in /home/kdichev/lib/python2.6/BitTorrent/StorageWrapper.py and create according directory structure
- Create a file of any size consisting of "s" characters only.
- Create torrent file:
btmakemetafile myfile.ext http://<frontend on G5K>:6969/announce
- Stick the torrent file into $HOME/public at the frontend.
- It is then available from within G5K under http://public.lille.grid5000.fr/~kdichev/{torrent file}
- Start the tracker on the frontend:
bttrack --port 6969 --dfile dstate
- Book nodes interactively:
qsub -I -lnodes=...
- Start one client that has the full copy
ssh <one-node> btdownloadheadless --url http://public.lille.grid5000.fr/~kdichev/{torrent file} &
- On all other nodes, launch the client at the same time:
script-per-process.sh
#!/bin/bash cd /tmp ; btdownloadheadless --display_interval 100 --url http://public.lille.grid5000.fr/~kdichev/{torrent file}
run.sh
mpirun -n 14 --machinefile hostfile $PWD/script-per-process.sh