Difference between revisions of "HCL Cluster Network"

Revision as of 14:21, 27 January 2011

Switch Management

The cluster is connected via two Cisco Catalyst 3560G switches. The ingress bandwidth on any physical port can be configured to any value between 8kb/s and 1Gb/s. The switches are connected to each other via a gigabit sfp cable.

As the <a href="Specs.html">Cluster Specifications</a> show, each node has two Network Interfaces, each with its own IP Address. Each eth0 is connected to switch 1, and each eth1 is connected to switch 2. Which topology you wish to use will determine which IP address you should use when referring to each machine.

Switch Access

The switches can be accessed through telnet from any machine on the cluster network. Type
telnet 192.168.21.252 for switch1 or telnet 192.168.21.253 for switch2, and the switch should prompt for a password. For the password, email brett becker.

Node Configuration

Here[1] is an excellent description how to introduce packet delays for outgoing traffic, which is a way to control latency. </p> <p align="center">Switch Configuration</p> <p>
For example, we will demonstrate how to limit the bandwidth of the connection between hcl01 and hcl02 to 100Mbps:
-----------------------------------
hcl02 $> telnet 192.168.21.252
     Trying 192.168.21.252...
     Connected to 192.168.21.252 (192.168.21.252).
     Escape character is '^]'.</p> <p>    User Access Verification</p> <p>Password: <enter password>
hclswitch1>enable
     Password: <enter password>
hclswitch1#configure terminal
     Enter configuration commands, one per line. End with CNTL/Z.
hclswitch1(config)#policy-map example
hclswitch1(config-pmap)#class ipclass1
hclswitch1(config-pmap-c)#police 100000000 800000 exceed-action drop
hclswitch1(config-pmap-c)#exit
hclswitch1(config-pmap)#exit
hclswitch1(config)#interface gigabitEthernet0/3
hclswitch1(config-if)#service-policy input example
hclswitch1(config-if)#exit
hclswitch1(config)#interface gigabitEthernet0/4
hclswitch1(config-if)#service-policy input example
hclswitch1(config-if)#exit
hclswitch1#show policy-map
   Policy Map example
    Class ipclass1
     police 100000000 800000 exceed-action drop
hclswitch1#exit
     Connection closed by foreign host.</p> <p>hcl02 $>
----------------------------------------</p> <p>In the above example, we telnet to the switch and enter the password. We then type “enable” and enter the password again. Then we type “configure terminal” to bring us into config mode. We then create a new policy-map named “example” We bind this policy-map to class “ipclass1”. ipclass1 is a class that incorporates all ports on the switch. PLEASE DO NOT REMOVE THIS CLASS! We then enter the key statement police 100000000 800000 exceed-action drop. This tells the switch that this policy-map is to limit the bandwidth to 100Mbps, with a bucket burst of 80000, and if the rate is exceeded packets are to be dropped. We then exit policy-map configuration and enter interface gigabitEthernet0/3. This is the port that is connected to hcl03. We then attach the policy-map “example” to this interface. We then do the same for port gigabitEthernet0/4 which is connected to hcl04. The policy-map is then viewed using the show command to ensure that it is correct. </p> <p>This example demonstrates an important fact about the cluster. hcl01’s eth0 (192.168.21.3) is connected to port gigabitEthernet0/1 on switch1. Similarly, hclx’s eth0 (192.168.21.x+2) is connected to gigabitEthernet0.x on switch1.
Further, hcl01’s eth1 (192.168.21.103) is connected to gigabitEthernet0/1 on switch2. Similarly, hclx’s eth1 (192.168.21.100+x+2) is connected to gigabitEthernet0/x on switch2.
The table below shows this comprehensively. </p>

 the above example, but on switch1, Interface gigabitEthernet0/25 should be assigned 
 the desired policy-map. Then on switch2, the same should be done. </p>

 example should be considered.</p>

 Cluster B, to comprised of hcl03 and hcl04. We want hcl01 and hcl02 to “talk” 
 to each other at 10Mbps, and hcl03 and hcl04 to “talk” at 1Gbps. 
 Additionally, we want to restrict the link between Clusters A and B to a bandwidth 
 of 250Mbps. 

 To accomplish this we perform the following steps:</p>

 is not. This means that the machine is connected to switch1.</p>

 to 10Mbps (10000000bps). Attach this policy-map to gigabitEthernet0/1 and gigabitEthernet0/2. 
 </p>

 This will list the active network devices. If the user before you cleaned up 
 after him/her self, only “lo” (the loopback interface) and “eth0” 
 should be listed. 

 hcl03 $> /sbin/ifup eth1 (debian command is sudo /sbin/ifup eth1)

 hcl03 $> /sbin/ifdown eth0 (debian command is sudo /sbin/ifdown eth0)</p>

 Then hcl03 is disconnected from switch1, as eth0 is connected to switch1. MAKE 
 SURE YOU ALWAYS BRING ONE INTERFACE UP BEFORE YOU BRING ANOTHER DOWN. OTHERWISE 
 THE MACHINE WILL BE ISOLATED WITH NO ACTIVE NETWORK DEVICES. To see what devices 
 are currently active, use the /sbin/ifconfig command. </p>

 log onto switch2 and make sure that there are no policy-maps existing. </p>

 250000000bps and attach it to gigabitEthernet0/25. Do the same for switch2.</p>

 SHOULD ALWAYS REMEMBER TO DELETE YOUR POLICY-MAPS WHEN YOUR JOBS ARE DONE SO 
 OTHER USER’S JOBS DON’T GET MESSED UP! </p>

 hcl0x $> telnet 192.168.21.252

      Trying 192.168.21.252...

      Connected to 192.168.21.252 (192.168.21.252).

      Escape character is '^]'.</p>

 Password: <enter password>

 hclswitch1>enable

 Password:

 hclswitch1#show policy-map

    Policy Map example

     Class ipclass1

      police 100000000 800000 exceed-action drop

 hclswitch1#config t

      Enter configuration commands, one per line. End with CNTL/Z.

 hclswitch1(config)#no policy-map example

 hclswitch1(config)#exit

 hclswitch1#show policy-map

 

 hclswitch1#exit

      Connection closed by foreign host.</p>

 ---------------------------------------------------------------</p>