Comware

 View Only

  • 1.  IRF and link aggregation problems

    Posted Oct 02, 2014 03:28 PM

    Hi everybody,

     

    I want to first thank to the people here respondisng to post and sharing their knowlage :)

     

    We have two HP 5900AF switches that we want to deploy into on our office netwotk in order to take the
    advantage of redundancy and bigger bandwith, I configured it the best I could but we running in
    to trouble with the end points (servers running CentOs)  when they don't want ro talk to each other, no even on the same switch!!! (pinging just time out every time) I'm runnng the servers with static IPs on VLAN 60.


    We want IRF and link aggreagation so here is my configuration and a little schematic:

     

    <SWITCH#1> system-view

    [SWITCH#1] irf mac-address persistent always (Enable MAC address persistance)

    [SWITCH#1] Irf member 1 priority 10

    [SWITCH#1] interface ten-gigabitethernet 1/0/17

    [SWITCH#1] Ten-GigabitEthernet1/0/17] shutdown

    [SWITCH#1] interface ten-gigabitethernet 1/0/18

    [SWITCH#1] Ten-GigabitEthernet1/0/18] shutdown

    [SWITCH#1] irf-port 1/1

    [SWITCH#1] irf-port1/1] port group interface ten-gigabitethernet 1/0/17

     

    ( Here I recieved a warning telling me to also shutdown port 19 and 20 because they belong to the
    same group so I did and I aso added them to the IRF even knowing that I will only link 17 and 18)

     

    [SWITCH#1] interface ten-gigabitethernet 1/0/19

    [SWITCH#1] Ten-GigabitEthernet1/0/19] shutdown

    [SWITCH#1] interface ten-gigabitethernet 1/0/20

    [SWITCH#1] Ten-GigabitEthernet1/0/20] shutdown

    [SWITCH#1] irf-port1/1] port group interface ten-gigabitethernet 1/0/19

    [SWITCH#1] irf-port1/1] quit

    [SWITCH#1] irf-port 1/2

    [SWITCH#1] irf-port1/2] port group interface ten-gigabitethernet 1/0/18

    [SWITCH#1] irf-port1/2] port group interface ten-gigabitethernet 1/0/20

    [SWITCH#1] irf-port1/2] quit

    [SWITCH#1] interface ten-gigabitethernet 1/0/17

    [SWITCH#1] Ten-GigabitEthernet1/0/17] undo shutdown

    [SWITCH#1] interface ten-gigabitethernet 1/0/18

    [SWITCH#1] Ten-GigabitEthernet1/0/18] undo shutdown

    [SWITCH#1] interface ten-gigabitethernet 1/0/19

    [SWITCH#1] Ten-GigabitEthernet1/0/19] undo shutdown

    [SWITCH#1] interface ten-gigabitethernet 1/0/20

    [SWITCH#1] Ten-GigabitEthernet1/0/20] undo shutdown

    [SWITCH#1] Ten-GigabitEthernet1/0/20] save

    [SWITCH#1] irf-port-configuration active


    -------------------------------------------------------------------------------------------------
    ------------------------------


    <SWITCH#2> system-view
    [SWITCH#2] irf member 1 renumber 2
    [SWITCH#2]save
    [SWITCH#2]reboot

    [SWITCH#2] irf mac-address persistent always (Enable MAC address persistance)

    [SWITCH#2] Irf member 2 priority 1

    [SWITCH#2] interface ten-gigabitethernet 2/0/17

    [SWITCH#2] Ten-GigabitEthernet1/0/20] shutdown

    [SWITCH#1] interface ten-gigabitethernet 2/0/18

    [SWITCH#2] Ten-GigabitEthernet1/0/21] shutdown

    [SWITCH#2] irf-port 1/1

    [SWITCH#2] irf-port1/1] port group interface ten-gigabitethernet 1/0/17

    ( Here I recieved the same warning as Switc#1)

    [SWITCH#2] interface ten-gigabitethernet 1/0/19

    [SWITCH#2] Ten-GigabitEthernet1/0/19] shutdown

    [SWITCH#2] interface ten-gigabitethernet 1/0/20

    [SWITCH#2] Ten-GigabitEthernet1/0/20] shutdown

    [SWITCH#2] irf-port1/1] port group interface ten-gigabitethernet 1/0/19

    [SWITCH#2] irf-port1/1] quit

    [SWITCH#2] irf-port 1/2

    [SWITCH#2] irf-port1/2] port group interface ten-gigabitethernet 1/0/18

    [SWITCH#2] irf-port1/2] port group interface ten-gigabitethernet 1/0/20

    [SWITCH#2] irf-port1/2] quit

    [SWITCH#2] interface ten-gigabitethernet 1/0/17

    [SWITCH#2] Ten-GigabitEthernet1/0/17] undo shutdown

    [SWITCH#2] interface ten-gigabitethernet 1/0/18

    [SWITCH#2] Ten-GigabitEthernet1/0/18] undo shutdown

    [SWITCH#2] interface ten-gigabitethernet 1/0/19

    [SWITCH#2] Ten-GigabitEthernet1/0/19] undo shutdown

    [SWITCH#2] interface ten-gigabitethernet 1/0/20

    [SWITCH#2] Ten-GigabitEthernet1/0/20] undo shutdown

    [SWITCH#2] Ten-GigabitEthernet1/0/20] save

    [SWITCH#2] irf-port-configuration active


    At this pont I connected the DAC like this:

     

    port ten-gigabitethernet 1/0/17 to ten-gigabitethernet 2/0/18 and port ten-gigabitethernet 1/0/18
    to ten-gigabitethernet 2/0/17

     

    Then Switch#1 start propagating his image to swtich#2 and when this prosess is done I see that the
    sysname of Switch#2 changed to Switch#1 and can see with the <disp irf> command that member 1 is
    "master" and member 2 is "standby", I see on irf topology the links are UP and on irf configuration
    the interfaces that belong to each IRF port.

    So up to here I can assume I have the IRF links with a 20G pipe.


    ***There is a step on the H3C site about changing mode with the <chassis convert mode irf> but I
    don't know if this step is required now that the IRF is up ?????***


    I then configured BFD MAD creating a separate VLAN and assigning to diffrent IP adresses per
    member:

     

    [SWITCH#1] vlan 30

    [SWITCH#1-vlan30] port ten-gigabitethernet 1/0/21 ten-gigabitethernet 2/0/21

    [SWITCH#1] quit


    [SWITCH#1] vlan 30

    [SWITCH#1] interface vlan-interface 30

    [SWITCH#1-Vlan-interface30] mad bfd enable

    [SWITCH#1-Vlan-interface30] mad ip address 192.168.5.1 24 member 1

    [SWITCH#1-Vlan-interface30] mad ip address 192.168.5.2 24 member 2

    [SWITCH#1] save

    [SWITCH#1] quit


    Now I created the VLAN for the LACPs:


    [SWITCH#1] ip route 0.0.0.0 0.0.0.0 10.0.0.254 (default gateway)

    [SWITCH#1] vlan 60

    [SWITCH#1] interface vlan-interface 1000

    [SWITCH#1-Vlan-interface60] ip address 10.0.0.1 255.255.255.0

    [SWITCH#1-Vlan-interface60] description all servers


    [SWITCH#1-Vlan-interface60] save


    [SWITCH#1-Vlan-interface60]quit


    [SWITCH#1] vlan 61

    [SWITCH#1] interface vlan-interface 61

    [SWITCH#1-Vlan-interface61] description for 2530 Switches


    LACP ports for SERVER 2:


    <SWITCH#1> system-view

    [SWITCH#1] port access permit vlan 60

    [SWITCH#1] interface bridge-aggregation 1

    [SWITCH#1] link-aggregation mode dynamic

    [SWITCH#1] port link-type access

    [SWITCH#1] port access permit vlan 60

    [SWITCH#1] interface bridge-aggregation 1


    [SWITCH#1] quit

    [SWITCH#1] interface ten-gigabitethernet 1/0/3

    [SWITCH#1-Ten-GigabitEthernet1/0/3] port link-aggregation group 1

    [SWITCH#1-Ten-GigabitEthernet1/0/3] quit


    [SWITCH#1] interface ten-gigabitethernet 2/0/3

    [SWITCH#1-Ten-GigabitEthernet2/0/3] port link-aggregation group 1


    [SWITCH#1-Ten-GigabitEthernet2/0/3] quit


    LACP ports for SERVER 1:


    [SWITCH#1] interface bridge-aggregation 2

    [SWITCH#1] link-aggregation mode dynamic

    [SWITCH#1] port link-type access

    [SWITCH#1] port access permit vlan 60

    [SWITCH#1] quit

    [SWITCH#1] interface ten-gigabitethernet 1/0/1

    [SWITCH#1-Ten-GigabitEthernet1/0/1] port link-aggregation group 2

    [SWITCH#1-Ten-GigabitEthernet1/0/1] quit

    [SWITCH#1] interface ten-gigabitethernet 1/0/2

    [SWITCH#1-Ten-GigabitEthernet1/0/2] port link-aggregation group 2

    [SWITCH#1-Ten-GigabitEthernet1/0/2] quit

    [SWITCH#1] interface ten-gigabitethernet 2/0/1

    [SWITCH#1-Ten-GigabitEthernet2/0/1] port link-aggregation group 2

    [SWITCH#1-Ten-GigabitEthernet2/0/1] quit

    [SWITCH#1]interface ten-gigabitethernet 2/0/2

    SWITCH#1-Ten-GigabitEthernet2/0/2] port link-aggregation group 2

    [SWITCH#1-Ten-GigabitEthernet2/0/2] quit


    LACP for 2530 switches:

     

    SWITCH#1] interface bridge-aggregation 3

    [SWITCH#1] link-aggregation mode dynamic

    [SWITCH#1] port link-type trunk

    [SWITCH#1] port access vlan 60

    [SWITCH#1] port access vlan 61

    [SWITCH#1] quit


    [SWITCH#1] interface ten-gigabitethernet 1/0/25

    [SWITCH#1-Ten-GigabitEthernet1/0/1] port link-aggregation group 3

    [SWITCH#1-Ten-GigabitEthernet1/0/1] quit

    [SWITCH#1] interface ten-gigabitethernet 1/0/26

    [SWITCH#1-Ten-GigabitEthernet1/0/2] port link-aggregation group 3

    [SWITCH#1-Ten-GigabitEthernet1/0/2] quit

    [SWITCH#1] interface ten-gigabitethernet 2/0/25

    [SWITCH#1-Ten-GigabitEthernet2/0/1] port link-aggregation group 1

    [SWITCH#1-Ten-GigabitEthernet2/0/1] quit

    [SWITCH#1]interface ten-gigabitethernet 2/0/26

    SWITCH#1-Ten-GigabitEthernet2/0/2] port link-aggregation group 1

    [SWITCH#1-Ten-GigabitEthernet2/0/2] quit

     

    If you guys can share a little light on this subject I will really appreciate!!



  • 2.  RE: IRF and link aggregation problems

    Posted Oct 05, 2014 08:37 AM

    order of config is important:

    1/ define bagg

    2/ assign physical ports

    3/ configure bagg with vlans

     

    In your example, you define bagg and set the vlans first. Since no physical members exist, the vlan propagation will not be effective on the member ports.

    By simply assigning a member port to the link-agg later on, the vlan config is not propagated.

    Since the physical member port vlan config does not match the bagg port, the port cannot be used in the link-agg, so no traffic will be forwarded.

     

    Basic validation for a bagg1 with sample g1/0/1 and g2/0/1 ports:

    dis cur int bagg 1

    dis cur int g1/0/1

    dis cur int g2/0/1

    > verify same port type and vlan configuration

     

    Linkagg validation:

    dis link-agg summary

    dis link-agg verbose

     

    best regards,Peter



  • 3.  RE: IRF and link aggregation problems

    Posted Feb 26, 2015 11:33 PM

    Hi @RexRay, 

     

    I am having the samilar issue as yours. Could you please let me know your status of this setup? 
    Much appreciate with your answer. 

    Sambath, 

    @RexRay wrote:

    Hi everybody,

     

    I want to first thank to the people here respondisng to post and sharing their knowlage :)

     

    We have two HP 5900AF switches that we want to deploy into on our office netwotk in order to take the
    advantage of redundancy and bigger bandwith, I configured it the best I could but we running in
    to trouble with the end points (servers running CentOs)  when they don't want ro talk to each other, no even on the same switch!!! (pinging just time out every time) I'm runnng the servers with static IPs on VLAN 60.


    We want IRF and link aggreagation so here is my configuration and a little schematic:

     

    <SWITCH#1> system-view

    [SWITCH#1] irf mac-address persistent always (Enable MAC address persistance)

    [SWITCH#1] Irf member 1 priority 10

    [SWITCH#1] interface ten-gigabitethernet 1/0/17

    [SWITCH#1] Ten-GigabitEthernet1/0/17] shutdown

    [SWITCH#1] interface ten-gigabitethernet 1/0/18

    [SWITCH#1] Ten-GigabitEthernet1/0/18] shutdown

    [SWITCH#1] irf-port 1/1

    [SWITCH#1] irf-port1/1] port group interface ten-gigabitethernet 1/0/17

     

    ( Here I recieved a warning telling me to also shutdown port 19 and 20 because they belong to the
    same group so I did and I aso added them to the IRF even knowing that I will only link 17 and 18)

     

    [SWITCH#1] interface ten-gigabitethernet 1/0/19

    [SWITCH#1] Ten-GigabitEthernet1/0/19] shutdown

    [SWITCH#1] interface ten-gigabitethernet 1/0/20

    [SWITCH#1] Ten-GigabitEthernet1/0/20] shutdown

    [SWITCH#1] irf-port1/1] port group interface ten-gigabitethernet 1/0/19

    [SWITCH#1] irf-port1/1] quit

    [SWITCH#1] irf-port 1/2

    [SWITCH#1] irf-port1/2] port group interface ten-gigabitethernet 1/0/18

    [SWITCH#1] irf-port1/2] port group interface ten-gigabitethernet 1/0/20

    [SWITCH#1] irf-port1/2] quit

    [SWITCH#1] interface ten-gigabitethernet 1/0/17

    [SWITCH#1] Ten-GigabitEthernet1/0/17] undo shutdown

    [SWITCH#1] interface ten-gigabitethernet 1/0/18

    [SWITCH#1] Ten-GigabitEthernet1/0/18] undo shutdown

    [SWITCH#1] interface ten-gigabitethernet 1/0/19

    [SWITCH#1] Ten-GigabitEthernet1/0/19] undo shutdown

    [SWITCH#1] interface ten-gigabitethernet 1/0/20

    [SWITCH#1] Ten-GigabitEthernet1/0/20] undo shutdown

    [SWITCH#1] Ten-GigabitEthernet1/0/20] save

    [SWITCH#1] irf-port-configuration active


    -------------------------------------------------------------------------------------------------
    ------------------------------


    <SWITCH#2> system-view
    [SWITCH#2] irf member 1 renumber 2
    [SWITCH#2]save
    [SWITCH#2]reboot

    [SWITCH#2] irf mac-address persistent always (Enable MAC address persistance)

    [SWITCH#2] Irf member 2 priority 1

    [SWITCH#2] interface ten-gigabitethernet 2/0/17

    [SWITCH#2] Ten-GigabitEthernet1/0/20] shutdown

    [SWITCH#1] interface ten-gigabitethernet 2/0/18

    [SWITCH#2] Ten-GigabitEthernet1/0/21] shutdown

    [SWITCH#2] irf-port 1/1

    [SWITCH#2] irf-port1/1] port group interface ten-gigabitethernet 1/0/17

    ( Here I recieved the same warning as Switc#1)

    [SWITCH#2] interface ten-gigabitethernet 1/0/19

    [SWITCH#2] Ten-GigabitEthernet1/0/19] shutdown

    [SWITCH#2] interface ten-gigabitethernet 1/0/20

    [SWITCH#2] Ten-GigabitEthernet1/0/20] shutdown

    [SWITCH#2] irf-port1/1] port group interface ten-gigabitethernet 1/0/19

    [SWITCH#2] irf-port1/1] quit

    [SWITCH#2] irf-port 1/2

    [SWITCH#2] irf-port1/2] port group interface ten-gigabitethernet 1/0/18

    [SWITCH#2] irf-port1/2] port group interface ten-gigabitethernet 1/0/20

    [SWITCH#2] irf-port1/2] quit

    [SWITCH#2] interface ten-gigabitethernet 1/0/17

    [SWITCH#2] Ten-GigabitEthernet1/0/17] undo shutdown

    [SWITCH#2] interface ten-gigabitethernet 1/0/18

    [SWITCH#2] Ten-GigabitEthernet1/0/18] undo shutdown

    [SWITCH#2] interface ten-gigabitethernet 1/0/19

    [SWITCH#2] Ten-GigabitEthernet1/0/19] undo shutdown

    [SWITCH#2] interface ten-gigabitethernet 1/0/20

    [SWITCH#2] Ten-GigabitEthernet1/0/20] undo shutdown

    [SWITCH#2] Ten-GigabitEthernet1/0/20] save

    [SWITCH#2] irf-port-configuration active


    At this pont I connected the DAC like this:

     

    port ten-gigabitethernet 1/0/17 to ten-gigabitethernet 2/0/18 and port ten-gigabitethernet 1/0/18
    to ten-gigabitethernet 2/0/17

     

    Then Switch#1 start propagating his image to swtich#2 and when this prosess is done I see that the
    sysname of Switch#2 changed to Switch#1 and can see with the <disp irf> command that member 1 is
    "master" and member 2 is "standby", I see on irf topology the links are UP and on irf configuration
    the interfaces that belong to each IRF port.

    So up to here I can assume I have the IRF links with a 20G pipe.


    ***There is a step on the H3C site about changing mode with the <chassis convert mode irf> but I
    don't know if this step is required now that the IRF is up ?????***


    I then configured BFD MAD creating a separate VLAN and assigning to diffrent IP adresses per
    member:

     

    [SWITCH#1] vlan 30

    [SWITCH#1-vlan30] port ten-gigabitethernet 1/0/21 ten-gigabitethernet 2/0/21

    [SWITCH#1] quit


    [SWITCH#1] vlan 30

    [SWITCH#1] interface vlan-interface 30

    [SWITCH#1-Vlan-interface30] mad bfd enable

    [SWITCH#1-Vlan-interface30] mad ip address 192.168.5.1 24 member 1

    [SWITCH#1-Vlan-interface30] mad ip address 192.168.5.2 24 member 2

    [SWITCH#1] save

    [SWITCH#1] quit


    Now I created the VLAN for the LACPs:


    [SWITCH#1] ip route 0.0.0.0 0.0.0.0 10.0.0.254 (default gateway)

    [SWITCH#1] vlan 60

    [SWITCH#1] interface vlan-interface 1000

    [SWITCH#1-Vlan-interface60] ip address 10.0.0.1 255.255.255.0

    [SWITCH#1-Vlan-interface60] description all servers


    [SWITCH#1-Vlan-interface60] save


    [SWITCH#1-Vlan-interface60]quit


    [SWITCH#1] vlan 61

    [SWITCH#1] interface vlan-interface 61

    [SWITCH#1-Vlan-interface61] description for 2530 Switches


    LACP ports for SERVER 2:


    <SWITCH#1> system-view

    [SWITCH#1] port access permit vlan 60

    [SWITCH#1] interface bridge-aggregation 1

    [SWITCH#1] link-aggregation mode dynamic

    [SWITCH#1] port link-type access

    [SWITCH#1] port access permit vlan 60

    [SWITCH#1] interface bridge-aggregation 1


    [SWITCH#1] quit

    [SWITCH#1] interface ten-gigabitethernet 1/0/3

    [SWITCH#1-Ten-GigabitEthernet1/0/3] port link-aggregation group 1

    [SWITCH#1-Ten-GigabitEthernet1/0/3] quit


    [SWITCH#1] interface ten-gigabitethernet 2/0/3

    [SWITCH#1-Ten-GigabitEthernet2/0/3] port link-aggregation group 1


    [SWITCH#1-Ten-GigabitEthernet2/0/3] quit


    LACP ports for SERVER 1:


    [SWITCH#1] interface bridge-aggregation 2

    [SWITCH#1] link-aggregation mode dynamic

    [SWITCH#1] port link-type access

    [SWITCH#1] port access permit vlan 60

    [SWITCH#1] quit

    [SWITCH#1] interface ten-gigabitethernet 1/0/1

    [SWITCH#1-Ten-GigabitEthernet1/0/1] port link-aggregation group 2

    [SWITCH#1-Ten-GigabitEthernet1/0/1] quit

    [SWITCH#1] interface ten-gigabitethernet 1/0/2

    [SWITCH#1-Ten-GigabitEthernet1/0/2] port link-aggregation group 2

    [SWITCH#1-Ten-GigabitEthernet1/0/2] quit

    [SWITCH#1] interface ten-gigabitethernet 2/0/1

    [SWITCH#1-Ten-GigabitEthernet2/0/1] port link-aggregation group 2

    [SWITCH#1-Ten-GigabitEthernet2/0/1] quit

    [SWITCH#1]interface ten-gigabitethernet 2/0/2

    SWITCH#1-Ten-GigabitEthernet2/0/2] port link-aggregation group 2

    [SWITCH#1-Ten-GigabitEthernet2/0/2] quit


    LACP for 2530 switches:

     

    SWITCH#1] interface bridge-aggregation 3

    [SWITCH#1] link-aggregation mode dynamic

    [SWITCH#1] port link-type trunk

    [SWITCH#1] port access vlan 60

    [SWITCH#1] port access vlan 61

    [SWITCH#1] quit


    [SWITCH#1] interface ten-gigabitethernet 1/0/25

    [SWITCH#1-Ten-GigabitEthernet1/0/1] port link-aggregation group 3

    [SWITCH#1-Ten-GigabitEthernet1/0/1] quit

    [SWITCH#1] interface ten-gigabitethernet 1/0/26

    [SWITCH#1-Ten-GigabitEthernet1/0/2] port link-aggregation group 3

    [SWITCH#1-Ten-GigabitEthernet1/0/2] quit

    [SWITCH#1] interface ten-gigabitethernet 2/0/25

    [SWITCH#1-Ten-GigabitEthernet2/0/1] port link-aggregation group 1

    [SWITCH#1-Ten-GigabitEthernet2/0/1] quit

    [SWITCH#1]interface ten-gigabitethernet 2/0/26

    SWITCH#1-Ten-GigabitEthernet2/0/2] port link-aggregation group 1

    [SWITCH#1-Ten-GigabitEthernet2/0/2] quit

     

    If you guys can share a little light on this subject I will really appreciate!!

     



  • 4.  RE: IRF and link aggregation problems

    Posted Feb 27, 2015 02:58 AM

    Hi Rexray

     

    ok. Lots of config here.

     

    1: Have you tried just connecting your CentOS servers in a single access port (no BAGG) and then just testing for normal connectivity?

     

    2: When you enable LACP, what does your CentOS config look like (assuming interfaces tgeX and tgeY bonds to bond0)? Your bond0 interface should be up, etc.

     

    Regards

     

     

     



Related Content