Redundant ECSP services HowTo

This document describes how to configure the ECSP services in a redundant train setup.

See Figure 1 below

          cst1                   cst2
        .-------.    .---------------------------.
       /  UUID1  \  /            UUID2            \
       '---------'  '-----------------------------'
        .-------.      .-------.    .-------.
      --+       +------+       +----+       +--     dir1 = (ethX5, ethX6)
  <-dir1| etbn1 |      | etbn2 |    | etbn3 |dir2-> dir2 = (ethX7, ethX8)
      --+       +------+       +----+       +--
        '---+---'      '---+---'    '-------'
            |              |            |
            |          --+-+------------+---- cst2-cn1 vlan10 (ethX3)
            |            |
            |          ECSC2
      --+---+----- cst1-cn1 vlan10 (ethX3)
        |
      ECSC1

Figure 1: Acceessing ECSP in a redundant consist setup.

Note

In order to get two ETB nodes to manage a single consist net, they both need to have the exact same configuration with respect to uuid, node and ecn configuration.

Note

Both nodes need to have VRRP configured and enabled on the CN side.

Configuration

Start off with ETB node 1 in consist 1 (etbn1).

etbn1:#> configure
etbn1:/config/#> vlan 10
Creating new VLAN vid:10 with name: vlan10
etbn1:/config/vlan-10/#> untagged ethX3
etbn1:/config/vlan-10/#> end
etbn1:/config/#> iface vlan10
etbn1:/config/iface-vlan10/#> no inet
etbn1:/config/iface-vlan10/#> inet static 10.0.0.10/18
etbn1:/config/iface-vlan10/inet-static-10.0.0.10/#> end
etbn1:/config/iface-vlan10/#> end
etbn1:/config/#> ttdp
Activating TTDP with default settings.
DNS Server activated
etbn1:/config/ttdp/#> uuid 11111111-1111-1111-1111-111111111111
etbn1:/config/ttdp/#> node 1 ecn 1
etbn1:/config/ttdp/#> ecn 1 vlan10
etbn1:/config/ttdp/#> dir1 ethX5,ethX6
Remember to manually set mdi/mdi-x mode
 in port settings for all agg ports.
etbn1:/config/ttdp/#> dir2 ethX7,ethX8
Remember to manually set mdi/mdi-x mode
 in port settings for all agg ports.
etbn1:/config/ttdp/#> local-id 1
etbn1:/config/ttdp/#> ecsp-iface vlan10
etbn1:/config/ttdp/#> ecsp-addr 10.0.0.10
etbn1:/config/ttdp/#> ecsc-addr 10.0.0.42
etbn1:/config/ttdp/#> end
TTDP: Created VLAN 492. Note that this VLAN will not be deleted automatically
  if TTDP is deactivated.
etbn1:/config/#> vlan 2
Creating new VLAN vid:2 with name: vlan2
etbn1:/config/vlan-2/#> no multicast-snooping
etbn1:/config/vlan-2/#> untagged lag-dir1,lag-dir2
etbn1:/config/vlan-2/#> end
etbn1:/config/#> end
Applying configuration.
Configuration activated.  Remember "copy run start" to save to flash (NVRAM**.
etbn1:/#>

Next, configure the ETB nodes for consist 2, which have 1 consist net managed by two nodes.

Start with ETB node 1 (etbn2) in the consist and configure vlans and the TTDP part.

etbn2:#> configure
etbn2:/config/#> vlan 10
Creating new VLAN vid:10 with name: vlan10
etbn2:/config/vlan-10/#> untagged ethX3
etbn2:/config/vlan-10/#> end
etbn2:/config/#> iface vlan10
etbn2:/config/iface-vlan10/#> no inet
etbn2:/config/iface-vlan10/#> inet static 10.0.0.10/18
etbn2:/config/iface-vlan10/inet-static-10.0.0.10/#> end
etbn2:/config/iface-vlan10/#> end
etbn2:/config/#> ttdp
Activating TTDP with default settings.
DNS Server activated>
etbn2:/config/ttdp/#> uuid 11111111-1111-1111-1111-111111111111
etbn2:/config/ttdp/#> node 1 ecn 1
etbn2:/config/ttdp/#> node 2 ecn 1
etbn2:/config/ttdp/#> ecn 1 vlan10
etbn2:/config/ttdp/#> dir1 ethX5,ethX6
Remember to manually set mdi/mdi-x mode
  in port settings for all agg ports.
etbn2:/config/ttdp/#> dir2 ethX7,ethX8
Remember to manually set mdi/mdi-x mode
  in port settings for all agg ports.
etbn2:/config/ttdp/#> local-id 1
etbn2:/config/ttdp/#> ecsp-iface vlan10
etbn2:/config/ttdp/#> ecsp-addr 10.0.0.10
etbn2:/config/ttdp/#> ecsp-leader-addr 10.0.0.100
etbn2:/config/ttdp/#> ecsc-addr 10.0.0.52
etbn2:/config/ttdp/#> end
TTDP: Created VLAN 492. Note that this VLAN will not be deleted automatically
  if TTDP is deactivated.
etbn2:/config/#> vlan 2
Creating new VLAN vid:2 with name: vlan2
etbn2:/config/vlan-2/#> no multicast-snooping
etbn2:/config/vlan-2/#> untagged lag-dir1,lag-dir2
etbn2:/config/vlan-2/#> end
etbn2:/config/#> end
Applying configuration.
Configuration activated.  Remember "copy run start" to save to flash (NVRAM).
etbn2:/#>

Now, repeat the exact steps above in the ETB node 2 (etbn3) in the consist. For brevity, only the steps that differs will be shown below.

...
etbn3:/config/iface-vlan10/#> inet static 10.0.0.2/18
...
etbn3:/config/ttdp/#> local-id 2
...
etbn3:/config/ttdp/#> ecsp-addr 10.0.0.10
etbn3:/config/ttdp/#> ecsp-leader-addr 10.0.0.100
etbn3:/config/ttdp/#> ecsc-addr 10.0.0.52
...

Note

See Port configuration on how to set MDI/MDIX on the aggregate ports.

The next step is to configure VRRP on each node in the redundant consist. Start with the node that will have the MASTER role.

NOTE: In this example, etbn2 is selected MASTER.

etbn2:#> configure
etbn2:/config/#> router
etbn2:/config/router/#> vrrp cn1
Creating new VRRP instance: cn1
Invalid settings: Interface not set.
etbn2:/config/router/vrrp-cn1/#> iface vlan1
Warning: No ports have been added to the configured VLAN.
VRRP will not work as expected with this configuration.
Invalid settings: Invalid IPv4 address.
etbn2:/config/router/vrrp-cn1/#> address 10.0.0.100
Invalid settings: VRID invalid. Valid values: 1 to 255.
etbn2:/config/router/vrrp-cn1/#> vrid 132
etbn2:/config/router/vrrp-cn1/#> version 3
etbn2:/config/router/vrrp-cn1/#> priority 150
etbn2:/config/router/vrrp-cn1/#> interval 1
etbn2:/config/router/vrrp-cn1/#> preempt delay 1
etbn2:/config/router/vrrp-cn1/#> end
etbn2:/config/router/#> end
etbn2:/config/#> end
Applying configuration.
Configuration activated.  Remember "copy run start" to save to flash (NVRAM).
etbn2:/#>

Repeat the same steps for etbn3 with a lower priority to make it backup.

...
etbn3:/config/router/vrrp-cn1/#> priority 100
...

Note

See Port configuration on how to set MDI/MDIX on the aggregate ports.

Communication Profile configuration

Finally, for the ECSP’s to function properly, a communication profile configuration is needed on each node.

cst1 communication profile configuration
cst2 communication profile configuration

Transfer the communication profile configuration file to /cfg/comm-profile.json on each device.

The cst1 configuration file to etbn1. The cst2 configuration file to etbn2 and etbn3.

Note

Ensure the filenames are correct. That is, they should end up with the name comm-profile.json in /cfg/ on their respective device.

Note

In the redundant consist here (cst2), both configuration files must be identical in both nodes in the consist.

See SCP HowTo for instructions on how to transfer files to the device.

When the above configuration is complete, the ECSP in cst1 uses IP address 10.0.0.10 on iface vlan10, while the ECSP in cst2 uses IP address 10.0.0.100 on iface vlan10.

To use the ECSP services on cst1, an ECSC client needs to be running on a host with IP address 10.0.0.42, and to use the ECSP services on cst2, an ECSC client needs to be running on a host with IP address 10.0.0.52.