One Consist Network with Two Redundant ETB Nodes HowTo

This document describes how to configure a consist with a single consist network managed by two redundant ETBNs. The consist is depicted in Figure 1.

The result of the inauguration will be a network where ETBN1 has the ETBN ID 1, the IP-address 10.128.0.1 (based on the ETBN ID and since the network is configured as TCMS). ETBN2 will attain ETBN-ID 2 and IP 10.128.1.2. CN1 will attain the network IP 10.128.64.0/18.

      .---------------------------.
     /            cst1             \
     '-----------------------------'
        .-------.    .-------.
      --+       +----+       +--     dir1 = (ethX5, ethX6)
  <-dir1| ETBN1 |    | ETBN2 |dir2-> dir2 = (ethX7, ethX8)
      --+       +----+       +--
        '---+---'    '---+---'
            |            |
        ----+------------+---- CN1 vlan10 (ethX3)

Figure 1: A single consist with one consist network managed by two redundant ETB nodes.

Note

In order to get two ETB nodes to manage a single consist net, they both need to have the exact same configuration with respect to uuid, node and ecn configuration. Also, the ETBN must have different local-id.

Both nodes also need to have VRRP configured and enabled on the CN side.

Configuration

Start with ETBN1 and configure VLANs and TTDP.

etbn1:#> configure
etbn1:/config/#> vlan 10
Creating new VLAN vid:10 with name: vlan10
etbn1:/config/vlan-10/#> untagged ethX3
etbn1:/config/vlan-10/#> end
etbn1:/config/#> iface vlan10
etbn1:/config/iface-vlan10/#> no inet
etbn1:/config/iface-vlan10/#> inet static 10.0.0.1/18
etbn1:/config/iface-vlan10/inet-static-10.0.0.1/#> end
etbn1:/config/iface-vlan10/#> end
etbn1:/config/#> ttdp
Activating TTDP with default settings.
etbn1:/config/ttdp/#> uuid 11111111-1111-1111-1111-111111111111
etbn1:/config/ttdp/#> node 1 ecn 1
etbn1:/config/ttdp/#> node 2 ecn 1
etbn1:/config/ttdp/#> ecn 1 vlan10
etbn1:/config/ttdp/#> dir1 ethX5,ethX6
Remember to manually set mdi/mdi-x mode
  in port settings for all agg ports.
etbn1:/config/ttdp/#> dir2 ethX7,ethX8
Remember to manually set mdi/mdi-x mode
  in port settings for all agg ports.
etbn1:/config/ttdp/#> local-id 1
etbn1:/config/ttdp/#> end
TTDP: Created VLAN 492. Note that this VLAN will not be deleted automatically
  if TTDP is deactivated.
etbn1:/config/#> vlan 2
Creating new VLAN vid:2 with name: vlan2
etbn1:/config/vlan-2/#> no multicast-snooping
etbn1:/config/vlan-2/#> untagged lag-dir1,lag-dir2
etbn1:/config/vlan-2/#> end

Continue by configuring the ports.

etbn1:/config/#> port ethX5
etbn1:/config/port-ethX5/#> speed-duplex 100-full
etbn1:/config/port-ethX5/#> no auto-negotiate
etbn1:/config/port-ethX5/#> fastlink
etbn1:/config/port-ethX5/#> mdix-mode mdi
etbn1:/config/port-ethX5/#> end
etbn1:/config/#> port ethX6
etbn1:/config/port-ethX6/#> speed-duplex 100-full
etbn1:/config/port-ethX6/#> no auto-negotiate
etbn1:/config/port-ethX6/#> fastlink
etbn1:/config/port-ethX6/#> mdix-mode mdi
etbn1:/config/port-ethX6/#> end
etbn1:/config/#> port ethX7
etbn1:/config/port-ethX7/#> speed-duplex 100-full
etbn1:/config/port-ethX7/#> no auto-negotiate
etbn1:/config/port-ethX7/#> fastlink
etbn1:/config/port-ethX7/#> mdix-mode mdi
etbn1:/config/port-ethX7/#> end
etbn1:/config/#> port ethX8
etbn1:/config/port-ethX8/#> speed-duplex 100-full
etbn1:/config/port-ethX8/#> no auto-negotiate
etbn1:/config/port-ethX8/#> fastlink
etbn1:/config/port-ethX8/#> mdix-mode mdi
etbn1:/config/port-ethX8/#> end

Note

In this HowTo, it is assumed that the ETB uses crossover cabling. For this reason, all ETB ports on both ETBNs use the same MDI-X mode. If non-crossover cabling is used, these settings must be changed for two of the inward-facing ETB ports.

The next step is to configure VRRP on each node. Start with ETBN1 which will have the MASTER role. The MASTER role is gained by setting the priority for the VRRP instance higher than on ETBN2 (see VRRP).

etbn1:/config/#> router
etbn1:/config/router/#> vrrp cn1
Creating new VRRP instance: cn1
Invalid settings: Interface not set.
etbn1:/config/router/vrrp-cn1/#> iface vlan1
Warning: No ports have been added to the configured VLAN.
VRRP will not work as expected with this configuration.
Invalid settings: Invalid IPv4 address.
etbn1:/config/router/vrrp-cn1/#> address 10.0.0.100
Invalid settings: VRID invalid. Valid values: 1 to 255.
etbn1:/config/router/vrrp-cn1/#> vrid 132
etbn1:/config/router/vrrp-cn1/#> version 3
etbn1:/config/router/vrrp-cn1/#> priority 150
etbn1:/config/router/vrrp-cn1/#> interval 1
etbn1:/config/router/vrrp-cn1/#> preempt delay 1
etbn1:/config/router/vrrp-cn1/#> end
etbn1:/config/router/#> end
etbn1:/config/#> end
Applying configuration.
Configuration activated.
Remember "copy run start" to save to flash (NVRAM).
etbn1:/#>

Now, repeat the exact steps above in the second ETB node. The only difference is the static address for VLAN 10 and the local id.

etbn2:#> configure
etbn2:/config/#> vlan 10
Creating new VLAN vid:10 with name: vlan10
etbn2:/config/vlan-10/#> untagged ethX3
etbn2:/config/vlan-10/#> end
etbn2:/config/#> iface vlan10
etbn2:/config/iface-vlan10/#> no inet
etbn2:/config/iface-vlan10/#> b>inet static 10.0.0.2/18
etbn2:/config/iface-vlan10/inet-static-10.0.0.2/#> end
etbn2:/config/iface-vlan10/#> end
etbn2:/config/#> ttdp
Activating TTDP with default settings.
etbn2:/config/ttdp/#> uuid 11111111-1111-1111-1111-111111111111
etbn2:/config/ttdp/#> node 1 ecn 1
etbn2:/config/ttdp/#> node 2 ecn 1
etbn2:/config/ttdp/#> ecn 1 vlan10
etbn2:/config/ttdp/#> dir1 ethX5,ethX6
Remember to manually set mdi/mdi-x mode
  in port settings for all agg ports.
etbn2:/config/ttdp/#> dir2 ethX7,ethX8
Remember to manually set mdi/mdi-x mode
  in port settings for all agg ports.
etbn2:/config/ttdp/#> local-id 2
etbn2:/config/ttdp/#> end
TTDP: Created VLAN 492. Note that this VLAN will not be deleted automatically
  if TTDP is deactivated.
etbn2:/config/#> vlan 2
Creating new VLAN vid:2 with name: vlan2
etbn2:/config/vlan-2/#> no multicast-snooping
etbn2:/config/vlan-2/#> untagged lag-dir1,lag-dir2
etbn2:/config/vlan-2/#> end

Continue by configuring the ports.

etbn2:/config/#> port ethX5
etbn2:/config/port-ethX5/#> speed-duplex 100-full
etbn2:/config/port-ethX5/#> no auto-negotiate
etbn2:/config/port-ethX5/#> fastlink
etbn2:/config/port-ethX5/#> mdix-mode mdi
etbn2:/config/port-ethX5/#> end
etbn2:/config/#> port ethX6
etbn2:/config/port-ethX6/#> speed-duplex 100-full
etbn2:/config/port-ethX6/#> no auto-negotiate
etbn2:/config/port-ethX6/#> fastlink
etbn2:/config/port-ethX6/#> mdix-mode mdi
etbn2:/config/port-ethX6/#> end
etbn2:/config/#> port ethX7
etbn2:/config/port-ethX7/#> speed-duplex 100-full
etbn2:/config/port-ethX7/#> no auto-negotiate
etbn2:/config/port-ethX7/#> fastlink
etbn2:/config/port-ethX7/#> mdix-mode mdi
etbn2:/config/port-ethX7/#> end
etbn2:/config/#> port ethX8
etbn2:/config/port-ethX8/#> speed-duplex 100-full
etbn2:/config/port-ethX8/#> no auto-negotiate
etbn2:/config/port-ethX8/#> fastlink
etbn2:/config/port-ethX8/#> mdix-mode mdi
etbn2:/config/port-ethX8/#> end

Repeat the same steps for ETBN2 with a lower priority to make it backup. We set the priority to 100.

etbn2:/config/#> router
etbn2:/config/router/#> vrrp cn1
Creating new VRRP instance: cn1
Invalid settings: Interface not set.
etbn2:/config/router/vrrp-cn1/#> iface vlan1
Warning: No ports have been added to the configured VLAN.
VRRP will not work as expected with this configuration.
Invalid settings: Invalid IPv4 address.
etbn2:/config/router/vrrp-cn1/#> address 10.0.0.100
Invalid settings: VRID invalid. Valid values: 1 to 255.
etbn2:/config/router/vrrp-cn1/#> vrid 132
etbn2:/config/router/vrrp-cn1/#> version 3
etbn2:/config/router/vrrp-cn1/#> priority 100
etbn2:/config/router/vrrp-cn1/#> interval 1
etbn2:/config/router/vrrp-cn1/#> preempt delay 1
etbn2:/config/router/vrrp-cn1/#> end
etbn2:/config/router/#> end
etbn2:/config/#> end
Applying configuration.
Configuration activated.
Remember "copy run start" to save to flash (NVRAM).
etbn2:/#>

Communication Profile Configuration

For this HowTo, we will be using the following premade configuration file:

cst1 communication profile configuration

  1. Transfer the communication profile configuration file to /cfg/comm-profile.json on each device.

The cst1 configuration file to etbn1 and etbn2.

Note

Ensure the filenames are correct. That is, they should have the name comm-profile.json in /cfg/ on their respective device.

Note

Since the consist is a redundant consist, both configuration files must be identical in both nodes in the consist.

See SCP HowTo for instructions on how to transfer files to the device or use the upload function on the TCN web configuration page.

Inauguration Result

Using the show ttdp command we now verify that we have recevied the intended network configuration. Highlighted in orange are the values that are of interest.

etbn1:/#> show ttdp
TTDP NODE                                                                     
backbone-id  : 0 (tcms)
etbn-id      : 1
etbn-ip      : 10.128.0.1
local-id     : 1
own-mac      : 0c:65:8c:93:00:00
uuid         : 11111111-1111-1111-1111-111111111111
connTableCnt : 0xb81af94
EtbTopoCnt   : 0x6f002b4
Inauguration : INAUGURATED
Inhibition   : Self: Off,  Others: Off,  Train: Off

CST-NET  IFACE     IP              CONNECTED ETBNs                            
   1     vlan10    10.0.0.1/18     1,2

NODE ID      MAC ADDRESS            ORIENTATION                               
      1      0c:65:8c:93:00:00      Direct
      2      0c:7a:40:ee:00:00      Direct

CONSIST                               NODES   DIRECTION  NETWORKS             
11111111-1111-1111-1111-111111111111  1..2    Direct     10.128.64.0/18

etbn1:/#>
etbn2:/#> show ttdp
TTDP NODE                                                                     
backbone-id  : 0 (tcms)
etbn-id      : 2
etbn-ip      : 10.128.0.2
local-id     : 2
own-mac      : 0c:7a:40:ee:00:00
uuid         : 11111111-1111-1111-1111-111111111111
connTableCnt : 0xb81af94
EtbTopoCnt   : 0x6f002b4
Inauguration : INAUGURATED
Inhibition   : Self: Off,  Others: Off,  Train: Off

CST-NET  IFACE     IP              CONNECTED ETBNs                            
   1     vlan10    10.0.0.2/18     1,2

NODE ID      MAC ADDRESS            ORIENTATION                               
      1      0c:65:8c:93:00:00      Direct
      2      0c:7a:40:ee:00:00      Direct

CONSIST                               NODES   DIRECTION  NETWORKS             
11111111-1111-1111-1111-111111111111  1..2    Direct     10.128.64.0/18

etbn2:/#>