IPMP on Solaris 10

Solaris has built-in IP Multi Pathing. IPMP can be setup with either IP tracking or link based. This is my notes on setting up link based IPMP on a LDOM with two virtual interfaces.

Setup the two interfaces:

1
# more /etc/hostname.vnet*
2
::::::::::::::
3
/etc/hostname.vnet0
4
::::::::::::::
5
myhostname netmask + broadcast + group sol10-ipmp up
6
::::::::::::::
7
/etc/hostname.vnet1
8
::::::::::::::
9
group sol10-ipmp up

After reboot ifconfig output:

1
# ifconfig -a
2
lo0: flags=2001000849&lt;UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL&gt; mtu 8232 index 1
3
inet 127.0.0.1 netmask ff000000
4
vnet0: flags=1000843&lt;UP,BROADCAST,RUNNING,MULTICAST,IPv4&gt; mtu 1500 index 2
5
inet 10.2.14.53 netmask fffff800 broadcast 10.2.15.255
6
groupname sol10-ipmp
7
ether 0:14:4f:fa:b5:34
8
vnet1: flags=1000843&lt;UP,BROADCAST,RUNNING,MULTICAST,IPv4&gt; mtu 1500 index 3
9
inet 0.0.0.0 netmask ff000000 broadcast 0.255.255.255
10
groupname sol10-ipmp
11
ether 0:14:4f:fa:42:b5

Down the main interface:

1
# if_mpadm -d vnet0
2
# tail -1 /var/adm/messages
3
Aug 22 14:46:07 myhostname in.mpathd[285]: [ID 832587 daemon.error] Successfully failed over from NIC vnet0 to NIC vnet1

Ifconfig output:

1
# ifconfig -a
2
lo0: flags=2001000849&lt;UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL&gt; mtu 8232 index 1
3
inet 127.0.0.1 netmask ff000000
4
vnet0: flags=89000842&lt;BROADCAST,RUNNING,MULTICAST,IPv4,NOFAILOVER,OFFLINE&gt; mtu 0 index 2
5
inet 0.0.0.0 netmask 0
6
groupname sol10-ipmp
7
ether 0:14:4f:fa:b5:34
8
vnet1: flags=1000843&lt;UP,BROADCAST,RUNNING,MULTICAST,IPv4&gt; mtu 1500 index 3
9
inet 0.0.0.0 netmask ff000000 broadcast 0.255.255.255
10
groupname sol10-ipmp
11
ether 0:14:4f:fa:42:b5
12
vnet1:1: flags=1000843&lt;UP,BROADCAST,RUNNING,MULTICAST,IPv4&gt; mtu 1500 index 3
13
inet 10.2.14.53 netmask fffff800 broadcast 10.2.15.255

Recover the main interface:

1
# if_mpadm -r vnet0
2

3
# tail -3 /var/adm/messages
4
Aug 22 14:46:30 myhostname in.mpathd[285]: [ID 620804 daemon.error] Successfully failed back to NIC vnet0
5
Aug 22 14:46:30 myhostname in.routed[656]: [ID 417587 daemon.error] IP_ADD_MEMBERSHIP ALLHOSTS: Address already in use
6
Aug 22 14:46:30 myhostname in.routed[656]: [ID 537788 daemon.warning] Could not join 224.0.0.9 on interface vnet0: Address already in use
7

8
# ifconfig -a
9
lo0: flags=2001000849&lt;UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL&gt; mtu 8232 index 1
10
inet 127.0.0.1 netmask ff000000
11
vnet0: flags=1000843&lt;UP,BROADCAST,RUNNING,MULTICAST,IPv4&gt; mtu 1500 index 2
12
inet 10.2.14.53 netmask fffff800 broadcast 10.2.15.255
13
groupname sol10-ipmp
14
ether 0:14:4f:fa:b5:34
15
vnet1: flags=1000843&lt;UP,BROADCAST,RUNNING,MULTICAST,IPv4&gt; mtu 1500 index 3
16
inet 0.0.0.0 netmask ff000000 broadcast 0.255.255.255
17
groupname sol10-ipmp
18
ether 0:14:4f:fa:42:b5