So you think you can NIC?

Sometimes in life, you get even bigger servers, with MOAR NICs then you can count on one hand.
At rAge we had 12 of the bad boys.

Here, we will use 5 in a server with 5 x 1 GbE on the Mobo, and an add in card with another 4 NICs.

We will only use 5 for now, as we dont wanna kill that switch so early in its lifetime!

This is what we are working with:

root@gamecache:/# networkctl
IDX LINK TYPE OPERATIONAL SETUP
1 lo loopback n/a n/a
2 ens7f0 ether n/a n/a
3 ens7f1 ether n/a n/a
4 ens4f0 ether n/a n/a
5 ens4f1 ether n/a n/a
6 ens5f0 ether n/a n/a
7 ens5f1 ether n/a n/a
8 enp12s0f0 ether n/a n/a
9 enp12s0f1 ether n/a n/a
10 enp16s0 ether n/a n/a

10 links listed.

That is 9 NICs, all 1GbE. So lets team up!

Here is what we would use in our interfaces file:

# The loopback network interface
auto lo
iface lo inet loopback

#Bond1
auto bond0
iface bond0 inet static
address 192.168.1.33
netmask 255.255.255.0
bond-slaves none
bond-mode 4
bond-miimon 100

#we will use port 1,2,3,4,A21 as we know they work

#Port 1
auto ens7f0
iface ens7f0 inet manual
bond-master bond0
bond-primary ens7f0 ens7f1 ens4f0 ens4f1 ens5f1

#Port 2
auto ens7f1
iface ens7f1 inet manual
bond-master bond0
bond-primary ens7f0 ens7f1 ens4f0 ens4f1 ens5f1
#Port 3
auto ens4f0
iface ens4f0 inet manual
bond-master bond0
bond-primary ens7f0 ens7f1 ens4f0 ens4f1 ens5f1

#Port 4
auto ens4f1
iface ens4f1 inet manual
bond-master bond0
bond-primary ens7f0 ens7f1 ens4f0 ens4f1 ens5f1

#Port 5
auto enp16s0
iface enp16s0 inet dhcp

#Add on 2 Port 1
auto ens5f1
iface ens5f1 inet manual
bond-master bond0
bond-primary ens7f0 ens7f1 ens4f0 ens4f1 ens5f1

#Add on 2 Port 2
#auto ens5f0
#iface ens5f0 inet dhcp
Quite a few NICs, and now we have 5Gbps at hand, with a total of 9 if we need in future.

Off to the DC we go!

Leave a Reply