8:48 p.m.
Hi,
I've set up a little cluster (1 MGS/MDS and 2 OSS) with lustre 2.6 on a
private network (eth0/10.0.1.X), with some clients (~10) and everything
was pretty easy to do (except the pain to make debian clients working
with newer kernels).
I wanted to add another network via eth1/172.27.7.X but i didn't find
clearly the information on how to do this. I did :
- unmount all the clients
- unmount OSTs and MDT
- unload lustre modules on both OSSs and the MDS with lustre_rmmod
- configured /etc/modprobe.d/lustre.conf according to new interfaces (
"options lnet networks=tcp0(eth0),tcp1(eth1)" )
If i restart the cluster, lustre restart in the same configuration,
except that lctl list_nids outputs my networks correctly on all nodes.
But at this point the cluster is still served on the 10.0.1.X network only.
What is the process to tell lustre to run on eth1 as well ?
I tried to follow the "Changing a Server NID" section of the manual as
it was advised in a archived post and ran :
- Unmount the clients.
- Unmount the MDT.
- Unmount all OSTs.
- If the MGS and MDS share a partition, start the MGS only: mount -t
lustre /dev/sdb -o nosvc /mdt
- Run the replace_nids command on the MGS: lctl replace_nids
10.0.1.60@tcp0,172.27.7.100@tcp1
- If the MGS and MDS share a partition, stop the MGS : umount /mdt
Then when i tried to start the cluster again i was unable to mount any
client. I did setup the clients lustre.conf as well and before i could
mount a client on an OSS node (I know it's bad but for testing purpose
its doable) where after these changes i couldn't.
Did I miss some point ?
I can fetch the old logs if needed because i simply rebuild the lustre
partition by running mkfs.lustre with the
--mgsnode=10.0.1.60,172.27.7.100 and --reformat options. It's running
but i'd like to know how to change network setup without reformating.
Thanks
-
Jérome BECOT
Administrateur Systèmes et Réseaux
Molécules à visée Thérapeutique par des approches in Silico (MTi)
Univ Paris Diderot, UMRS973 Inserm
Case 013
Bât. Lamarck A, porte 412
35, rue Hélène Brion 75205 Paris Cedex 13
France
Tel : 01 57 27 83 82