tunefs.lustre --erase-param --mgsnode=<new_nid> --writeconf /dev/sda
Where in your case the new_nid is: 10.0.1.60@tcp0,172.27.7.100@tcp1
On all osts and MDTs as well(if you have a separate one).
Cheers,
Arman.
Hi,
I've set up a little cluster (1 MGS/MDS and 2 OSS) with lustre 2.6 on a private network (eth0/10.0.1.X), with some clients (~10) and everything was pretty easy to do (except the pain to make debian clients working with newer kernels).
I wanted to add another network via eth1/172.27.7.X but i didn't find clearly the information on how to do this. I did :
- unmount all the clients
- unmount OSTs and MDT
- unload lustre modules on both OSSs and the MDS with lustre_rmmod
- configured /etc/modprobe.d/lustre.conf according to new interfaces ( "options lnet networks=tcp0(eth0),tcp1(eth1)" )
If i restart the cluster, lustre restart in the same configuration, except that lctl list_nids outputs my networks correctly on all nodes. But at this point the cluster is still served on the 10.0.1.X network only.
What is the process to tell lustre to run on eth1 as well ?
I tried to follow the "Changing a Server NID" section of the manual as it was advised in a archived post and ran :
- Unmount the clients.
- Unmount the MDT.
- Unmount all OSTs.
- If the MGS and MDS share a partition, start the MGS only: mount -t lustre /dev/sdb -o nosvc /mdt
- Run the replace_nids command on the MGS: lctl replace_nids 10.0.1.60@tcp0,172.27.7.100@tcp1
- If the MGS and MDS share a partition, stop the MGS : umount /mdt
Then when i tried to start the cluster again i was unable to mount any client. I did setup the clients lustre.conf as well and before i could mount a client on an OSS node (I know it's bad but for testing purpose its doable) where after these changes i couldn't.
Did I miss some point ?
I can fetch the old logs if needed because i simply rebuild the lustre partition by running mkfs.lustre with the --mgsnode=10.0.1.60,172.27.7.100 and --reformat options. It's running but i'd like to know how to change network setup without reformating.
Thanks
-
Jérome BECOT
Administrateur Systèmes et Réseaux
Molécules à visée Thérapeutique par des approches in Silico (MTi)
Univ Paris Diderot, UMRS973 Inserm
Case 013
Bât. Lamarck A, porte 412
35, rue Hélène Brion 75205 Paris Cedex 13
France
Tel : 01 57 27 83 82
_______________________________________________
HPDD-discuss mailing list
HPDD-discuss@lists.01.org
https://lists.01.org/mailman/listinfo/hpdd-discuss