I tried to move my MDS from one filesystem on the same machine to another, using the procedure outlined in the Lustre manuals (I didn't use dd, since the underlying disks weren't the same size and also I did not think it was required). Specifically, I used rsync to copy the files, and also used getfattr/setfattr to copy over the extended attributes. Some brief poking around seemed to show that the EA information made it into the new filesystem. However, when I went to mount the "new" MDS partition, it failed with the following error: May 30 23:36:50 mds-foo kernel: [ 186.604083] LustreError: 3082:0:(md_local_object.c:433:llo_local_objects_setup()) creating obj [fld] fid = [0x200000001:0x3:0x0] rc = -116 May 30 23:36:50 mds-foo kernel: [ 186.698205] LustreError: 3082:0:(mdt_handler.c:4576:mdt_init0()) Can't init device stack, rc -116 May 30 23:36:50 mds-foo kernel: [ 186.797206] LustreError: 3082:0:(obd_config.c:522:class_setup()) setup foo-MDT0000 failed (-116) May 30 23:36:50 mds-foo kernel: [ 186.806140] LustreError: 3082:0:(obd_config.c:1363:class_config_llog_handler()) Err -116 on cfg command: May 30 23:36:50 mds-foo kernel: [ 186.815615] Lustre: cmd=cf003 0:foo-MDT0000 1:foo-MDT0000_UUID 2:0 3:foo-MDT0000-mdtlov 4:f There were more errors, bu they all pretty much were cascading from these errors. I switched back to the original filesystem and everything worked. I am willing to believe I did something wrong, but I'm not sure what; I did everything the directions said to do. -116 is ESTALE, and I found in the code where I believe that error was returned, but it was a little unclear to me what the root cause was. Can anyone offer any advice? --Ken _______________________________________________ HPDD-discuss mailing list HPDD-discuss(a)lists.01.org https://lists.01.org/mailman/listinfo/hpdd-discuss

I tried to move my MDS from one filesystem on the same machine to another, using the procedure outlined in the Lustre manuals (I didn't use dd, since the underlying disks weren't the same size and also I did not think it was required).

Specifically, I used rsync to copy the files, and also used getfattr/setfattr to copy over the extended attributes. Some brief poking around seemed to show that the EA information made it into the new filesystem.

However, when I went to mount the "new" MDS partition, it failed with the following error: May 30 23:36:50 mds-foo kernel: [ 186.604083] LustreError: 3082:0:(md_local_object.c:433:llo_local_objects_setup()) creating obj [fld] fid = [0x200000001:0x3:0x0] rc = -116 May 30 23:36:50 mds-foo kernel: [ 186.698205] LustreError: 3082:0:(mdt_handler.c:4576:mdt_init0()) Can't init device stack, rc -116 May 30 23:36:50 mds-foo kernel: [ 186.797206] LustreError: 3082:0:(obd_config.c:522:class_setup()) setup foo-MDT0000 failed (-116) May 30 23:36:50 mds-foo kernel: [ 186.806140] LustreError: 3082:0:(obd_config.c:1363:class_config_llog_handler()) Err -116 on cfg command: May 30 23:36:50 mds-foo kernel: [ 186.815615] Lustre: cmd=cf003 0:foo-MDT0000 1:foo-MDT0000_UUID 2:0 3:foo-MDT0000-mdtlov 4:f There were more errors, bu they all pretty much were cascading from these errors. I switched back to the original filesystem and everything worked. I am willing to believe I did something wrong, but I'm not sure what; I did everything the directions said to do. -116 is ESTALE, and I found in the code where I believe that error was returned, but it was a little unclear to me what the root cause was. Can anyone offer any advice? --Ken _______________________________________________ HPDD-discuss mailing list HPDD-discuss(a)lists.01.org https://lists.01.org/mailman/listinfo/hpdd-discuss

Which version of Lustre is this? File based backup / restore does not work in 2.x. OI scrub which rebuilds the object index is available from Lustre 2.3 onwards. So file based backup / restore will work from 2.3 onwards.

You could try this http://xyratex.prod.acquia-sites.com/sites/default/files/Migration_WC2.1_P atches_1-0.tar.gz Shadow wrote this tool, it allows you to correct OI database, though it's not been updated in a while so I'm not sure how cleanly it will patch.

On Tue, Jun 4, 2013 at 12:10 PM, Ken Hornstein <kenh(a)cmf.nrl.navy.mil&gt; wrote: >Which version of Lustre is this? File based backup / restore does not >work >in 2.x. OI scrub which rebuilds the object index is available from Lustre >2.3 onwards. So file based backup / restore will work from 2.3 onwards. Well, crud. I guess that's what Colin was going to tell me, and I see Andreas said the same thing. So, this leads to a follow-up question: _where_ is latest and greatest Lustre manual? I used the one labelled 2.0 here: http://wiki.lustre.org/manual/LustreManual20_HTML/LustreOperations.html Which doesn't actually mention that you can't do a file-level backup on the MDT. Some poking around led me to the Whamcloud one, which actually does say that. Perhaps an upgrade to 2.4 is in order (which we were interested in doing anyway).