You said that I just need to start mapred service at master. So, While
I run jps command I get te following output:
[root@lustreclient1 hadoop]# jps
18295 Jps
15561 JobTracker
What about the lustreclient2(datanode)? Do I need to run :
bin/start-all.sh
As of now while I run jps it shows no output which means nothing is
running at datanode end.
Please suggest.
On 3/20/13, linux freaker <linuxfreaker(a)gmail.com> wrote:
I am going to test it today.
Thanks for confirming.
On 3/20/13, Diep, Minh <minh.diep(a)intel.com> wrote:
> It would be /mnt/lustre/<some data dir>
>
> On 3/19/13 9:48 AM, "linux freaker" <linuxfreaker(a)gmail.com> wrote:
>
>>Thanks.
>>One more query- I can see that when we run wordcount example in case
>>of HDFS, we simply used to run command as:
>>
>>
>>$bin/hadoop jar hadoop*examples*.jar wordcount /user/hduser/ebooks
>>/user/hduser/ebooks-output
>>
>>Before which we used to copy Local data into HDFS as shown:
>>
>>bin/hadoop dfs -copyFromLocal /tmp/ebooks /user/hduser/ebooks.
>>
>>If I want to run wordcount example in case of lustre, what would be
>>the right approach?
>>
>>Please suggest.
>>
>>On Tue, Mar 19, 2013 at 9:40 PM, Diep, Minh <minh.diep(a)intel.com> wrote:
>>> Yes, that is correct.
>>>
>>> On 3/19/13 9:05 AM, "linux freaker" <linuxfreaker(a)gmail.com>
wrote:
>>>
>>>>Hi,
>>>>
>>>>Thanks for the quick response.
>>>>All I understand is:
>>>>
>>>>
>>>>Master Node (NameNode)
>>>>=====================
>>>>
>>>>File: conf/core-site.xml
>>>>
>>>><property>
>>>><name>fs.default.name</name>
>>>><value>file:///</value>
>>>></property>
>>>><property>
>>>>
>>>><name>fs.file.impl</name>
>>>><value>org.apache.hadoop.fs.LocalFileSystem</value>
>>>>
>>>><name>hadoop.tmp.dir</name>
>>>><value>/mnt/lustre/hadoop_tmp/lustrecient1</value>
>>>>
>>>>
>>>>
>>>>File: mapred-site.xml
>>>>
>>>>
>>>><name>mapred.job.tracker</name>
>>>><value>lustreclient1:9101</value>
>>>>
>>>>
>>>>
>>>>Slave Nodes(DataNodes)
>>>>======================
>>>>
>>>>File: conf/core-site.xml
>>>>
>>>><property>
>>>><name>fs.default.name</name>
>>>><value>file:///</value>
>>>></property>
>>>><property>
>>>>
>>>><name>fs.file.impl</name>
>>>><value>org.apache.hadoop.fs.LocalFileSystem</value>
>>>>
>>>><name>hadoop.tmp.dir</name>
>>>><value>/mnt/lustre/hadoop_tmp/lustrecient2</value>
>>>>
>>>>File:mapred-site.xml
>>>>
>>>>In mapred-site.xml:
>>>><name>mapred.job.tracker</name>
>>>><value>lustreclient1:9101</value> <== Is it correct?
>>>>
>>>>Please confirm if the entry is correct?
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>On Tue, Mar 19, 2013 at 8:30 PM, Diep, Minh <minh.diep(a)intel.com>
>