[hadoop@hadoopmaster1 ~]$ /usr/lib/hadoop/bin/hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-*.jar teragen 100 tmp/teragenout
:
:
:
Caused by: java.net.ConnectException: Call From hadoopmaster1/192.168.1.187 to hadoopmaster1:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
Solution : Restart HDFS Name Node
[hdfs@hadoopmaster1 ~]$jps
32192 DataNode
[hdfs@hadoopmaster1 ~]$jps
32192 DataNode
su hdfs
stop
/usr/lib/hadoop/sbin/hadoop-daemon.sh --config $HADOOP_CONF_DIR stop namenode
/usr/lib/hadoop/sbin/hadoop-daemon.sh --config $HADOOP_CONF_DIR stop secondarynamenode
/usr/lib/hadoop/sbin/hadoop-daemon.sh --config $HADOOP_CONF_DIR stop datanode
start
/usr/lib/hadoop/sbin/hadoop-daemon.sh --config $HADOOP_CONF_DIR start namenode
/usr/lib/hadoop/sbin/hadoop-daemon.sh --config $HADOOP_CONF_DIR start secondarynamenode
/usr/lib/hadoop/sbin/hadoop-daemon.sh --config $HADOOP_CONF_DIR start datanode
[hdfs@hadoopmaster1 ~]$jps
32192 DataNode
31851 NameNode
[root@hadoopmaster1 conf]# netstat -lent | grep :8020
tcp 0 0 192.168.1.187:8020 0.0.0.0:* LISTEN 493 548347
[hadoop@hadoopmaster1 ~]$ /usr/lib/hadoop/bin/hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-*.jar teragen 10 tmp/teragenout
java.io.IOException: Output directory tmp/teragenout already exists.
[hadoop@hadoopmaster1 ~]$ /usr/lib/hadoop/bin/hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-*.jar teragen 10 tmp/teragenout2
14/09/09 21:25:26 INFO client.RMProxy: Connecting to ResourceManager at hadoopmaster1/192.168.1.187:8050
14/09/09 21:25:29 INFO terasort.TeraSort: Generating 10 using 2
14/09/09 21:25:29 INFO mapreduce.JobSubmitter: number of splits:2
14/09/09 21:25:30 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1410306715808_0002
14/09/09 21:25:32 INFO impl.YarnClientImpl: Submitted application application_1410306715808_0002
14/09/09 21:25:33 INFO mapreduce.Job: The url to track the job: http://hadoopmaster1:8088/proxy/application_1410306715808_0002/
14/09/09 21:25:33 INFO mapreduce.Job: Running job: job_1410306715808_0002
14/09/09 21:26:04 INFO mapreduce.Job: Job job_1410306715808_0002 running in uber mode : false
14/09/09 21:26:05 INFO mapreduce.Job: map 0% reduce 0%
14/09/09 21:26:49 INFO mapreduce.Job: map 100% reduce 0%
14/09/09 21:26:56 INFO mapreduce.Job: Job job_1410306715808_0002 completed successfully
14/09/09 21:26:57 INFO mapreduce.Job: Counters: 31
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=192632
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=158
HDFS: Number of bytes written=1000
HDFS: Number of read operations=8
HDFS: Number of large read operations=0
HDFS: Number of write operations=4
Job Counters
Launched map tasks=2
Other local map tasks=2
Total time spent by all maps in occupied slots (ms)=264387
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=88129
Total vcore-seconds taken by all map tasks=88129
Total megabyte-seconds taken by all map tasks=135366144
Map-Reduce Framework
Map input records=10
Map output records=10
Input split bytes=158
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=399
CPU time spent (ms)=3170
Physical memory (bytes) snapshot=188051456
Virtual memory (bytes) snapshot=2521628672
Total committed heap usage (bytes)=31719424
org.apache.hadoop.examples.terasort.TeraGen$Counters
CHECKSUM=24474895181
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=1000
I really like the dear information you offer in your articles. I’m able to bookmark your site and show the kids check out up here generally. Im fairly positive theyre likely to be informed a great deal of new stuff here than anyone
ReplyDeleteangularjs-Training in sholinganallur
angularjs-Training in velachery
angularjs Training in bangalore
angularjs Training in bangalore
angularjs Training in btm
angularjs Training in electronic-city
Impressive. Your story always bring hope and new energy. Keep up the good work.
ReplyDeleteCore Java interview questions and answers
Java training in Chennai | Java training in Tambaram
Java training in Chennai | Java training in Velachery
Java training in Chennai | Java training in Omr
Good Post, I am a big believer in posting comments on sites to let the blog writers know that they ve added something advantageous to the world wide web.
ReplyDeleteonline Python training
python training in chennai
Inspiring writings and I greatly admired what you have to say , I hope you continue to provide new ideas for us all and greetings success always for you..Keep update more information.
ReplyDeleterpa training in chennai
rpa training in bangalore
rpa course in bangalore
best rpa training in bangalore
rpa online training
Wow it is really wonderful and awesome thus it is very much useful for me to understand many concepts and helped me a lot. it is really explainable very well and i got more information from your blog.
ReplyDeleteData Science training in Chennai | Data Science Training Institute in Chennai
Data science training in Bangalore | Data Science Training institute in Bangalore
Data science training in pune | Data Science training institute in Pune
Data science online training | online Data Science certification Training-Gangboard
Data Science Interview questions and answers
Very informative!! Thanks for sharing with us.
ReplyDeleteselenium Classes in chennai
selenium certification in chennai
Selenium Training in Chennai
web designing training in chennai
Big Data Training in Chennai
Advanced java training in chennai
J2EE Training in Chennai
JAVA Training Chennai
I have bookmarked this blog for my future reference. Thanks for sharing this useful information with us.
ReplyDeleteBlue Prism Training in Chennai
Blue Prism Training Institute in Chennai
RPA Training in Chennai
UiPath Training in Chennai
Data Analytics Courses in Chennai
Big Data Analytics Courses in Chennai
Inspiring blogs for both Big Data Training in Bangalore and Hadoop Training in Bangalore
ReplyDeleteI simply wanted to write down a quick word to say thanks to you for those wonderful tips and hints you are showing on this site.
ReplyDeleteData Science Training in Chennai
Robotic Process Automation Training in Chennai
Cloud Computing Training in Chennai
Data Warehousing Training in Chennai
Dev Ops Training in Chennai
Informative post indeed, I’ve being in and out reading posts regularly and I see alot of engaging people sharing things and majority of the shared information is very valuable and so, here’s my fine read.
ReplyDeleteclick here to check results
click here to check marks
click here to change your password
click here to claim your ecard
click here to continue your profile creation
Such a Informative Blog...These Blogs are stimulating users to explore their Interest towards studies, Thanks for Sharing a valuable blogs.
ReplyDeletepython training in chennai | python training in annanagar | python training in omr | python training in porur | python training in tambaram | python training in velachery
python training in chennai | python training in annanagar | python training in omr | python training in porur | python training in tambaram | python training in velachery
Great Blog. the blog is easily clarify the queries for the learners.
ReplyDeleteData Science Training Course In Chennai | Data Science Training Course In Anna Nagar | Data Science Training Course In OMR | Data Science Training Course In Porur | Data Science Training Course In Tambaram | Data Science Training Course In Velachery
Greetings. I know this is somewhat off-topic, but I was wondering if you knew where I could get a captcha plugin for my comment form? I’m using the same blog platform like yours, and I’m having difficulty finding one?Thanks!!!
ReplyDeleteAndroid Training in Chennai
Android Online Training in Chennai
Android Training in Bangalore
Android Training in Hyderabad
Android Training in Coimbatore
Android Training
Android Online Training
Thanks for sharing this article about seo. i read your blog every time.. oracle training in chennai
ReplyDeletePretty article! I found some useful information in your blog, it was awesome to read, thanks for sharing this great content to my vision, keep sharing.
ReplyDeletehardware and networking training in chennai
hardware and networking training in porur
xamarin training in chennai
xamarin training in porur
ios training in chennai
ios training in porur
iot training in chennai
iot training in porur
Hi,
ReplyDeleteVery nice post,thank you for shring this article.
keep updating...
Big data hadoop training
Hadoop administration online training
Too Good article,Thank you for sharing this awesome Blog.
ReplyDeleteKeep Updating more....
Big Data Hadoop Course