It is useful to understand what would be the size of data and free space if you want to write something to HDFS. Default block size in HDFS is 64MB, so one file will take at least 64MB. Also, default replication ratio is 3x. The size will be:
3 * Sum(i)(size[i] / 64 + 1)Check the block size and replication ratio:
$HADOOP_HOME/bin/hadoop fsck /
Check the free space (plain free space, not taking into account replication or block size):$HADOOP_HOME/bin/hadoop dfsadmin -report
How big is the folder (it is actually replication ratio times bigger):$HADOOP_HOME/bin/hadoop dfs -dus [/some/folder]
There are lots of information about latest technology and how to get trained in them, like Big Data Hadoop Training in Chennai have spread around the web, but this is a unique one according to me. The strategy you have updated here will make me to get trained in future technologies(Hadoop Course in Chennai). By the way you are running a great blog. Thanks for sharing this.
ReplyDeleteBest Hadoop Training in Chennai
| Best hadoop training institute in chennai
Cloud is one of the tremendous technology that any company in this world would rely on(Salesforce Training institutes in Chennai). Using this technology many tough tasks can be accomplished easily in no time. Your content are also explaining the same(Salesforce developer training in chennai). Thanks for sharing this in here. You are running a great blog, keep up this good work.
ReplyDeleteThis comment has been removed by the author.
ReplyDeleteThis is my first visit to your site.It is a stunning post. Exceptionally valuable to me. I preferred it.Keep update your blog.
ReplyDeleteRegards, Hadoop Training Chennai | Hadoop Training in Chennai
it’s really nice and meanful. it’s really cool blog. Linking is very useful thing.you have really helped lots of people who visit blog and provide them usefull information.
ReplyDeleteHadoop Training in Hyderabad
Great blog.
ReplyDeleteBig Data Hadoop Training In Chennai | Big Data Hadoop Training In anna nagar | Big Data Hadoop Training In omr | Big Data Hadoop Training In porur | Big Data Hadoop Training In tambaram | Big Data Hadoop Training In velachery