top button
Flag Notify
    Connect to us
      Site Registration

Site Registration

How to upgrade from Hadoop 2.3 to Hadoop 2.4?

0 votes
661 views

I had a quick google and can't find any documentation on rolling upgrade, does anyone know how to upgrade from Hadoop 2.3 to 2.4?

posted May 30, 2014 by Meenal Mishra

Share this question
Facebook Share Button Twitter Share Button LinkedIn Share Button

1 Answer

+1 vote

rollingUpgrade is available since hadoop 2.4, so you can't use -rollingUpgrade to upgrade a 2.3 cluster to 2.4. I tried to upgrade a 2.0 HDFS cluster to 2.4 several days ago, following are some details, wish this can give some help to you:

  1. Put the active NN into safemode: dfsadmin -safemode enter
  2. Perform a saveNamespace operation: dfsadmin -saveNamespace
  3. For each component you are using, back up configuration data, databases, and other important files
  4. Shutdown hadoop serverice across your entire cluster
  5. Check each host to make sure that there are no processes running hdfs/yarn
  6. Back up your HDFS metadata
  7. Upgrade and start the Journal Nodes and ZKFC
  8. Make sure that all the journal nodes and zkfc have started normally
  9. Execute this upgrade operation on active NN: namenode -upgrade (Important)
  10. Wait and make sure from ANN's log that upgrade is completed (from log)
  11. Bootstrap standby NN: namenode -bootstrapStandby
  12. Start standby NN: namenode start
  13. Start each of the DNs: datanode start
  14. Make sure that everything is running smoothly, this could take a matter of days, or even weeks
  15. Finalize the hdfs metadata upgrade: dfsadmin -finalizeUpgrade
answer May 30, 2014 by Dewang Chaudhary
Similar Questions
+1 vote
How to upgrade hadoop from 2.0 to hadoop 2.4.0?

I currently have a hadoop 2.0 cluster in production, I want to upgrade to latest release.
current version: hadoop version Hadoop 2.0.0-cdh4.6.0

Cluster has the following services:
hbase hive hue impala mapreduce oozie sqoop zookeeper

Can someone point me to how to upgrade hadoop from 2.0 to hadoop 2.4.0?

+1 vote
Upgrade of GIT from 1.8.4 to 2.0.3

I have an issue to update the git on Mac. I am trying to use this command line to update my git to 2.0.3. 

git clone https://github.com/git/git

I currently have git 1.8.4, and I have no idea to remove the older version either. Please help me.

+1 vote
How to upgrade hadoop cluster?

I want to upgrade my cluster ,in doc,one of step is backup namenode dfs.namenode.name.dir directory.
I have two directories defined in hdfs-site.xml, should I backup them all ,or just one of them?

dfs.namenode.name.dir
file:///data/namespace/1,file:///data/namespace/2
+4 votes
Hadoop upgrading/migrating downtime from Apache Hadoop 1.x to 2.x

I want to know while upgrading/migrating from Apache Hadoop 1.x to 2.x(MRv2YARN) in a production cluster of several nodes is there any *ANTICIPATED DOWNTIME* that one needs to be aware of?

0 votes
Upgrade of legacy system from old Java version (1.3/1.4) to latest Java 8?

I wanted to know what are the best practices/process to be followed if we are planning to migrate some legacy code in Java 1.3/1.4 to the latest version ie Java 8.

...