You can start HDFS without finalizing the upgrade. When you are ready to discard your backup, you can finalize the upgrade.
Verify your filesystem health before finalizing the upgrade and removing the old config.
As the $HDFS_USER, enter:
hdfs dfsadmin -finalizeUpgrade
