Hortonworks Docs » Data Platform 3.0.0 » Migrating data

Migrating data

Also available as:

PDF

loading table of contents...

Data migration to Apache Hive
Moving data from databases to Apache Hive
- Create a Sqoop import command
- Import RDBMS data into Hive
Moving data from HDFS to Apache Hive
Hive import command options

Moving data from HDFS to Apache Hive

You can import data from diverse data sources into HDFS, perform ETL processes, and then query the data in Apache Hive.

Ingest the data.
You create a single Sqoop import command that imports data from diverse data sources, such as a relational database, into HDFS.
Convert the data to ORC format.
To query data in HDFS in Hive, you apply a schema to the data and then store data in ORC format.
Incrementally update the imported data.
Updating imported tables involves importing incremental changes made to the original table using Sqoop and then merging changes with the tables imported into Hive.

© 2012–2019, Hortonworks, Inc.

Document licensed under the Creative Commons Attribution ShareAlike 4.0 License.

Hortonworks.com | Documentation | Support | Community