Replication differences between HDP 2.6.5 to 3.x
In HDP 2.6.5 version, managed tables are managed by Hive.
In HDP 2.6.5 version, managed tables are operated by Hive. The managed tables can be any file format like ORC, AVRO or Flat file, and can also be both transactional and non-transactional. But in HDP 3.x version, managed tables are always transactional (either full ACID or micro-managed tables).
When Hive tables are replicated from HDP 2.6.5 to 3.x, the source tables get converted to transactional tables or external tables at target, and remain so throughout the replication process.
The conversion criteria is:
- Managed tables with ORC file format will be converted to full ACID tables.
- Managed tables with file format other than ORC will be converted to transactional tables having Insert-Only support.
- Managed tables with external AVRO schema or multi-level directories or non-native tables will be converted as external tables.