Fixed Issues in HBase

Review the list of Apache HBase issues that are resolved in Cloudera Runtime 7.2.11.

CDPD-28309: This change is trying to make the check of table existence backward compatible with hbase-1.x such that CldrCopyTable of HBase-2.x communicates with a HBase-1.x cluster.
Detail: in `checkOutputSpecs` when checking table existence with using connection to check with hbase:meta, it fails when we're communicating with different hbase versions, e.g. using hbase-2.x client checking with hbase-1.x cluster that a column `family` does not exist in hbase-1.x's hbase:meta. This issue is resolved.

TSB 2021-506: Active HBase MOB files can be removed

Actively used MOB files can be deleted by MobFileCleanerChore due to incorrect serialization of reference file names. This is causing data loss on MOB-enabled tables.

Related Apache Jiras: HBASE-23723 (cause) and HBASE-25970 (fix)

  • Severity: High
  • Components affected: HBase
  • Releases affected:
    • CDP Private Cloud Base 7.1.1, 7.1.2, 7.1.3, 7.1.4, 7.1.5, 7.1.6
    • CDP Public Cloud 7.2.0, 7.2.1, 7.2.2, 7.2.6, 7.2.7, 7.2.8, 7.2.9, 7.2.10
  • Users affected: All users of HBase MOB feature on the impacted releases
  • Impact: Potential Data Loss
  • Actoin required:
    • Upgrade (recommended):
      1. Diable MobFileCleanerChore (setting the hbase.master.mob.cleaner.period property to 0).
      2. Upgrade to the latest version of CDP containing the fix: HBASE-25970.
      3. Run Major Compaction on MOB enabled tables (major_compact 'table').
      4. Enable MobFileCleanerChore (revert the hbase.master.mob.cleaner.period property to the original value).
    • Workaround: There is no known workaround at this point. Disabling MobFileCleanerChore (setting the hbase.master.mob.cleaner.period property to 0) prevents the active MOB file deletion but with that configuration MOB files will keep accumulating on the cluster.
  • Adressed in release/refresh/patch:
    • Addressed in CDP Private Cloud Base 7.1.7 and later versions
    • Addressed in CDP Public Cloud version and later versions
For the latest update on this issue, see the corresponding Knowledge article: TSB 2021-506: Active HBase MOB files can be removed

Apache Patch Information

  • HBASE-25970 MOB data loss - incorrect concatenation of MOB_FILE_REFS
  • HBASE-25929 RegionServer JVM crash when compaction
  • HBASE-25665 Option to use hostname instead of canonical hostname for secure HBase cluster connection
  • HBASE-24286 Automatically submit SCPs for unknown RS on startup
  • HBASE-26124 Backport HBASE-25373 "Remove HTrace completely in code base and try to make use of OpenTelemetry"