July 26, 2024

1. In Cloudera Manager, click Clusters > Hive > Configuration to navigate to the configuration page for HMS.
2. Search for hive.compactor.worker.threads and modify the value to '0'.
3. Save the changes and restart the Hive service.

1. Ensure that SSL is enabled by setting SSL=1.
2. Remove authentication by setting AuthMech=0.
3. Remove the JWTString parameter.
4. Add the parameter http.header.Authorization and set it to the word "Bearer" followed by a space and the JWT string

DSN configuration before the workaround

SSL=1
AuthMech=8
JWTString=full_jwt_text

SSL=1
AuthMech=0
http.header.Authorization=Bearer full_jwt_text

merge into mydb.target.branch_branch1 t using mydb.source.branch_branch1 s on t.id = s.id when matched then update set value = 'matched';

1. Log in to the CDP Management Console as an Administrator.
2. Go to Environment > Data Lake and open Cloudera Manager for your environment.
3. Go to Clusters > Ranger RAZ service > Instances > RAZ server > Processes and note the value of the fs.s3a.ext.raz.rest.host.url property from the core-site.xml file. You need this to specify the value of the api_url property in the Hue configuration.

   For Azure environments, note the value of the fs.azure.ext.raz.rest.host.url property.

   For AWS and GCS environments, note the value of the fs.s3a.ext.raz.rest.host.url property.

4. Go to CDW > Virtual Warehouse > > Edit > CONFIGURATIONS and select the hue-safety-valve from the Configuration files dropdown menu.
5. Add the following lines in the hue-safety-valve field:

   [desktop]
   [[raz]]
   is_enabled=true
   api_url=https://[***INSTANCE-1***]:6082/,https://[***INSTANCE-2***]:6082/

6. Click Apply Changes.

insert into table partition_transform_4 select t, ts from t1 cluster by ts;

SdxDDBTableName:
       Description: DynamoDB table name for the SDX S3 file listings, created through S3Guard
       Type: String
       Default: " "

kubectl get ns

1. Log into the AWS IAM console at https://console.aws.amazon.com/iam/.
2. In the navigation panel, choose Roles.
3. Search the list of roles for NodeInstanceRole.
4. Click Permissions.
5. Select cluster-autoscaler and click Edit policy.
6. Add the ec2:CreateTags line in the Actions section after the ec2:DescribeLaunchTemplateVersions line as shown:

   "Version": "2012-10-17",
             "Statement": [
             {
             "Action": [
             "autoscaling:DescribeAutoScalingGroups",
             "autoscaling:DescribeAutoScalingInstances",
             "autoscaling:DescribeTags",
             "autoscaling:DescribeLaunchConfigurations",
             "autoscaling:SetDesiredCapacity",
             "autoscaling:TerminateInstanceInAutoScalingGroup",
             "ec2:DescribeLaunchTemplateVersions",
             "ec2:CreateTags"
             ],

7. Save changes.

my-storage-account-name/log-files/clusters/my-env/my-warehouse-xx-yy/warehouse/debug-artifacts/hive/compute-zz-mvvf/compute-zz-mvvf-0926210111-0927090111-01234.zip

In the third line shown below, change the value of LLAP_DAEMON_OPTS from -Xss256k to -Xss1M, and then click Apply Changes:

FROM:

-Dorg.wildfly.openssl.path=/usr/lib64 -Dzookeeper.sasl.client=false -Djdk.tls.disabledAlgorithms=SSLv3,GCM -Dhttp.maxConnections=12 -Xms24G -Xmx48G -Xss256k ...

TO:

... -Xss1M ...

1. In the Hive Virtual Warehouse tile, click the edit icon. This launches the Virtual Warehouse details page.
2. In the details page for the Virtual Warehouse, click the Configurations tab.
3. Click the Hiveserver2 sub-tab.
4. Select hive-site from the configuration file drop-down list menu.
5. Search for the configuration property hive.metastore.sasl.enabled.
6. Set the hive.metastore.sasl.enabled configuration property to true.
7. Click Apply in the upper right corner of the page to save the configuration.
8. Click the Actions menu and select Clone to clone the Hive Virtual Warehouse:

   

1. SSH into your CDP environment host.
2. To delete a directory within your S3 bucket, run the following command:

   hdfs dfs -rm -r [***COMPLETE-PATH-TO-S3-BUCKET***]/[***DIRECTORY-NAME***]

3. To rename a folder, create a new directory and run the following command to move files from the source directory to the target directory:

   hdfs dfs -mkdir [***DIRECTORY-NAME***]

   hdfs dfs -mv [***COMPLETE-PATH-TO-S3-BUCKET***]/[***SOURCE-DIRECTORY***] [***COMPLETE-PATH-TO-S3-BUCKET***]/[***TARGET-DIRECTORY***]

1. Add the following configurations to hadoop-core-site for the Database Catalog and the Virtual Warehouse.
   • fs.s3.maxConnections=1000
   • fs.s3a.connection.maximum=1000
2. Restart the Database Catalog and Virtual Warehouse.

• Set the table property 'external.table.purge'='FALSE'.
• Do not drop a table during migration from Hive to Iceberg.

• Run separate queries to insert data into only one table at a time.
• Turn off STAT task locking as follows:

  set iceberg.hive.request-lock-on-stats-task=false;