May 2024
This release of the Data Hub service introduces the following changes:
New default Azure VM instance types in cluster templates
In the built-in Data Hub templates, the following instance types are being replaced:
- Standard_D5_v2 is being replaced with Standard_D16s_v3
- Standard_D8_v3 is being replaced with Standard_D8s_v3
- Standard_D16_v3 is being replaced with Standard_D16s_v3
- Standard_E16_v3 is being replaced with Standard_E16s_v3
- Standard_E8_v3 is being replaced with Standard_E8s_v3
The following table provides more detail:
| Template name | Group | Previous instance type | New instance type |
| 7.x - Data Engineering: HA: Apache Spark3, Apache Hive, Apache Oozie for Azure | manager | Standard_D16_v3 | Standard_D16s_v3 |
| 7.x - Data Engineering: HA: Apache Spark3, Apache Hive, Apache Oozie for Azure | compute | Standard_D5_v2 | Standard_D16s_v3 |
| 7.x - Data Engineering: HA: Apache Spark3, Apache Hive, Apache Oozie for Azure | worker | Standard_D16_v3 | Standard_D16s_v3 |
| 7.x - Data Engineering: HA: Apache Spark3, Apache Hive, Apache Oozie for Azure | gateway | Standard_D16_v3 | Standard_D16s_v3 |
| 7.x - Data Engineering: HA: Apache Spark3, Apache Hive, Apache Oozie for Azure | master | Standard_D16_v3 | Standard_D16s_v3 |
| 7.x - Data Engineering: HA: Apache Spark3, Apache Hive, Apache Oozie for Azure | masterx | Standard_D16_v3 | Standard_D16s_v3 |
| 7.x - Data Engineering Spark3 for Azure | master | Standard_D16_v3 | Standard_D16s_v3 |
| 7.x - Data Engineering Spark3 for Azure | compute | Standard_D5_v2 | Standard_D16s_v3 |
| 7.x - Data Engineering Spark3 for Azure | worker | Standard_D5_v2 | Standard_D16s_v3 |
| 7.x - Data Engineering Spark3 for Azure | gateway | Standard_D8_v3 | Standard_D16s_v3 |
| 7.x - Data Discovery and Exploration for Spark3 for Azure | master | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Data Discovery and Exploration for Spark3 for Azure | gateway | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Data Discovery and Exploration for Spark3 for Azure | leader | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Data Discovery and Exploration for Spark3 for Azure | worker | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Data Discovery and Exploration for Spark3 for Azure | yarnworker | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Data Mart: Apache Impala, Hue for Azure | master | Standard_E8_v3 | Standard_E8s_v3 |
| 7.x - Edge Flow Management Light Duty for Azure | management | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - COD Edge Node for for Azure | leader | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streaming Analytics Heavy Duty for Azure | manager | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streaming Analytics Heavy Duty for Azure | master | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streaming Analytics Heavy Duty for Azure | worker | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streaming Analytics Light Duty for Azure | manager | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streaming Analytics Light Duty for Azure | master | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streaming Analytics Light Duty for Azure | worker | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Flow Management Light Duty for Azure | management | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Flow Management Light Duty for Azure | nifi_scaling | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Flow Management Light Duty for Azure | nifi | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Flow Management Heavy Duty for Azure | management | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Real-time Data Mart - Spark3 for Azure | master1 | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Real-time Data Mart - Spark3 for Azure | master2 | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Real-time Data Mart - Spark3 for Azure | master3 | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streams Messaging High Availability for Azure | manager | Standard_D16_v3 | Standard_D16s_v3 |
| 7.x - Streams Messaging High Availability for Azure | core_zookeeper | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streams Messaging High Availability for Azure | core_broker | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streams Messaging High Availability for Azure | srm | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streams Messaging Light Duty for Azure | broker | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streams Messaging Light Duty for Azure | kraft | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streams Messaging Heavy Duty for Azure | registry | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streams Messaging Heavy Duty for Azure | smm | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streams Messaging Heavy Duty for Azure | srm | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streams Messaging Heavy Duty for Azure | connect | Standard_D8_v3 | Standard_D8s_v3 |
| 7.x - Streams Messaging Heavy Duty for Azure | kraft | Standard_D8_v3 | Standard_D8s_v3 |
If you would like to create Data Hubs with the previously used instance types, you can achieve this by configuring a custom instance type.
