Engine Upgrade 1.5.0

Cloudera Data Science Workbench 1.5.0 (and later) ships version 7 of the base engine image.

Cloudera Data Science Workbench 1.5.0 (and later) ships version 7 of the base engine image which includes the following versions of R and Python:

R - 3.5.1
Python - 2.7.11, 3.6.1

Pre-installed Packages in Engine 7

For details about the packages included in the base engine, see Cloudera Data Science Workbench Engine Versions and Packaging .

Upgrade Projects to Use the Latest Base Engine Images - Make sure you test and upgrade existing projects to Base Image v7 (Project Settings > Engine) to take advantage of the latest fixes.

The base engine image you use must be compatible with the version of CDH you are running. This is especially important if you are running workloads on Spark. Older base engines (v6 and lower) cannot support the latest versions of CDH 6. That is because these engines were configured to point to the Spark 2 parcel. However, on CDH 6 clusters, Spark is now packaged as a part of CDH 6 and the separate add-on Spark 2 parcel is no longer supported. If you want to run Spark workloads on CDH 6, you must upgrade your projects to base engine 7 (or higher).

Table 1. CDSW Base Engine Compatibility for Spark Workloads on CDH 5 and CDH 6
Base Engine Versions	CDH 5	CDH 6
Base engines 6 (and lower)	Yes	No
Base engines 7 (and higher)	Yes	Yes