Hortonworks Data Platform for HDInsight
Also available as:
PDF

Atlas

This release provides Atlas 0.8.0 and the following Apache patches:

  • ATLAS-1921: basic-search UI: added range validation for entity/trait attributes.

  • ATLAS-1964: UI, Support to resize and order columns in Search table.

  • ATLAS-2169: delete request fails when hard-delete is configured.

  • ATLAS-2229: DSL changes to use V2 data structures (fix DSL query errors).

  • ATLAS-2272: UI - Save the state of dragged columns using save search API..

  • ATLAS-2276: update Hive hook to add an option to retain case-sensitivity of path in hdfs_path entities.

  • ATLAS-2281: UI fix to address error in saving tag/type attribute filter queries with null/not-null filters.

  • ATLAS-2282: Saved favorite search appears only on refresh after creation when there are 25+ favorite searches.

  • ATLAS-2283: add subTypes field in AtlasClassificationDef and AtlasEntityDef.

  • ATLAS-2284: Add Hbase-Common jar for hive packaging to fix hbase tables NoClassDef issue while import-hive.

  • ATLAS-2285: UI fix in handling of date attributes during saved searche rename.

  • ATLAS-2286: fix attribute kafka_topic.topic to set isUnique=false.

  • ATLAS-2289: separate embedded kafka/zookeeper start/stop from KafkaNotification.

  • Atlas-2294: type creation populates description field with empty string when no value is provided.

  • ATLAS-2295: UI updates for classifications.

  • ATLAS-2296: basic search enhancement to optionally exclude sub-type entities and sub-classifications.

  • ATLAS-2307: basic-search enhancement to optionally exclude sub-type entities and sub-classification-types (UI).

  • ATLAS-2310: Fix URL encoding incase of HA in passive node which caused wrong redirection url.

  • ATLAS-2312: Use ThreadLocal DateFormat objects to avoid simultaneous use from multiple threads.

  • ATLAS-2318: UI - clicking on child tag twice, parent tag is selected.

  • ATLAS-2319: UI - deleting a tag which at 25+ position needs a refresh.

  • ATLAS-2320: basic-search with wildcard classification fails when full-text query is specified.

  • ATLAS-2329: Atlas UI Multiple Hovers appears if user click on another tag which is incorrect.

  • ATLAS-2332: support for attributes having nested collection datatype.

  • ATLAS-2339: UI - Modifications in columns in Basic search result view affects DSL also..

  • ATLAS-2352: add configuration to specify validity for authentication token.

  • ATLAS-2421: updated Atlas notificaiton module to support V2 data structures; updated HBase hook to use V2 notifications.

  • ATLAS-2422: added support to export all entities of given types.

  • ATLAS-2439: updated Sqoop hook to use V2 notifications.

  • ATLAS-2442: Fix for read-only permission to allow read entity when http method is POST.

  • ATLAS-2443: include unique attributes in entity-delete notifications.

  • ATLAS-2468: Basic search issue with numeric NEQ within OR clause.

  • ATLAS-2500: added additional headers in HTTP response.

HDP 2.6.4 provided Atlas 0.8.0 and the following Apache patches:

  • ATLAS-1954: Integration tests for Basic search.

  • ATLAS-2208: Include historical entities in Schema tab checked by default for DELETED tables.

  • ATLAS-2214: fix for NPE during notNull condition.

  • ATLAS-2218: TestMetadata fix after ATLAS-1218, ATLAS-2087 changes.

  • ATLAS-2222: UI, Search using entity and trait attributes - , in string attribute filter throws 400 Bad request.

  • ATLAS-2236: UI - Basic Search Post request send attribute filters even after removing Type.

  • ATLAS-2240: Fix duplicate type name error in QuickStartV2IT.

  • ATLAS-2244: UI - Basic Search Table not using referredEntities to render entity details.

  • ATLAS-2250: Upgrade JQuery version to 3.*.

  • ATLAS-2267: Update basic search to support classification attributes.

  • ATLAS-2274: search for classification '*' with a typeName filter results in error.

  • ATLAS-2275: fix for incorrect serialization of date type trait attributes in entity notification.

  • ATLAS-2277: search for classification '*' doesn't honor excludeDeletedEntities=true.

  • ATLAS-2284: added jersey-multipart jar to Hive hook packaging .

HDP 2.6.3 provided Atlas 0.8.0 and the following Apache patches:

  • ATLAS-1218: Atlas says it is started but does not accept REST requests.

  • ATLAS-1867: ATLASClientV2 correct delete typedefs expected http code.

  • ATLAS-1905: Search UI is confusing to user.

  • ATLAS-1944: HookConsumer updated to address case where consumer is stopped before starting. Updated unit tests..

  • ATLAS-1988: Implement REST API to search for related entities - Add excludeDeletedEntities flag.

  • ATLAS-1993: UI updates to show list of Tables in detail page hive_db entity.

  • ATLAS-1996: Updated Log4J configuration to limit size of log files..

  • ATLAS-2003: Add Javadoc format to class summaries.

  • ATLAS-2004: Move Apache license header to the beginning of file. (Richard Ding via nixonrodrigues).

  • ATLAS-2015: Fix Maven warnings.

  • ATLAS-2017: updated import API to make request parameter optional.

  • ATLAS-2017: updated import API to make request parameter optional (#2 - fix for unit test failure).

  • ATLAS-2024: Updated Atlas TWiki for basic search functionality (ATLAS-1880).

  • ATLAS-2025: Validation of classification/type in basic search query.

  • ATLAS-2027: UI : Add type-name with attribute name in query-builder.

  • ATLAS-2028: invalid attributes in basic-search request should fail with status code 400.

  • ATLAS-2033: Modified to produce ugly JSON for Kafka topic messages..

  • ATLAS-2038: Integration Tests for AtlasAuthentication and Authorization Filter.

  • ATLAS-2038: Minor refactoring to use org.apache.commons.codec.binary.Base64..

  • ATLAS-2039: Unable to edit date value from UI when entity definition is POSTed without value for date attribute..

  • ATLAS-2041: UI: Show tag names with dot, when taxonomy is disabled.

  • ATLAS-2047: Exception Thrown by Kafka Consumer Ends up Filling Logs Due to Incorrect Handling.

  • ATLAS-2047: Update to fix IT failure in build environment..

  • ATLAS-2048: Fix for Unit test failure on 0.8-incubating branch.

  • ATLAS-2054: Add flag to exclude attribute mapping in FullTextMapper.

  • ATLAS-2060: Fix logger class name typos.

  • ATLAS-2062: Add flag to disable v1 gremlin search API using atlas-application property.

  • ATLAS-2071: UI : Minification of atlas code (js,css).

  • ATLAS-2074: AtlasType.resolveReferences() method made package-private.

  • ATLAS-2075: notification enhancement to handle large messages, using compression and multi-part messages.

  • ATLAS-2078: ATLAS-2114: Type update using v1 API doesn't route to createUpdateTypesDef in v2 API.

  • ATLAS-2079: Fix coverity scan issue and IT failures introduced by ATLAS-2062: missing changes.

  • ATLAS-2079: Fix coverity scan issue and IT failures introduced by ATLAS-2062.

  • ATLAS-2083: Refactor Atlas<Type>DefStore classes to reduce code duplication.

  • ATLAS-2089: Upgrade Jetty to newer version.

  • ATLAS-2090: UI - Cache busting for static content (css, js).

  • ATLAS-2091: basic search update to avoid index query for attribute values containing Tokenizer characters.

  • ATLAS-2092: Create edgeLabel while updating the index.

  • ATLAS-2097: Update docs site.xml about 0.8.1 documentation and release information.

  • ATLAS-2100: UserProfile & SavedSearch API implementation. Fixed accidentally deleted type..

  • ATLAS-2100: UserProfile & SavedSearch API implementation ATLAS-2141: edit/disassociate tag results in NPE.

  • ATLAS-2101: Update Implementation to Eliminate Use of Stopwatch.

  • ATLAS-2102: Atlas UI Improvements: Search results page. patch has (ATLAS-2103:2104,2105,2107,2108).

  • ATLAS-2111: UI: Select query is not able to render the search table in Advance search.

  • ATLAS-2115: Basic search updates to fix performance regression.

  • ATLAS-2117: basic search updates to handle issue caused by tokenization in indexer.

  • ATLAS-2118: basic search fix - incorrect results for contains operator.

  • ATLAS-2120: Import API updated to detect attribute-type change.

  • ATLAS-2121: basic-search update to use case-sensitive filter for type-name / tag-name.

  • ATLAS-2128: UI Regression : DSL Results pagination doesn't spawn more than 2 pages.

  • ATLAS-2129: Addressed Case Where Abrupt Shutdown of Atlas During Import Retains Entities Imported Before Shutdown.

  • ATLAS-2129: import fix to handle shutdown while in the middle of import.

  • ATLAS-2129: import fix to handle shutdown while in the middle of import (unit test fix).

  • ATLAS-2130: Call made to fetch tables of a database doesn't have exlcudeDeletedEntities parameter.

  • ATLAS-2132: incorrect error for invalid file path/unreadable file provided during import.

  • ATLAS-2134: Code Improvements..

  • ATLAS-2140: Throwing overly generic exceptions, or unnecessarily exceptions.

  • ATLAS-2144: add Knox x-forwarded path to Atlas base URL when Atlas is access via knox proxy.

  • ATLAS-2145: Build failure in atlas-dashboardv2 due to js-beautify issue.

  • ATLAS-2146: Remove Powermock Usage.

  • ATLAS-2148: saved-search API enhancement to support searchType.

  • ATLAS-2150: UI to support search-history and favorites.

  • ATLAS-2151: fix incorrect handling of OR condition in index query.

  • ATLAS-2153: UI : Adding more columns to the search table masks the Remove tag button.

  • ATLAS-2156: save-search UI to allow user to edit name.

  • ATLAS-2157: HiveHook fix to handle getTable() error for temproray tables.

  • ATLAS-2158: good coding practices.

  • ATLAS-2159: Incorrect createTime retrieved for entity attributes in related entities search.

  • ATLAS-2160: added REST APIs to execute a saved-search.

  • ATLAS-2162: Add hyperlink for URI formatted attribute value on property table.

  • ATLAS-2163: UI updates to handle Saved search query having deleted types.

  • ATLAS-2166: Block Knox proxy service user for kerberos authentication.

  • ATLAS-2167: UI - Redirection of Pagination gives issue if user enter Page No. which does not exists.

  • ATLAS-2168: When a second search is fired in between the pages of the first search results , offset is not reset to 0.

  • ATLAS-2171: Atlas UI fix when accessed via Knox proxy without / at the end.

  • ATLAS-2172: Atlas AD search filter is not get honored when logging into Atlas UI.

  • ATLAS-2174: code improvements and validations.

  • ATLAS-2174: Query length validations and path normalization.

  • ATLAS-2179: Split Atlas client library to avoid unnecessary dependencies.

  • ATLAS-2182: UI : Web elements are hidden when zoomed in.

  • ATLAS-2184: fixed isNull/notNull in-memory predicates to handle empty value.

  • ATLAS-2184: IS_NULL, NOT_NULL operator support (#2).

  • ATLAS-2184: IS_NULL and NOT_NULL operator support.

  • ATLAS-2185: UI to handle is_null, not_null operators for attribute search.

  • ATLAS-2186: Jetty downgrade to v8..

  • ATLAS-2187: fix for build break in powerpc.

  • ATLAS-2187: UI improved debugging in minification.

  • ATLAS-2188: UI can trim whitespaces at the beginning or end of search query.

  • ATLAS-2189: IE-9 Alignment Issues.

  • ATLAS-2192: notification consumer updates to handle stale split messages.

  • ATLAS-2194: In Basic Search for Tag if any columns are removed then UI throws exception.

  • ATLAS-2195: fix to close a graph transaction left open during Atlas startup.

  • ATLAS-2195: fix to close trasaction left open while queries index keys (#2).

  • ATLAS-2198: fix for Hive Hook OOM for large notification messages.

  • ATLAS-2211: Dangling transaction issue within GraphBackedMetadataRepository.

  • ATLAS-2212: UI fix to allow negative number input for tag attributes.

  • ATLAS-2213: Remove unused attributes from Hive hook.

HDP 2.6.2 provides Atlas 0.8.0 and the following Apache patches:

  • ATLAS-1198: Spring Framework (v4 with Spring security) over GuiceATLAS-1872 Spring fix for Kerberos and bean ordering/default.

  • ATLAS-1733: updated atlas_stop.py script to work in Windows environment.

  • ATLAS-1734: Import API update to make type import optional.

  • ATLAS-1753: Sandbox test data to avoid interference.

  • ATLAS-1766: updated NotificationConsumer implementation to use new Kafka Consumer API, to enable support for SASL_SSL protocol.

  • ATLAS-1804: Allow PAM for authentication..

  • ATLAS-1808: UI : All selected entities are assigned to tag when Assign Tag corresponding to 1 entity is clicked..

  • ATLAS-1809: UI : Update button in Edit tag attributes window should be enabled only when any update is done.

  • ATLAS-1810: UI : Audit details of any tag event (Added,Updated) has only tag name and event..

  • ATLAS-1811: UI : Audit Events are not shown in sorted order based on time sometimes..

  • ATLAS-1817: (.1) UI :Fix for TagLayout page when tag is not associated with any entity..

  • ATLAS-1817: UI : n+1 pages are created, even though only n*25 instances are retrieved.

  • ATLAS-1819: V2 API to get entity with classification returns 500.

  • ATLAS-1823: UI - Change in base path URL for few api/images to make it relative from path it is accessed..

  • ATLAS-1825: updated import to support optional transformation of attribute values.

  • ATLAS-1826: UI Create Entity : Type doesn't list the inverseRef constrained attribute options when name length is less than 3 (qinglin,xia via kbhatt)..

  • ATLAS-1832: If no attribute is present in tag then showing edit-button for a tag in tags tab on entity page..

  • ATLAS-1834: TestNG asserts over JUnit for consistency.

  • ATLAS-1848: update UI to remove json2.js dependency.

  • ATLAS-1851: update import API to support resume from a specific entity/position.

  • ATLAS-1866: DSL 'like' operator fails for associated entity attributes.

  • ATLAS-1876: fix to handle large float/double values during ser-de, export/import.

  • ATLAS-1878: Fix for NPE when a request without any query path lands on atlas.

  • ATLAS-1879: fixed - classification update removes some properties.

  • ATLAS-1880: search API with support for entity/tag attribute filters.

  • ATLAS-1889: fix to handle concurrent calls to update tags for an entity.

  • ATLAS-1894: Search using entity/tag attribute filters.

  • ATLAS-1896: Fix for adding Cross Origin [CORS] headers for Atlas.

  • ATLAS-1897: UI - Render HTML element based on attribute data-type while assigning Tag to entity..

  • ATLAS-1902: updated search UI to allow user to select columns in search result.

  • ATLAS-1906: Atlas client should support setting hadoop-jwt token in header..

  • ATLAS-1908: updated to use existing Kafka consumer properties when equivalent new Kafka consumer properties are not present.

  • ATLAS-1914: clear button in search UI to clear filter attributes.

  • ATLAS-1919: Refactored ZipSink to record committed guids.

  • ATLAS-1920: UI : Search using entity and trait attributes - Operators for enum and boolean data type filters..

  • ATLAS-1925: basic search fixes for ATLAS-1917, ATLAS-1922, ATLAS-1926.

  • ATLAS-1927: UI updates in rendering of tag attributes.

  • ATLAS-1938: updated search UI to avoid unnecessary calls on Refresh button click.

  • ATLAS-1939: added parameter validation to prevent NPE during import.

  • ATLAS-1940: fix to remove duplicate type which causes Atlas server to fail during startup.

  • ATLAS-1944: Implemented ShutdownableThread for HookConsumer.

  • ATLAS-1944: updated handling of shutdown in KafkaConsumer.

  • ATLAS-1945: updated UI to use fixed version of plugins.

  • ATLAS-1947: AtlasSearchResult to include referredEntity headers.

  • ATLAS-1948: export fix to correct the import order.

  • ATLAS-1951: Fix for error code for unauthenticated REST API call..

  • ATLAS-1952: UI optimization to use searchResult.referredEntity to render object type attributes.

  • ATLAS-1956: AtlasSearchResult should include attributes present in filter criteria.

  • ATLAS-1960: fixed handling of import/export APIs in HA configuration.

  • ATLAS-1961: Basic search improvement in use of Solr index for attribute filtering.

  • ATLAS-1961: Basic search improvement in use of Solr index for attribute filtering (# 2).

  • ATLAS-1961: Basic search improvement in use of Solr index for attribute filtering (# 3).

  • ATLAS-1961: Basic search improvement in use of Solr index for attribute filtering (#4, #5).

  • ATLAS-1967: search UI - render attribute filter based on browser URL.

  • ATLAS-1968: updated import documentation for fileName option usage.

  • ATLAS-1981: Cache escaped type-query string to avoid repeated computation.

  • ATLAS-1981: fix for unit test failures.

  • ATLAS-1981: fix for unit test failures (#2).

  • ATLAS-1982: doc, website updated - to remove references to 'incubator', and with current PMC info.

  • ATLAS-1985: fix incorrect URL-encoding while redirecting to active instance in HA.

  • ATLAS-1988: added REST API to search for related entities.

  • ATLAS-1989: Hooks to include atlas-intg library.

  • ATLAS-1994: fix - basic-search ignores tag attribute filters when free-text query is present ATLAS-2008 basic-search gremlin query updated to use bind varibles, to avoid ClassCastException.

  • ATLAS-1995: updated entity-lookup-by-unique-attributes to use indexQuery.

  • ATLAS-1997: fix to avoid NPE while getting vertex_indices.

  • ATLAS-1998: Default error page for 404, 500 and Throwable from Jetty.

  • ATLAS-2009: Fix in AuthorizationFilter, added return for unauthorized request..

  • ATLAS-2014: populate createdBy, updatedBy fields on type create and update.

  • ATLAS-2018: UI: Attribute filter does not preserve state.

  • ATLAS-2020: Result Table Column Filter : Filtering using Columns in Result table always sets excludeDeletedEntities to True.

  • ATLAS-2021: UI Regression : Tags Tab in Entity details page not loaded..

  • ATLAS-2022: Validate limit and offset for basic search query.

  • ATLAS-2044: In-memory filtering for correctness after index query.

  • ATLAS-2046: UI Regression - Columns Filter not listing all attributes of a datatype.

  • ATLAS-2052: updated packaing to exclude junit jar.

  • ATLAS-2056: removed unused library references.

  • ATLAS-2061: fixed basic-search handling of enum attributes in filter.

  • ATLAS-2073: UI - removing tag or type from drop-down will not exclude respective filters.

HDP 2.6.1 provided Atlas 0.8.0 and the following Apache patches:

  • ATLAS-855: Atlas logs contain stale transaction eviction message.

  • ATLAS-1433: Atlas allows creation of tag with attributes' name same as that of its parent tags.

  • ATLAS-1611: Regression: Incorrect error code for the negative tests, returned: 500 server error, expected: 400 bad request.

  • ATLAS-1644: Taxonomy API /api/atlas/v1/taxonomies is broken.(sumasai).

  • ATLAS-1660: Error code mismatch in while GETing a type that doesn't exist.

  • ATLAS-1663: Fix defects reported by Coverity Scan.

  • ATLAS-1672: fix for issues flagged by Coverity scan.

  • ATLAS-1673: Type deletion should check for reference & instances.

  • ATLAS-1680: Support for browser login using kerberos keytab.

  • ATLAS-1681: Added type validations for compatibility with legacy typesystem.

  • ATLAS-1684: export should include super-type definitions, import should preserve system attribute values.

  • ATLAS-1685: fix for issues flagged by coverity scan.

  • ATLAS-1686: fixed import to use the given guid, instead of looking into store with unique attribute.

  • ATLAS-1688: fix lineage UI resize issues.

  • ATLAS-1697: fix log4j configuration for import-hive.sh.

  • ATLAS-1707: fix to remove external css reference for font file.

  • ATLAS-1709: Unit tests for import and export APIs.

  • ATLAS-1710: added entity-lookup API for entity create/update UI.

  • ATLAS-1710: added entity-lookup API for entity create/update UI (#2).

  • ATLAS-1714: UI : Properties tab doesn't load when an entity has attribute of type array of integers.

  • ATLAS-1717: IX-Documentation.

  • ATLAS-1718: UI update to support enum-type attributes for tags.

  • ATLAS-1719: updated tag association UI to support enum-type attribute values from a drop-down.

  • ATLAS-1721: updated action-string in the audit logs generated during import.

  • ATLAS-1724: ATLAS-1722: fix export to report error while exporting a non-existing entity.

  • ATLAS-1726: Creating type name with space causes exceptions while doing DSL search.

  • ATLAS-1727: Mask userdetails in quick Start utility.

  • ATLAS-1730: fixes in type validations and special character handling in attribute names.

  • ATLAS-1732: After Zoom_out from Lineage view scroll stopped working.

  • ATLAS-1735: Coverity Scan Fixes for 4/13.

  • ATLAS-1736: fixes in type validations and special character handling in attribute names.

  • ATLAS-1737: UI - Delete tag(classification) from UI.

  • ATLAS-1742: Provide option to exclude deleted entities in basic and fulltext search.

  • ATLAS-1744: Error when searching type with attribute name order , limit , offset (sumasai).

  • ATLAS-1745: Add google fonts license information to 3party-licenses.

  • ATLAS-1747: fixes in type validations and special character handling in attribute names.

  • ATLAS-1750: type ahead for entity input in create/update entity UI.

  • ATLAS-1751: Implement REST endpoint to support update of classification attribute.

  • ATLAS-1752: Fix for Atlas group for kerberos authentication.

  • ATLAS-1755: added checkbox to exclude deleted entities in basic and fulltext search.

  • ATLAS-1756: UI update to allow user to edit tag attribute values.

  • ATLAS-1759: UI - Add checkbox to exclude deleted entities in schema table.

  • ATLAS-1760: UI update to render property value per attribute type in entity definition.

  • ATLAS-1761: improve attribute search to enable search based on display text.

  • ATLAS-1762: updated error code returned by type create/updated APIs.

  • ATLAS-1767: Support KNOX SSO Token based authentication on Atlas REST API calls.

  • ATLAS-1771: confirmation dialog while deleting tag appears incorrectly in IE-9.

  • ATLAS-1776: UI fix to not hide 'Include historical entities' checkbox when searching a type with all DELETED entities.

  • ATLAS-1780: Type deletion should invalidate property keys in Titan to allow re-creation with different data type if needed.

  • ATLAS-1812: On browser refresh if, tag is doesn't exist, then URL should update with the first tag.

  • ATLAS-1815: Basic search API might return fewer entities when excludeDeletedEntities=true.

  • ATLAS-1816: button to navigate to next page in search-result is disabled incorrectly.

  • ATLAS-1818: basic-search enhancements to improve search performance.

HDP 2.6.0 provided Atlas 0.8.0 and the following Apache patches:

  • ATLAS-1333: fix for incorrect json4s library version in Atlas Storm hook.

  • ATLAS-1469: User provided values for tag attributes should be evaluated for its data type..

  • ATLAS-1470: Tag is not associated to an entity when incorrect value for byte type is provided.

  • ATLAS-1503: optimization of export implementation.

  • ATLAS-1611: incorrect error code for negative tests (#2).

  • ATLAS-1630: basic search performance improvement (#3).

  • ATLAS-1659: Update full-text search string when traits/tags are added/removed from entity.

  • ATLAS-1664: Able to add already added tag to an entity through REST API.

  • ATLAS-1665: export optimization to reduce file-size and export-time.

  • ATLAS-1666: fix for IT failures caused by earlier commit.

  • ATLAS-1666: Updated exception handling to avoid use of generic exceptions.

  • ATLAS-1667: Atlas UI cleanup for lineage.

  • ATLAS-1669: Removed Unused class.

  • ATLAS-1670: fix for IT failures introduced due to ATLAS-1664.

  • ATLAS-1671: fix for missing client IP in Ranger audit log for Atlas authorizations.

  • ATLAS-1675: type-registry re-initialization failure when instance goes from passive to active state.

  • ATLAS-1676: update Hive hook to set hdfs_path.clusterName attribute.

  • ATLAS-1682: UI update to add new overlay loader to tables; fix incorrect state while switching between basic and Advance search.

  • ATLAS-1687: hbase_column_family and hbase_column are not loaded after upgrade.