Tez
HDP 2.3.2 provides Tez 0.7.0 and the following Apache patches:
IMPROVEMENTS
TEZ-2767 Make TezMxBeanResourceCalculator the default resource calculator.
TEZ-2789 Backport events added in TEZ-2612 to branch-0.7.
TEZ-2813 Tez UI, add counter data for rest api calls to AM Web Services v2.
TEZ-2817 Tez UI, update in progress counter data for the dag vertices and tasks table.
TEZ-2876 Tez UI, Update vertex, task and attempt details page while in progress.
TEZ-2817 Tez UI, update in progress counter data for the dag vertices and tasks table.
TEZ-2812 Tez UI, Update task and attempt tables while in progress.
TEZ-2830 Backport TEZ-2774 to branch-0.7. Improvements to logging in the AM and part of the runtime.
TEZ-2719 Consider reducing logs in unordered fetcher with shared-fetch option.
TEZ-2844 Backport TEZ-2775 to branch-0.7. Improve and consolidate logging in Runtime components.
BUG FIXES
TEZ-2602 Throwing EOFException when launching MR job.
TEZ-2745 ClassNotFound in InputInitializer causes AM to crash.
TEZ-2768 Log a useful error message when the summary stream cannot be closed when shutting down an AM.
TEZ-2549 Reduce Counter Load on the Timeline Server.
TEZ-2291 TEZ UI. Improper vertex name in tables.
TEZ-2211 Tez UI. Allow users to configure timezone.
TEZ-2754 Tez UI. StartTime and EndTime is not displayed with right format in Graphical View.
TEZ-2761 Tez UI. update the progress on the dag and vertices pages with info from AM.
TEZ-2766 Tez UI. Add vertex in-progress info in DAG details.
TEZ-2761 Addendum fix build failure for java 6.
TEZ-2752 logUnsuccessful completion in Attempt should write original finish time to ATS.
TEZ-2807 Log data in the finish event instead of the start event.
TEZ-2792 Add AM web service API for tasks.
TEZ-2792 Addendum fix build failure for java 6.
TEZ-2780 Tez UI, Update All Tasks page while in progress.
TEZ-2660 Tez UI, need to show application page even if system metrics publish is disabled.
TEZ-2825 Report progress in terms of completed tasks to reduce load on AM for Tez UI.
TEZ-2663 SessionNotRunning exceptions are wrapped in a ServiceException from a dying AM.
TEZ-2842 Tez UI, Update Tez App details page while in-progress.
TEZ-2483 Tez UI, Show error if in progress fails due to AM not reachable.
TEZ-2847 Tez UI, Task details doesn't gets updated on manual refresh after job complete.
TEZ-814 Improve heuristic for determining a task has failed outputs.
TEZ-2812 Preemption sometimes does not respect heartbeats between pre-emptions.
TEZ-2834 Make Tez preemption resilient to incorrect free resource reported by YARN.
TEZ-814 Improve heuristic for determining a task has failed outputs.
TEZ-2816 Preemption sometimes does not respect heartbeats between pre-emptions.
TEZ-2853 Tez UI, task attempt page is coming empty.
INCOMPATIBLE CHANGES
TEZ-2768 Log a useful error message when the summary stream cannot be closed when shutting down an AM.
HDP 2.3.0 provided Tez 0.7.0 and the following Apache patches:
IMPROVEMENTS
BUG FIXES
TEZ-1529 ATS and TezClient integration in secure kerberos enabled cluster.
TEZ-2391 TestVertexImpl timing out at times on Jenkins builds.
TEZ-2409 Allow different edges to have different routing plugins
TEZ-2447 Tez UI: Generic changes based on feedbacks.
TEZ-2453 Tez UI: show the dagInfo is the application has set the same.
TEZ-2455 Tez UI: Dag view caching, error handling and minor layout changes
TEZ-2474 The old taskNum is logged incorrectly when parallelism is changed
TEZ-2475 Fix a potential hang in Tez local mode caused by incorrectly handled interrupts.
TEZ-2478 Move OneToOne routing to store events in Tasks.
TEZ-2481 Tez UI: graphical view does not render properly on IE11
TEZ-2482 Tez UI: Mouse events not working on IE11
TEZ-2489 Disable warn log for Timeline ACL error when tez.allow.disabled.timeline-domains set to true.
TEZ-2504 Tez UI: tables - show status column without scrolling, numeric 0 shown as Not available
TEZ-2505 PipelinedSorter uses Comparator objects concurrently from multiple threads.
TEZ-2509 YarnTaskSchedulerService should not try to allocate containers if AM is shutting down.
TEZ-2513 Tez UI: Allow filtering by DAG ID on All dags table.
TEZ-2523 Tez UI: derive applicationId from dag/vertex id instead of relying on json data
TEZ-2527 Tez UI: Application hangs on entering erroneous RegEx in counter table search box
TEZ-2528 Tez UI: Column selector buttons gets clipped, and table scroll bar not visible in mac.
TEZ-2535 Tez UI: Failed task attempts link in vertex details page is broken.
TEZ-2539 Tez UI: Pages are not updating in IE.
TEZ-2541 DAGClientImpl enable TimelineClient check is wrong.
TEZ-2546 Tez UI: Fetch hive query text from timeline if dagInfo is not set.
TEZ-2547 Tez UI: Download Data fails on secure, cross-origin clusters
TEZ-2548 TezClient submitDAG can hang if the AM is in the process of shutting down.
TEZ-2554 Tez UI: View log link does not correctly propagate login credential to read log from YARN web.
TEZ-2568 auto_sortmerge_join_5 fails in Tez mode