Hadoop

End of Life for Hadoop 2.8

• HADTWO-2375: Hadoop 2.8 has been removed from the cluster AMI.

Enhancement

• HADTWO-2585: The HDFS connector JAR for Oracle OCI has been upgraded to version 2.9.2.4.

Bug Fixes

• HADTWO-2365: QDS now marks a Hadoop worker node as unhealthy if its root disk is full. This unhealthy node is eventually removed from the cluster.
• HADTWO-2490: Fixes a problem that caused Spark shell commands to fail with the following error when the cluster was being downscaled: Unable to close file because the last block does not have enough number of replicas.
• HADTWO-2506: Eliminates a race condition which caused data to be written on decommissioned HDFS Datanodes.