VM and Hadoop Configuration
S3Flex | E3Flex | E4Flex | A1Flex | |
OCPU | 8 | 8 | 8 | 16 |
Cores/Threads | 8/16 | 8/16 | 8/16 | 16/16 |
Mem | 96G | 96G | 96G | 96G |
Arch | x86_64 | x86_64 | x86_64 | aarch64 |
Kernel | Oracle Linux 8.5 | |||
Storage | iSCSi 2 x 500G luns, VPU 50, 2 x 480 MBPS | |||
JDK | JDK11 |
Hadoop and Yarn Configuration
dfs.block.size - 512M
yarn.scheduler.minimum-allocation-mb - 1024
yarn.scheduler.maximum-allocation-mb - 65536
yarn.scheduler.minimum-allocation-vcores - 1
yarn.scheduler.maximum-allocation-vcores - 15
yarn.nodemanager.resource.cpu-vcores - 16
yarn.nodemanager.resource.memory-mb - 94208
mapreduce.map.memory.mb - 1024
mapreduce.reduce.memory.mb - 3072
mapred.reduce.parallel.copies - 14
mapreduce.reduce.shuffle.parallelcopies - 12
mapreduce.map.java.opts - 2048M