Commits on Jun 14, 2021

1. use arrow-unsafe allocator by default …

   This patch makes arrow-unsafe allocator as default profile
   
   arrow-netty will instance netty memory pool to reduce the
   alloc/dealloc overhead which introduced big memory footprint.
   
   local perf tests showed the performace is not heavily impacted
   after switch to arrow-unsafe
   
   one more benefit is we could remove the -XX:MaxDirectMemorySize flag
   which also impacts the vanilla Spark memory usage
   
   Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

   

   zhouyuan committed Jun 14, 2021
   Configuration menu

   • View commit details
   • Copy full SHA for 7692a08
   • Browse repository at this point

   Copy the full SHA

   7692a08 View commit details

   Browse the repository at this point in the history