Need clarification on role of Catalyst optimizer and Project Tungsten. How it works [closed]

Need clarificaiton on role of Catalyst optimizer and Project Tungstern

Catalyst optimizer will produce optimised Physical plan from logical plan.

The optimised physical plan will then taken by Code generator to emit Rdd's.

Here the Code generator Catalyst Optimizer is Project Tungstern?

Here the Code generator in Catalyst Optimizer is called as Whole Stage Code generator?

When I look at lot of artical Code generator will emit Rdd. Who will then generate bytecode from the RDD.

I am totally confused with Code generator and Project Tungstern.Please help me

https://stackoverflow.com/questions/66945074/need-clarification-on-role-of-catalyst-optimizer-and-project-tungsten-how-it-wo April 05, 2021 at 03:27AM