The real cost of Spark UDF

18 April 2020

There are plenty of articles explaining how to use UDFs in Spark and what benefits/drawbacks they have over native functions. In this post we will look under the hood of Spark UDFs to get an understanding of the performance overhead they incur.

read more