How to configure authentication for Spark Connect?


I would like to implement token base authentication for spark connect. I have added nginx as proxy. Idea is we can send the token from pyspark 3.5, client side and intercept that token in nginx to validate it before request forward to spark connect. However, I am not getting the token in nginx. anyone has idea? does pyspark doesn't support grpc header?

Posted by Jagdish Gadhiya (21) at 2025-07-21T10:03:08Z

Caught for

Ends with ?
Low Length
No Code Block
One Line only
Low Rep