I am reaching out to seek your assistance with an issue I am encountering while running a simple Hop pipeline using the Beam Spark pipeline engine. The pipeline executes without any issues when using the default local runner, but it fails when I switch to the Beam Spark engine option. I want to run hop pipeline on Beam with Spark runner it can be either using hop gui or with spark-submit command.

I am reaching out to seek your assistance with an issue I am encountering while running a simple Hop pipeline using the Beam Spark pipeline engine. The pipeline executes without any issues when using the default local runner, but it fails when I switch to the Beam Spark engine option. I want to run hop pipeline on Beam with Spark runner it can be either using hop gui or with spark-submit command. #2443