We’re trying to stand up a cluster with a custom server, Mongo, Elasticsearch, and Spark.
We have everything but Spark working with public containers and charts. We are having quite a bit of difficulty with Spark for reasons probably too specific to mention here.
Is anyone managing Spark ~2.3.3 with k8s? What container & chart are you using? Here we are not looking for k8s as Spark master, we are looking for k8s to run the entire cluster with Spark as one component.
Thanks in advance