The intent of this talk is to share the experience of building such a service and deploying it on a Kubernetes cluster. In this talk we will discuss all the requirements which an enterprise grade Hadoop/Spark cluster running on containers bring in for a container orchestrator. This talk will cover in details how Kubernetes orchestrator can be used to meet all our needs of resource management, scheduling, networking and network isolation, volume management etc.
