Kubernetes Platform Information

S Docker Versi Comments/

Components Reference Links Kubernetes References
No Image on Remarks
hadoop (data apache/ 2 or https://github.com/apache/ https://github.com/helm/charts/tree/
1 Official Image
node) hadoop 3 hadoop master/stable/hadoop
hadoop(worke apache/ 2 or https://github.com/apache/ https://github.com/helm/charts/tree/
2 Official Image
r node) hadoop 3 hadoop master/stable/hadoop
yarn - No Official https://hub.docker.com/search? https://github.com/helm/charts/tree/
3 NA NA
nodemanager Image present q=hadoop-yarn master/stable/hadoop
https://spark.apache.org/docs/latest/
running-on-kubernetes.html
https://medium.com/empathyco/running-
apache/ apache-spark-on-kubernetes-
4 spark - workers 3x Official Image
spark 2e64c73d0bb2
https://medium.com/analytics-vidhya/dep
https://hub.docker.com/r/ loy-spark-on-kubernetes-cluster-
apache/spark/tags 7779c658bf6c
https://trino.io/episodes/24.html
trinodb/
5 trino 394 Official Image https://hub.docker.com/r/ https://posulliv.github.io/posts/trino-
trino
trinodb/trino/tags helm/
https://docs.starburst.io/starburst-
enterprise/k8s/deploy-hms.html
No Official
6 Hive     https://medium.com/quintoandar-tech-
Image present
blog/old-but-gold-implementing-a-hive-
  metastore-infrastructure-225a8056fea8
No Official https://www.linkedin.com/pulse/kafka-
Image zookeeper-cluster-setup-kubernetes-
present. running-suthram-cissp-ccsp?
7 Kafka    
Closest match trk=articles_directory
is bitnami https://hub.docker.com/search? https://docs.bitnami.com/tutorials/deploy
kafka q=kafka -scalable-kafka-zookeeper-cluster-
kubernetes/
https://hub.docker.com/_/ https://levelup.gitconnected.com/how-to-
8 zookeper Official Image
zookeeper deploy-apache-kafka-with-kubernetes-
zookeper 3.8.0 9bd5caf7694f
Recommende
d to Use
9 PostgreSQL     Managed  
Service on
Cloud  
Recommende
d to Use
10 Redis     Managed  
Service on
Cloud  

Common Questions:
 Will the default official images work for the requirement?
 How the components will be integrated?
o Example scenario how the data persistence and job persistence will be handled. This is important to
design the kubernetes objects and deployments.
 Yarn is not a separate component in Docker image I believe it is a part of Hadoop official image. Can we use
the same image to deploy yarn?
 All the official Docker image states the use of Map Reduce. However I remember the on-prem deployments
are not using Map Reduce. What is the procedure to incorporate the same on Docker/Kubernetes Platform?
 All the configuration was accessible or modifiable in on-prem/server based installation. However the Docker
environment will work on isolated manner only integration would be pointing to relevant DB/master services.
Do we have any references of configuration’s that have been used on any Docker deployment methods
before?