Acceldata Torch Cloud (managed Kubernetes) Installation

Acceldata Torch uses Kubernetes for deployment and execution. This is guided by Replicated Kots which is responsible for deployment providing single click experience to end customer. This document describes how to deploy in EKS. Similar setup can be done for other cloud provider.

Creating the cluster

With eksctl user can create a Amazon managed Kubernetes cluster.

☁ ~ eksctl create cluster \
--name replicated-test-01 \
--version 1.17 \
--region us-east-2 \
--nodegroup-name replicated-nodes \
--node-type t3.large \
--nodes 3 \
--nodes-min 1 \
--nodes-max 4 \
[] eksctl version 0.27.0
[] using region us-east-2
[] setting availability zones to [us-east-2b us-east-2c us-east-2a]
[] subnets for us-east-2b - public: private:
[] subnets for us-east-2c - public: private:
[] subnets for us-east-2a - public: private:
[] using Kubernetes version 1.17
[] creating EKS cluster "replicated-test-01" in "us-east-2" region with managed nodes
[] will create 2 separate CloudFormation stacks for cluster itself and the initial managed nodegroup
[] if you encounter any issues, check CloudFormation console or try 'eksctl utils describe-stacks --region=us-east-2 --cluster=replicated-test-01'
[] CloudWatch logging will not be enabled for cluster "replicated-test-01" in "us-east-2"
[] you can enable it with 'eksctl utils update-cluster-logging --region=us-east-2 --cluster=replicated-test-01'
[] Kubernetes API endpoint access will use default of {publicAccess=true, privateAccess=false} for cluster "replicated-test-01" in "us-east-2"
[] 2 sequential tasks: { create cluster control plane "replicated-test-01", 2 sequential sub-tasks: { no tasks, create managed nodegroup "replicated-nodes" } }
[] building cluster stack "eksctl-replicated-test-01-cluster"
[] deploying stack "eksctl-replicated-test-01-cluster"
[] building managed nodegroup stack "eksctl-replicated-test-01-nodegroup-replicated-nodes"
[] deploying stack "eksctl-replicated-test-01-nodegroup-replicated-nodes"
[] waiting for the control plane availability...
[] saved kubeconfig as "/home/dipayan/.kube/config"
[] no tasks
[] all EKS cluster resources for "replicated-test-01" have been created
[] nodegroup "replicated-nodes" has 3 node(s)
[] node "" is ready
[] node "" is ready
[] node "" is ready
[] waiting for at least 1 node(s) to become ready in "replicated-nodes"
[] nodegroup "replicated-nodes" has 3 node(s)
[] node "" is ready
[] node "" is ready
[] node "" is ready
[] kubectl command should work with "/home/dipayan/.kube/config", try 'kubectl get nodes'
[] EKS cluster "replicated-test-01" in "us-east-2" region is ready

Upon completion, user will be able to see the nodes in the cluster using kubectl get nodes command.

☁ ~ kubectl get nodes
NAME STATUS ROLES AGE VERSION Ready <none> 90s v1.17.11-eks-cfdc40 Ready <none> 86s v1.17.11-eks-cfdc40 Ready <none> 84s v1.17.11-eks-cfdc40

Kots installation

Next step is to install Replicated kots.

☁ ~ curl | bash
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 3567 0 3567 0 0 2215 0 --:--:-- 0:00:01 --:--:-- 2215
Installing replicatedhq/kots v1.21.2 (
######################################################################## 100.0%#=#=-# #
Installed at /usr/local/bin/kubectl-kots

After the installation of kots, you need to install Acceldata Torch.

☁ ~ kubectl kots install torch/beta
Enter the namespace to deploy to: torch
• Deploying Admin Console
• Creating namespace ✓
• Waiting for datastore to be ready ✓
Enter a new password to be used for the Admin Console: ••••••••
• Waiting for Admin Console to be ready ✓
• Press Ctrl+C to exit
• Go to http://localhost:8800 to access the Admin Console

This command would ask for the namespace. When prompted, please provide the namespace where Torch has to be deployed. The command will also ask for the Kots Admin password. When prompted, provide the password. This password is required to log into the admin console.

At the end, the command will start a port forward and the admin console can be accessed at http://localhost:8800 in a browser.

To start the tunnel again, execute kubectl kots admin-console --namespace <namespace>. Replace <namespace> with the namespace provided during installation.

In the browser, the first screen will ask for the password.


Next, it will ask to upload the license file provided by acceldata.


Then, the configuration screen loads. The process is same for both types of installation.

After the configuring the system, user should click on the deploy button on the next screen. This would take few minutes to complete.

Deployment Screen

Verify installation

After few minutes, the following services should be visible.

kubectl get services -n torch
ad-analysis-service ClusterIP <none> 19021/TCP 159m
ad-catalog ClusterIP <none> 8888/TCP 159m
ad-catalog-auth-db ClusterIP <none> 27017/TCP 159m
ad-catalog-db ClusterIP <none> 5432/TCP 159m
ad-catalog-ui ClusterIP <none> 4000/TCP 159m
ad-torch-auth ClusterIP <none> 9090/TCP 159m
ad-torch-ml ClusterIP <none> 19035/TCP 159m
kotsadm ClusterIP <none> 3000/TCP 164m
kotsadm-minio ClusterIP <none> 9000/TCP 165m
kotsadm-postgres ClusterIP <none> 5432/TCP 165m
livy ClusterIP <none> 80/TCP 159m
livy-headless ClusterIP None <none> <none> 159m
torch-api-gateway LoadBalancer 80:32651/TCP,443:31041/TCP 148m

Accessing the Torch Application

For the torch-api-gateway service shown above, the system will assign an external LoadBalancer dns.

The Torch UI can be accessed from the DNS provided for the nginx ingress.

For example: Open to start the Torch UI.