Quickstart

Acceldata is designed to be easily installed and you can get up and running in a few minutes.

Acceldata is a container native platform and is composed of multiple services which can be installed

Pre-requisites

Must To Have:

  • Install Docker for your platform.

  • Bash unix shell configured for the user.

  • SSH

    • From Acceldata host you should be able to ssh into all nodes in the cluster without a password.
  • Internet

    • If the internet access in Acceldata host is via http_proxy/https_proxy then you need to make below configurations for docker to use the proxy.

      • HTTP PROXY:

        sudo mkdir -p /etc/systemd/system/docker.service.d
        vi /etc/systemd/system/docker.service.d/http-proxy.conf
        • Include below and restart docker service:
        [Service]
        Environment="HTTP_PROXY=<http proxy url>"
      • HTTPS PROXY

        sudo mkdir -p /etc/systemd/system/docker.service.d
        vi /etc/systemd/system/docker.service.d/https-proxy.conf
        • Include below and restart docker service:
        [Service]
        Environment="HTTPS_PROXY=<https proxy url>"
  • Ports

    • From Acceldata host to data lake

      • Cluster’s resource manager URL port

      • Cluster’s ATS URL port

      • MR Jobhistory URL’s port

      • Hive Metastore URI port

      • Hive LLAP Port

      • Webhdfs port

      • Datanode port

      • Kafka broker port

      • ZooKeeper Server port

      • From data lake to Acceldata host

        • Metrics service port - 19009
        • Log search and aggregation port - 19013,19014
        • All cluster node's log receiving port - 19012
      • You should be able to listen to port 4000 from your network on Acceldata host in which Acceldata dashboard is bound.

  • Kerberos

    • You should be able to run kinit with hdfs headless keytab from Acceldata host.
    • port 88 (on kdc server) should be accessible from Acceldata host
  • Download the Acceldata CLI

Quick setup (~5 minutes)

  • Create a home directory for Acceldata

    mkdir acceldata
  • Move the Acceldata CLI into the directory

    mv accelo acceldata/
    cd acceldata
  • Execute:

    ./accelo init
    • This will ask for the Acceldata installation directory and creates an environment file /etc/profile.d/ad.sh.
    • Source this environment file in to your current shell by executing the command source /etc/profile.d/ad.sh.
    • Now, execute the command accelo init again and when asked enter the customer image tag.
    • Check current Acceldata status by executing the command accelo info. This will create the required directory structure and files in the Acceldata home folder, if not already created.
  • Setup Acceldata core:

    • Execute:

      accelo login docker
    • Execute:

      accelo deploy core
    • Edit the file acceldata.conf created and mentioned by the previous step output and add the values for your cluster as instructed in the file, At the minimum change yarn.rm.url and set the Yarn resource manager URL.

    • Execute:

      accelo deploy core
    • Navigate to localhost:4000 and login with the default credentials and navigate to the applications tab

    • Move on to full install guide for the full setup.

  • Quick setup in action: