passwordless cluster

#local

key=secret

user=wasit

host=1.2.3.4

ssh-keygen -t rsa -b 4096 -f $HOME/.ssh/$key

ssh-copy-id -i $HOME/.ssh/$key.pub $user@$host

#enter password many times :)

ssh -t -i $HOME/.ssh/$key $user@$host 'sudo su root'

#wasit's host server

ssh localhost

cp home/wasit/.ssh/authorized_keys /root/.ssh

setup new python env on ubuntu18.04

https://matthewbrown.io/2018/05/05/setting-up-my-python-workspace-2018/

Setup graph on Ubuntu 18.04

https://github.com/ellson/MOTHBALLED-graphviz/issues/1237#issuecomment-321374053

sentiment dataset

https://archive.ics.uci.edu/ml/datasets/Sentiment+Labelled+Sentences

Mesos cluster on Vagrant

Install Mesos locally

Install Virtualbox:
  sudo apt-get install virtualbox

Install Vagrant:
  https://www.vagrantup.com/downloads.html
  sudo dpkg -i /home/wasit/Downloads/vagrant_2.0.1_x86_64.deb

Install plugin:
  sudo vagrant plugin install vagrant-hostmanager

Up:
  cp VagrantConfig-1m-1a-1p.yaml VagrantConfig.yaml
  vagrant up

Remove:
vagrant halt
vagrant destroy -f

Sleep:
vagrant suspend
vagrant resume


ref:
  https://github.com/dcos/dcos-vagrant#setup
  https://github.com/dcos/dcos-vagrant/blob/master/docs/deploy.md

DO ssh key

https://www.digitalocean.com/community/tutorials/how-to-use-ssh-keys-with-putty-on-digitalocean-droplets-windows-users#setting-up-an-ssh-session-with-ssh-keys-in-putty

ETL review

Spark:
https://youtu.be/Zb9YW8XjxnE?t=32m22s

Talend:
https://www.talend.com/resources/webinars/talend-open-studio-for-big-data-for-dummies/?aliId=318108320

Pentaho:
https://talendexpert.com/pentaho-vs-talend/