Ching-Chuan Chen's Blogger

Statistics, Machine Learning and Programming

0%

Posted on Edited on In Disqus:

這一篇文章主要是在CentOS 7.4最小安裝下去部署Oracle database

我會建立Oracle database的主要原因是

為了下一篇測試從Oracle database拉資料到sqoop

(Note: modified at 2018/04/19)

Read more »

Posted on Edited on In Disqus:

之前有一系列文章是在mint 17上部署R-hadoop的環境

這篇主要是在centos 7.2最小安裝下去部署hadoop, yarn, zookeeper, hbase, phoenix以及spark

一樣是透過VM做部署，所以目標是部署好其中一台後

再把那一台的映像檔做clone，變成slaves

Read more »

Posted on Edited on In Disqus:

我在ptt分享過magrittr的文章(連結)，做為資料處理系列文章的第一篇

後來有一些額外的心得(連結)，所以又有一篇補充了一些觀念

一個大陸人Kun Ren(任堃)後來在2015年上傳了一個pipeR套件

Read more »

Posted on Edited on In Disqus:

I try to install Unix system on a machine with fake raid supported by intel RST in BIOS.
But I spent 36 hours to install ubuntu 16.04, it did not come to succeed.
Accidentally, I saw a massage that installation of centos on fake raid is easier than ubuntu,
so I try to install and succeed. The reference website is PowerRC.

Read more »

Posted on Edited on In Disqus:

Revolution R Open (Now named Microsoft R Open) provides Intel MKL multi-threaded BLAS.
This post is to record the installation of MRO in ubuntu 16.04.

Read more »

Posted on Edited on In Disqus: 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
sudo add-apt-repository ppa:webupd8team/sublime-text-3
sudo apt-get update
sudo apt-get install sublime-text-installer
sudo add-apt-repository ppa:webupd8team/java && sudo apt-get update && sudo apt-get install oracle-java8-installer && sudo apt-get install oracle-java8-set-default
apt-cache search readline xorg-dev && sudo apt-get install libreadline6 libreadline6-dev xorg-dev tcl8.6-dev tk8.6-dev libtiff5 libtiff5-dev libjpeg-dev libpng12-dev libcairo2-dev libglu1-mesa-dev libgsl0-dev libicu-dev R-base R-base-dev libnlopt-dev libstdc++6 build-essential libcurl4-openssl-dev libxml2-dev aptitude r-base r-base-dev libnlopt-dev libstdc++6 build-essential libcurl4-openssl-dev libxml2-dev libssl-dev

# installation of rstudio-server
sudo apt-get install gdebi-core
wget https://download2.rstudio.org/rstudio-server-0.99.896-amd64.deb
sudo gdebi rstudio-server-0.99.896-amd64.deb
sudo cp /usr/lib/rstudio-server/extras/init.d/debian/rstudio-server /etc/init.d/
sudo apt-get install sysv-rc-conf
sudo sysv-rc-conf rstudio-server on
# check whether rstudio-server open when boot
sysv-rc-conf --list rstudio-server
# port to rstudio-server
iptables -A INPUT -p tcp --dport 8787 -j ACCEPT

# remove R
rm -r /usr/local/lib/R

# download the installation file
wget https://mran.revolutionanalytics.com/install/mro/3.2.4/MRO-3.2.4-Ubuntu-15.4.x86_64.deb
wget https://mran.revolutionanalytics.com/install/mro/3.2.4/RevoMath-3.2.4.tar.gz
# install MRO
sudo dpkg -i MRO-3.2.4-Ubuntu-15.4.x86_64.deb
# unpack MKL
tar -xzf RevoMath-3.2.4.tar.gz
cd RevoMath
# install MKL
sudo bash ./RevoMath.sh

sudo chown -R celest.celest /usr/lib64/MRO-3.2.4/R-3.2.4/lib/R
sudo chmod -R 775 /usr/lib64/MRO-3.2.4/R-3.2.4/lib/R

# install texlive
sudo apt-get install texinfo texlive texlive-binaries texlive-latex-base texlive-latex-extra texlive-fonts-extra

# for server
sudo apt-get install ssh rsync openssh-server
ssh-keygen -t rsa -P "" # generate SSH key
# Enable SSH Key
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

# for VM, to use unity mode
sudo apt-get install gnome-shell

Posted on Edited on In Disqus:

Revolution R Open (Now named Microsoft R Open) provides Intel MKL multi-threaded BLAS.
RcppParallel provides parallel tools for R via Intel TBB. (Note: On other platforms, it use TinyThread library.)
However, does RcppParallel conflict with Intel MKL multi-threaded BLAS?

Read more »

Posted on Edited on In Disqus:

這是我自己在PTT PO的文，詳細介紹tidyr，以下是正文~~

本篇是最後一篇，主要介紹tidyr，以下是要介紹的內容：

  1. data.table:::dcast.data.table

  2. data.table:::melt

  3. tidyr:::gather

  4. tidyr:::spread

  5. tidyr:::separate

Read more »