Add node prodapp03 (centos 6.8) node on haproxy 7-1-2017 Add node prodapp04 (centos 6.8) node on haproxy 14-1-2017 Will remove prodapp02 (centos 5.6) node on haproxy 21-1-2017 Following steps need need to be done for adding new nodes in production learnexa server step 1. Maintenance Page On in Haproxy sudo openconnect na1.cloud-vpn.net ssh expprodl@10.166.152.11 ###(login to prodapp01) cd /home/expprodl/crossbow ./runcap.sh Enter target environment number [1,2]: 2 (according to environment for ex production or qa ) Enter Cap Task number [1-9]: 9 ——to install maintanence page step 2. From prodapp01 To Prdoapp03 , Prodapp04 Nodes Following folder need to be copy for identical configuration /deploy/crossbow/shared/config/ step 3. vi /etc/fstab #prodapp03 Nodes for gluster mount Remove this lines 10-166-152-15:/asset-volume /deploy/crossbow/shared/assets glusterfs defaults 1 0 10-166-152-15:/data-volume /deploy/crossbow/shared/system/uploaded_datas glusterfs defaults 1 0 10-166-152-15:/images-volume /deploy/crossbow/shared/system/images glusterfs defaults 1 0 10-166-152-15:/site_backgrounds /deploy/crossbow/shared/system/site_backgrounds glusterfs defaults 1 0 10-166-152-15:/site_logos /deploy/crossbow/shared/system/site_logos glusterfs defaults 1 0 10-166-152-15:/styles /deploy/crossbow/shared/system/styles glusterfs defaults 1 0 10-166-152-15:/sheets /deploy/crossbow/shared/system/sheets glusterfs defaults 1 0 10-166-152-15:/templates /deploy/crossbow/shared/system/templates glusterfs defaults 1 0 Add below lines 10-166-152-13:/asset-volume /deploy/crossbow/shared/assets glusterfs defaults 1 0 10-166-152-13:/data-volume /deploy/crossbow/shared/system/uploaded_datas glusterfs defaults 1 0 10-166-152-13:/images-volume /deploy/crossbow/current/public/system/images glusterfs defaults 1 0 10-166-152-13:/site_backgrounds /deploy/crossbow/shared/system/site_backgrounds glusterfs defaults 1 0 10-166-152-13:/site_logos /deploy/crossbow/shared/system/site_logos glusterfs defaults 1 0 10-166-152-13:/styles /deploy/crossbow/shared/system/styles glusterfs defaults 1 0 10-166-152-13:/sheets /deploy/crossbow/shared/system/sheets glusterfs defaults 1 0 10-166-152-13:/templates /deploy/crossbow/shared/system/templates glusterfs defaults 1 0 clear log file prodapp03 and prodapp04 > /deploy/crossbow/shared/log/production.log prodapp03 and prodapp04 restart servers init 6 step 4. Dkim install Prodapp03 and Prodapp04 steps following link https://wiki.exphosted.com/doku.php/email_server_domain_reputation?s[]=dkim step 5. Haproxy config file backup and Add New Nodes prodapp03 and prodapp04 Nodes , login to haproxy ssh expprodl@10.166.152.16 su root #switch to root Add node prodapp03 (centos 6.8) node on haproxy 7-1-2017 vi /opt/haproxy/haproxy.cfg From backend learnexa balance roundrobin option httplog option forwardfor cookie SERVERID insert indirect source 10.166.152.246 #timeout client 150000ms timeout connect 35000ms timeout server 8m option httpchk HEAD /contact-us/new HTTP/1.1\r\nHost:\ www.learnexa.com\r\nUser-Agent:\ HaProxy server prodapp01 10.166.152.11:80 check port 80 cookie app1 maxconn 31 inter 5000 rise 2 fall 3 server prodapp02 10.166.152.19:80 check port 80 cookie app2 maxconn 31 inter 5000 rise 2 fall 3 # server prodapp03 10.166.152.14:80 check port 80 cookie app3 maxconn 31 inter 5000 rise 2 fall 3 TO backend learnexa balance roundrobin option httplog option forwardfor cookie SERVERID insert indirect source 10.166.152.246 #timeout client 150000ms timeout connect 35000ms timeout server 8m option httpchk HEAD /contact-us/new HTTP/1.1\r\nHost:\ www.learnexa.com\r\nUser-Agent:\ HaProxy server prodapp01 10.166.152.11:80 check port 80 cookie app1 maxconn 31 inter 5000 rise 2 fall 3 server prodapp02 10.166.152.19:80 check port 80 cookie app2 maxconn 31 inter 5000 rise 2 fall 3 server prodapp03 10.166.152.14:80 check port 80 cookie app3 maxconn 31 inter 5000 rise 2 fall 3 Haproxy service reload /etc/init.d/haproxy reload step 6.New Public for prodapp03 prodapp04 prodapp04 public ip = 198.46.49.166 mail04.learnexa.com prodapp03 public ip = 198.46.49.161 mail03.learnexa.com have to add dns entry for forward lookup zone For this week end migration learnexa adding new nodes prodapp03 in Production Haproxy Load Balancer step 7. Maintenance Page Remove in Haproxy sudo openconnect na1.cloud-vpn.net ssh expprodl@10.166.152.11 ###(login to prodapp01) cd /home/expprodl/crossbow ./runcap.sh Enter target environment number [1,2]: 2 (according to environment for ex production or qa ) Enter Cap Task number [1-9]: 8 ——to remove maintanence page =========================================================================================================================================================================================================================== Add node prodapp04 (centos 6.8) node on haproxy 14-1-2017 Following steps need need to be done for adding new nodes in production learnexa server step 8. Maintenance Page On in Haproxy sudo openconnect na1.cloud-vpn.net ssh expprodl@10.166.152.11 ###(login to prodapp01) cd /home/expprodl/crossbow ./runcap.sh Enter target environment number [1,2]: 2 (according to environment for ex production or qa ) Enter Cap Task number [1-9]: 9 ——to install maintanence page step 9. vi /etc/fstab #prodapp04 Nodes for gluster mount Remove this lines 10-166-152-15:/asset-volume /deploy/crossbow/shared/assets glusterfs defaults 1 0 10-166-152-15:/data-volume /deploy/crossbow/shared/system/uploaded_datas glusterfs defaults 1 0 10-166-152-15:/images-volume /deploy/crossbow/shared/system/images glusterfs defaults 1 0 10-166-152-15:/site_backgrounds /deploy/crossbow/shared/system/site_backgrounds glusterfs defaults 1 0 10-166-152-15:/site_logos /deploy/crossbow/shared/system/site_logos glusterfs defaults 1 0 10-166-152-15:/styles /deploy/crossbow/shared/system/styles glusterfs defaults 1 0 10-166-152-15:/sheets /deploy/crossbow/shared/system/sheets glusterfs defaults 1 0 10-166-152-15:/templates /deploy/crossbow/shared/system/templates glusterfs defaults 1 0 Add below lines 10-166-152-13:/asset-volume /deploy/crossbow/shared/assets glusterfs defaults 1 0 10-166-152-13:/data-volume /deploy/crossbow/shared/system/uploaded_datas glusterfs defaults 1 0 10-166-152-13:/images-volume /deploy/crossbow/current/public/system/images glusterfs defaults 1 0 10-166-152-13:/site_backgrounds /deploy/crossbow/shared/system/site_backgrounds glusterfs defaults 1 0 10-166-152-13:/site_logos /deploy/crossbow/shared/system/site_logos glusterfs defaults 1 0 10-166-152-13:/styles /deploy/crossbow/shared/system/styles glusterfs defaults 1 0 10-166-152-13:/sheets /deploy/crossbow/shared/system/sheets glusterfs defaults 1 0 10-166-152-13:/templates /deploy/crossbow/shared/system/templates glusterfs defaults 1 0 clear log file prodapp04 > /deploy/crossbow/shared/log/production.log prodapp04 restart servers init 6 step 10 login to haproxy ssh expprodl@10.166.152.16 su root #switch to root Add node prodapp04 (centos 6.8) node on haproxy 14-1-2017 vi /opt/haproxy/haproxy.cfg From backend learnexa balance roundrobin option httplog option forwardfor cookie SERVERID insert indirect source 10.166.152.246 #timeout client 150000ms timeout connect 35000ms timeout server 8m option httpchk HEAD /contact-us/new HTTP/1.1\r\nHost:\ www.learnexa.com\r\nUser-Agent:\ HaProxy server prodapp01 10.166.152.11:80 check port 80 cookie app1 maxconn 31 inter 5000 rise 2 fall 3 server prodapp02 10.166.152.19:80 check port 80 cookie app2 maxconn 31 inter 5000 rise 2 fall 3 server prodapp03 10.166.152.14:80 check port 80 cookie app3 maxconn 31 inter 5000 rise 2 fall 3 TO backend learnexa balance roundrobin option httplog option forwardfor cookie SERVERID insert indirect source 10.166.152.246 #timeout client 150000ms timeout connect 35000ms timeout server 8m option httpchk HEAD /contact-us/new HTTP/1.1\r\nHost:\ www.learnexa.com\r\nUser-Agent:\ HaProxy server prodapp01 10.166.152.11:80 check port 80 cookie app1 maxconn 31 inter 5000 rise 2 fall 3 server prodapp02 10.166.152.19:80 check port 80 cookie app2 maxconn 31 inter 5000 rise 2 fall 3 server prodapp03 10.166.152.14:80 check port 80 cookie app3 maxconn 31 inter 5000 rise 2 fall 3 server prodapp04 10.166.152.22:80 check port 80 cookie app4 maxconn 31 inter 5000 rise 2 fall 3 Haproxy service reload /etc/init.d/haproxy reload step 10. Maintenance Page Remove in Haproxy sudo openconnect na1.cloud-vpn.net ssh expprodl@10.166.152.11 ###(login to prodapp01) cd /home/expprodl/crossbow ./runcap.sh Enter target environment number [1,2]: 2 (according to environment for ex production or qa ) Enter Cap Task number [1-9]: 8 ——to remove maintanence page =========================================================================================================================================================================================================================== Things to do later 1. Memcache roles move from app01 server to Slave DB 2. Rufus roles move from all app servers to Slave DB