為了讓 WEB APP 不因一台主機當機而影響作業，開始架構二台 JBOSS 主機，並利用 JBOSS plug in 在 Apache 的 mod_cluster-1.2.6 來作 Load Balancer
版本：
JDK：jdk-8u45-linux-x64.rpm
JBOSS EAP 6.4
Apache & mod_cluster 1.2.6.Final : http://downloads.jboss.org/mod_cluster//1.2.6.Final/linux-i686/mod_cluster-1.2.6.Final-src-ssl.tar.gz
環境：
domain Master ：192.168.30.100
domain Slave：192.168.30.101
一、開始安裝 JDK
Step 01: 移除 OpenJDK
| [root@localhost ~]# rpm -qa | grep java [root@localhost ~]# yum remove java* |
Step 02：安裝 JDK
|
[root@localhost tmp]# rpm -ivh jdk-8u45-linux-x64.rpm [root@bm tmp]# java -version |
Step 03：編輯「/etc/profile」檔案，在最後加入
| export JAVA_HOME=/usr/java/jdk1.8.0_45 export JRE_HOME=/usr/java/jdk1.8.0_45/jre export ANT_HOME=/opt/apache-ant-1.7.0 export JBOSS_HOME=/opt/jboss-eap-6.4 export APACHE_HOME=/opt/jboss/httpd export PATH=$JAVA_HOME/bin:$JRE_HOME/bin:$PATH:$ANT_HOME/bin export CLASSPATH=$CLASSPATH:.:$JAVA_HOME/lib:$JRE_HOME/lib |
二、開始安裝 JBoss EAP 6.4
Step 01：上傳 jboss-eap-6.4.0.zip 並解壓於 /opt 下
|
[root@bm tmp]# unzip jboss-eap-6.4.0.zip |
Step 02：重開主機，並啟動 JBOSS Domain Mode 作測試( Master 與 Slave 作同樣的動作)
| [root@bm tmp]# $JBOSS_HOME/bin/domain.sh |
三、開始作 Domain Configuration 設定
￭ Interface config on master(192.168.30.100)
Step 01：修改 vi domain/configuration/host.xml
初始值如下：
| <interfaces> <interface name="management"> <inet-address value="${jboss.bind.address.management:127.0.0.1}"/> </interface> <interface name="public"> <inet-address value="${jboss.bind.address:127.0.0.1}"/> </interface> <interface name="unsecure"> <!-- Used for IIOP sockets in the standard configuration. To secure JacORB you need to setup SSL --> <inet-address value="${jboss.bind.address.unsecure:127.0.0.1}"/> </interface> </interfaces> |
變更如下
| <interfaces> <interface name="management"> <inet-address value="${jboss.bind.address.management:192.168.30.100}"/> </interface> <interface name="public"> <inet-address value="${jboss.bind.address:192.168.30.100}"/> </interface> <interface name="unsecure"> <!-- Used for IIOP sockets in the standard configuration. To secure JacORB you need to setup SSL --> <inet-address value="${jboss.bind.address.unsecure:192.168.30.100}"/> </interface> </interfaces> |
Step02：建立 Domain Mode 主機間溝通用專用的帳號：domainAdmin，並取得 secret key
增加管理帳號：domainAdmin
密碼：password
| [root@localhost bin]# ./add-user.sh What type of user do you wish to add? a) Management User (mgmt-users.properties) b) Application User (application-users.properties) (a): Enter the details of the new user to add. Using realm 'ManagementRealm' as discovered from the existing property files. Username : domainAdmin Password requirements are listed below. To modify these restrictions edit the add-user.properties configuration file. - The password must not be one of the following restricted values {root, admin, administrator} - The password must contain at least 8 characters, 1 alphabetic character(s), 1 digit(s), 1 non-alphanumeric symbol(s) - The password must be different from the username Password : password Re-enter Password : password What groups do you want this user to belong to? (Please enter a comma separated list, or leave blank for none)[ ]: About to add user 'domainMaster' for realm 'ManagementRealm' Is this correct yes/no? yes Added user 'domainMaster' to file '/opt/jboss-eap-6.3/standalone/configuration/mgmt-users.properties' Added user 'domainMaster' to file '/opt/jboss-eap-6.3/domain/configuration/mgmt-users.properties' Added user 'domainMaster' with groups to file '/opt/jboss-eap-6.3/standalone/configuration/mgmt-groups.properties' Added user 'domainMaster' with groups to file '/opt/jboss-eap-6.3/domain/configuration/mgmt-groups.properties' Is this new user going to be used for one AS process to connect to another AS process? e.g. for a slave host controller connecting to the master or for a Remoting connection for server to server EJB calls. yes/no? yes To represent the user add the following to the server-identities definition <secret value="SkJvc3NFQVA2LjM=" /> |
￭ Interface config on slave(192.168.30.101)
Step 01：修改 vi domain/configuration/host.xml 相關的值如下
| <?xml version='1.0' encoding='UTF-8'?> <host name="slave" xmlns="urn:jboss:domain:1.6"> <management> <security-realms> <security-realm name="ManagementRealm"> <server-identities> <secret value="SkJvc3NFQVA2LjM=" /> </server-identities> <authentication> <properties path="mgmt-users.properties" relative-to="jboss.domain.config.dir"/> </authentication> <authorization map-groups-to-roles="false"> <properties path="mgmt-groups.properties" relative-to="jboss.domain.config.dir"/> </authorization> </security-realm> <security-realm name="ApplicationRealm"> <authentication> <local default-user="$local" allowed-users="*" skip-group-loading="true" /> <properties path="application-users.properties" relative-to="jboss.domain.config.dir" /> </authentication> <authorization> <properties path="application-roles.properties" relative-to="jboss.domain.config.dir"/> </authorization> </security-realm> </security-realms> <audit-log> <formatters> <json-formatter name="json-formatter"/> </formatters> <handlers> <file-handler name="host-file" formatter="json-formatter" relative-to="jboss.domain.data.dir" path="audit-log.log"/> <file-handler name="server-file" formatter="json-formatter" relative-to="jboss.server.data.dir" path="audit-log.log"/> </handlers> <logger log-boot="true" log-read-only="false" enabled="false"> <handlers> <handler name="host-file"/> </handlers> </logger> <server-logger log-boot="true" log-read-only="false" enabled="false"> <handlers> <handler name="server-file"/> </handlers> </server-logger> </audit-log> <management-interfaces> <native-interface security-realm="ManagementRealm"> <socket interface="management" port="${jboss.management.native.port:9999}"/> </native-interface> <http-interface security-realm="ManagementRealm"> <socket interface="management" port="${jboss.management.http.port:9990}"/> </http-interface> </management-interfaces> </management> <domain-controller> <remote host="192.168.30.100" port="9999" security-realm="ManagementRealm" username="domainAdmin" /> <!-- Alternative remote domain controller configuration with a host and port --> <!-- <remote host="${jboss.domain.master.address}" port="${jboss.domain.master.port:9999}" security-realm="ManagementRealm"/> --> </domain-controller> <interfaces> <interface name="management"> <inet-address value="${jboss.bind.address.management:192.168.30.101}"/> </interface> <interface name="public"> <inet-address value="${jboss.bind.address:192.168.30.101}"/> </interface> <interface name="unsecure"> <!-- Used for IIOP sockets in the standard configuration. To secure JacORB you need to setup SSL --> <inet-address value="${jboss.bind.address.unsecure:192.168.30.101}"/> </interface> </interfaces> <jvms> <jvm name="default"> <heap size="64m" max-size="256m"/> <permgen size="256m" max-size="256m"/> <jvm-options> <option value="-server"/> </jvm-options> </jvm> </jvms> <servers> <server name="slave-one" group="other-server-group"> <!-- Remote JPDA debugging for a specific server <jvm name="default"> <jvm-options> <option value="-agentlib:jdwp=transport=dt_socket,address=8787,server=y,suspend=n"/> </jvm-options> </jvm> --> </server> <server name="slave-two" group="other-server-group" auto-start="true"> <!-- server-two avoids port conflicts by incrementing the ports in the default socket-group declared in the server-group --> <socket-bindings port-offset="150"/> </server> <server name="slave-three" group="other-server-group" auto-start="false"> <!-- server-three avoids port conflicts by incrementing the ports in the default socket-group declared in the server-group --> <socket-bindings port-offset="250"/> </server> </servers> </host> |
Step 02：Domain Mode 是聽從 Master 主機，所以將 Slave 的 domain.xml 更名為 domain.xml.move
| mv $JBOSS_HOME/domain/configuration/domain.xml $JBOSS_HOME/domain/configuration/domain.xml.move |
四、Cluster Configuration： 使用 mod_cluster 1.2.6.Final
Step 01: 安裝 apache，到 http://mod-cluster.jboss.org/downloads 下載 mod_cluster-1.2.6.Final-linux2-x64-ssl.tar.gz
將 mod_cluster-1.2.6.Final-linux2-x64-ssl.tar.gz 上載到Server後解壓
| [root@eap-master tmp]# tar -xzvf mod_cluster-1.2.6.Final-linux2-x64-ssl.tar.gz [root@eap-master tmp]# cp –rp /tmp/opt/jboss /opt |
Step 02: 分別修改 192.168.30.100 & 192.168.30.101 Apache 的 httpd.conf
￭ 修改 Master(192.168.30.100) 的 mod_cluster：vi $APACHE_HOME/httpd/conf/httpd.conf
| ServerName eap-master.globeunion.com:80 <VirtualHost 192.168.30.100:80> <Directory /> Order deny,allow Deny from all Allow from all </Directory> <Location /cluster_manager> SetHandler mod_cluster-manager Order deny,allow Deny from all Allow from all </Location> </VirtualHost> Listen 192.168.30.100:6666 #ManagerBalancerName mycluster ManagerBalancerName other-server-group <VirtualHost 192.168.30.100:6666> <Directory /> Order deny,allow Deny from all Allow from all </Directory> ServerAdvertise on http://192.168.30.100:6666 EnableMCPMReceive </VirtualHost> |
￭ 修改 Slave(192.168.30.101) 的 mod_cluster：vi $APACHE_HOME/httpd/conf/httpd.conf
| ServerName eap-slave.globeunion.com:80 # MOD_CLUSTER_ADDS # Adjust to you hostname and subnet. <IfModule manager_module> <VirtualHost 192.168.30.101:80> <Directory /> Order deny,allow Deny from all Allow from all </Directory> <Location /cluster_manager> SetHandler mod_cluster-manager Order deny,allow Deny from all Allow from all </Location> </VirtualHost> Listen 192.168.30.101:6666 #ManagerBalancerName mycluster ManagerBalancerName other-server-group <VirtualHost 192.168.30.101:6666> <Directory /> Order deny,allow Deny from all Allow from all </Directory> ServerAdvertise on http:// 192.168.30.101:6666 EnableMCPMReceive </VirtualHost> </IfModule> |
Step 03：修改192.168.30.100-Master 的 domain.xml 裡的 profile name="full-ha"：
vi domain/configuration/domain.xml 相關的值如下
| <profile name="full-ha"> <subsystem xmlns="urn:jboss:domain:messaging:1.4"> <hornetq-server> <cluster-user>domainAdmin</cluster-user> <cluster-password>password</cluster-password> <persistence-enabled>true</persistence-enabled> <journal-type>NIO</journal-type> <journal-min-files>2</journal-min-files> <connectors> <netty-connector name="netty" socket-binding="messaging"/> <netty-connector name="netty-throughput" socket-binding="messaging-throughput"> <param key="batch-delay" value="50"/> </netty-connector> <in-vm-connector name="in-vm" server-id="0"/> </connectors> </hornetq-server> </subsystem> <subsystem xmlns="urn:jboss:domain:modcluster:1.2"> <mod-cluster-config advertise-socket="modcluster" connector="ajp" proxy-list="192.168.30.100:6666,192.168.30.101:6666" balancer="mycluster"> <dynamic-load-provider> <load-metric type="busyness"/> </dynamic-load-provider> </mod-cluster-config> </subsystem> <subsystem xmlns="urn:jboss:domain:web:2.2" default-virtual-server="default-host" native="false" instance-id="${jboss.node.name}"> <connector name="http" protocol="HTTP/1.1" scheme="http" socket-binding="http"/> <connector name="ajp" protocol="AJP/1.3" scheme="http" socket-binding="ajp"/> <virtual-server name="default-host" enable-welcome-root="true"> <alias name="localhost"/> <alias name="example.com"/> </virtual-server> </subsystem> </profile> |
五、關閉防火牆
|
[root@bm bin]# systemctl list-unit-files | grep fire firewalld.service enabled [root@bm bin]# systemctl disable firewalld.service |
六、相關服務手動啟動
|
#Apache Server Start/Stop $APACHE_HOME/sbin/apachectl start/stop/status #JBOSS EAP Server Start $JBOSS_HOME/bin/domain.sh #JBOSS EAP Domain 管理介面 http://192.168.30.100:9990/console
|
七、將 Apache Server 設定成 Service
Step 01：copy apachectl 到 /etc/init.d
| [root@eap-master init.d]# cp /opt/jboss/httpd/sbin/apachectl /etc/init.d |
Step 02: 修改 /etc/init.d/apachectl
|
#!/bin/sh 在第二行加入以下兩句： |
第一行，告訴系統使用的shell,所以的shell腳本都是這樣。
第二行，chkconfig後面有三個參數2345,80和90告 訴chkconfig程式，需要在rc2.d~rc5.d目錄下，創建名字為 S80auto_run的檔連接，連接到/etc/rc.d/init.d目錄下的的auto_run腳本。第一個字元是S，系統在啟動的時候，運行腳 本auto_run，就會添加一個start參數，告訴腳本，現在是啟動模式。同時在rc0.d和rc6.d目錄下，創建名字為K90auto_run的 檔連接，第一個字元為K，個系統在關閉系統的時候，會運行auto_run，添加一個stop，告訴腳本，現在是關閉模式。
注意上面的三行是中，第二、三行是必須的，否則在運行chkconfig --add auto_run時，會報錯。
完整如下：
| #!/bin/sh # chkconfig: 2345 80 90 # description:auto_run # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # Apache control script designed to allow an easy command line interface # to controlling Apache. Written by Marc Slemko, 1997/08/23 # # The exit codes returned are: # XXX this doc is no longer correct now that the interesting # XXX functions are handled by httpd # 0 - operation completed successfully # 1 - # 2 - usage error # 3 - httpd could not be started # 4 - httpd could not be stopped # 5 - httpd could not be started during a restart # 6 - httpd could not be restarted during a restart # 7 - httpd could not be restarted during a graceful restart # 8 - configuration syntax error # # When multiple arguments are given, only the error from the _last_ # one is reported. Run "apachectl help" for usage info # ARGV="$@" # # |||||||||||||||||||| START CONFIGURATION SECTION |||||||||||||||||||| # -------------------- -------------------- # # the path to your httpd binary, including options if necessary HTTPD='/opt/jboss/httpd/sbin/httpd' # # pick up any necessary environment variables if test -f /opt/jboss/httpd/sbin/envvars; then . /opt/jboss/httpd/sbin/envvars fi # # a command that outputs a formatted text version of the HTML at the # url given on the command line. Designed for lynx, however other # programs may work. LYNX="lynx -dump" # # the URL to your server's mod_status status page. If you do not # have one, then status and fullstatus will not work. STATUSURL="http://localhost:80/server-status" # # Set this variable to a command that increases the maximum # number of file descriptors allowed per child process. This is # critical for configurations that use many file descriptors, # such as mass vhosting, or a multithreaded server. ULIMIT_MAX_FILES="ulimit -S -n `ulimit -H -n`" # -------------------- -------------------- # |||||||||||||||||||| END CONFIGURATION SECTION |||||||||||||||||||| # Set the maximum number of file descriptors allowed per child process. if [ "x$ULIMIT_MAX_FILES" != "x" ] ; then $ULIMIT_MAX_FILES fi ERROR=0 if [ "x$ARGV" = "x" ] ; then ARGV="-h" fi case $ARGV in start|stop|restart|graceful|graceful-stop) $HTTPD -k $ARGV ERROR=$? ;; startssl|sslstart|start-SSL) echo The startssl option is no longer supported. echo Please edit httpd.conf to include the SSL configuration settings echo and then use "apachectl start". ERROR=2 ;; configtest) $HTTPD -t ERROR=$? ;; status) $LYNX $STATUSURL | awk ' /process$/ { print; exit } { print } ' ;; fullstatus) $LYNX $STATUSURL ;; *) $HTTPD $ARGV ERROR=$? esac exit $ERROR |
Step 03: 強制設成 Service
|
[root@eap-master init.d]# chkconfig --add apachectl [root@eap-master init.d]# chkconfig --list apachectl |
這樣 apache 除了會自動開機啟動外，還可以直接下 service apachectl start/stop 啟動
八、設定 建立 JBoss EAP 的 Domain 為 Service
Step 01: copy jboss-as.conf 到 /etc/jboss-as/ ；copy jboss-as-domain.sh 到 /etc/init.d/
|
[root@bm etc]# cp /opt/jboss-eap-6.4/bin/init.d/jboss-as.conf /etc/jboss-as/ [root@bm jboss-as]# cp /opt/jboss-eap-6.4/bin/init.d/jboss-as-domain.sh /etc/init.d/ |
Step 02: 修改 /etc/jboss-as/jboss-as.conf
| # The username who should own the process. # JBOSS_USER=root # The amount of time to wait for startup # STARTUP_WAIT=30 # The amount of time to wait for shutdown # # SHUTDOWN_WAIT=30 # Location to keep the console log # # JBOSS_CONSOLE_LOG=/var/log/jboss-as/console.log |
Step 03: 修改 /etc/init.d/jboss-as-domain.sh
| #!/bin/sh # # JBoss domain control script # # chkconfig: - 80 20 # description: JBoss AS Domain # processname: domain # pidfile: /var/run/jboss-as/jboss-as-domain.pid # config: /etc/jboss-as/jboss-as.conf # Source function library. . /etc/init.d/functions # Load Java configuration. #[ -r /etc/java/java.conf ] && . /etc/java/java.conf #export JAVA_HOME # Load JBoss AS init.d configuration. if [ -z "$JBOSS_CONF" ]; then JBOSS_CONF="/etc/jboss-as/jboss-as.conf" fi [ -r "$JBOSS_CONF" ] && . "${JBOSS_CONF}" # Set defaults. if [ -z "$JBOSS_HOME" ]; then JBOSS_HOME=/opt/jboss-eap-6.4 fi export JBOSS_HOME |
Step 04: 註冊 JBOSS 成 Service
|
[user@host init.d]$ sudo chkconfig --add jboss-as-domain.sh [user@host init.d]$ sudo chkconfig --level 2345 jboss-as-domain.sh on #設置 jboss-as-domain.sh 在運行級別為2、3、4、5的情況下都是on（開啟）的狀態 |
這樣子就可以兩台相互備援了.
附註：
￭ 若同一個環境有不同的 mod_cluster, 為了不要互相引響，可以在 mod_cluster 的httpd.conf 加入 allow 作限制如下：vi $APACHE_HOME/httpd/conf/httpd.conf
| ## 2015/09/22 added by polin wei <VirtualHost 192.168.30.100:80> <Directory /> Order deny,allow Deny from all Allow from all </Directory> <Location /cluster_manager> SetHandler mod_cluster-manager Order deny,allow Deny from all Allow from 192.168.30. </Location> </VirtualHost> Listen 192.168.30.100:6666 #ManagerBalancerName mycluster ManagerBalancerName other-server-group <VirtualHost 10.10.2.52:6666> <Directory /> Order deny,allow Deny from all Allow from 192.168.30.100 Allow from 192.168.30.101 </Directory> ServerAdvertise on http://192.168.30.100:6666 EnableMCPMReceive </VirtualHost> |
參考:
http://wiki.lunarpages.com/Allow_and_Deny_by_IP_Address
留言列表
PTC-Windchill (1)