搜索引擎>> solr_hdfs_ha_docker>> 返回
项目作者： risdenk

项目描述 ：
Solr HDFS HA Docker Testing
高级语言： PLpgSQL
项目地址: git://github.com/risdenk/solr_hdfs_ha_docker.git
创建时间： 2017-03-01T02:36:02Z
项目社区：https://github.com/risdenk/solr_hdfs_ha_docker
开源协议：
下载


Solr HDFS HA Docker

Overview

SOLR-10215 found that the HDFS HA support for Solr 6.4.0 and 6.4.1 was broken. This repository has tools can help test Solr against HDFS.

Features

  • Ambari 2.4.2
  • HDP 2.5
  • Blueprints (HDFS HA)

Getting Started

  1. docker-compose pull
  2. docker-compose build --pull
  3. ./run.sh

Testing Solr Versions

  1. docker-compose exec --user=solr solr1 bash
  2. export JAVA_HOME=/usr/jdk64/jdk1.8.0_77
  3. cd /opt/solr

Solr 6.3.0 - Works

  1. wget -nc -O solr-6.3.0.tgz http://archive.apache.org/dist/lucene/solr/6.3.0/solr-6.3.0.tgz
  2. tar zxvf solr-6.3.0.tgz
  3. cd /opt/solr/solr-6.3.0/
  4. HADOOP_USER_NAME=hdfs hdfs dfs -mkdir -p /apps/solr630
  5. HADOOP_USER_NAME=hdfs hdfs dfs -chown solr /apps/solr630
  6. ./bin/solr start -c -z zk1 -a "-Dsolr.directoryFactory=HdfsDirectoryFactory -Dsolr.lock.type=hdfs -Dsolr.hdfs.home=$(hdfs getconf -confKey fs.defaultFS)/apps/solr630 -Dsolr.hdfs.confdir=/etc/hadoop/conf"
  7. ./bin/solr create -c solr630
  8. ./bin/solr delete -c solr630 || true
  9. ./bin/solr stop -all
  10. HADOOP_USER_NAME=hdfs hdfs dfs -rm -r -f /apps/solr630
  11. cd /opt/solr
  12. rm -rf /opt/solr/solr-6.3.0/

Solr 6.4.0 and 6.4.1 - Doesn’t Work

  1. wget -nc -O solr-6.4.1.tgz http://apache.mirrors.lucidnetworks.net/lucene/solr/6.4.1/solr-6.4.1.tgz
  2. tar zxvf solr-6.4.1.tgz
  3. cd /opt/solr/solr-6.4.1/
  4. HADOOP_USER_NAME=hdfs hdfs dfs -mkdir -p /apps/solr641
  5. HADOOP_USER_NAME=hdfs hdfs dfs -chown solr /apps/solr641
  6. ./bin/solr zk mkroot /solr641 -z zk1
  7. ./bin/solr start -c -z zk1/solr641 -a "-Dsolr.directoryFactory=HdfsDirectoryFactory -Dsolr.lock.type=hdfs -Dsolr.hdfs.home=$(hdfs getconf -confKey fs.defaultFS)/apps/solr641 -Dsolr.hdfs.confdir=/etc/hadoop/conf"
  8. ./bin/solr create -c solr641
  9. ./bin/solr delete -c solr641 || true
  10. ./bin/solr stop -all
  11. ./bin/solr zk rm -r /solr641 -z zk1
  12. HADOOP_USER_NAME=hdfs hdfs dfs -rm -r -f /apps/solr641
  13. cd /opt/solr
  14. rm -rf /opt/solr/solr-6.4.1/

Solr 6.5.0-254 - Works

  1. wget -nc -O solr-6.5.0-254.tgz https://builds.apache.org/job/Solr-Artifacts-6.x/lastStableBuild/artifact/solr/package/solr-6.5.0-254.tgz
  2. tar zxvf solr-6.5.0-254.tgz
  3. cd /opt/solr/solr-6.5.0-254/
  4. HADOOP_USER_NAME=hdfs hdfs dfs -mkdir -p /apps/solr650
  5. HADOOP_USER_NAME=hdfs hdfs dfs -chown solr /apps/solr650
  6. ./bin/solr zk mkroot /solr650 -z zk1
  7. ./bin/solr start -c -z zk1/solr650 -a "-Dsolr.directoryFactory=HdfsDirectoryFactory -Dsolr.lock.type=hdfs -Dsolr.hdfs.home=$(hdfs getconf -confKey fs.defaultFS)/apps/solr650 -Dsolr.hdfs.confdir=/etc/hadoop/conf"
  8. ./bin/solr create -c solr650
  9. ./bin/solr delete -c solr650 || true
  10. ./bin/solr stop -all
  11. ./bin/solr zk rm -r /solr650 -z zk1
  12. HADOOP_USER_NAME=hdfs hdfs dfs -rm -r -f /apps/solr650
  13. cd /opt/solr
  14. rm -rf /opt/solr/solr-6.5.0-254/