Occurrence processing, indexing and batch processing
Scala implementation of biocache backend.
This code base manages the loading, sampling, processing and indexing of occurrence records for the ALA.
There are additional tools to support outlier detection, duplicate detection and identifying extra-limital outliers
based on authoritative distribution polygons for taxa.
Please use the Ansible scripts to set this software up in your own environment.
https://github.com/AtlasOfLivingAustralia/ala-install
We are currently running 2 development branches
This library is built with maven. By default a mvn install will try to run a test suite which will fail without a local installation of a name index.
The name index can be downloaded here and needs to be extracted to the
directory /data/lucene/namematching
or wherever the name.dir is configured to point to in your /data/biocache/config/biocache-config.properties file.
Also, to pass SDS tests the system requires sds layers. They can be downloaded here. Or, if that link does not work try here. Extract the content of this file into /data/biocache/layers.
To skip the tests during the build, run mvn install -DskipTests=true.
For a list of releases click here
For a list of built releases, see here
The 2.x version of this code base that makes use of cassandra 3.x and SOLR 6.x with SOLR cloud support.
See the cassandra3 branch for details.
There are differences when using cassandra.case.sensitive=true
solr.collection config var is mandatory
YourKit is kindly supporting open source projects with its full-featured Java Profiler. YourKit, LLC is the creator of innovative and intelligent tools for profiling Java and .NET applications.
Take a look at YourKit’s leading software products: YourKit Java Profiler and YourKit .NET Profiler.
JetBrains is also a big supporter of open source projects and has kindly provided licenses for their fantastic IDE IntelliJ to ALA. Learn more at the IntelliJ site.