History: Elasticsearch
Source of version: 76
Copy to clipboard
! Elasticsearch
See also ((OpenSearch)) and ((Manticore Search))
"[http://en.wikipedia.org/wiki/Elasticsearch|Elasticsearch] is a distributed, RESTful, free/open source search server based on Apache Lucene." Elasticsearch brings faster search, better search and some ((Natural Language Processing)) features.
It is interoperable with Tiki, starting in ((Tiki12)).
!!# Features enabled by Elasticsearch
* ((Faceted search)), which also be used through ((PluginCustomSearch))
** ((Date-based aggregations))
* ((Stored Search))
* ((Natural Language Processing))
* ((Module More Like This))
* ((Federated Search))
!!# How to configure
{img fileId="819" desc="Configurable from tiki-admin.php?page=search"}
!!# One server vs a cluster
Elasticsearch can be installed as a cluster of servers but can also run on the same server as Tiki. If you have a very high volume of content and have performance issues, you can install on a separate server, set up a cluster or get it as SaaS. You should not install Elasticsearch on a server that has a small amount of RAM (ex.: 1 gig)
!!# Support matrix
.x means the latest release of that branch
|| Tiki | Elasticsearch
21.9+, 24.4+. 25.2+ | 2.x, 5.x, 6.x, 7.x and 8.x
21.x, 22.x, 23.x, 24.x and 25.x | 2.x, 5.x, 6.x and 7.x
19.x and 20.x | 2.x, 5.x and 6.x
18.x | 2.x and 5.x (Sites with a lot of data require [http://sourceforge.net/p/tikiwiki/code/65929|a fix from 2018-04-05] which requires 18.2 and Elasticsearch 5.x)
15.x | 1.x and 2.x
12.x | 1.x and 2.x
||
!! Upgrading to Elasticsearch 8
* When upgrading from pre 7.17 version: You may need to hard-deleted the whole elasticsearch folder and rebuild index.
* 8.x comes with security module enabled by default which asks for Basic auth every REST API request, so our Tiki connection doesn't work. To keep it backwards compatible, just turn off security: {CODE()}xpack.security.enabled: false{CODE} in elasticsearch.yml config file.
!! Upgrading to Elasticsearch 5
Since Elasticsearch automatically updates 2.x index to 5.x first time it starts - you can see some errors then. First time it rebuilds index might also show errors due to the automatic upgrade problems. However, once it builds the index on 5.x, then further rebuilds must not have errors. So, 2 index rebuilds after upgrade is the safest path to go.
!!# Factoids
{HTML()}<script type='text/javascript' src='https://www.openhub.net/p/elasticsearch/widgets/project_factoids_stats?format=js'></script>{HTML}
!!-# Video
{youtube movie="https://www.youtube.com/watch?v=lpZ6ZajygDY"}
!!# Installation
* https://www.elastic.co/guide/en/elasticsearch/reference/current/setup.html
* http://wikisuite.org/How-to-install-Elasticsearch-on-ClearOS
!!# Peculiarities
See: ((PluginList filter control block|#Peculiarities_for_Elasticsearch))
!!# GUI
* http://www.adminer.org/ supports Elasticsearch
* [https://www.elastic.co/products/kibana|Kibana]
* [http://help.plot.ly/database-connectors/elasticsearch/|Plotly]
!!# Kibana
Kibana: [https://www.elastic.co/products/kibana]. Some installation notes:
I mostly followed [https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-1-7-logstash-1-5-and-kibana-4-1-elk-stack-on-centos-7|these instructions] but haven't got Logstash working yet, and I already had Apache installed so didn't use Nginx, but added this extra apache config file: -+/usr/local/apache/conf/includes/pre_virtualhost_global.conf+-
{CODE(colors="nginx")}
ProxyRequests On
ProxyPass /app/kibana http://127.0.0.1:5601/app/kibana
ProxyPassReverse /app/kibana http://127.0.0.1:5601/app/kibana
ProxyPass /bundles http://127.0.0.1:5601/bundles
ProxyPassReverse /bundles http://127.0.0.1:5601/bundles
ProxyPass /elasticsearch http://127.0.0.1:9200/
ProxyPassReverse /elasticsearch http://127.0.0.1:9200/
# One of these blocks is probably redundant, and you need to make the htpasswd.users file yourself
<Directory /opt/kibana>
Order deny,allow
Allow from all
AuthType Basic
AuthName "Restricted Area"
AuthUserFile /opt/kibana/config/htpasswd.users
Require valid-user
</Directory>
<Proxy *>
Order deny,allow
Allow from all
AuthType Basic
AuthName "Restricted Area"
AuthUserFile /opt/kibana/config/htpasswd.users
Require valid-user
</Proxy>
{CODE}
^Note: You need to get the right version of Kibana to match your version of Elastic, I am currently on Elastic 2.4 with Kibana 4.6 ^
A newer simpler way is to use: http://wikisuite.org/How-to-install-Kibana-on-ClearOS
!!# SaaS options
* https://duckduckgo.com/?q=hosted+elasticsearch
{TABS(tabs="Elasticsearch Service|Amazon AWS|Bonsai|Scalefastr|QBox|Searchly|Logz|ObjectRocket" toggle="n")}
__''The official Elasticsearch Service from the creators: [https://www.elastic.co/products/elasticsearch/service|site link]''__
__===Version===:__
*v.5x, v.6x ''(see not below)''
__===Cost===:__
*roughly $30/GB RAM
*1GB RAM / 24GB disk space = $50/month.
*~~black,#FF9:4GB RAM / 96GB disk space = $121/month.~~
*64GB RAM / 1.5TB disk space = $1766/month
*256GB RAM / 6TB disk space = $6191/month.
__===Kibana===?__
*yes (ELK stack)
__===Other Notes===:__
*''"We make the two latest minor versions of the latest major version available for provisioning. In addition, the latest minor version of the previous major version is also available."''
/////
__''Amazon AWS [https://aws.amazon.com/elasticsearch-service/|site link]''__
__===Version===:__
*v.1x - v.6x
__===Cost===:__
*roughly $13/GB RAM
**‘General Purpose’
**disc. space = $0.135/GB disk space
*1GB RAM / 20GB disk space =$16/month
*~~black,#FF9:4GB RAM / 100GB disk space = $67/month~~
*64GB RAM / 1TB disk space =$1004/month
__===Kibana===?__
*yes (ELK stack)
__===Other Notes===:__
/////
__''Bonsai [https://bonsai.io/|site link]''__
__===Version===:__
*non-dedicated: 5x, 6x,
*dedicated: region dependent, from v.1x- v.6x
__===Cost===:__
SHARED (3 datacenters):
*roughly: $50/GB (RAM.)
*Free: 125MB RAM / 125MB disk space
*500MB RAM / 2GB disk space = $20/month.
*1.25GB RAM / 5GB disk space = $50/month.
*~~black,#FF9:3GB RAM / 30GB disk space = $150/month.~~
*12GB RAM / 120GB disk space = $600/month.
DEDICATED:
*$60/GB (RAM.)
*~~black,#FF9:10Gb / 80GB disk space = $600/month.~~
*20GB RAM / 200GB disk space = $1200/month.
*40GB RAM / 400GB disk space = $2400/month.
__===Kibana===?__
*yes (ELK stack)
__===Other Notes===:__
/////
__''Scalefastr [https://www.scalefastr.io/|site link]''__
__===Version===:__
*v.1x - v.5x
__===Cost===:__
(no small packages)
*roughly $8/GB (RAM)
*256GB RAM / 4TB (4node) = $2045/month.
*384GB RAM / 6TB (6node) = $2943/month.
*512GB RAM / 8TB (6node) = $4090/month.
__===Kibana===?__
*yes (ELK stack)
__===Other Notes===:__
*''“We only offer storage solutions with a minimum of four nodes. This allows for three total copies of data plus one server to handle failures. Since we deploy on bare metal, this means we're a bit monthre expensive for smaller clusters but they are also much faster than our competitors. We're also much much monthre affordable on the high end. Usually 30-50% less than our competitors for data at large scale."''
/////
__''QBox [https://qbox.io/|site link]''__
__===Version===:__
*v.1x - v.5x
__===Cost===:__
*$12 - 40/GB RAM
*1GB RAM / 20GB disk space = $40/month
*~~black,#FF9:4GB RAM / 80GB disk space = $90/month~~
*64GB RAM / 1.2TB disk space = $1342/month
*768GB RAM / 15.3TB disk space = $10,043/month.
__===Kibana===?__
*yes (ELK stack)
__===Other Notes===:__
/////
__''Searchly [http://www.searchly.com/|site link]''__
__===Version===:__
*v.1x - v.5x
__===Cost===:__
(only shared RAM, see below)
*3 ‘Indeces’ / 1GB disk space = $9/month.
*~~black,#FF9:9 ‘Indeces’ / 6GB disk space = $59/month.~~
*18 ‘Indeces’ / 30GB disk space = $199/month.
*44 ‘Indeces’ / 100GB disk space = $799/month.
__===Kibana===?__
*yes (ELK stack)
__===Other Notes===:__
*''"Indices count do not influence the search performance. Searchly is using shared architecture, therefore there are no dedicated ram."''
/////
__''Logz [https://logz.io/|site link]''__
__===Version===:__
*v.5x
__===Cost===:__
*roughly: $46 - 57 /GB disc
**''see note below about RAM''
*Free 3GB (disc, not RAM.);
*5GB disk space = $290/month.
*100GB disk space = $4620/month.
*100GB - 15TB disk space = ‘contact us’
__===Kibana===?__
*yes (ELK stack)
__===Other Notes===:__
*''"We are not priced based on RAM allocation because of multi-tenancy and a couple other factors-- instead we charge based on daily log volume ingested and retention time (e.g. 5 GB/day, 14 days retention)."''
*public [https://github.com/logzio/public-api|API's] on Github
*free trial on site
/////
__''ObjectRocket [https://www.objectrocket.com/managed-elasticsearch/|site link]''__
__===Version===:__
*v.5x - v.6x
__===Cost===:__
*roughly $30/GB RAM
*2GB RAM / 16GB (2 x 8GB nodes) = $60/month.
*~~black,#FF9:4GB RAM / 32GB (2 x 16GB nodes) = $240/month.~~
*12GB RAM / 96GB (3 x 32GB nodes) = $1,379/month.
*64GB RAM / 512GB (2 x 256GB nodes) = $5517/month
__===Kibana===?__
*yes (ELK stack)
__===Other Notes===:__
*''price changed - updated Object Rocket May 20, 2018''
{TABS}
*''as of April 2018''
!!# Related
* ((How to configure Tiki for Elasticsearch Service))
* ((Recommendation Engine))
* [https://chrome.google.com/webstore/detail/elasticsearch-query-build/cioobgbmiehdijndbmjkbjlkdeijdibp|Elasticsearch Query builder] extension for Google Chrome
* ((Logging using ELK Stack))
-=alias=-
* (alias(Elastic Search)) | (alias(Kibana))