elasticsearch


elasticsearch: Proper config in 3 node cluster for each node to have full copy of index?


3 node cluster of ElasticSearch 1.7.2 on CentOS
In a traditional cluster perspective, for a 3 node environment, the approach is to allow the failure of any one node, and the cluster will still be operational.
The default elasticsearch.yml reflects this, and all is well.
In our environment, 3 nodes, we want any one node to be able to stand alone and operate even if both other nodes are lost.
We believe the following achieves this:
index.number_of_replicas: 2 # in 3-node cluster, every node will have p or r copy of every shard
discovery.zen.minimum_master_nodes: 2 # reqd for 3 node env, but what happens when only 1 node survives?
Any additions or changes to the above appro?
We also have the three node cluster with all node being capable of becoming master. I guess apart from minimum master nodes, rest config remains the same as default. Just as a word of precaution, when the cluster has only one node working, then there are no replicas available on that node. Try not to have that situation in production when you are indexing data otherwise it takes good time to propogate all changes and reallocation of shards once other nodes are up if the data set is huge. Cheers.
The answer is:
index.number_of_replicas: 2
On a 3 node system, this means every node will have a replica of every shard, so any 1 node can stand alone/has all the data.
Distributed database are meant to be resistant to failures, but each node is not meant to be stand alone. It would be possible to setup ES such that each node has 100% of the data from each of the indexes but that would mean extra replicas and less shards. Both of those are going to lead to reduced performance from the cluster.
If you are really worried that 2 of your nodes will go down at the same time I suggest adding a 4th data node instead of setting it up so that the 3rd node is stand alone.

Related Links

elasticsearch - aggregating counts on array matches
ElasticSearch has_child query does not support query_string
elastic search autocomplete, searching with space creating an issue
(ELK) logstash grok for SBR accounting log
aws cloudsearch/lucene query street names
Getting cardinality of multiple fields?
Aggregating a Key/Value list in ElasticSearch
“reverse cardinality” in elasticsearch?
ElasticSearch- Using Fields doesn't return any documents on Nest
Analyzer to find , e.g: “starbucks” when mistakenly querying “star bucks”
Elasticsearch - boost document based on field's specific value
How to get elasticsearch most used words?
Umlaut in Elastic Suggesters
Index creation move elastic search cluster to red
Is there multiword synonyms with slop in ES
Elasticsearch: How do you delete a mapping type without deleting an entire index?

Categories

HOME
android-espresso
magento2
android-studio
xcode
blast
clearcase
facebook-messenger
dotnetnuke
d3.js
softlayer
scroll
swi-prolog
windows-10
iverilog
header
mosquitto
navigation
share
haxe
tweepy
selection
msmq
swarm
mpu6050
complexity-theory
c#-7.0
gravity
salt-cloud
gollum-wiki
pymongo
websphere-portal
cell
running-object-table
intune
tightvnc
vcenter
delayed-job
private-key
ms-media-foundation
keyboard-layout
macports
cartopy
eclipse-gmf
microsoft-ui-automation
xll
pyttsx
dagger
minikube
transparency
asihttprequest
absolute
sonarqube5.2
android-5.0-lollipop
nonlinear-functions
solr-query-syntax
android-webservice
mobile-angular-ui
wikimapia
alertify
gmaps.js
.when
allegro
rational-performance-test
zynq
always-on-top
callouts
raw-sockets
wolfram-language
odp.net-managed
i2b2
okta-api
onepage-checkout
cortana
ui4j
python-cffi
fanotify
blank-line
fantom
kefir.js
scala-swing
maven-shade-plugin
mojo
configurable-product
cout
inequality
visual-studio-6
back
osascript
csslint
redpitaya
neo4jphp
xmi
gpu-programming
usb-flash-drive
iosched
illuminate-container
rautomation
iirf
insertonsubmit
stty
eager-loading
multiple-dispatch
live-wallpaper
prototypal-inheritance
netstream
microblogging
database-deadlocks
fork-join
aptitude
explicit
resharper-5.1
eventaggregator
account-management

Resources

Encrypt Message



code
soft
python
ios
c
html
jquery
cloud
mobile