elasticsearch


Bulk Search operation takes a lot of time when Field data loading is set to Eager, in Elastic Search v2.4.4


I have around 20 million documents in my ES index with 3 shards and a single node.
I have 15 fields out of which I want to perform search on only 5 fields.
So, I have kept those 5 fields as 'index: not_analyzed' and field data settings are kept as 'loading:eager'.
I don't want to perform any kind of sorting or aggregation or scoring on the results.
The rest of the 10 fields are kept as 'enabled:false' since I just want to retrieve those fields in my output.
When I start the bulk search operation on all the 5 fields, it takes a lot of time to search.
In some cases, we have noticed that the speed of search increases after some time (approx half an hour).
Can you help me why it takes so much time to search?
Is it better to use field data or doc_values (as specified in the ES doc - https://www.elastic.co/blog/support-in-the-wild-my-biggest-elasticsearch-problem-at-scale)
And there is also an option where we can keep the 'doc_values: true' along with 'field data loading: eager' and 'field data format: disabled' at the same time? Since field data loads all the data in memory and doc_values store the data in disk, how does this combination work?
Thanks in advance.

Related Links

ElasticSearch Couchbase Replication Issue
How to query for inner_hits against grandparents in multi-generational setup
Request timedout during delete/create on elasticsearch while snapshot is being taken
how to use two parallel Aggregation for elasticsearch nest
How do I enable remote access/request in Elasticsearch 2.0?
elasticsearch faking index per user - how are routing values inferred when updating?
elasticsearch: Proper config in 3 node cluster for each node to have full copy of index?
Multiple Nested Aggregations in Elasticsearch
Reconnection in Elasticsearch Cluster
Elasticsearch - Has_Parent or Has_Child query returning empty results
Elasticsearch search body from URL search
Fields not getting sorted in alphabetical order in elasticsearch
Sorting strings in elastic search
Missing data when using unique count and creating an aggregation in Kibana
elasticsearch filter array data with aggs
Sorting based on different properties with elasticsearch

Categories

HOME
oracle
macos-sierra
freeradius
ontouchlistener
long-integer
postgresql-9.4
activemq
openlayers-3
nsis
elk-stack
capistrano
gprs
tweepy
static-analysis
roku
yeoman-generator-angular
migrate
mailmerge
google-tasks-api
rest-assured
android-contacts
google-sites
deepfreeze
social-tables
coreldraw
mime-types
cell
pdf.js
high-availability
python-appium
background-color
echosign
sales
amazon-iam
epplus
landscape
netstat
stackpanel
macports
aurelia-http-client
sbjson
yoast
expandablelistview
reverse-dns
spongycastle
xcglogger
nusoap
palindrome
mobile-angular-ui
glimpse
dymola
sidewaffle
hmmlearn
http4s
openerp-6
ipywidgets
groovyfx
eclemma
ajaxmin
swiffy
mercurial-extension
python-cffi
stack-smash
google-maps-api-2
ibm-was
opencyc
ora-04091
extend
algebraixlib
mathematical-expressions
microsoft-expression-web
neo4jphp
flipboard
sensormanager
mute
coalesce
tnt4j
statechart
dibs
itunes-sdk
jdom
litespeed
kext
jdownloader
multiple-users
isapi-redirect

Resources

Encrypt Message