Bulk Search operation takes a lot of time when Field data loading is set to Eager, in Elastic Search v2.4.4
I have around 20 million documents in my ES index with 3 shards and a single node. I have 15 fields out of which I want to perform search on only 5 fields. So, I have kept those 5 fields as 'index: not_analyzed' and field data settings are kept as 'loading:eager'. I don't want to perform any kind of sorting or aggregation or scoring on the results. The rest of the 10 fields are kept as 'enabled:false' since I just want to retrieve those fields in my output. When I start the bulk search operation on all the 5 fields, it takes a lot of time to search. In some cases, we have noticed that the speed of search increases after some time (approx half an hour). Can you help me why it takes so much time to search? Is it better to use field data or doc_values (as specified in the ES doc - https://www.elastic.co/blog/support-in-the-wild-my-biggest-elasticsearch-problem-at-scale) And there is also an option where we can keep the 'doc_values: true' along with 'field data loading: eager' and 'field data format: disabled' at the same time? Since field data loads all the data in memory and doc_values store the data in disk, how does this combination work? Thanks in advance.
ElasticSearch Couchbase Replication Issue
How to query for inner_hits against grandparents in multi-generational setup
Request timedout during delete/create on elasticsearch while snapshot is being taken
how to use two parallel Aggregation for elasticsearch nest
How do I enable remote access/request in Elasticsearch 2.0?
elasticsearch faking index per user - how are routing values inferred when updating?
elasticsearch: Proper config in 3 node cluster for each node to have full copy of index?
Multiple Nested Aggregations in Elasticsearch
Reconnection in Elasticsearch Cluster
Elasticsearch - Has_Parent or Has_Child query returning empty results
Elasticsearch search body from URL search
Fields not getting sorted in alphabetical order in elasticsearch
Sorting strings in elastic search
Missing data when using unique count and creating an aggregation in Kibana
elasticsearch filter array data with aggs
Sorting based on different properties with elasticsearch