elasticsearch


Scalabe Log management with visualization and anomaly detection


Currently, I am in the tools/stack deciding phase for a project.
Objectives:
- Log aggregation from over 200 servers with around 200 million transactions per day. So, the stack must be highly scalable.
- Data visualization/Dashboard like number of users hitting a particular page etc.
- Anomaly detection to predict server failures in advance.
- Preferably open source stack
As there are a lot of tools and stacks available in the market for log management, can somebody guide me in the right direction for my use-case and requirements.
I am thinking of opting ELK stack but not sure about its scalability to more than 200 servers and also I am doubtful about the anomaly detection on top of ELK stack. Any better open source option than ELK stack?
Thanks in advance.

Related Links

Issue while querying on a field that store a file path on ElasticSearch
elasticsearch/logstash and logstash-contrib: Couldn't find any plugin named 'x'
What is the difference between Lucene and Elasticsearch
Cannot create Phoenix JDBC river in Elasticsearch
Disabling field analyzing by default in elastic search
time difference in elasticsearch took and that calculated manually
elasticsearch comparison between fields
Find all ID where ID are not in my blacklist
How to order results by custom value and then by _score
Kibana homepage shows blank after deleting all indices
elasticsearch: update in a nested object (HTTP)
Using Phoenix to help to integrate elastic-search and Hbase. When use sqlline.py,to create table, bad happens
Shards and replicas elastic search
Elasticsearch Completion Suggester - Sort suggestions
Can _score from different queries be compared?
Difference between a “plain” terms query and a terms query using a filter

Categories

HOME
nam
flask
weblogic12c
eclipse-plugin
jms
visual-studio-2010
autocomplete
ipv6
joomla3.2
u-boot
angular2-template
responsive-design
anchor
jpa-criteria
selection
yahoo
siesta
solution
yeoman-generator-angular
match
sap-fiori
graphdb
csrf
powermock
texas-instruments
twisted
rpmbuild
social-tables
activeadmin
eclipse-emf
high-availability
echosign
social-networking
google-play-developer-api
matlab-app-designer
autodesk-model-derivative
custom-keyboard
bootstrap-sass
landscape
variable-variables
microkernel
transparency
oracle-bmcs
code-push
axis
liteide
adblock
scala-breeze
non-linear-regression
hibernate-ogm
visual-format-language
extjs4.1
gtk#
polymaps
degrees
nrf51
wildfly-9
deviare
openquery
bilinear-interpolation
apache-pig-grunt
highlighting
urbit
mathnet
wif4.5
certificate-authority
voronoi
ioexception
smart-tv
ibm-was
extend
karma-coverage
textscan
global-scope
iplimage
senchatouch-2.4
webaii
map
typesafe-stack
strdup
autonumber
visual-c++-2005
colon
xsd2code
iirf
gamesalad
zend-server-ce
tablet-pc
ognl
fxruby
tacit-programming
rakudo
regioninfo

Resources

Encrypt Message