Scalabe Log management with visualization and anomaly detection
Currently, I am in the tools/stack deciding phase for a project. Objectives: - Log aggregation from over 200 servers with around 200 million transactions per day. So, the stack must be highly scalable. - Data visualization/Dashboard like number of users hitting a particular page etc. - Anomaly detection to predict server failures in advance. - Preferably open source stack As there are a lot of tools and stacks available in the market for log management, can somebody guide me in the right direction for my use-case and requirements. I am thinking of opting ELK stack but not sure about its scalability to more than 200 servers and also I am doubtful about the anomaly detection on top of ELK stack. Any better open source option than ELK stack? Thanks in advance.
Issue while querying on a field that store a file path on ElasticSearch
elasticsearch/logstash and logstash-contrib: Couldn't find any plugin named 'x'
What is the difference between Lucene and Elasticsearch
Cannot create Phoenix JDBC river in Elasticsearch
Disabling field analyzing by default in elastic search
time difference in elasticsearch took and that calculated manually
elasticsearch comparison between fields
Find all ID where ID are not in my blacklist
How to order results by custom value and then by _score
Kibana homepage shows blank after deleting all indices
elasticsearch: update in a nested object (HTTP)
Using Phoenix to help to integrate elastic-search and Hbase. When use sqlline.py,to create table, bad happens
Shards and replicas elastic search
Elasticsearch Completion Suggester - Sort suggestions
Can _score from different queries be compared?
Difference between a “plain” terms query and a terms query using a filter