Arkadiusz Trawiński, PhD
Product Lead of Data Scientist team in IT monitoring department of ING. PhD in Physics, BSc in Computer Science.
Sessions
06-16
10:15
40min
Log messages processing using NLP tools
Arkadiusz Trawiński, PhD
The analysis of logging messages is a big challenge because of their massive number, different origins and unspecify formats. These challenges can be partially address with NLP techniques and ultimately detect, predict or even maybe avoid incidents. What we demonstrate is complete monitoring solution. That includes clustering and uncovering warning-incident correlation with a Hawkes model. This model was previously successfully applied for earthquake predictions based on aftershocks. The Hawkes process model is well-defined mathematically and can process a large volume of data.
Salisbury