Projects / AI Innovation Challenge

Data Center Anomaly Detection using Machine Learning

Challenge Completed!


Omdena Featured image

A team of 50 AI Engineers applied machine learning for anomaly detection that lead to data center outages using the Root Cause Analysis (RCA) process.

By partnering with Omdena, Israel-based startup Sensai aims to create a robust automation process that automates the analysis of data center metrics for rapid AD and RCA, smoothly integrates into their current data management system, and contributes to their end goal of creating self-healing capabilities for data centers.

The problem

In data Centers, once an anomaly is detected, Site Reliability Engineers (SREs) need to identify and understand the root cause of that anomaly asap by analyzing the sequence of events that led to the anomaly. In most cases, identifying the root cause is done manually and takes significant time and effort.

Sensai’s target is to reduce the human effort required for root cause analysis by automating the whole process of identification and RCA, using state-of-the-art machine learning and causal inference mechanisms.

Causal inference is gaining colossal momentum these days and is becoming the next big thing. A few days ago, the Nobel prize in economics was given to causal inference researchers “for their methodological contributions to the analysis of causal relationships.”

The project outcomes

The team built various ML models and applied data science techniques to find unsupervised solutions to identify and analyze the “most likely” events leading to anomalies. The algorithms detect in multivariate time series metrics data collected from different machines and applications in hybrid data centers in real-time.

  1. Using Machine Learning algorithms to (I) detect anomalies and (II) analyze and identify the root cause – the ‘most likely’ event leading to the detected anomaly.
  2. The dataset is a multivariate time series data collected from different machines and applications in hybrid data centers.
First Omdena Project?

Join the Omdena community to make a real-world impact and develop your career

Build a global network and get mentoring support

Earn money through paid gigs and access many more opportunities



Your benefits

Address a significant real-world problem with your skills

Get hired at top companies by building your Omdena project portfolio (via certificates, references, etc.)

Access paid projects, speaking gigs, and writing opportunities



Requirements

Good English

A very good grasp in computer science and/or mathematics

Student, (aspiring) data scientist, (senior) ML engineer, data engineer, or domain expert (no need for AI expertise)

Programming experience with Python

Understanding of Machine Learning, Deep Learning and GANs.



This challenge has been hosted with our friends at


Application Form
media card
Building Real-Time Anomaly Detection for Traveling Agency Transactions
media card
Building AI-powered Early Warning System for Extreme Weather Conditions in Tanzania
media card
Optimizing the Accuracy & Explainability of Medical Insurance Claim (Fraud, Waste and Abuse) FWA Detection by Leveraging AI & Anomaly Detection

Become an Omdena Collaborator

media card
Visit the Omdena Collaborator Dashboard Learn More