Comprehensive Framework for Evaluating Intrusion Detection Systems in Power Grids and Beyond
As part of my master thesis, I developed an evaluation framework for industrial intrusion detection systems (IIDS) in cooperation with Fraunhofer FKIE. This framework allows a fully automated evaluation of a given IIDS within a complex power grid simulation by combining the execution of sophisticated attacks based on the IEC 60870-5-104 power grid protocols with a thorough data collection.
By combining the collected information about attacks, network traffic, grid states, and alerts generated by the IIDS, the framework calculates evaluation metrics and visualizes the results in a variety of ways. More information about the inner workings of this framework can be found in my master thesis. The framework was implemented in Python and automated using Bash.