The development of a software solution requires automated quality control to deliver a better customer experience. Our Unified Monitoring solution is based on a best-of-breed approach using tried-and-trusted open source tools. In our vision, the development processes should deliver integrated solutions through automated systems which manage not only the building and verification of the software modules developed, but in addition the validation of their interactions.
In this post, I want to give you an overview of our testing process, mainly focused on the new tests integrated in NetEye 4 to simulate user interaction with the graphical interface.
A Short Introduction to our Continuous Integration System
Our R&D team has deployed a Continuous Integration process (based on Jenkins) which consists of the following steps:
Preparation and verification of the build process, which includes starting up a dedicated environment (i.e., a Docker container) and resolving all dependencies
Building the modules affected by the changes (e.g., bug fixes, features, etc.)
Booting up the product (e.g., NetEye) with its services and modules, and installing the new, just-built changes
Testing based on three different approaches:
Unit Tests to verify that the procedure for each submodule is compliant with expectations;
Integration Tests to test modules as a group by evaluating their interactions and communications (e.g., interactions with a database or between modules)
Graphical User Interface testing to ensure integrity from the user’s perspective
Automated deployment in test environments
Graphical User Interface Testing
In recent months, we extended our Continuous Integration system to support automated GUI tests leveraging the Selenium Suite. The R&D Team developed test cases for each NetEye 4 module, and these are launched automatically during the test phase of our Continuous Integration process.
The following video shows one simple test case which includes logging on to the web GUI, the creation and modification of a new rule in the Event Handler module of NetEye 4, and verification of all drop down menus. Note that the video is not accelerated, and the actions, such as clicking and typing, are carried out by the automated process, without any user interaction required.
These Graphical User Interface tests are not only useful for verifying the integrity of the modules and their interactions, but also for ensuring that the software still performs the same way even after making changes or adding new features. In other words, to avoid regressions which are particularity critical for end users.
Hi, my name is Michele Santuari and I am a Telecommunication engineer felt in love with OpenFlow, the first attempt of centralized network management, provisioning, and monitoring. I embraced the Software Defined Networking approach to discover a passion for programming languages. Now, I am into Agile methodologies and crazy development process management.
Author
Michele Santuari
Hi, my name is Michele Santuari and I am a Telecommunication engineer felt in love with OpenFlow, the first attempt of centralized network management, provisioning, and monitoring. I embraced the Software Defined Networking approach to discover a passion for programming languages. Now, I am into Agile methodologies and crazy development process management.
Hello everyone! As you may remember, a topic I like to discuss a lot on this blog is the Proof of Concept (POC) about how we could enhance search within our online NetEye User Guide. Well, we're happy to share Read More
In the ever-evolving landscape of IT monitoring and management, the ability to efficiently handle multi-dimensional namespaces is crucial. Within NetEye, Log-SIEM (Elastic), provides a comprehensive solution for managing the single namespace dimension with the namespace of a data_stream. This blog Read More
Hey everyone! We played around a bit last time with our radar data to build a model that we could train outside Elasticsearch, loading it through Eland and then applying it using an ingest pipeline. But since our data is Read More
Right now, at Würth Phoenix, we are investing in automating most of our operations using Ansible. You're probably already familiar with what Ansible does, but to summarize, Ansible is an open-source, command-line IT automation application written in Python. I've talked Read More
OpenShift already has a built-in monitoring suite with Prometheus, Grafana, and Alertmanager. This is all well and good, but what if organizations want to monitor their entire infrastructure, integrating all monitoring results under one umbrella? In this case, it's necessary Read More