2023: Code Quality Assurance Using E2E Tests

Master's theses

Florian Gareis



Artemis is an open-source interactive learning platform that uses different exercise types to support blended learning. Ensuring its continuous operation requires comprehensive testing of its functionality. While a CI system already tests every contribution to the software by unit, integration, and system tests/End-to-end (E2E), the system tests, in particular, lack coverage of multiple components, including test exams, communication features, and certain exam features.

By extending E2E test coverage, this work ensures a thorough validation of Artemis’s various components, providing a continuous evaluation of the current state of the platform. Concurrently, reducing test flakiness within the E2E tests is crucial in ensuring consistent test outcomes and system stability, making the test results a more reliable robustness indicator.

Furthermore, this thesis introduces Sorry-Cypress, an open-source dashboard tool, into the development workflow. This tool supports debugging of failing E2E tests by assisting developers in identifying, analyzing, and rectifying failing tests efficiently, thereby streamlining the development process.

Head of Research Group

Prof. Dr. Stephan Krusche

Administrative office

Sophia Adelmeier

Office: 01.07.052
Phone: +49 (89) 289-18206
Fax: +49 (89) 289-18207 Boltzmannstraße 3
85748 Garching b. München