Rigorous Testing and Evaluation of a Text-to-PASS Model Generator
A previous thesis at the chair for Software Engineering developed a prototype of a Text-To-Process Model Generator for the subject-oriented process modeling language PASS. The main focus of that work was to create an Architecture and a running prototype overall.
This goal has been achieved and the software is available at: https://github.com/I2PM/Text-to-PASS-Model-Generator
The goal of this Thesis is to evaluate the software by applying increasingly complex processual descriptions to answer the following questions and goals:
- What are the limits of the Software (size of possible Input/complexity of a described process, imprecise textual descriptions, different languages, etc.)?
- If Limits are found, are there ways to overcome those (Better Prompts? using different LLMs? Better User Instructions for Users?)
- What is the usage process, and can it be improved? Interactions?