A Tool to Automate Student UML diagram Evaluation
Unified modelling language (UML) is the accepted standard and modelling language for modeling in software development process. UML is widely used by most course tutors in teaching modules of software engineering and system analysis and design. Students taking such courses do submit assignments with UML diagrams such as use case, class, sequence, activity and so on. Different versions of such diagrams produced by the students for a given problem have to be assessed by the course tutor which is a challenging and time-consuming task. This paper presents a java-based tool which is developed based on a simple yet effective algorithm developed by the authors that will read student and tutors solution diagrams as inputs and evaluate and grade the diagrams automatically. The output of the tool is the score of the student diagram in respect of lecturer’s final solution. The output is presented in two feedback files, one containing students’ score for the lecturers and the other to be send to the student to note the areas that were incorrect. The tool has been tested and evaluated using a simple and assumed UML class diagram. The result shows that the tool functions effectively and can produce detail feedbacks for both students and tutors. The outcome of this paper contributes towards automating UML diagram evaluations.
P. Kumarapeli, S. De Lusignan, T. Ellis, and B. Jones, “Using Unified Modelling Language (UML) as a process-modelling technique for clinical-research process improvement,” Informatics for Health and Social Care, vol. 32, no. 1, pp. 51–64, 2007.
P. Mayer, A. Schroeder, and N. Koch, “MDD4SOA: Model-driven service orchestration,” in Enterprise Distributed Object Computing Conference, 2008. EDOC’08. 12th International IEEE, 2008, pp. 203–212.
G. T. Jun, J. Ward, Z. Morris, and J. Clarkson, “Health care process modelling: which method when?,” International Journal for Quality in Health Care, p. mzp016, 2009.
S. Garde, B. Baumgarten, O. Basu, N. Graf, R. Haux, R. Herold, U. Kutscha, F. Schilling, B. Selle, C. Spiess, and others, “A meta-model of chemotherapy planning in the multi-hospital/multi-trial-center-environment of pediatric oncology,” Methods Inf Med, vol. 43, no. 2, pp. 171–183, 2004.
A. M. Fernández-Sáez, M. R. Chaudron, and M. Genero, “An industrial case study on the use of UML in software maintenance and its perceived benefits and hurdles,” Empirical Software Engineering, vol. 23, no. 6, pp. 3281–3345, 2018.
A. Lopes, I. Steinmacher, and T. Conte, “UML Acceptance: Analyzing the Students’ Perception of UML Diagrams,” in Proceedings of the XXXIII Brazilian Symposium on Software Engineering, 2019, pp. 264–272.
F. J. Lucas, F. Molina, and A. Toval, “A systematic review of UML model consistency management,” Information and Software Technology, vol. 51, no. 12, pp. 1631–1645, 2009.
K. Farias and B. C. da Silva, “What’s the grade of your diagram? towards a streamlined approach for grading UML diagrams,” in Proceedings of the 23rd ACM/IEEE International Conference on Model Driven Engineering Languages and Systems: Companion Proceedings, 2020, pp. 1–2.
D. R. Stikkolorum, P. van der Putten, C. Sperandio, and M. Chaudron, “Towards Automated Grading of UML Class Diagrams with Machine Learning.,” in BNAIC/BENELEARN, 2019.
A. Adamu and W. M. N. W. Zainon, “Similarity Assessment of UML Sequence Diagrams Using Dynamic Programming,” in International Visual Informatics Conference, 2017, pp. 270–278.
M. A.-R. Al-Khiaty and M. Ahmed, “UML class diagrams: Similarity aspects and matching,” Lecture Notes on Software Engineering, vol. 4, no. 1, p. 41, 2016.
R. Fauzan, D. Siahaan, S. Rochimah, and E. Triandini, “Class Diagram Similarity Measurement: A Different Approach,” in 2018 3rd International Conference on Information Technology, Information System and Electrical Engineering (ICITISEE), 2018, pp. 215–219.
C. K. Poon, T.-L. Wong, C. M. Tang, J. K. L. Li, Y. T. Yu, and V. C. S. Lee, “Automatic assessment via intelligent analysis of students’ program output patterns,” in International Conference on Blended Learning, 2018, pp. 238–250.
M. A.-R. Al-Khiaty and M. Ahmed, “Matching UML class diagrams using a Hybridized Greedy-Genetic algorithm,” in 2017 12th International Scientific and Technical Conference on Computer Sciences and Information Technologies (CSIT), 2017, vol. 1, pp. 161–166.
D. Siahaan, Y. Desnelita, and others, “Structural and semantic similarity measurement of UML sequence diagrams,” in 2017 11th International Conference on Information & Communication Technology and System (ICTS), 2017, pp. 227–234.
W. Bian, O. Alam, and J. Kienzle, “Automated grading of class diagrams,” in 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C), 2019, pp. 700–709.
P. Herout and P. Brada, “UML-Test Application for Automated Validation of Students’ UML Class Diagram,” in 2016 IEEE 29th International Conference on Software Engineering Education and Training (CSEET), 2016, pp. 222–226.
T. Reischmann and H. Kuchen, “Towards an E-assessment tool for advanced software engineering skills,” in Proceedings of the 16th Koli Calling International Conference on Computing Education Research, 2016, pp. 81–90.
V. Vachharajani and J. Pareek, “Framework to approximate label matching for automatic assessment of use-case diagram,” International Journal of Distance Education Technologies (IJDET), vol. 17, no. 3, pp. 75–95, 2019.
V. Vachharajani and J. Pareek, “A proposed architecture for automated assessment of use case diagrams,” International Journal of Computer Applications, vol. 108, no. 4, 2014.
E. Triandini, R. Fauzan, D. O. Siahaan, and S. Rochimah, “Sequence diagram similarity measurement: a different approach,” in 2019 16th International Joint Conference on Computer Science and Software Engineering (JCSSE), 2019, pp. 348–351.
J. Liebenberg and V. Pieterse, “Investigating the feasibility of automatic assessment of programming tasks,” 2018.
A. Bey, P. Jermann, and P. Dillenbourg, “A comparison between two automatic assessment approaches for programming: An empirical study on MOOCs,” Journal of Educational Technology & Society, vol. 21, no. 2, pp. 259–272, 2018.
T. Rani and S. Garg, “Comparison of different UML tool: Tool approach,” International Journal Of Engineering And Computer Science, vol. 2, no. 6, pp. 1900–1908, 2013.
P. Thomas, “Online Automatic Marking of Diagram,” Springer, vol. 26, no. 349–359, 2012.
S. Chren, B. Buhnova, M. Macak, L. Daubner, and B. Rossi, “Mistakes in UML diagrams: analysis of student projects in a software engineering course,” in 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET), 2019, pp. 100–109.
M. Striewe and M. Goedicke, “Automated checks on UML diagrams,” in Proceedings of the 16th annual joint conference on Innovation and technology in computer science education, 2011, pp. 38–42.
How to Cite
Copyright (c) 2021 Salisu Modi , Hanan Abdulrahman Taher, Hoger Mahmud
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors retain copyright
The use of a Creative Commons License enables authors/editors to retain copyright to their work. Publications can be reused and redistributed as long as the original author is correctly attributed.
- The researcher(s), whether a single or joint research paper, must sell and transfer to the publisher (the Academic Journal of Nawroz University) through all the duration of the publication which starts from the date of entering this Agreement into force, the exclusive rights of the research paper/article. These rights include the translation, reuse of papers/articles, transmit or distribute, or use the material or parts(s) contained therein to be published in scientific, academic, technical, professional journals or any other periodicals including any other works derived from them, all over the world, in English and Arabic, whether in print or in electronic edition of such journals and periodicals in all types of media or formats now or that may exist in the future. Rights also include giving license (or granting permission) to a third party to use the materials and any other works derived from them and publish them in such journals and periodicals all over the world. Transfer right under this Agreement includes the right to modify such materials to be used with computer systems and software, or to reproduce or publish it in e-formats and also to incorporate them into retrieval systems.
- Reproduction, reference, transmission, distribution or any other use of the content, or any parts of the subjects included in that content in any manner permitted by this Agreement, must be accompanied by mentioning the source which is (the Academic Journal of Nawroz University) and the publisher in addition to the title of the article, the name of the author (or co-authors), journal’s name, volume or issue, publisher's copyright, and publication year.
- The Academic Journal of Nawroz University reserves all rights to publish research papers/articles issued under a “Creative Commons License (CC BY-NC-ND 4.0) which permits unrestricted use, distribution, and reproduction of the paper/article by any means, provided that the original work is correctly cited.
- Reservation of Rights
The researcher(s) preserves all intellectual property rights (except for the one transferred to the publisher under this Agreement).
- Researcher’s guarantee
The researcher(s) hereby guarantees that the content of the paper/article is original. It has been submitted only to the Academic Journal of Nawroz University and has not been previously published by any other party.
In the event that the paper/article is written jointly with other researchers, the researcher guarantees that he/she has informed the other co-authors about the terms of this agreement, as well as obtaining their signature or written permission to sign on their behalf.
The author further guarantees:
- The research paper/article does not contain any defamatory statements or illegal comments.
- The research paper/article does not violate other's rights (including but not limited to copyright, patent, and trademark rights).
This research paper/article does not contain any facts or instructions that could cause damages or harm to others, and publishing it does not lead to disclosure of any confidential information.