{"id":1162,"date":"2024-09-18T11:51:54","date_gmt":"2024-09-18T09:51:54","guid":{"rendered":"https:\/\/sii.ua\/blog\/?p=1162"},"modified":"2024-09-18T11:51:56","modified_gmt":"2024-09-18T09:51:56","slug":"when-the-going-gets-tough-the-tough-get-going-with-vision-ai","status":"publish","type":"post","link":"https:\/\/sii.ua\/blog\/en\/when-the-going-gets-tough-the-tough-get-going-with-vision-ai\/","title":{"rendered":"When the going gets tough, the tough get going with Vision AI"},"content":{"rendered":"\n

‘<\/em>Is it possible for test automation tools to learn the UI of an application in the same way a real-life user learns it<\/em>?’ <\/em>\u2013 that was the question the Tricentis Team asked themselves when they started working on Vision AI.<\/p>\n\n\n\n

Vision AI can be defined as an “intelligent” user interface (UI) test automation engine that allows automation of test scripts without the use of code. Among the application of its functionalities, one may point to situations in which defining selectors for automation purposes is impossible due to the early phase of development (when only mock-ups are available) or verification of complex structures and graphic elements on the website (e.g., maps, diagrams) is required. This tool will also provide an opportunity to involve non-technical users with crucial domain and test process knowledge.<\/p>\n\n\n\n

During Vision AI development, Tricentis used machine learning as a data analysis method, thanks to which the tool’s engine, like the end user, can interpret various screens and objects available in the application. Moreover, in the event of changes to the application resulting in a test failure, the “Vision AI Self-Healing” module will allow Vision AI to “self-repair” the script based on its learned “intelligence.”<\/p>\n\n\n\n

Vision AI\u2019s engine is integrated with Tricentis Tosca tool. If you are interested in Tosca, check out the blog post (PL) on SII\u2019s page: Czy Tosca i podobne rozwi\u0105zania codeless s\u0105 przysz\u0142o\u015bci\u0105 testowania?<\/a><\/p>\n\n\n\n

In this article, we will discuss in more detail the use cases of Vision AI in IT projects mentioned at the beginning, focusing on the aspects that distinguish this tool from “classic” test automation frameworks.<\/p>\n\n\n\n

Configuration<\/strong><\/h2>\n\n\n\n

We must start with the configuration to prepare our environment for work with Vision AI. Preparations may be divided into a few stages:<\/p>\n\n\n\n