{"id":66404,"date":"2026-04-23T15:01:07","date_gmt":"2026-04-23T15:01:07","guid":{"rendered":"https:\/\/sii.ua\/?p=66404"},"modified":"2026-04-23T15:01:10","modified_gmt":"2026-04-23T15:01:10","slug":"ai-in-software-testing-sii-publishes-a-breakthrough-testing-lab-ai-edition-report","status":"publish","type":"post","link":"https:\/\/sii.ua\/en\/news-feed\/ai-in-software-testing-sii-publishes-a-breakthrough-testing-lab-ai-edition-report\/","title":{"rendered":"AI in software testing: Sii publishes a breakthrough Testing Lab \u2013 AI Edition report"},"content":{"rendered":"\n<div class=\"wp-block-sii-nsw-container container container-7fc0668f-8640-4930-bf77-28555be77d8d\"><style type=\"text\/css\">.container-7fc0668f-8640-4930-bf77-28555be77d8d {  }\n                         @media screen and (max-width: 991px) { .container-7fc0668f-8640-4930-bf77-28555be77d8d {  } }<\/style>\n<p><strong>Artificial intelligence has firmly entered into the daily work of IT teams, becoming a natural element of the environment rather than just a temporary experiment. Although in areas such as documentation analysis or creating manual test scenarios the benefits of its use seem intuitive, the industry still lacks reliable data regarding test automation.  <\/strong><\/p>\n\n\n\n<p>Sii conducted Testing Lab \u2013 AI Edition \u2013 a controlled research experiment aimed at measuring the real increase in productivity and verifying whether faster work does not come at the expense of code quality. Read on to see the results and access the full report from the Study.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>20 experts, 8 hours, and a clash of two worlds<\/strong><\/h3>\n\n\n\n<p>The experiment was designed as a controlled comparison of two working methods. The event involved <strong>20 experts<\/strong>, divided into ten two-person teams with a similar level of experience. Participants were assigned to two groups:<\/p>\n\n\n\n<ul class=\"wp-block-list is-style-checked-gradient\">\n<li><strong>Team AI: <\/strong>Teams using coding assistants and LLM-based models.<\/li>\n\n\n\n<li><strong>Team Oldschool:<\/strong> A group working with traditional methods, without the support of artificial intelligence.<\/li>\n<\/ul>\n\n\n\n<p>Participants faced a \u201cgreenfield\u201d challenge \u2013 they had to design and implement from scratch a framework for UI and API test automation for an e-commerce system in a Java, C#, and Playwright\/Selenium stack. The content was supervised by a jury, made of Sii Poland experts: Krzysztof Bednarski, Tomasz Kuran, and Remigiusz Bednarczyk.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Why is it worth reading our report?<\/strong><\/h3>\n\n\n\n<p>You will learn the answer to the question: <strong>how much AI changes the productivity and quality of QA teams\u2019 work<\/strong>. In the report, we present:<\/p>\n\n\n\n<ul class=\"wp-block-list is-style-checked-gradient\">\n<li><strong>The scale of the difference that cannot be ignored<\/strong><br>AI teams delivered from 5 to nearly 200 tests. Teams without AI \u2013 from 5 to 8. This is not optimization, but a complete change in performance level.<\/li>\n\n\n\n<li><strong>What happens to quality<\/strong><br>We evaluated the code according to 8 engineering criteria (including: architecture, stability, test data, diagnostics). AI not only accelerates work \u2013 in many areas, it improves the quality of the solution in the organization.<\/li>\n\n\n\n<li><strong>Why experience is even more important today<\/strong><br>The best results were achieved by teams working iteratively and consciously steering the model. AI does not level the field \u2013 it amplifies the best experts, who use AI the right way.<\/li>\n\n\n\n<li><strong>Where AI fails<\/strong><br>Models can \u201cget stuck\u201d in the wrong direction \u2013 for example, with dynamic selectors. Sii Poland experts show specific cases and their consequences.<\/li>\n\n\n\n<li><strong>How to make decisions about AI implementation<\/strong><br>The report provides a basis for building a strategy based on data, not on trends.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Smart use of AI starts with knowledge \u2013 download the report<\/strong><\/h3>\n\n\n\n<p>Do not base your strategy on assumptions \u2013 check the facts and prepare your team for a new era of testing. Download the full report and find out how to implement AI wisely in your projects!<\/p>\n\n\n\n<div style=\"height:70px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n<\/div>\n\n\n\n<section class=\"wp-block-nsw-block-section nsw-section  section-1fcd63d6-451b-4c88-a723-0cfb8b299cca\" id=\"\"><style type=\"text\/css\">.section-1fcd63d6-451b-4c88-a723-0cfb8b299cca { padding-top:80px;padding-bottom:50px;background:#ffffff;background-image:url(https:\/\/sii.pl\/wp-content\/uploads\/2026\/04\/Bez-nazwy-880-x-291-px-2.png);background-size:100% auto; }\n     \t\t\t\t\t @media screen and (max-width: 991px) { .section-1fcd63d6-451b-4c88-a723-0cfb8b299cca { padding-top:30px;padding-bottom:30px;background-image:url(https:\/\/sii.pl\/wp-content\/uploads\/2024\/09\/Key_figures_mobile.jpg); } }<\/style>\n<div class=\"wp-block-sii-nsw-container container container-9b133258-deb2-4fd5-a922-79babbda604b\"><style type=\"text\/css\">.container-9b133258-deb2-4fd5-a922-79babbda604b {  }\n                         @media screen and (max-width: 991px) { .container-9b133258-deb2-4fd5-a922-79babbda604b {  } }<\/style>\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-1 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:80%\">\n<h2 class=\"wp-block-heading has-nsw-h-2-font-size\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-nswc-gradient-color\">TESTING LAB &#8211; AI EDITION<\/mark><\/h2>\n\n\n\n<p><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-nswc-natural-100-color\">.<\/mark><\/p>\n\n\n\n<h2 class=\"wp-block-heading has-nsw-p-2-font-size\">What really determines the success of testing<br>in the era of LLMs?<\/h2>\n\n\n\n<p class=\"has-nsw-p-2-font-size\"><br>We explored this during a research experiment.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p style=\"font-style:normal;font-weight:400\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-nswc-natural-100-color\">.<\/mark><\/p>\n\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button is-style-nsw-gradient-button\"><a class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/sii.pl\/wp-content\/uploads\/2026\/04\/EN_SWM-30407-CC-Testing-Hackaton-testingowy-Testing-Lab-AI-Edition-4.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">Read the full report<\/a><\/div>\n<\/div>\n\n\n\n<h2 class=\"wp-block-heading has-nsw-h-4-font-size\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-nswc-natural-100-color\">.<\/mark><\/h2>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\"><\/div>\n<\/div>\n<\/div>\n<\/section>\n\n\n\n<div class=\"wp-block-sii-nsw-container container container-7814bc0e-e9bf-4ec8-a90f-ce550d085385\"><style type=\"text\/css\">.container-7814bc0e-e9bf-4ec8-a90f-ce550d085385 {  }\n                         @media screen and (max-width: 991px) { .container-7814bc0e-e9bf-4ec8-a90f-ce550d085385 {  } }<\/style>\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>What\u2019s next? Continuation of the experiment <\/strong><\/h3>\n\n\n\n<p>The first edition showed very clearly: AI can provide a huge advantage, but the outcome is determined by how it is used. The differences between teams were so significant that not the technology itself, but the approach to working with it became the most important conclusion of the study.<\/p>\n\n\n\n<p>That is why the next edition of Testing Lab will focus on finding the most effective ways to use AI. Sii Team wants to check which methods, tools, and approaches actually accelerate work, allow for maintaining high code quality, and at the same time limit the costs resulting from the use of models.<\/p>\n\n\n\n<p>If the first edition answered the question \u201cdoes AI work\u201d, the next one will answer a much more important one: how to use AI to maximize the effect without compromising quality and costs.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":51,"featured_media":66405,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"categories":[1],"tags":[1222],"class_list":["post-66404","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","tag-artificial-intelligence"],"acf":[],"aioseo_notices":[],"featured_media_url":"https:\/\/sii.ua\/wp-content\/uploads\/2026\/04\/1920x740_cover-www-worker-TestingLab3-1.jpg","category_names":["Uncategorized"],"_links":{"self":[{"href":"https:\/\/sii.ua\/en\/wp-json\/wp\/v2\/posts\/66404"}],"collection":[{"href":"https:\/\/sii.ua\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sii.ua\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sii.ua\/en\/wp-json\/wp\/v2\/users\/51"}],"replies":[{"embeddable":true,"href":"https:\/\/sii.ua\/en\/wp-json\/wp\/v2\/comments?post=66404"}],"version-history":[{"count":1,"href":"https:\/\/sii.ua\/en\/wp-json\/wp\/v2\/posts\/66404\/revisions"}],"predecessor-version":[{"id":66407,"href":"https:\/\/sii.ua\/en\/wp-json\/wp\/v2\/posts\/66404\/revisions\/66407"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sii.ua\/en\/wp-json\/wp\/v2\/media\/66405"}],"wp:attachment":[{"href":"https:\/\/sii.ua\/en\/wp-json\/wp\/v2\/media?parent=66404"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sii.ua\/en\/wp-json\/wp\/v2\/categories?post=66404"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sii.ua\/en\/wp-json\/wp\/v2\/tags?post=66404"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}