{"id":634,"date":"2021-04-27T06:11:36","date_gmt":"2021-04-27T06:11:36","guid":{"rendered":"https:\/\/metrics.blogg.gu.se\/?p=634"},"modified":"2021-04-27T06:11:36","modified_gmt":"2021-04-27T06:11:36","slug":"how-much-does-a-testing-cost-and-how-to-estimate-it","status":"publish","type":"post","link":"https:\/\/metrics.blogg.gu.se\/?p=634","title":{"rendered":"How much does a testing cost and how to estimate it&#8230;"},"content":{"rendered":"\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"683\" src=\"https:\/\/metrics.blogg.gu.se\/files\/2021\/04\/shinkansen-5237269_1920-1024x683.jpg\" alt=\"\" class=\"wp-image-635\" srcset=\"https:\/\/metrics.blogg.gu.se\/files\/2021\/04\/shinkansen-5237269_1920-1024x683.jpg 1024w, https:\/\/metrics.blogg.gu.se\/files\/2021\/04\/shinkansen-5237269_1920-300x200.jpg 300w, https:\/\/metrics.blogg.gu.se\/files\/2021\/04\/shinkansen-5237269_1920-768x512.jpg 768w, https:\/\/metrics.blogg.gu.se\/files\/2021\/04\/shinkansen-5237269_1920-1200x800.jpg 1200w, https:\/\/metrics.blogg.gu.se\/files\/2021\/04\/shinkansen-5237269_1920-1320x880.jpg 1320w, https:\/\/metrics.blogg.gu.se\/files\/2021\/04\/shinkansen-5237269_1920.jpg 1920w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><figcaption>BIld av <a href=\"https:\/\/pixabay.com\/sv\/users\/arminep-8300920\/?utm_source=link-attribution&amp;utm_medium=referral&amp;utm_campaign=image&amp;utm_content=5237269\">Armin Forster<\/a> fr\u00e5n <a href=\"https:\/\/pixabay.com\/sv\/?utm_source=link-attribution&amp;utm_medium=referral&amp;utm_campaign=image&amp;utm_content=5237269\">Pixabay<\/a><\/figcaption><\/figure>\n\n\n\n<p><a href=\"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3442694\">CSUR5403-53 (acm.org)<\/a><\/p>\n\n\n\n<p class=\"has-drop-cap\">Testing of software systems is a task which costs a lot. As a former tester, I see this as a neverending story &#8211; you&#8217;re done with your testing, new code is added, you are not done anymore, you test more, you&#8217;re done, new code&#8230;. and so on.<\/p>\n\n\n\n<p>When I was a tester, there was no tools for automating the test process (we&#8217;re talking 1990&#8217;s here). Well, ok, there was CppUnit, and it was a great help &#8211; I could create a suite and execute it. Then I needed to add new test cases, create functional tests, etc. It was fun, until it wasn&#8217;t anymore. <\/p>\n\n\n\n<p>I would have given a lot for having tools for test orchestration back then. A lot of things happened since then. This paper presents a great overview of how testing cost is estimated &#8211; I know, it&#8217;s not orchestration, but hear me out. I like this paper, because it shows anyways which tools are used, how test cost is estimated (e.g. based on metrics like coverage, effort, etc) and how the tests are evaluated. <\/p>\n\n\n\n<p>I recommend this reading as an overview, a starting point for understanding the testing processes today, and, eventually, to optimize the test processes based on the right premises (not HiPPO). <\/p>\n","protected":false},"excerpt":{"rendered":"<p>CSUR5403-53 (acm.org) Testing of software systems is a task which costs a lot. As a former tester, I see this as a neverending story &#8211; you&#8217;re done with your testing, new code is added, you are not done anymore, you test more, you&#8217;re done, new code&#8230;. and so on. When I was a tester, there &hellip; <a href=\"https:\/\/metrics.blogg.gu.se\/?p=634\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;How much does a testing cost and how to estimate it&#8230;&#8221;<\/span><\/a><\/p>\n","protected":false},"author":68,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=\/wp\/v2\/posts\/634"}],"collection":[{"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=\/wp\/v2\/users\/68"}],"replies":[{"embeddable":true,"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=634"}],"version-history":[{"count":1,"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=\/wp\/v2\/posts\/634\/revisions"}],"predecessor-version":[{"id":636,"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=\/wp\/v2\/posts\/634\/revisions\/636"}],"wp:attachment":[{"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=634"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=634"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=634"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}