{"id":83,"date":"2019-06-17T19:25:50","date_gmt":"2019-06-17T19:25:50","guid":{"rendered":"https:\/\/www.bddtesting.com\/?page_id=83"},"modified":"2019-06-17T19:25:50","modified_gmt":"2019-06-17T19:25:50","slug":"next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing","status":"publish","type":"page","link":"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/","title":{"rendered":"Next-generation BDD: From Automated Web Tests to Automated Web Acceptance Testing"},"content":{"rendered":"\n<p>Last year, our&nbsp;<a href=\"http:\/\/www.gumtree.com.au\/\" rel=\"noreferrer noopener\" target=\"_blank\">Gumtree Australia<\/a>&nbsp;team started to use behavior-driven development in our agile development process. Initially, we searched for an open-source BDD framework to implement for BDD testing. Since we work on a web application, we wanted our automated BDD tests to exercise the application as a customer view, via a web interface. Of course, many web testing libraries do just that, including open-source tools such as&nbsp;<a href=\"http:\/\/www.seleniumhq.org\/\" rel=\"noreferrer noopener\" target=\"_blank\">Selenium<\/a>&nbsp;and&nbsp;<a href=\"http:\/\/docs.seleniumhq.org\/projects\/webdriver\/\" rel=\"noreferrer noopener\" target=\"_blank\">WebDriver<\/a>&nbsp;(Selenium 2). However, we discovered that no existing BDD framework supports web automation testing directly.<\/p>\n\n\n\n<p>We decided to simply integrate the open-source BDD tool&nbsp;<a href=\"http:\/\/jbehave.org\/\" rel=\"noreferrer noopener\" target=\"_blank\">JBehave<\/a>&nbsp;with Selenium, but soon learned that this solution doesn\u2019t completely fulfill the potential of automated BDD tests. It can\u2019t drive the project development and documentation processes as much as we expected.<\/p>\n\n\n\n<p>Different stakeholders need to view BDD tests at different levels. For instance, QA needs results to show how the application behaved under test. Upper managers are not so interested in the finer details, but rather want to see the number and complexity of the features defined and implemented so far, and if the project is still on track.<\/p>\n\n\n\n<p>We needed a testing framework that could let us express and report on BDD tests at different levels, manage the stories and their scenarios effectively, and then drill down into the details as required. And so we started to develop a product that matches our needs. We named this product the Behavior Automation Framework (Beaf) and designed it to make the practice of behavior-driven development easier. Based on JBehave as well as more traditional tools like&nbsp;<a href=\"http:\/\/testng.org\/doc\/index.html\" rel=\"noreferrer noopener\" target=\"_blank\">TestNg<\/a>, Beaf includes a host of features to simplify writing automated BDD tests and interpreting the results.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><a href=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/beaf-01.png\" target=\"_blank\" rel=\"noreferrer noopener\"><img decoding=\"async\" src=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/beaf-01.png\" alt=\"beaf-01\"\/><\/a><\/figure>\n\n\n\n<p>Beaf\u2019s extensions and utilities improve web testing on WebDriver\/Selenium2 in four ways:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Supplying a Story web console, where PMs\/QAs can manage all the existing stories, divide stories into different categories or groups, and create\/edit stories using the correct BDD format.<\/li><\/ul>\n\n\n\n<figure class=\"wp-block-image\"><a href=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/beaf-02.png\" target=\"_blank\" rel=\"noreferrer noopener\"><img decoding=\"async\" src=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/_resampled\/ResizedImageWzMwMCw4M10\/beaf-02.png\" alt=\"beaf-02\"\/><\/a><\/figure>\n\n\n\n<ul class=\"wp-block-list\"><li>Organizing web tests into reusable steps, and mapping them back to their original requirements and user stories.<\/li><\/ul>\n\n\n\n<figure class=\"wp-block-image\"><a href=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/beaf-03.png\" target=\"_blank\" rel=\"noreferrer noopener\"><img decoding=\"async\" src=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/_resampled\/ResizedImageWzMwMCwxNzRd\/beaf-03.png\" alt=\"beaf-03\"\/><\/a><\/figure>\n\n\n\n<ul class=\"wp-block-list\"><li>Generating reports and documentation about BDD tests. Whenever a test case is executed, Beaf generates a report. Each report contains a narrative description of the test, including a short comment and screenshot for each step. The report provides not only information about the test results, but also documentation about how the scenarios under test have been implemented. Reports serve as living documentation, illustrating how an application implements the specified requirements.<\/li><\/ul>\n\n\n\n<figure class=\"wp-block-image\"><a href=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/beaf-06.png\" target=\"_blank\" rel=\"noreferrer noopener\"><img decoding=\"async\" src=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/_resampled\/ResizedImageWzYwMCw0Njhd\/beaf-06.png\" alt=\"beaf-06\"\/><\/a><\/figure>\n\n\n\n<ul class=\"wp-block-list\"><li>Incorporating high-level summaries and aggregations of test results into reports. These overviews include how many stories and their scenarios have been tested by automated BDD tests. Taken as a set of objective metrics, test results show the relative size and progress of each feature being implemented.<\/li><\/ul>\n\n\n\n<figure class=\"wp-block-image\"><a href=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/beaf-04.png\" target=\"_blank\" rel=\"noreferrer noopener\"><img decoding=\"async\" src=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/_resampled\/ResizedImageWzYwMCwxNzhd\/beaf-04.png\" alt=\"beaf-04\"\/><\/a><\/figure>\n\n\n\n<p>When executing a test, whether it be with&nbsp;<a href=\"http:\/\/junit.org\/\" rel=\"noreferrer noopener\" target=\"_blank\">JUnit<\/a>,&nbsp;<a href=\"http:\/\/jmock.org\/\" rel=\"noreferrer noopener\" target=\"_blank\">jMock<\/a>, or another framework, Beaf handles many of the Selenium 2\/WebDriver infrastructure details. For example, Beaf can run cases cross-platform, including desktop (Firefox, Chrome), mobile (iPhone), and tablet (iPad). Testers can opt to open a new browser for each test, or use the same browser session for all of the tests in a class. The browser\/device to be used can also be set in the Beaf configuration.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><a href=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/beaf-05.png\" target=\"_blank\" rel=\"noreferrer noopener\"><img decoding=\"async\" src=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/_resampled\/ResizedImageWzYwMCw0MzJd\/beaf-05.png\" alt=\"beaf-05\"\/><\/a><\/figure>\n\n\n\n<p>Using common steps provides a layer of abstraction between the behavior being tested and the way the web application implements that behavior. This level of abstraction makes it easier to manage changes in implementation details, because a desired behavior will generally change less frequently than the details of how it is to be implemented. Abstraction also allows implementation details to be centralized in one place.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>@When(\"posting an Ad in the \\\"$category\\\" category\")\npublic void postingAd(@Named(\"category\") String category) throws Throwable\n{\n    \/\/ 1. PageFactory will generate ad post pages under specified category.  \n    \/\/ 2. Page status will be sent to next step by ThreadLocal.\n    postAdPage.set(PostAdPageFactory.createPostAdPage(category, AdType.OFFER.name()));\n}\n<\/code><\/pre>\n\n\n\n<p>In addition to test reports, Beaf supplies a very useful web module called the Beaf Dashboard, which provides a higher-level view of current status. The dashboard shows the state of all of the stories, both in terms of their relative priorities and in terms of how many P1\/P2\/P3 stories and scenarios are fully, partially, or not automated. This information gives a good idea of the amount of work involved in implementing different parts of the project. The dashboard also keeps track of test results over time, so that users can visualize in concrete terms the amount of work done so far versus the estimated amount of work remaining to be done.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><a href=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/beaf-07.png\" target=\"_blank\" rel=\"noreferrer noopener\"><img decoding=\"async\" src=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/_resampled\/ResizedImageWzYwMCwyNjFd\/beaf-07.png\" alt=\"beaf-07\"\/><\/a><\/figure>\n\n\n\n<p>Beaf facilitates QA people joining projects in stages. It provides PD\/QA with the detailed information required to test and update code, while giving business managers and PMs the more high-level views and reports that suit their needs. However, the greater potential of Beaf is the ability to turn automated web tests into automated web acceptance testing, in the true spirit of BDD.<\/p>\n\n\n\n<p><a href=\"https:\/\/www.ebayinc.com\/stories\/blogs\/tech\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/\">https:\/\/www.ebayinc.com\/stories\/blogs\/tech\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Last year, our&nbsp;Gumtree Australia&nbsp;team started to use behavior-driven development in our agile development process. Initially, we searched for an open-source BDD framework to implement for BDD testing. Since we work on a web application, we wanted our automated BDD tests to exercise &#8230;.&nbsp;&nbsp;<a class=\" special\" href=\"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/\">Read More<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"pagelayer_contact_templates":[],"_pagelayer_content":"","_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"class_list":["post-83","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.0 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Next-generation BDD: From Automated Web Tests to Automated Web Acceptance Testing &#8226; BDD Testing<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Next-generation BDD: From Automated Web Tests to Automated Web Acceptance Testing &#8226; BDD Testing\" \/>\n<meta property=\"og:description\" content=\"Last year, our&nbsp;Gumtree Australia&nbsp;team started to use behavior-driven development in our agile development process. Initially, we searched for an open-source BDD framework to implement for BDD testing. Since we work on a web application, we wanted our automated BDD tests to exercise ....&nbsp;&nbsp;Read More\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/\" \/>\n<meta property=\"og:site_name\" content=\"BDD Testing\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/beaf-01.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/\",\"url\":\"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/\",\"name\":\"Next-generation BDD: From Automated Web Tests to Automated Web Acceptance Testing &#8226; BDD Testing\",\"isPartOf\":{\"@id\":\"https:\/\/www.bddtesting.com\/#website\"},\"datePublished\":\"2019-06-17T19:25:50+00:00\",\"dateModified\":\"2019-06-17T19:25:50+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.bddtesting.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Next-generation BDD: From Automated Web Tests to Automated Web Acceptance Testing\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.bddtesting.com\/#website\",\"url\":\"https:\/\/www.bddtesting.com\/\",\"name\":\"BDD Testing\",\"description\":\"Behavior-driven development testing\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.bddtesting.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Next-generation BDD: From Automated Web Tests to Automated Web Acceptance Testing &#8226; BDD Testing","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/","og_locale":"en_US","og_type":"article","og_title":"Next-generation BDD: From Automated Web Tests to Automated Web Acceptance Testing &#8226; BDD Testing","og_description":"Last year, our&nbsp;Gumtree Australia&nbsp;team started to use behavior-driven development in our agile development process. Initially, we searched for an open-source BDD framework to implement for BDD testing. Since we work on a web application, we wanted our automated BDD tests to exercise ....&nbsp;&nbsp;Read More","og_url":"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/","og_site_name":"BDD Testing","og_image":[{"url":"https:\/\/www.ebayinc.com\/assets\/Uploads\/Blog\/2014\/09\/beaf-01.png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/","url":"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/","name":"Next-generation BDD: From Automated Web Tests to Automated Web Acceptance Testing &#8226; BDD Testing","isPartOf":{"@id":"https:\/\/www.bddtesting.com\/#website"},"datePublished":"2019-06-17T19:25:50+00:00","dateModified":"2019-06-17T19:25:50+00:00","breadcrumb":{"@id":"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.bddtesting.com\/next-generation-bdd-from-automated-web-tests-to-automated-web-acceptance-testing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.bddtesting.com\/"},{"@type":"ListItem","position":2,"name":"Next-generation BDD: From Automated Web Tests to Automated Web Acceptance Testing"}]},{"@type":"WebSite","@id":"https:\/\/www.bddtesting.com\/#website","url":"https:\/\/www.bddtesting.com\/","name":"BDD Testing","description":"Behavior-driven development testing","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.bddtesting.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/www.bddtesting.com\/wp-json\/wp\/v2\/pages\/83"}],"collection":[{"href":"https:\/\/www.bddtesting.com\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.bddtesting.com\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.bddtesting.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bddtesting.com\/wp-json\/wp\/v2\/comments?post=83"}],"version-history":[{"count":1,"href":"https:\/\/www.bddtesting.com\/wp-json\/wp\/v2\/pages\/83\/revisions"}],"predecessor-version":[{"id":84,"href":"https:\/\/www.bddtesting.com\/wp-json\/wp\/v2\/pages\/83\/revisions\/84"}],"wp:attachment":[{"href":"https:\/\/www.bddtesting.com\/wp-json\/wp\/v2\/media?parent=83"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}