Skip to content

Latest commit

 

History

History
295 lines (219 loc) · 20.3 KB

README.md

File metadata and controls

295 lines (219 loc) · 20.3 KB

Serenity BDD

Gitter Continuous Integration javadoc

That feeling you get when you know you can trust your tests

Serenity BDD is a library designed to make writing automated acceptance tests easier, and more fun.

Learn more about Serenity, and discover tutorials, docs and more, on the official Serenity BDD website

What does it do?

Serenity helps structure your automated acceptance tests in order to make them easier to understand and maintain, and provides great reporting capabilties on top of tools like Cucumber and JUnit. It also provides tight integration with WebDriver and RestAssured, to make both web testing and API testing easier and more efficient.

Serenity works in two ways:

  • It instruments your test code and reports on the steps that your tests execute to achieve their goals, and stores the test results in a standardized format;
  • It aggregates these test results into clear and meaningful reports, that reflect not only the outcomes of your tests, but also the status of your project. For example, you can get Serenity to report on what requirements, features or stories you have implemented, and how well (or not) they were tested.

Serenity makes your test cleaner

Serenity provides libraries and patterns that make it easier to write cleaner, more reusable code. It provides tight integration with Selenium WebDriver, and modern testing patterns such as Lean Page Objects, Action Classes, and the Screenplay Pattern. You can learn more about these patterns in this article.

Serenity makes your reports richer

Serenity reports aim to be more than simple test reports - they are designed to provide living documentation of your product. The reports give an overview of the test results:

Serenity Test Summary

But they also let you document your requirements hierarchy, and the state of the acceptance criteria associated with your requirements:

Serenity Requirements Summary

When you use BDD tools like Cucumber or JBehave, Serenity will include the feature details in a format that both team members and business folk can read:

Serenity Feature Details

And if you drill into the details, Serenity will give you a detailed account of how the test played out, including interactions and screenshots:

Serenity Test Details

Found a bug?

You can raise a defect here. Note that this is an open source project, so the fastest way to fix an issue is to fix it yourself and to propose a pull request.

Note that pretty much all current development on the Serenity code base is driven by commercial support contracts. As with any open source project, support is never free - it is just payed for from a volunteer's spare time, through a sponsoring organisation or via a commercial support package. Currently, we have very little bandwidth for issues which are not requested or prioritised by a client with a commercial support package, so if an issue is important to you, your project or your company, a commercial support package is the more effective and most ethical way of getting a fix or implementation done quickly.

We also propose one-on-one troubleshooting sessions to help you get your problems resolved faster.

Some companies and individuals who find that Serenity BDD helps in their daily work choose to give back by sponsoring the project in different capacities. Bug fixes or change requests coming from sponsors are generally prioritised over other requests.

Here are a few tips to make it easier for us to help you:

Give as much context as possible.

Simply saying "The reports don't get generated" will not help us very much. Give as much context as possible, including:

  • Serenity version (serenity-core and the other serenity libraries, such as serenity-cucummber and serenity-jbehave)
  • If you are using Firefox, firefox and geckodriver version
  • If you are using Chrome, chrome and chromedriver version
  • What Operating System are you using

Also, make sure you try with the latest version of Serenity - your bug may already be fixed, and in any case error messages from the latest version will be more relevant when we try to track down the source of the problem.

Use living documentation

It is easier for us to fix something we can see breaking. If someone has to volunteer an hour of there time to reproduce a defect, Start of with one of the Serenity started projects (like this one and add a scenario or test case that both illustrates and describes your issue. If possible, write the test to describe the behaviour you expect, so that it fails when the defect is present, and that it will pass when the defect is fixed.

You can help out by sponsoring Serenity BDD directly here: ❤️ Sponsor

Take a look at this article for more information.

Need Commercial Support?

If you are using Serenity for your company projects and need faster or more in-depth support, including training and coaching, why not ask your company to explore our commercial support options? We recognize that businesses have unique needs and require specialized attention. That's why we've designed a comprehensive range of support options tailored to your requirements. Whether it's prioritized tickets for pressing issues, custom Serenity work to integrate seamlessly with your existing systems, or remote mentoring and pair programming sessions to enhance your team's capabilities, we've got you covered. Our packages even include options for unlimited email support and additional live support hours at competitive rates. With monthly and annual payment plans, our support models aim to supercharge your Serenity experience, reducing downtime, accelerating development, and ensuring you get the most value out of your automation efforts. Let's chat and find the right fit for your needs!

Where can I learn more?

Check out Serenity BDD in more detail here:

Learn Online

Release Notes

Release notes are available for major releases:

What is the latest stable version I should use?

The tables below list the latest stable and tested versions of Serenity BDD and other related libraries.

Serenity with JUnit

serenity-core serenity-maven-plugin Selenium version RestAssured version Appium client version
4.2.8 4.2.8 4.26.0 5.5.0 8.3.0
4.1.3 4.1.3 4.18.1 5.3.1 8.3.0
4.1.0 4.1.0 4.16.0 5.3.1 8.3.0
4.0.12 4.0.12 4.12.1 5.3.1 8.3.0
4.0.1 4.0.1 4.12.0 5.3.1 8.3.0
3.9.8 3.9.8 4.11.0 5.2.0 8.3.0
3.6.12 3.6.12 4.8.0 5.2.0 8.3.0
3.6.12 3.6.12 4.8.0 5.2.0 8.3.0
3.3.10 3.3.10 4.5.2 5.2.0 8.2.0
3.3.4 3.3.4 4.4.0 5.1.1 8.1.1
3.2.4 3.2.4 4.1.3 5.0.1 8.0.0
3.2.2 3.2.2 4.1.2 4.5.1 8.0.0
3.1.15 3.1.15 4.1.1 4.4.0 8.0.0-BETA
3.1.1 3.1.1 4.0.0 4.3.3 8.0.0-BETA
3.0.5 3.0.5 3.141.59 4.3.3 7.5.1
2.5.8 2.5.8 3.141.59 4.3.3 7.5.1
2.5.7 2.5.7 3.141.59 4.3.3 7.5.1
2.4.51 2.4.51 3.141.59 4.3.3 7.5.1
2.4.34 2.4.34 3.141.59 4.3.3 7.5.1
2.4.24 2.4.24 3.141.59 4.3.3 7.5.1
2.3.12 2.3.12 3.141.59 4.3.2 7.3.0
2.3.5 2.3.5 3.141.59 4.3.1 7.3.0
2.3.4 2.3.4 3.141.59 3.3.0 7.2.0
2.2.12 2.2.12 3.141.59 3.3.0 7.2.0
2.2.5 2.2.5 3.141.59 3.3.0 7.2.0
2.2.2 2.2.2 3.141.59 3.3.0 7.2.0
2.2.0 2.2.0 3.141.59 3.3.0 7.2.0
2.1.5 2.1.5 3.141.59 3.3.0 7.2.0
2.1.0 2.1.0 3.141.59 3.3.0 7.2.0
2.0.90 2.0.90 3.141.59 3.3.0 7.2.0
2.0.84 2.0.84 3.141.59 3.3.0 7.2.0
2.0.71 2.0.71 3.141.59 3.3.0 7.2.0
2.0.69 2.0.69 3.141.59 3.3.0 7.0.0
2.0.56 2.0.56 3.141.59 3.3.0 7.0.0
2.0.52 2.0.52 3.141.59 3.3.0 7.0.0
2.0.48 2.0.48 3.141.59 3.3.0 7.0.0

Sample project: Serenity JUnit Starter Project.

Cucumber 7 (Serenity 3.1.15 onwards)

serenity-core serenity-maven-plugin serenity-cucumber Cucumber
4.2.8 4.2.8 4.2.8 7.20.1
4.1.3 4.1.3 4.1.3 7.15.0
4.0.12 4.0.12 4.0.12 7.14.0
4.0.1 4.0.1 4.0.1 7.13.0
3.9.8 3.9.8 3.9.8 7.13.0
3.6.12 3.6.12 3.6.12 7.11.0
3.3.10 3.3.10 3.3.10 7.8.1
3.3.4 3.3.4 3.3.4 7.4.1
3.2.4 3.2.4 3.2.4 7.2.3
3.1.20 3.1.20 3.1.20 7.1.1
3.1.15 3.1.15 3.1.15 7.0.0

Cucumber 6

Note: Cucumber 6 is no longer supported in newer versions of Serenity.

serenity-core serenity-maven-plugin serenity-cucumber6 Cucumber
2.5.8 2.5.8 2.5.8 6.10.4
2.5.7 2.5.7 2.5.7 6.10.4
2.4.51 2.4.51 2.4.51 6.10.4
2.4.34 2.4.34 2.4.34 6.10.4
2.4.24 2.4.24 2.4.24 6.10.2
2.3.12 2.3.12 2.3.12 6.9.1
2.3.4 2.3.4 2.3.4 6.6.0
2.3.4 2.3.4 2.3.4 6.6.0
2.2.12 2.2.5 2.2.5 5.6.0
2.2.2 2.2.2 2.2.2 5.6.0
2.2.0 2.2.0 2.2.0 5.5.0

Sample project: Serenity Cucumber Starter Project.

Cucumber 4

Note: Cucumber 4 is no longer supported in newer versions of Serenity.

serenity-core serenity-maven-plugin serenity-cucumber4 Cucumber
2.1.5 2.1.5 2.1.2 4.8.0
2.1.0 2.1.0 2.1.0 4.8.0
2.0.90 2.0.90 1.0.29 4.8.0
2.0.84 2.0.84 1.0.21 4.2.0
2.0.69 2.0.69 1.0.18 4.2.0
2.0.56 2.0.56 1.0.15 4.2.0
2.0.54 2.0.54 1.0.14 4.2.0
2.0.52 2.0.52 1.0.14 4.2.0
2.0.48 2.0.48 1.0.12 4.2.0

Sample project: Serenity Cucumber 4 Starter Project.

Cucumber 2

Note: Cucumber 2 is no longer supported in newer versions of Serenity.

serenity-core serenity-maven-plugin serenity-cucumber Cucumber
2.1.5 2.1.5 1.9.50 2.4.0
2.0.90 2.0.90 1.9.49 2.4.0
2.0.84 2.0.84 1.9.48 2.4.0
2.0.69 2.0.69 1.9.45 2.4.0
2.0.56 2.0.56 1.9.40 2.4.0
2.0.54 2.0.54 1.9.39 2.4.0
2.0.52 2.0.52 1.9.39 2.4.0
2.0.48 2.0.48 1.9.37 2.4.0

Sample project: Serenity Cucumber Starter Project.

Serenity with JBehave

JBehave is not currently supported in the current version of Serenity BDD, and no new development is being done with the Serenity/JBehave integration.

serenity-core serenity-maven-plugin serenity-jbehave JBehave
2.0.52 2.0.52 1.0.46 4.5
2.0.42 2.0.48 1.0.45 4.5

Sample project: Serenity JBehave Starter Project.

Version number format

Serenity uses a three-digit version number notation, with the following meaning:

 <major>.<minor>.<build>

The first and second digits are for more significant updates, including new features or important bug fixes. The third is updated automatically for every new release, and is generated by the build process.

Commit message conventions

Commit messages are used to generate the release notes for each release. To do this, we loosely follow the AngularJS commit conventions: for commit messages to appear in the release notes, the title line needs to respect the following format:

  <type>: <message>

where is one of the following:

  • feat: A new feature
  • fix: A bug fix
  • docs: Documentation only changes
  • style: Changes that do not affect the meaning of the code (white-space, formatting, missing semi-colons, etc)
  • refactor: A code change that neither fixes a bug or adds a feature
  • perf: A code change that improves performance
  • test: Adding missing tests
  • chore: Changes to the build process or auxiliary tools and libraries such as documentation generation

Also commits can consists of several lines - to include some additional information in relase notes. For example:

feat: A new feature to make something better
now it will be available to call api.function() with additional parameters like api.function(Integer)

it will be included in release notes as:

  • feat: A new feature to make something better

    now it will be available to call api.function() with additional parameters like api.function(Integer)

Please take a look at release notes to find some more examples of mutiline commits.

For more information, read the Contributing guide for this repo.

Starting from version 1.1.26, any commits without one of these prefixes will not appear in the release notes.

Licensing

This distribution, as a whole, is licensed under the terms of the Apache License, Version 2.0

History - Serenity and Thucydides

Serenity was originally called Thucydides, and the package structure still reflects this history. Thucydides is discussed at length in the BDD in Action under the name Thucydides - everything discussed in "BDD in Action" is directly applicable for Serenity except for the artifact names.

Thucydides was renamed Serenity in November 2014, and moving forward, all new work will be done on Serenity. The artifact names reflect this change, e.g.

  • net.thucydides:thucydides-code becomes net.serenity:core
  • net.thucydides:thucydides-junit becomes net.serenity:serenity-junit
  • net.thucydides:thucydides-jbehave becomes net.serenity:serenity-jbehave
  • net.thucydides:thucydides-cucumber becomes net.serenity:serenity-cucumber

and so on.