All software projects should be managing regression that can be introduced from release to release by developers or from outside factors. Working with a codebot as a member of your team is no different.
A codebot operates within a strict set of constraints to enable the output to be deterministic. Provided we are following the rules outlined by:
- Protected Regions,
- Bot Written Warning,
- Bot version upgrade process, and
- we practise discipline within our team for model changes (communicate changes being made),
the bot will behave as expected and we will have no surprises.
With this in mind, we still need to ensure that we adjust or expand our tests to cover new custom code or any modified bot written code. These changes will ensure that our test suite can assist in detecting regression as would be the normal practice when developing with a human colleague.