App CI/CD test suite brainstorming #69

New Issue

decentral1se · 2021-06-04T14:27:09Z

decentral1se commented

2021-06-04 14:27:09 +00:00

Following coop-cloud/abra#125. We'll be in a position to take on one part of what we discussed in the CoS fund - the apps CI system.

We have renovate-bot auto-merging upgrades and drone-abra auto-publishing new tags for us, the next is to run each app through a test suite like Yunohost does so that we can have some guarantee the new version can be deployed and will succeed.

That test suite can have tests like, can you upgrade from the first version ever published all the way through to the last version without seeing a failure? Can you rollback the opposite way and not see a failure? Can you back up the app? And so on.

Hopefully from those suite builds we could generate a rating / score / etc. which could be the top-level thing other co-op cloud instance admins and end-users see.

Let's get the thoughts going in this thread anyway 🚀

Following https://git.autonomic.zone/coop-cloud/abra/issues/125. We'll be in a position to take on one part of what we discussed in the CoS fund - the apps CI system. We have `renovate-bot` auto-merging upgrades and `drone-abra` auto-publishing new tags for us, the next is to run each app through a test suite like Yunohost does so that we can have some guarantee the new version can be deployed and will succeed. That test suite can have tests like, can you upgrade from the first version ever published all the way through to the last version without seeing a failure? Can you rollback the opposite way and not see a failure? Can you back up the app? And so on. Hopefully from those suite builds we could generate a rating / score / etc. which could be the top-level thing other co-op cloud instance admins and end-users see. Let's get the thoughts going in this thread anyway :rocket:

❤️ 1

decentral1se added this to the Beta release milestone 2021-06-04 14:27:09 +00:00

decentral1se added the

enhancement

label 2021-06-04 14:27:09 +00:00

decentral1se commented

2021-06-04 14:27:42 +00:00

Also depends on coop-cloud/abra#165.

Also depends on https://git.autonomic.zone/coop-cloud/abra/issues/165.

decentral1se changed title from ~~App CI system brainstorming~~ to App CI/CD test suite brainstorming

2021-06-04 14:28:45 +00:00

decentral1se added the