run Tier1 tests via TMT/FMF

Use the TMT/FMF instead of STI for running tests. STI does not respect
the adjust section in main.fmf files of stored tests.

Related: rhbz#2107109
This commit is contained in:
Milos Malik 2022-07-11 16:02:36 +02:00 committed by Petr Lautrbach
parent c3f497359d
commit cf56395c07
11 changed files with 78 additions and 23 deletions

1
.fmf/version Normal file
View File

@ -0,0 +1 @@
1

6
plans/tests.fmf Normal file
View File

@ -0,0 +1,6 @@
summary: Tier 1 setroubleshoot test plan
discover:
how: fmf
execute:
how: tmt

View File

@ -0,0 +1,19 @@
summary: Test for BZ#1811644 (Let setroubleshoot to report bugs on components)
contact: Vit Mojzis <vmojzis@redhat.com>
component:
- setroubleshoot
test: ./runtest.sh
framework: beakerlib
recommend:
- setroubleshoot-server
- flatpak-selinux
- tpm2-abrmd-selinux
- container-selinux
- usbguard-selinux
- mysql-selinux
- fapolicyd-selinux
duration: 5m
link:
- relates: https://bugzilla.redhat.com/show_bug.cgi?id=1811644
extra-summary: /CoreOS/setroubleshoot/Regression/Report-bugs-on-corresponding-components
extra-task: /CoreOS/setroubleshoot/Regression/Report-bugs-on-corresponding-components

View File

@ -26,7 +26,6 @@
# ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
# Include Beaker environment
. /usr/bin/rhts-environment.sh || exit 1
. /usr/share/beakerlib/beakerlib.sh || exit 1
PACKAGE="setroubleshoot"

View File

@ -0,0 +1,15 @@
summary: Does setroubleshoot report any 'Plugin Exception' during analyses?
contact: Petr Lautrbach <plautrba@redhat.com>
component:
- setroubleshoot
test: ./runtest.sh
framework: beakerlib
recommend:
- setroubleshoot-server
environment:
AVC_ERROR: +no_avc_check
duration: 5m
link:
- relates: https://bugzilla.redhat.com/show_bug.cgi?id=1784564
extra-summary: /CoreOS/setroubleshoot/Regression/no-plugin-exception-during-analyses
extra-task: /CoreOS/setroubleshoot/Regression/no-plugin-exception-during-analyses

View File

@ -27,7 +27,6 @@
# ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
# Include Beaker environment
. /usr/bin/rhts-environment.sh || exit 1
. /usr/share/beakerlib/beakerlib.sh || exit 1
PACKAGE="setroubleshoot"

View File

@ -0,0 +1,13 @@
summary: Test for traceback when using sealert -s with display set to invalid value
contact: Vit Mojzis <vmojzis@redhat.com>
component:
- setroubleshoot
test: ./runtest.sh
framework: beakerlib
recommend:
- setroubleshoot
duration: 5m
link:
- relates: https://bugzilla.redhat.com/show_bug.cgi?id=1574434
extra-summary: /CoreOS/setroubleshoot/Regression/sealert-s-traceback-invalid-display
extra-task: /CoreOS/setroubleshoot/Regression/sealert-s-traceback-invalid-display

View File

@ -26,7 +26,6 @@
# ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
# Include Beaker environment
. /usr/bin/rhts-environment.sh || exit 1
. /usr/share/beakerlib/beakerlib.sh || exit 1
PACKAGE="setroubleshoot-server"

View File

@ -0,0 +1,24 @@
summary: Does the plugin work as expected?
description: |+
Does the plugin work as expected?
Default value of ANALYSIS_DELAY can be overriden.
contact: Milos Malik <mmalik@redhat.com>
component:
- setroubleshoot-plugins
test: ./runtest.sh
framework: beakerlib
recommend:
- setroubleshoot-plugins
- setroubleshoot-server
- audit
- setools-console
- psmisc
- libselinux-utils
- rsyslog
environment:
AVC_ERROR: +no_avc_check
duration: 10m
extra-summary: /CoreOS/setroubleshoot-plugins/Sanity/public_content
extra-task: /CoreOS/setroubleshoot-plugins/Sanity/public_content

View File

@ -27,7 +27,6 @@
# ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
# Include Beaker environment
. /usr/bin/rhts-environment.sh || exit 1
. /usr/share/beakerlib/beakerlib.sh || exit 1
PACKAGE="setroubleshoot-plugins"

View File

@ -1,19 +0,0 @@
- hosts: localhost
roles:
- role: standard-test-beakerlib
tags:
- classic
tests:
- Regression/embedded-null-byte-in-audit-records
- Regression/no-plugin-exception-during-analyses
- Regression/sealert-s-traceback-invalid-display
- Regression/Report-bugs-on-corresponding-components
- Sanity/public_content
required_packages:
- setroubleshoot-server
- setroubleshoot-plugins
- audit
- setools-console
- psmisc
- libselinux-utils
- rsyslog