lldpd/tests/tests.yml

14 lines
250 B
YAML
Raw Permalink Normal View History

Adds tests according to the CI Justification Adds tests according to the CI wiki specifically the standard test interface in the spec. The playbook includes Tier1 level test cases that have been tested in the following contexts and is passing reliably: Classic. Test logs are stored in the artifacts directory. The following steps are used to execute the tests using the standard test interface: Test enveronment Make sure you have installed packages from the spec ``` ansible-2.4.1.0-2.fc28.noarch python2-dnf-2.7.5-1.fc28.noarch libselinux-python-2.7-2.fc28.x86_64 standard-test-roles-2.5-1.fc28.noarch Run tests for Classic Snip of the example test run for Classic tests: ``` :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Setup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: lldpd-1.0.1-1.fc28.x86_64 :: [ 17:45:16 ] :: [ PASS ] :: Checking for the presence of lldpd rpm :: [ 17:45:16 ] :: [ LOG ] :: Package versions: :: [ 17:45:16 ] :: [ LOG ] :: lldpd-1.0.1-1.fc28.x86_64 :: [ 17:45:16 ] :: [ BEGIN ] :: Running 'cp lldpd-tests.py /usr/bin/' :: [ 17:45:16 ] :: [ PASS ] :: Command 'cp lldpd-tests.py /usr/bin/' (Expected 0, got 0) :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 0s :: Assertions: 2 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Test :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 17:45:16 ] :: [ LOG ] :: lladpd tests :: [ 17:45:16 ] :: [ BEGIN ] :: Running '/usr/bin/python3 /usr/bin/lldpd-tests.py' test_lldpd_trasmitted_lldp_attributes (__main__.lldpdTests) verify at the other end of veth received LLDP packets that contains attibutes (link address, hostname, TTL, system desc). tcpdump ... reading from file /tmp/lldpd-tcp-dump.pcap, link-type EN10MB (Ethernet) ok test_lldpd_trasmitted_lldp_packets (__main__.lldpdTests) verify at the other end of veth ifname lldpd has received LLDP packets. tcpdump ... reading from file /tmp/lldpd-tcp-dump.pcap, link-type EN10MB (Ethernet) ok test_lldpd_received_lldp_packets_sent_by_systemd_networkd (__main__.lldpdTestsViaNetworkd) ... ok test_systemd_networkd_received_lldp_packets (__main__.lldpdTestsViaNetworkd) ... ok ---------------------------------------------------------------------- Ran 4 tests in 64.222s OK :: [ 17:46:21 ] :: [ PASS ] :: Command '/usr/bin/python3 /usr/bin/lldpd-tests.py' (Expected 0, got 0) :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 65s :: Assertions: 1 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Cleanup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 17:46:21 ] :: [ BEGIN ] :: Running 'rm /usr/bin/lldpd-tests.py' :: [ 17:46:21 ] :: [ PASS ] :: Command 'rm /usr/bin/lldpd-tests.py' (Expected 0, got 0) :: [ 17:46:21 ] :: [ LOG ] :: lladpd tests done :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 0s :: Assertions: 1 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: TEST PROTOCOL :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: Package : lldpd Installed : lldpd-1.0.1-1.fc28.x86_64 beakerlib RPM : beakerlib-1.17-13.fc28.noarch Test started : 2018-05-23 17:45:15 IST Test finished : 2018-05-23 17:46:21 IST (still running) Test duration : 66 seconds Test name : unknown Distro : Fedora release 28 (Twenty Eight) Hostname : Zeus Architecture : x86_64 CPUs : 8 x Intel(R) Core(TM) i7-4700MQ CPU @ 2.40GHz RAM size : 15731 MB HDD size : 226.83 GB :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Setup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 17:45:16 ] :: [ PASS ] :: Checking for the presence of lldpd rpm :: [ 17:45:16 ] :: [ LOG ] :: Package versions: :: [ 17:45:16 ] :: [ LOG ] :: lldpd-1.0.1-1.fc28.x86_64 :: [ 17:45:16 ] :: [ PASS ] :: Command 'cp lldpd-tests.py /usr/bin/' (Expected 0, got 0) :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 0s :: Assertions: 2 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Test :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 17:45:16 ] :: [ LOG ] :: lladpd tests :: [ 17:46:21 ] :: [ PASS ] :: Command '/usr/bin/python3 /usr/bin/lldpd-tests.py' (Expected 0, got 0) :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 65s :: Assertions: 1 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Cleanup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 17:46:21 ] :: [ PASS ] :: Command 'rm /usr/bin/lldpd-tests.py' (Expected 0, got 0) :: [ 17:46:21 ] :: [ LOG ] :: lladpd tests done :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 0s :: Assertions: 1 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: unknown :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 17:46:21 ] :: [ LOG ] :: JOURNAL XML: /var/tmp/beakerlib-msOLBiM/journal.xml :: [ 17:46:21 ] :: [ LOG ] :: JOURNAL TXT: /var/tmp/beakerlib-msOLBiM/journal.txt :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 66s :: Phases: 3 good, 0 bad :: OVERALL RESULT: PASS
2018-05-23 12:18:08 +00:00
- hosts: localhost
roles:
- role: standard-test-beakerlib
tags:
- classic
tests:
- miscellaneous-tests
required_packages:
Fix: lldpd name to requuire package list ansible-playbook tests.yml [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' PLAY [localhost] *************************************************************************************************************************************************************************************************** TASK [Gathering Facts] ********************************************************************************************************************************************************************************************* ok: [localhost] TASK [str-common : Check if system is Atomic Host] ***************************************************************************************************************************************************************** ok: [localhost] TASK [str-common : Set fact 'is_atomic'] *************************************************************************************************************************************************************************** ok: [localhost] TASK [str-common : Set facts about system] ************************************************************************************************************************************************************************* ok: [localhost] TASK [str-common : Hardcode Python interpreter for ansible modules on RHEL8 based OS] ****************************************************************************************************************************** skipping: [localhost] TASK [str-common : debug] ****************************************************************************************************************************************************************************************** skipping: [localhost] TASK [str-common : debug] ****************************************************************************************************************************************************************************************** skipping: [localhost] TASK [str-common : debug] ****************************************************************************************************************************************************************************************** skipping: [localhost] TASK [str-common : Add test-runner to ansible inventory] *********************************************************************************************************************************************************** changed: [localhost] TASK [str-common : Gather facts] *********************************************************************************************************************************************************************************** ok: [localhost -> test-runner] TASK [str-common : Set facts about test-runner] ******************************************************************************************************************************************************************** ok: [localhost -> test-runner] TASK [str-common : Hardcode Python interpreter for ansible modules on RHEL8 based OS] ****************************************************************************************************************************** skipping: [localhost] TASK [str-common : Fetch tests from remote repositories] *********************************************************************************************************************************************************** skipping: [localhost] TASK [str-common : debug] ****************************************************************************************************************************************************************************************** skipping: [localhost] TASK [str-common : debug] ****************************************************************************************************************************************************************************************** skipping: [localhost] TASK [str-common : debug] ****************************************************************************************************************************************************************************************** skipping: [localhost] TASK [str-common : debug] ****************************************************************************************************************************************************************************************** skipping: [localhost] TASK [str-common : Build packages lists to be present on test environment] ***************************************************************************************************************************************** ok: [localhost] TASK [str-common : debug] ****************************************************************************************************************************************************************************************** skipping: [localhost] TASK [str-common : include_tasks] ********************************************************************************************************************************************************************************** included: /usr/share/ansible/roles/str-common/tasks/pkgs-dnf.yml for localhost TASK [str-common : Install test-specific package requirements] ***************************************************************************************************************************************************** ok: [localhost] => (item=lldpd) ok: [localhost] => (item=python3) ok: [localhost] => (item=tcpdump) ok: [localhost] => (item=systemd) ok: [localhost] => (item=iproute) TASK [str-common : Install the common requirements on target] ****************************************************************************************************************************************************** ok: [localhost] => (item=rsync) TASK [str-common : Install dnf-utils] ****************************************************************************************************************************************************************************** [WARNING]: Consider using the dnf module rather than running dnf. If you need to use command because dnf is insufficient you can add warn=False to this command task or set command_warnings=False in ansible.cfg to get rid of this message. changed: [localhost] TASK [str-common : Install debuginfo packages] ********************************************************************************************************************************************************************* TASK [str-common : package] **************************************************************************************************************************************************************************************** skipping: [localhost] TASK [str-common : Enable copr repos using DNF] ******************************************************************************************************************************************************************** skipping: [localhost] TASK [str-common : Make artifacts directory] *********************************************************************************************************************************************************************** changed: [localhost] TASK [str-common : Copy tests to test environment] ***************************************************************************************************************************************************************** changed: [localhost] TASK [standard-test-beakerlib : package] *************************************************************************************************************************************************************************** ok: [localhost -> test-runner] TASK [standard-test-beakerlib : shell] ***************************************************************************************************************************************************************************** changed: [localhost -> test-runner] TASK [standard-test-beakerlib : package] *************************************************************************************************************************************************************************** skipping: [localhost] TASK [standard-test-beakerlib : shell] ***************************************************************************************************************************************************************************** skipping: [localhost] TASK [standard-test-beakerlib : Install the beakerlib requirements] ************************************************************************************************************************************************ ok: [localhost -> test-runner] => (item=beakerlib) ok: [localhost -> test-runner] => (item=restraint-rhts) ok: [localhost -> test-runner] => (item=rsync) TASK [standard-test-beakerlib : debug] ***************************************************************************************************************************************************************************** skipping: [localhost] TASK [standard-test-beakerlib : Install the beakerlib requirements to test environment] **************************************************************************************************************************** ok: [localhost] => (item=rsync) ok: [localhost] => (item=findutils) ok: [localhost] => (item=make) changed: [localhost] => (item=libselinux-python) ok: [localhost] => (item=python2-lxml) TASK [standard-test-beakerlib : Put beakerlib binaries to test environment] **************************************************************************************************************************************** ok: [localhost] => (item=/usr/bin/beakerlib-testwatcher) ok: [localhost] => (item=/usr/bin/beakerlib-lsb_release) ok: [localhost] => (item=/usr/bin/beakerlib-journalling) ok: [localhost] => (item=/usr/bin/beakerlib-journalcmp) ok: [localhost] => (item=/usr/bin/beakerlib-rlMemPeak) ok: [localhost] => (item=/usr/bin/beakerlib-rlMemAvg) ok: [localhost] => (item=/usr/bin/beakerlib-deja-summarize) ok: [localhost] => (item=/usr/share/beakerlib/journal.sh) ok: [localhost] => (item=/usr/share/beakerlib/testing.sh) ok: [localhost] => (item=/usr/share/beakerlib/synchronisation.sh) ok: [localhost] => (item=/usr/share/beakerlib/analyze.sh) ok: [localhost] => (item=/usr/share/beakerlib/performance.sh) changed: [localhost] => (item=/usr/share/beakerlib/libraries.sh) ok: [localhost] => (item=/usr/share/beakerlib/dictionary.vim) ok: [localhost] => (item=/usr/share/beakerlib/rpms.sh) ok: [localhost] => (item=/usr/share/beakerlib/storage.sh) changed: [localhost] => (item=/usr/share/beakerlib/beakerlib.sh) ok: [localhost] => (item=/usr/share/beakerlib/virtualX.sh) ok: [localhost] => (item=/usr/share/beakerlib/infrastructure.sh) ok: [localhost] => (item=/usr/share/beakerlib/logging.sh) ok: [localhost] => (item=/usr/bin/rhts-lint) ok: [localhost] => (item=/usr/bin/rhts-submit-log) ok: [localhost] => (item=/usr/bin/rhts-flush) ok: [localhost] => (item=/usr/bin/rhts-recipe-sync-block) ok: [localhost] => (item=/usr/bin/rhts-recipe-sync-set) ok: [localhost] => (item=/usr/bin/rhts-reboot) ok: [localhost] => (item=/usr/bin/rhts-sync-set) ok: [localhost] => (item=/usr/bin/rhts-environment.sh) ok: [localhost] => (item=/usr/bin/rhts-backup) ok: [localhost] => (item=/usr/bin/rhts-abort) ok: [localhost] => (item=/usr/bin/rhts-report-result) changed: [localhost] => (item=/usr/bin/rhts-run-simple-test) ok: [localhost] => (item=/usr/bin/rhts-sync-block) ok: [localhost] => (item=/usr/bin/rhts-restore) ok: [localhost] => (item=/usr/share/rhts/lib/rhts-make.include) ok: [localhost] => (item=/usr/bin/rstrnt-backup) ok: [localhost] => (item=/usr/bin/rstrnt-package) ok: [localhost] => (item=/usr/bin/rstrnt-abort) ok: [localhost] => (item=/usr/bin/rstrnt-adjust-watchdog) ok: [localhost] => (item=/usr/bin/rstrnt-reboot) ok: [localhost] => (item=/usr/bin/rstrnt-sync) ok: [localhost] => (item=/usr/bin/rstrnt-report-log) ok: [localhost] => (item=/usr/bin/rstrnt-restore) ok: [localhost] => (item=/usr/bin/rstrnt-report-result) ok: [localhost] => (item=/usr/share/ansible/roles/standard-test-beakerlib/files/rpm.py) TASK [standard-test-beakerlib : Copy tests to test environment] **************************************************************************************************************************************************** changed: [localhost] TASK [standard-test-beakerlib : Fix up beakerlib at tests environment] ********************************************************************************************************************************************* changed: [localhost] TASK [standard-test-beakerlib : Run beakerlib tests] *************************************************************************************************************************************************************** changed: [localhost] => (item=miscellaneous-tests) TASK [standard-test-beakerlib : Make the master tests summary log artifact] **************************************************************************************************************************************** changed: [localhost] => (item=miscellaneous-tests) TASK [standard-test-beakerlib : include_role] ********************************************************************************************************************************************************************** TASK [str-common : Pull out the logs from test environment to test runner] ***************************************************************************************************************************************** changed: [localhost] TASK [standard-test-beakerlib : Check the results] ***************************************************************************************************************************************************************** changed: [localhost] PLAY RECAP ********************************************************************************************************************************************************************************************************* localhost : ok=25 changed=13 unreachable=0 failed=0 posix on :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: TEST PROTOCOL :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: Package : lldpd Installed : lldpd-1.0.1-1.fc29.x86_64 beakerlib RPM : beakerlib-1.17-13.fc29.noarch Test started : 2018-05-24 01:29:14 IST Test finished : Test duration : Test name : miscellaneous-tests Distro : Fedora release 29 (Rawhide) Hostname : Zeus Architecture : x86_64 CPUs : 1 x Intel(R) Core(TM) i7-4700MQ CPU @ 2.40GHz RAM size : 963 MB HDD size : 6.98 GB :: [ 01:29:14 ] :: [ WARNING ] :: POSIX mode detected and switched off :: [ 01:29:14 ] :: [ WARNING ] :: POSIX mode detected and switched off :: [ 01:29:14 ] :: [ WARNING ] :: Please fix your test to have /bin/bash shebang :: [ 01:29:14 ] :: [ WARNING ] :: Please fix your test to have /bin/bash shebang :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Setup :: Setup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: lldpd-1.0.1-1.fc29.x86_64 :: [ 01:29:14 ] :: [ PASS ] :: Checking for the presence of lldpd rpm :: [ 01:29:14 ] :: [ PASS ] :: Checking for the presence of lldpd rpm :: [ 01:29:14 ] :: [ LOG ] :: Package versions: :: [ 01:29:14 ] :: [ LOG ] :: Package versions: :: [ 01:29:14 ] :: [ LOG ] :: lldpd-1.0.1-1.fc29.x86_64 :: [ 01:29:14 ] :: [ LOG ] :: lldpd-1.0.1-1.fc29.x86_64 :: [ 01:29:14 ] :: [ BEGIN ] :: Running 'cp lldpd-tests.py /usr/bin/' :: [ 01:29:14 ] :: [ PASS ] :: Command 'cp lldpd-tests.py /usr/bin/' (Expected 0, got 0) :: [ 01:29:14 ] :: [ PASS ] :: Command 'cp lldpd-tests.py /usr/bin/' (Expected 0, got 0) :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 0s :: Duration: 0s :: Assertions: 2 good, 0 bad :: Assertions: 2 good, 0 bad :: RESULT: PASS :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Test :: Test :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 01:29:14 ] :: [ LOG ] :: lladpd tests :: [ 01:29:14 ] :: [ LOG ] :: lladpd tests :: [ 01:29:14 ] :: [ BEGIN ] :: Running '/usr/bin/python3 /usr/bin/lldpd-tests.py' test_lldpd_trasmitted_lldp_attributes (__main__.lldpdTests) verify at the other end of veth received LLDP packets that contains attibutes (link address, hostname, TTL, system desc). tcpdump ... reading from file /tmp/lldpd-tcp-dump.pcap, link-type EN10MB (Ethernet) ok test_lldpd_trasmitted_lldp_packets (__main__.lldpdTests) verify at the other end of veth ifname lldpd has received LLDP packets. tcpdump ... reading from file /tmp/lldpd-tcp-dump.pcap, link-type EN10MB (Ethernet) ok test_lldpd_received_lldp_packets_sent_by_systemd_networkd (__main__.lldpdTestsViaNetworkd) ... ok test_systemd_networkd_received_lldp_packets (__main__.lldpdTestsViaNetworkd) ... ok ---------------------------------------------------------------------- Ran 4 tests in 63.926s OK :: [ 01:30:18 ] :: [ PASS ] :: Command '/usr/bin/python3 /usr/bin/lldpd-tests.py' (Expected 0, got 0) :: [ 01:30:18 ] :: [ PASS ] :: Command '/usr/bin/python3 /usr/bin/lldpd-tests.py' (Expected 0, got 0) :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 64s :: Duration: 64s :: Assertions: 1 good, 0 bad :: Assertions: 1 good, 0 bad :: RESULT: PASS :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Cleanup :: Cleanup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 01:30:18 ] :: [ BEGIN ] :: Running 'rm /usr/bin/lldpd-tests.py' :: [ 01:30:18 ] :: [ PASS ] :: Command 'rm /usr/bin/lldpd-tests.py' (Expected 0, got 0) :: [ 01:30:18 ] :: [ PASS ] :: Command 'rm /usr/bin/lldpd-tests.py' (Expected 0, got 0) :: [ 01:30:18 ] :: [ LOG ] :: lladpd tests done :: [ 01:30:18 ] :: [ LOG ] :: lladpd tests done :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 0s :: Duration: 0s :: Assertions: 1 good, 0 bad :: Assertions: 1 good, 0 bad :: RESULT: PASS :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: TEST PROTOCOL :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: Package : lldpd Installed : lldpd-1.0.1-1.fc29.x86_64 beakerlib RPM : beakerlib-1.17-13.fc29.noarch Test started : 2018-05-24 01:29:14 IST Test finished : 2018-05-24 01:30:18 IST (still running) Test duration : 64 seconds Test name : miscellaneous-tests Distro : Fedora release 29 (Rawhide) Hostname : Zeus Architecture : x86_64 CPUs : 1 x Intel(R) Core(TM) i7-4700MQ CPU @ 2.40GHz RAM size : 963 MB HDD size : 6.98 GB :: [ 01:29:14 ] :: [ WARNING ] :: POSIX mode detected and switched off :: [ 01:29:14 ] :: [ WARNING ] :: Please fix your test to have /bin/bash shebang :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Setup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 01:29:14 ] :: [ PASS ] :: Checking for the presence of lldpd rpm :: [ 01:29:14 ] :: [ LOG ] :: Package versions: :: [ 01:29:14 ] :: [ LOG ] :: lldpd-1.0.1-1.fc29.x86_64 :: [ 01:29:14 ] :: [ PASS ] :: Command 'cp lldpd-tests.py /usr/bin/' (Expected 0, got 0) :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 0s :: Assertions: 2 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Test :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 01:29:14 ] :: [ LOG ] :: lladpd tests :: [ 01:30:18 ] :: [ PASS ] :: Command '/usr/bin/python3 /usr/bin/lldpd-tests.py' (Expected 0, got 0) :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 64s :: Assertions: 1 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Cleanup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 01:30:18 ] :: [ PASS ] :: Command 'rm /usr/bin/lldpd-tests.py' (Expected 0, got 0) :: [ 01:30:18 ] :: [ LOG ] :: lladpd tests done :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 0s :: Assertions: 1 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: miscellaneous-tests :: miscellaneous-tests :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 01:30:18 ] :: [ LOG ] :: JOURNAL XML: /var/tmp/beakerlib-o97vwu4/journal.xml :: [ 01:30:18 ] :: [ LOG ] :: JOURNAL XML: /var/tmp/beakerlib-o97vwu4/journal.xml :: [ 01:30:18 ] :: [ LOG ] :: JOURNAL TXT: /var/tmp/beakerlib-o97vwu4/journal.txt :: [ 01:30:18 ] :: [ LOG ] :: JOURNAL TXT: /var/tmp/beakerlib-o97vwu4/journal.txt :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 64s :: Duration: 64s :: Phases: 3 good, 0 bad :: Phases: 3 good, 0 bad :: OVERALL RESULT: PASS :: OVERALL RESULT: PASS
2018-05-23 20:02:05 +00:00
- lldpd
Adds tests according to the CI Justification Adds tests according to the CI wiki specifically the standard test interface in the spec. The playbook includes Tier1 level test cases that have been tested in the following contexts and is passing reliably: Classic. Test logs are stored in the artifacts directory. The following steps are used to execute the tests using the standard test interface: Test enveronment Make sure you have installed packages from the spec ``` ansible-2.4.1.0-2.fc28.noarch python2-dnf-2.7.5-1.fc28.noarch libselinux-python-2.7-2.fc28.x86_64 standard-test-roles-2.5-1.fc28.noarch Run tests for Classic Snip of the example test run for Classic tests: ``` :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Setup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: lldpd-1.0.1-1.fc28.x86_64 :: [ 17:45:16 ] :: [ PASS ] :: Checking for the presence of lldpd rpm :: [ 17:45:16 ] :: [ LOG ] :: Package versions: :: [ 17:45:16 ] :: [ LOG ] :: lldpd-1.0.1-1.fc28.x86_64 :: [ 17:45:16 ] :: [ BEGIN ] :: Running 'cp lldpd-tests.py /usr/bin/' :: [ 17:45:16 ] :: [ PASS ] :: Command 'cp lldpd-tests.py /usr/bin/' (Expected 0, got 0) :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 0s :: Assertions: 2 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Test :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 17:45:16 ] :: [ LOG ] :: lladpd tests :: [ 17:45:16 ] :: [ BEGIN ] :: Running '/usr/bin/python3 /usr/bin/lldpd-tests.py' test_lldpd_trasmitted_lldp_attributes (__main__.lldpdTests) verify at the other end of veth received LLDP packets that contains attibutes (link address, hostname, TTL, system desc). tcpdump ... reading from file /tmp/lldpd-tcp-dump.pcap, link-type EN10MB (Ethernet) ok test_lldpd_trasmitted_lldp_packets (__main__.lldpdTests) verify at the other end of veth ifname lldpd has received LLDP packets. tcpdump ... reading from file /tmp/lldpd-tcp-dump.pcap, link-type EN10MB (Ethernet) ok test_lldpd_received_lldp_packets_sent_by_systemd_networkd (__main__.lldpdTestsViaNetworkd) ... ok test_systemd_networkd_received_lldp_packets (__main__.lldpdTestsViaNetworkd) ... ok ---------------------------------------------------------------------- Ran 4 tests in 64.222s OK :: [ 17:46:21 ] :: [ PASS ] :: Command '/usr/bin/python3 /usr/bin/lldpd-tests.py' (Expected 0, got 0) :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 65s :: Assertions: 1 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Cleanup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 17:46:21 ] :: [ BEGIN ] :: Running 'rm /usr/bin/lldpd-tests.py' :: [ 17:46:21 ] :: [ PASS ] :: Command 'rm /usr/bin/lldpd-tests.py' (Expected 0, got 0) :: [ 17:46:21 ] :: [ LOG ] :: lladpd tests done :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 0s :: Assertions: 1 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: TEST PROTOCOL :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: Package : lldpd Installed : lldpd-1.0.1-1.fc28.x86_64 beakerlib RPM : beakerlib-1.17-13.fc28.noarch Test started : 2018-05-23 17:45:15 IST Test finished : 2018-05-23 17:46:21 IST (still running) Test duration : 66 seconds Test name : unknown Distro : Fedora release 28 (Twenty Eight) Hostname : Zeus Architecture : x86_64 CPUs : 8 x Intel(R) Core(TM) i7-4700MQ CPU @ 2.40GHz RAM size : 15731 MB HDD size : 226.83 GB :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Setup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 17:45:16 ] :: [ PASS ] :: Checking for the presence of lldpd rpm :: [ 17:45:16 ] :: [ LOG ] :: Package versions: :: [ 17:45:16 ] :: [ LOG ] :: lldpd-1.0.1-1.fc28.x86_64 :: [ 17:45:16 ] :: [ PASS ] :: Command 'cp lldpd-tests.py /usr/bin/' (Expected 0, got 0) :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 0s :: Assertions: 2 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Test :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 17:45:16 ] :: [ LOG ] :: lladpd tests :: [ 17:46:21 ] :: [ PASS ] :: Command '/usr/bin/python3 /usr/bin/lldpd-tests.py' (Expected 0, got 0) :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 65s :: Assertions: 1 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Cleanup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 17:46:21 ] :: [ PASS ] :: Command 'rm /usr/bin/lldpd-tests.py' (Expected 0, got 0) :: [ 17:46:21 ] :: [ LOG ] :: lladpd tests done :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 0s :: Assertions: 1 good, 0 bad :: RESULT: PASS :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: unknown :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ 17:46:21 ] :: [ LOG ] :: JOURNAL XML: /var/tmp/beakerlib-msOLBiM/journal.xml :: [ 17:46:21 ] :: [ LOG ] :: JOURNAL TXT: /var/tmp/beakerlib-msOLBiM/journal.txt :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: Duration: 66s :: Phases: 3 good, 0 bad :: OVERALL RESULT: PASS
2018-05-23 12:18:08 +00:00
- python3
- tcpdump
- systemd
- iproute