Commit Graph

20 Commits

Author SHA1 Message Date
Susant Sahani 28fe98a570 Adds tests according to the CI
Justification
Adds tests according to the CI wiki specifically the standard test interface in the spec.
The playbook includes Tier1 level test cases that have been tested in the following contexts and
is passing reliably: Classic. Test logs are stored in the artifacts directory.
The following steps are used to execute the tests using the standard test interface:

Test enveronment
Make sure you have installed packages from the spec
```
ansible-2.4.1.0-2.fc28.noarch
python2-dnf-2.7.5-1.fc28.noarch
libselinux-python-2.7-2.fc28.x86_64
standard-test-roles-2.5-1.fc28.noarch
Run tests for Classic
Snip of the example test run for Classic tests:
```

::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Setup
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

lldpd-1.0.1-1.fc28.x86_64
:: [ 17:45:16 ] :: [   PASS   ] :: Checking for the presence of lldpd rpm
:: [ 17:45:16 ] :: [   LOG    ] :: Package versions:
:: [ 17:45:16 ] :: [   LOG    ] ::   lldpd-1.0.1-1.fc28.x86_64
:: [ 17:45:16 ] :: [  BEGIN   ] :: Running 'cp lldpd-tests.py /usr/bin/'
:: [ 17:45:16 ] :: [   PASS   ] :: Command 'cp lldpd-tests.py /usr/bin/' (Expected 0, got 0)
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Duration: 0s
::   Assertions: 2 good, 0 bad
::   RESULT: PASS

::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Test
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

:: [ 17:45:16 ] :: [   LOG    ] :: lladpd tests
:: [ 17:45:16 ] :: [  BEGIN   ] :: Running '/usr/bin/python3 /usr/bin/lldpd-tests.py'
test_lldpd_trasmitted_lldp_attributes (__main__.lldpdTests)
verify at the other end of veth received LLDP packets that contains attibutes (link address, hostname, TTL, system desc). tcpdump ... reading from file /tmp/lldpd-tcp-dump.pcap, link-type EN10MB (Ethernet)
ok
test_lldpd_trasmitted_lldp_packets (__main__.lldpdTests)
verify at the other end of veth ifname lldpd has received LLDP packets. tcpdump ... reading from file /tmp/lldpd-tcp-dump.pcap, link-type EN10MB (Ethernet)
ok
test_lldpd_received_lldp_packets_sent_by_systemd_networkd (__main__.lldpdTestsViaNetworkd) ... ok
test_systemd_networkd_received_lldp_packets (__main__.lldpdTestsViaNetworkd) ... ok

----------------------------------------------------------------------
Ran 4 tests in 64.222s

OK
:: [ 17:46:21 ] :: [   PASS   ] :: Command '/usr/bin/python3 /usr/bin/lldpd-tests.py' (Expected 0, got 0)
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Duration: 65s
::   Assertions: 1 good, 0 bad
::   RESULT: PASS

::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Cleanup
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

:: [ 17:46:21 ] :: [  BEGIN   ] :: Running 'rm /usr/bin/lldpd-tests.py'
:: [ 17:46:21 ] :: [   PASS   ] :: Command 'rm /usr/bin/lldpd-tests.py' (Expected 0, got 0)
:: [ 17:46:21 ] :: [   LOG    ] :: lladpd tests done
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Duration: 0s
::   Assertions: 1 good, 0 bad
::   RESULT: PASS

::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   TEST PROTOCOL
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

    Package       : lldpd
    Installed     : lldpd-1.0.1-1.fc28.x86_64
    beakerlib RPM : beakerlib-1.17-13.fc28.noarch
    Test started  : 2018-05-23 17:45:15 IST
    Test finished : 2018-05-23 17:46:21 IST (still running)
    Test duration : 66 seconds
    Test name     : unknown
    Distro        : Fedora release 28 (Twenty Eight)
    Hostname      : Zeus
    Architecture  : x86_64
    CPUs          : 8 x Intel(R) Core(TM) i7-4700MQ CPU @ 2.40GHz
    RAM size      : 15731 MB
    HDD size      : 226.83 GB

::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Setup
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

:: [ 17:45:16 ] :: [   PASS   ] :: Checking for the presence of lldpd rpm
:: [ 17:45:16 ] :: [   LOG    ] :: Package versions:
:: [ 17:45:16 ] :: [   LOG    ] ::   lldpd-1.0.1-1.fc28.x86_64
:: [ 17:45:16 ] :: [   PASS   ] :: Command 'cp lldpd-tests.py /usr/bin/' (Expected 0, got 0)
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Duration: 0s
::   Assertions: 2 good, 0 bad
::   RESULT: PASS

::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Test
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

:: [ 17:45:16 ] :: [   LOG    ] :: lladpd tests
:: [ 17:46:21 ] :: [   PASS   ] :: Command '/usr/bin/python3 /usr/bin/lldpd-tests.py' (Expected 0, got 0)
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Duration: 65s
::   Assertions: 1 good, 0 bad
::   RESULT: PASS

::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Cleanup
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

:: [ 17:46:21 ] :: [   PASS   ] :: Command 'rm /usr/bin/lldpd-tests.py' (Expected 0, got 0)
:: [ 17:46:21 ] :: [   LOG    ] :: lladpd tests done
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Duration: 0s
::   Assertions: 1 good, 0 bad
::   RESULT: PASS

::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   unknown
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

:: [ 17:46:21 ] :: [   LOG    ] :: JOURNAL XML: /var/tmp/beakerlib-msOLBiM/journal.xml
:: [ 17:46:21 ] :: [   LOG    ] :: JOURNAL TXT: /var/tmp/beakerlib-msOLBiM/journal.txt
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Duration: 66s
::   Phases: 3 good, 0 bad
::   OVERALL RESULT: PASS
2018-05-23 17:48:08 +05:30
James Hogarth 5211a095d4 update to 1.0.1 2018-04-18 02:08:52 +01:00
Fedora Release Engineering 79dced3f6a - Rebuilt for https://fedoraproject.org/wiki/Fedora_28_Mass_Rebuild
Signed-off-by: Fedora Release Engineering <releng@fedoraproject.org>
2018-02-08 00:01:45 +00:00
James Hogarth ab58163b33 update to 0.9.8 2017-08-21 09:32:56 +01:00
Igor Gnatenko 297d2b100c Rebuilt after RPM update (№ 3)
Signed-off-by: Igor Gnatenko <ignatenko@redhat.com>
2017-08-11 11:09:50 +02:00
Igor Gnatenko 87910f0599 Rebuilt for RPM soname bump
Signed-off-by: Igor Gnatenko <ignatenko@redhat.com>
2017-08-10 22:10:05 +02:00
Igor Gnatenko b702b8bf86 Rebuilt for RPM soname bump
Signed-off-by: Igor Gnatenko <ignatenko@redhat.com>
2017-08-10 20:27:31 +02:00
Fedora Release Engineering 9975eaeeb2 - Rebuilt for https://fedoraproject.org/wiki/Fedora_27_Binutils_Mass_Rebuild 2017-08-03 02:41:22 +00:00
Fedora Release Engineering 8b1f61747b - Rebuilt for https://fedoraproject.org/wiki/Fedora_27_Mass_Rebuild 2017-07-26 20:13:34 +00:00
James Hogarth dfc2385208 bad copy pasta 2017-04-06 01:04:56 +01:00
James Hogarth 72e0ed28fb get the right unit file for the right fedora version 2017-04-06 01:02:13 +01:00
James Hogarth 6414434122 bump rel 2017-04-06 00:27:55 +01:00
James Hogarth 1781f65a8b epel7 systemd complains due to keyword differences 2017-04-06 00:27:13 +01:00
James Hogarth b74be06ceb guidelines require it not to start by default 2017-04-06 00:00:55 +01:00
James Hogarth 5e9eb81f3f actually add the release tarball 2017-04-05 23:39:13 +01:00
James Hogarth 8d0e5e52d5 bring epel6 init file in line with guidelines 2017-04-05 23:34:51 +01:00
James Hogarth a026e25dbb add epel6 conditionals 2017-04-05 23:07:58 +01:00
James Hogarth 7fc6e678ea upstream requested we use the 'official' release tarball which removes the need for autoconf 2017-04-05 22:49:06 +01:00
James Hogarth 13ff48255a Initial import 2017-04-05 16:42:11 +01:00
Fedora Release Engineering 65c178de26 Initial setup of the repo 2017-04-05 15:30:09 +00:00