Commit Graph

54 Commits

Author SHA1 Message Date
Adam Williamson
08243564f3 cloud: set Google root size to 10 GB and EC2 back to 5 GB
It's the *Google* image that's required to have a 10 GB root
for performance reasons, not the EC2 image, as the comment says,
but the change was inadvertently applied to the EC2 image not
the Google one. This means our Google image is slow and our EC2
images are failing to be published as AMIs.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-20 09:10:53 -07:00
Jeremy Cline
319e5e8153 container: update package list to match f39 more closely
Gary Buhrmaster noticed gzip was missing from the Fedora 40 container.
An extremely quick and gross diff produced by doing:

podman run -it --rm --entrypoint /usr/bin/rpm fedora:39 -qa \
  | sort | uniq | awk '{ split($0,a,"-[0-9]"); print a[1] }' > f39.txt

shows the following for Fedora Minimal 39 -> 40:

-abattis-cantarell-vf-fonts
+audit-libs
-default-fonts-core-sans
-fonts-filesystem
-google-noto-fonts-common
-google-noto-sans-mono-vf-fonts
-google-noto-sans-vf-fonts
-google-noto-serif-vf-fonts
-gpg-pubkey
+gpg-pubkey-a15b79cc
+json-c
-langpacks-core-en
-langpacks-en
-langpacks-fonts-en
+libcap-ng
+libeconf
-libsigsegv
+libtool-ltdl
+pam-libs
-systemd-libs
-util-linux-core
-zlib
+zlib-ng-compat

For Fedora 39 -> 40:

-authselect
-authselect-libs
-cracklib
-gpg-pubkey
+gpg-pubkey-a15b79cc
-gzip
-libdb
-libpwquality
-libsigsegv
+libtool-ltdl
-pam
-sudo
-systemd-libs
-util-linux-core
-zlib
+zlib-ng-compat

This adds gzip and sudo back to the non-minimal container, as well as
bzip2, xz, and zstd to round out the set of [de]compression tools.
2024-03-18 11:57:38 -04:00
Kevin Fenzi
92b028992c Keep kbd-misc for now
On ppc64le, power-utils is pulled in by being default in Core group.
This in turn pulls in power-utils-core, which pulls in systemd-udev.
When kiwi goes to remove kbd-misc on ppc64le only, it fails because
systemd-udev is a protected package. On other arches since it's not
installed, it works.

So, we are going to just drop this for now and revisit solutions after
Beta is out the door.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-03-13 17:41:55 -07:00
Neal Gompa
ac559c73fd teams/cloud/container: Add name labels for the containers
These were accidentally omitted when they were ported over.
2024-03-12 22:13:14 -04:00
Neal Gompa
ff7affb890 teams/cloud/container: Filter out mesa-va-drivers for s390x for Toolbox
VA-API does not exist in s390x, so we need this filtered out for
that architecture.
2024-03-12 07:14:11 -04:00
Neal Gompa
12cb853ad9 Add s390x variant for Cloud-Base-Generic
This allows building cloud images for Z systems.
2024-03-11 21:36:23 -04:00
Debarshi Ray
734e5d0679 teams/cloud/container: Use vim-minimal, not vim-enhanced, for Toolbx
Fedora Silverblue and Workstation [1], and so the Container/Dockerfile
and Kickstart [2] equivalents of the fedora-toolbox OCI images, contain
vim-minimal by default, not vim-enhanced.  This is because the default
editor is GNU nano, not Vim [3].

[1] https://pagure.io/fedora-comps/

[2] fedora-kickstarts commit d6aac886a01ae625
    https://pagure.io/fedora-kickstarts/c/d6aac886a01ae625
    https://pagure.io/fedora-kickstarts/pull-request/1003

[3] https://fedoraproject.org/wiki/Changes/UseNanoByDefault

https://pagure.io/fedora-kiwi-descriptions/pull-request/24
2024-03-11 17:36:58 +01:00
Debarshi Ray
5eddb74619 teams/cloud/container: Use 'toolbx' as VARIANT_ID in os-release(5)
The same change was made to the Kickstart equivalent of the
fedora-toolbox:41 OCI image recently [1].

This is meant to distinguish OCI containers and images that are designed
specifically for Toolbx from others.  Toolbx containers are long-lasting
pet containers for interactive command line use, which makes them
substantially different from short-lived containers running services.

Therefore, it can be useful to be able to identify Toolbx containers and
images when generating statistics about Fedora usage.

[1] fedora-kickstarts commit 0d99c64eb2721c5b
    https://pagure.io/fedora-kickstarts/c/0d99c64eb2721c5b
    https://pagure.io/fedora-kickstarts/pull-request/1015

https://pagure.io/Fedora-Council/tickets/issue/449
2024-03-11 16:03:20 +01:00
Debarshi Ray
4a5017422f teams/cloud/container: Drop zstd from Toolbx
The zstd RPM is neither part of the default Fedora Silverblue
and Workstation installation [1], nor the Container/Dockerfile and
Kickstart equivalents of the fedora-toolbox images [2,3].  Therefore,
there's no need to need to include it in the KIWI description.

Fallout from d27e4c3f6c

[1] https://pagure.io/fedora-comps/

[2] https://src.fedoraproject.org/container/fedora-toolbox
    https://github.com/containers/toolbox/tree/main/images/fedora

[3] https://pagure.io/fedora-kickstarts/blob/main/f/fedora-container-toolbox.ks

https://pagure.io/fedora-kiwi-descriptions/pull-request/21
2024-03-11 15:51:30 +01:00
Debarshi Ray
e44856603d teams/cloud/container: Install languages & weak dependencies for Toolbx
The Container/Dockerfile and Kickstart equivalents of the fedora-toolbox
OCI images installed all locale definitions, translations, and weak
dependencies (barring exceptions) [1,2].  In fact, the Containerfile
tried very hard to restore any content that was stripped out by the
fedora base image.  Hence, the KIWI descriptions should do the same.

Sometimes, like in the case of the gawk and gawk-all-langpacks RPMs,
skipping weak dependencies also strips out translations.

The Kickstart files did this by decoupling fedora-container-common.ks
from fedora-container-common.ks [3], and this is the KIWI equivalent of
the same change.

The separate 'packages' elements of types 'bootstrap' and 'image' [4]
are no longer needed and have been fused into one.  This avoids the need
to specify the 'ignore' child elements separately.

This change has two workarounds that deserve mention.

First, enabling weak dependencies for the packages that used to come
from the ContainerCore profile pulls in systemd, and config.xml
specifies a keytable for all the KIWI descriptions.  These two combined
makes KIWI try to set the keymap/keytable using systemd-firstboot(1),
and it fails the build with:
  [ INFO    ]: Setting up keytable:
  [ DEBUG   ]: EXEC: [chroot /path/to/image-root systemd-firstboot --help]
  [ DEBUG   ]: EXEC: [chroot /path/to/image-root systemd-firstboot --keymap=us]
  [ DEBUG   ]: EXEC: Failed with stderr: Keymap us is not installed.
  , stdout: (no output on stdout)
  [ ERROR   ]: KiwiCommandError: chroot: stderr: Keymap us is not installed.
  , stdout: (no output on stdout)

This has been worked around by making the keymaps available during the
image build through the kbd-misc RPM, which is later uninstalled.

Second, KIWI isn't passing the 'ignore' child elements to DNF [5], and
hence they currently have no effect.  This has been worked around by
uninstalling the RPMs later.

Some noteworthy changes in the list of RPMs in the fedora-toolbox image
after this change:
   ...
  +gawk-all-langpacks-5.3.0-3.fc40.x86_64
   ...
  -glibc-2.39.9000-5.fc41.i686
  -glibc-gconv-extra-2.39.9000-5.fc41.i686
  -glibc-minimal-langpack-2.39.9000-5.fc41.x86_64
   ...
  -libgcc-14.0.1-0.8.fc41.i686
   ...
  +python-unversioned-command-3.12.2-2.fc41.noarch

They are all in line with the latest Kickstart equivalent of the image.

[1] https://src.fedoraproject.org/container/fedora-toolbox
    https://github.com/containers/toolbox/tree/main/images/fedora

[2] https://pagure.io/fedora-kickstarts/blob/main/f/fedora-container-toolbox.ks

[3] fedora-kickstarts commit 30f76d387d9e7f5c
    https://pagure.io/fedora-kickstarts/c/30f76d387d9e7f5c
    https://pagure.io/fedora-kickstarts/pull-request/1002

[4] https://osinside.github.io/kiwi/concept_and_workflow/packages.html

[5] https://github.com/OSInside/kiwi/issues/2499

https://pagure.io/fedora-kiwi-descriptions/pull-request/21
2024-03-11 15:27:09 +01:00
Debarshi Ray
5966419ca5 VARIANTS: Fix the image type of the container images
Otherwise, the build fails with:
  $ sudo kiwi-ng \
           --type tbz \
           --profile Container-Toolbox \
           system build \
           --description . \
           --target-dir ./outdir
  [ INFO    ]: 01:40:41 | Reading runtime config file: '/etc/kiwi.yml'
  [ INFO    ]: 01:40:41 | Loading XML description
  [ INFO    ]: 01:40:41 | Support for multiple markup descriptions
                          available
  [ ERROR   ]: 01:40:41 | KiwiTypeNotFound: Build type 'tbz' not found
                          for applied profiles: ['Container-Toolbox',
                          'ContainerCore']

Fallout from 0becdd4d43

https://pagure.io/fedora-kiwi-descriptions/pull-request/20
2024-03-07 01:48:32 +01:00
Neal Gompa
0becdd4d43 teams/cloud/container, tmt: Build the container images as OCI images
This incorporates the labels that are expected for Fedora images.
2024-03-06 17:41:28 -05:00
Neal Gompa
31d0b2a70f teams/cloud/cloud: Bump the Google Cloud image to 10G
Anything lower than that causes performance problems.
2024-03-06 13:51:35 -05:00
Neal Gompa
31f9f8a743 components/boot: Force grubby at bootstrap phase
If no preference is expressed, sdubby will be selected instead of
grubby, which breaks image builds. Thus, install grubby early to
avoid this issue.
2024-03-04 21:25:39 -05:00
Neal Gompa
b558e172c1 Install fedora-release-* at bootstrap phase for various images
This ensures that the correct variant packages are installed.
2024-03-04 20:18:11 -05:00
Jeremy Cline
f874d413eb No longer enable waagent.service via config.sh
The service is now enabled via systemd presets.
2024-02-29 11:24:53 -05:00
Neal Gompa
4f5bafccf3 tmt: Install kiwi-systemdeps for containers and disk images
These are needed for the images currently being validated in CI.
2024-02-24 14:57:26 -05:00
Neal Gompa
12275dff55 Add ppc64le variant for Cloud-Base-Generic
This allows building cloud images for POWER systems.
2024-02-24 14:57:26 -05:00
Neal Gompa
3ac0ae9240 teams/cloud: Define compatible architectures for existing profiles
Most of the Fedora Cloud-owned profiles are limited to a subset of
architectures, generally x86_64 and aarch64 (with the exception of
the VirtualBox Vagrant image, which is x86_64 only).
2024-02-24 14:57:26 -05:00
Neal Gompa
ce013b2c21 components/desktops/mate: Switch from earlyoom to systemd-oomd 2024-02-24 14:29:45 -05:00
Neal Gompa
7cc5101bcc Rename MATE desktop snippets from MATE-Compiz to MATE
This prepares for the future change to another compositor with Wayland.
2024-02-24 14:29:39 -05:00
Neal Gompa
7235c1e6f4 teams/cloud: Reformat profile image types for readability
This makes it easier to read what all the settings are.
2024-02-23 05:15:15 -05:00
Neal Gompa
10d4f7c9ae components/boot: Drop duplicate profiles section
Multiple profiles can be defined in a profiles section.
2024-02-22 19:49:16 -05:00
Neal Gompa
bc0a22eae0 Set version to Rawhide 2024-02-22 19:45:01 -05:00
Jeremy Cline
9322f54b49 azure: install the hyperv-daemons package
This pulls in a number of services to integrate a guest running under
Hyper-V. These services are all automatically activated via udev rules.
2024-02-23 00:31:35 +00:00
Jeremy Cline
83a43059d3 azure: support accelerated networking feature
Azure provides an optional "Accelerated Networking" feature. Enabling
this feature when creating a VM enables SR-IOV and provides the guest
with a virtual function.

Supporting this requires two changes. Firstly, the kernel-modules
package is required as it contains the Mellanox drivers required for the
VF provided to the guest. Secondly, the interface needs to be ignored by
NetworkManager or it'll try and fail to bring up the device and the VM
will be unreachable except by serial console. If this is observed, it's
likely new hardware has been deployed and additional drivers need to be
added to the NetworkManager config.

See https://learn.microsoft.com/en-us/azure/virtual-network/accelerated-networking-overview
for details.
2024-02-23 00:31:35 +00:00
Jeremy Cline
d9584ccd70 azure: ensure early boot messages are directed to the serial console
In the event that there's an issue with early boot, setting
earlyprintk=ttyS0 ensures that the messages are routed to the serial
console so it can be debugged.

This particular option is documented as required in the Azure VM
certification FAQ[0].

[0] https://learn.microsoft.com/en-us/partner-center/marketplace/azure-vm-certification-faq#linux-test-cases
2024-02-23 00:31:35 +00:00
Jeremy Cline
78ea0154a4 azure: enable the Azure Linux Agent service
The WALinuxAgent package was already being installed, but the service
was enabled. This ensures it'll start when the VM is created.
2024-02-23 00:31:35 +00:00
Neal Gompa
7497716476 Reorganize configuration around Fedora teams
This realigns the configuration into separate files/folders that
would be modified by specific teams (e.g. WGs and SIGs).
2024-02-22 19:15:21 -05:00
Gerd Hoffmann
41c9052e09 tmt: add test plan for Cloud-Base-UEFI-UKI
Signed-off-by: Gerd Hoffmann <kraxel@redhat.com>
2024-01-25 15:41:02 +01:00
Gerd Hoffmann
1de547fc3d platforms/cloud: add Cloud-Base-UEFI-UKI profile
This is a variation of Cloud-Base-Generic which boots using UKIs.

This also adds uki-editbootconfig.sh script which makes the
image bootable via "UEFI firmware -> shim.efi -> UKI.efi".

Some background information:
https://fedoraproject.org/wiki/Changes/Unified_Kernel_Support_Phase_2

Signed-off-by: Gerd Hoffmann <kraxel@redhat.com>
2024-01-25 15:06:58 +01:00
Neal Gompa
573870b3a4 platforms/workstation: Add live media variants for numerous desktops
This enables building live ISO images for all the various spins.
2024-01-13 17:09:35 -05:00
Neal Gompa
74f06fd207 config.sh: Add configuration for numerous desktops
This makes adjustments for the script part for configuring images
of the various desktops.
2024-01-13 17:03:41 -05:00
Neal Gompa
30ef6928bf components/desktop-environments, config.sh: Add SoaS variant
This adds the basic configuration for Sugar on a Stick.
2024-01-13 16:56:47 -05:00
Neal Gompa
3dcd3d2240 components/desktop-environments: Add numerous desktop environments
This adds desktop environments that are the basis of existing Fedora
Linux spins.
2024-01-13 16:39:49 -05:00
Neal Gompa
6226513d97 components/desktop-environments: kde: Add kde-spin-initial-setup
The initial-setup packages for firstboot were split into their own
comps group that ensures initial-setup-gui is configured to use
kwin as the Wayland compositor.
2024-01-13 16:39:49 -05:00
Neal Gompa
14d8288472 Add maintainers.toml
This contains the somewhat current reference of the current maintainers
of the various spins.
2024-01-13 16:39:49 -05:00
Neal Gompa
ed9fd4f4f7 Split documentation of variants into its own file
As the list of buildable variants grows, it will be harder to maintain
in the main README. Thus, split it out to its own file to keep the
README manageable.
2024-01-13 16:39:49 -05:00
Neal Gompa
c41b562b10 tmt/tests/build-image: Purge the image working root after the build
Once the image build is done, we do not need the working tree
anymore and leaving it around causes it to get archived at the
end of CI runs when it is totally unneeded.
2024-01-13 05:13:42 -05:00
Neal Gompa
11e6913afa root/etc/fstab.script: Drop SELinux labeling workaround
This has been fixed properly with kiwi 9.25.21.
2024-01-13 05:13:42 -05:00
Neal Gompa
824d61365f Rename Fedora-Linux to Fedora
This makes the various name+profile combinations more closely
match their official names.
2024-01-13 05:11:48 -05:00
Neal Gompa
d27e4c3f6c Add base container definitions
This adds the definitions for building the container tarballs for
the base container, the minimal base container, and the toolbox
container.
2024-01-07 22:16:11 -05:00
Neal Gompa
e6896b13c2 platforms, tmt: Rename and restructure cloud variants
We now have more than one cloud system that is essentially a KVM
environment that uses cloud-init to boot, so now we declare that
"generic" and have the OpenStack and Oracle images reuse those
definitions.

Also, in preparation for layered cloud image variants, rename
them from "Cloud-" to "Cloud-Base-". Vagrant variants are
similarly prefixed to make it clear who provides them.

Finally, restructure the layout of the tmt plans to match the
description structure.
2023-12-21 09:04:37 -05:00
Neal Gompa
f9b944d050 README: Add link to Zuul instance in CI section 2023-12-20 08:41:58 -05:00
Neal Gompa
b5003bffbe Add Zuul CI configuration
This allows us to have pull requests tested before we review changes
to merge.
2023-12-20 07:55:40 -05:00
Neal Gompa
724d3376e7 components/boot: Explicitly select grubby
This avoids issues caused by the existence of grubby and sdubby.
2023-12-19 15:54:30 -05:00
Neal Gompa
80a1081de6 kiwi-build: Add support for setting the kiwi description directory
Generally, the kiwi descriptions are in the same directory, but
when this script is being called out-of-tree, it needs to be told
where they are.
2023-12-19 15:29:19 -05:00
Neal Gompa
f5632edf2b platforms/cloud: Add Oracle Cloud image
Oracle Cloud images are KVM cloud images, just like the OpenStack
images. Reuse the OpenStack image definition for Oracle Cloud.
2023-10-14 16:50:29 -04:00
Neal Gompa
118e70f9db platforms/vagrant: Define Vagrant images for libvirt and VirtualBox
KIWI differentiates between libvirt and VirtualBox based Vagrant
images, especially for the box format, so now we split up the
Vagrant definition accordingly.
2023-10-14 16:30:57 -04:00
Neal Gompa
48c770ad56 platforms/vagrant: Remove cloud-init
This is not used for Vagrant.
2023-10-14 16:08:29 -04:00