Commit Graph

528 Commits

Author SHA1 Message Date
Adam Williamson
e82a95813c nightly scripts: Use $DESTDIR more
We set $DESTDIR in all these scripts, but then use its value
several times without just...using it. Let's use it!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-25 12:12:21 +01:00
Adam Williamson
93bf27c8f2 Emit 'location' key in fedmsgs, pointing to compose URL
For fedmsg_meta we have to provide a 'link'. At present we do
this with a rather large and icky pile of conditionals which
doesn't work properly. It's much simpler to figure out the URL
in the compose script and emit it in the fedmsg, then meta can
just...use it. For older fedmsgs we'll just point to the base
kojipkgs location for the link.

For synced composes, we use the synced URL on dl (this matches
what the meta stuff tried to do before). For non-synced composes
we just use the kojipkgs location.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-25 11:00:52 +01:00
Adam Williamson
bdf439a42a Apply cloud, docker and twoweek changes from 27 branch to master
These aren't really used on the master branch, but we may as
well make sure they're up to date, if only so *next* time we
branch we don't regress. These are the changes I made to add the
shortname to fedmsgs, fix exit on failed compose, and clean up
a few other things.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-24 20:59:52 +01:00
Mohan Boddu
2e93359cf2 Adding mariadb-connector-odbc to multilib
Fixes #493

Signed-off-by: Mohan Boddu <mboddu@redhat.com>
2018-01-03 10:33:30 -05:00
Adam Williamson
4347965ab4 fedora-productimg-server is no more, don't try and install it
This is breaking server image creation. **NOTE**: I don't know
if it's correct to remove the whole <buildinstallpackages>
block like this, or leave it there but empty - if we need to
do the latter, I can adjust the PR.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2017-12-20 17:25:18 -08:00
Adam Williamson
ded7d70929 nightly: include shortname in fedmsgs, clean up version vars
The main point here is to include the compose 'shortname' in
compose fedmsgs, as #484 does for post-release compose types.
While doing this I noticed there's rather a lot of mess and
cruft in the various version-related variables here (and a few
others).

`GIT_BRANCH` variable is never used anywhere any more, so it's
removed.

`BRANCH` was never used anywhere, so it is gone. (It appears
to have been added in a25b08c7 but never used). There seemed
to be no useful distinction between `DIST` and `BRANCHED`, and
both actually seem to be used mainly to specify a release
version. The exception is that `BRANCHED` was set to
"Modular-Bikeshed" in nightly-modular.sh , but there is no
justification for this that I can find, and its only practical
use was as the value of the `branch` key in fedmsgs. So far as
I can figure out, the original purpose of the `branch` key was
for when we sent out `compose.branched.(foo)` fedmsgs - it
was e.g. 'f18' when Branched was Fedora 18. As we now don't
send out `compose.branched` messages any more, but include the
release number in the message topic for Branched messages
(e.g. `compose.27`), this purpose no longer applies. So the
key just doesn't seem to have any particular use at all any
more, and I don't think changing its value will have any real
consequences.

Thus, `BRANCH`, `BRANCHED` and `DIST` are replaced by `RELEASE`
and `RELEASE_TITLE`, which specify the release version. Their
values will be identical for numerical release versions, but
for Rawhide and Bikeshed we need to know both the lower-case
and title-case versions of the name; RELEASE_TITLE is the
title-case version.

We use `$SHORT-$RELEASE_TITLE` to replace several instances
of hardcoding in the scripts (e.g. Fedora-Modular-Bikeshed).

The `ATOMIC`, `ATOMICREPO` and `ATOMICDEST` variables that were
blindly copied from nightly.sh to nightly-modular.sh, but never
actually used in it, are also removed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2017-12-04 17:57:16 -08:00
Adam Williamson
e0fb303122 Bail after failed compose in nightly-modular.sh
When nightly-modular.sh was added, it wasn't set to check the
exit code from pungi-koji, as nightly.sh does. This was I guess
because it didn't do much after the compose finished at that
time, and the author thought it was OK for the few things it
*did* do to happen on both successful and failed composes.

However, it now does more stuff after compose completion, like
nightly.sh, including trying to generate changelog files and
send out a compose report email. But because the pungi-koji
exit code check is missing, it tries to do these things even
for failed composes. Changelog generation will fail when the
compose failed, and the email that gets sent out will have a
missing compose ID (because NEWCOMPOSE_ID and SHORTCOMPOSE_ID
can't be set properly and will be blank), and will be empty
because the changelog file that's supposed to be read in as the
content of the email isn't there. This is why we are getting
an empty mail with subject "Fedora Modular bikeshed compose
report:  changes" every time a compose fails.

So, let's put that check in just like nightly.sh does.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2017-12-04 14:08:15 -08:00
Kevin Fenzi
755b505664 Merge #457 Revert "Do not block retired packages for now" 2017-11-28 18:23:18 +00:00
Nils Philippsen
41129ed9c7 add system-tools:master
Signed-off-by: Nils Philippsen <nils@redhat.com>
2017-11-20 17:02:29 +01:00
Mohan Boddu
b5869f393a Revert "Do not block retired packages for now"
We have a release now, so we can revert this commit and start
blocking retired packages

This reverts commit 35bc52d14b.

Signed-off-by: Mohan Boddu <mboddu@redhat.com>
2017-11-15 10:48:45 -05:00
Robert Marshall
53f131ee82 Let pungi produce comps file in rawhide composes
- change comps_file setting in the fedora.conf to use the new scm_dict
  type from the latest pungi release
- remove the make step from the nightly shell script

Signed-off-by: Robert Marshall <rmarshall@redhat.com>
2017-11-13 16:31:50 -05:00
Petr Písař
36ce1bad59 variants-modular: add cmake-master
Signed-off-by: Petr Písař <ppisar@redhat.com>
2017-11-10 14:28:05 +01:00
Patrick Uiterwijk
35bc52d14b Do not block retired packages for now
Signed-off-by: Patrick Uiterwijk <patrick@puiterwijk.org>
2017-11-03 19:22:15 +01:00
Igor Gnatenko
f0529c5f40 variants-modular: add libtom:master
Signed-off-by: Igor Gnatenko <ignatenkobrain@fedoraproject.org>
2017-11-02 17:24:54 +01:00
Tomas Mlcoch
9f318be95e Send email reports about bikeshed composes
Note: depcheck logs are ignored for now.
Details: https://pagure.io/releng/issue/7074

Signed-off-by: Tomas Mlcoch <tmlcoch@redhat.com>
2017-10-13 12:46:13 +02:00
Igor Gnatenko
84b3aab261 variants-modular: add meson:master
Signed-off-by: Igor Gnatenko <ignatenkobrain@fedoraproject.org>
2017-10-12 17:37:57 +02:00
James Antill
1e410d5852 Add the missing modules: maven,mysql,ninja,nodejs.
Signed-off-by: James Antill <james@fedoraproject.org>
2017-10-09 16:36:49 -04:00
Dennis Gilmore
eb85dbf93a do not skip live_images phase
in order to make the 32 bit arm server image we need to run the
live_images phase.

Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2017-10-06 15:51:52 -05:00
Dennis Gilmore
2a5d906046 Merge #396 Getting rid of "live_target", will fallback to global setting. For https://pagure.io/releng/issue/7074 2017-10-05 15:51:14 +00:00
Dennis Gilmore
cc966a963f rename minimal container subvariant
The subvariants need to be uniqure and Container_Base
is not really valid for Container_Minimal. So rename it.

Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2017-10-05 09:39:49 -05:00
Rashmi Nargundkar
cfed7ddd33 Getting rid of "live_target", will fallback to global setting. For https://pagure.io/releng/issue/7074
Signed-off-by: Rashmi Nargundkar <rnargund@redhat.com>
2017-10-05 10:28:05 -04:00
Tomas Mlcoch
f6c66b201a Rsync bikeshed to /pub/fedora/linux/development/ in nightly-modular.sh
Part of https://pagure.io/releng/issue/7074

Signed-off-by: Tomas Mlcoch <tmlcoch@redhat.com>
2017-10-04 20:41:53 +02:00
Tomas Mlcoch
5eca04913a Rename Rawhide -> Bikeshed in nightly-modular.sh
Part of https://pagure.io/releng/issue/7074

Signed-off-by: Tomas Mlcoch <tmlcoch@redhat.com>
2017-10-04 18:32:27 +02:00
Dennis Gilmore
58799ad68e Merge #393 Update the modular configuration file to use newly created kickstart(fedora-modular-arm-server.ks). For issue : https://pagure.io/releng/issue/7074 2017-10-04 16:25:04 +00:00
Rashmi Nargundkar
0ed87c41ab Update the modular configuration file to use newly created kickstart(fedora-modular-arm-server.ks). For issue : https://pagure.io/releng/issue/7074
Signed-off-by: Rashmi Nargundkar <rnargund@redhat.com>
2017-10-04 12:02:01 -04:00
Tomas Mlcoch
2f65b2844c Rename Rawhide -> Bikeshed in fedora-modular.conf
Part of https://pagure.io/releng/issue/7074

Signed-off-by: Tomas Mlcoch <tmlcoch@redhat.com>
2017-10-04 17:58:30 +02:00
Dennis Gilmore
f9183f6fab Merge #391 Configure 32 bit arm images using appliance-creator for https://pagure.io/releng/issue/7074 2017-10-04 15:26:59 +00:00
Rashmi Nargundkar
1a38291bab Configure 32 bit arm images using appliance-creator for https://pagure.io/releng/issue/7074
Signed-off-by: Rashmi Nargundkar <rnargund@redhat.com>
2017-10-03 17:06:08 -04:00
Dennis Gilmore
3ed79f4ac5 Merge #382 Server being non blocking variant 2017-10-03 21:03:32 +00:00
langdon
56c3671c94 adding in new modules to the modular compose.
Signed-off-by: langdon langdon@fedoraproject.org
2017-10-03 14:39:15 -04:00
Till Maas
a5a1994895 Explicitly select koji profile
This is required to adjust to
https://pagure.io/releng/pull-request/7059

Signed-off-by: Till Maas <opensource@till.name>
2017-09-28 23:15:46 +02:00
Mohan Boddu
59948a3b7c Server being non blocking variant
Signed-off-by: Mohan Boddu <mboddu@redhat.com>
2017-09-28 16:05:01 -04:00
Rashmi Nargundkar
897f776932 enable createiso generation on all arches and volume id substitution for bikeshed
Fixing createiso enablement for https://pagure.io/releng/issue/7074

Signed-off-by: Rashmi Nargundkar <rnargund@redhat.com>
2017-09-28 15:01:05 -04:00
Dennis Gilmore
c1d809e8e9 Merge #377 Add virtualization to workstation comps 2017-09-27 21:19:42 +00:00
Kevin Fenzi
0d8338db69 Merge #342 Set the gather_profiler option. 2017-09-27 17:26:23 +00:00
Colin Walters
818b3b1965 Add virtualization to workstation comps
So that we can install `virt-client` in workstationostree by default.

Depends: https://pagure.io/fedora-comps/pull-request/175
Signed-off-by: Colin Walters <walters@verbum.org>
2017-09-27 11:41:10 -04:00
Dennis Gilmore
33e77931e7 modular compoase fixups
set the distags in containers correctly
build images for more arches
Rename Docker to Container
build minimal and base container images

Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2017-09-27 09:54:03 -05:00
Lubomír Sedlář
968f8fdf52 Wait for ostree to be signed before using it
Images should include signed bits, so we need to block the compose until
the commit is signed.

Related: https://pagure.io/pungi/issue/650
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-09-21 07:52:33 +02:00
Petr Šabata
2f2a187f60 Update modular variants
Dropping shim because we decided to ship the traditional, signed Fedora
version in this release.  Adding hardware-support, which carries
dependencies for the installer, and adding perl, which is required by
hardware-support.

Also reordering the list so it's easier to read.

Signed-off-by: Petr Šabata <contyk@redhat.com>
2017-09-20 19:51:33 +02:00
Dusty Mabe
ffa5fd956e
Revert "fedora: Use Atomic installtree/ISO for cloud image builds"
We can't use the Atomic Host installer image because it runs at the
same time the image builds do. See [1].

[1] https://src.fedoraproject.org/rpms/pungi/pull-request/://docs.pagure.org/pungi/phases.html

This reverts commit 97b45259db.

Signed-off-by: Dusty Mabe <dusty@dustymabe.com>
2017-09-15 18:09:57 -04:00
Dusty Mabe
ea7b045988
nightly: prune atomic workstation
This adds pruning for atomic workstation. We don't yet rsync atomic
workstation out like we do for atomic host. I'm not sure why but didn't
want to add that as part of this commit.

Signed-off-by: Dusty Mabe <dusty@dustymabe.com>
2017-09-15 08:40:17 -04:00
Dusty Mabe
2726280e0c
nightly: use Atomic Host in variables
Signed-off-by: Dusty Mabe <dusty@dustymabe.com>
2017-09-15 08:37:56 -04:00
Colin Walters
97b45259db fedora: Use Atomic installtree/ISO for cloud image builds
This will enable the optimizations landed in
https://github.com/rhinstaller/anaconda/pull/1119
to avoid lots of HTTP requests when installing the cloud images.

Signed-off-by: Colin Walters <walters@verbum.org>
2017-09-14 15:04:04 -04:00
Lubomír Sedlář
e8ea945776 Shorted WorkstationOstree in volume ID
Since this is basically a workaround, it should look like it was part of
regular Workstation.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-09-14 07:52:53 +02:00
Lubomír Sedlář
45e48488f4 Fix broken deps e-mail header for future releases
Instead of having to add the `--treename` argument after each branching,
let the script compute it automatically.

Relates: https://pagure.io/pungi-fedora/issue/350
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-09-11 11:10:34 +02:00
Peter Robinson
eb8b2cb76b drop ppc64 docker images, we dropped them in the past because the docker binaries aren't build for ppc64 BE but they've somehow come back
Signed-off-by: Peter Robinson <pbrobinson@fedoraproject.org>
2017-09-10 16:34:44 +01:00
Lubomír Sedlář
c1a92cd21f Move Workstation Ostree installer to separate variant
Creating the image requires running lorax. There is however already one
lorax instance being run in the buildinstall phase. When the second one
runs, it overwrites the outputs from first one and people expecting to
boot netinst over PXE are instead getting ostree workstation.

Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1477916
Relates: https://pagure.io/pungi/issue/695
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-09-07 15:29:56 +02:00
Lubomír Sedlář
f39dd56b5a Use dnf repoclosure
Instead of the old version provided by Yum.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-09-07 08:36:14 +02:00
Ralph Bean
6fa7d7fe81 Include the installer module in the modular rawhide compose, for images!
Signed-off-by: Ralph Bean <rbean@redhat.com>
2017-09-06 14:33:04 -04:00
Ralph Bean
bcc04edb34 Set the gather_profiler option.
See https://pagure.io/pungi/pull-request/727

Once that is merged, released, and deployed, this change will let us see
New and Fascinating Details about the compose process.

Signed-off-by: Ralph Bean <rbean@redhat.com>
2017-09-01 20:09:27 -04:00