Commit Graph

91 Commits

Author SHA1 Message Date
Mohan Boddu
bee13ff719 Sync Server to /pub/fedora-secondary/releases/development/{release}
Caused by https://pagure.io/pungi-fedora/c/d7476ad444c35d62ebe9bbe0654503bbe8820c55?branch=f28

Signed-off-by: Mohan Boddu <mboddu@redhat.com>
2018-03-30 09:00:51 -04:00
Dennis Gilmore
718c3613f1 alt arch syncing fixes
sync the Everything variant for alt arches again, somehow it got dropped.
link t the alt arch Everything variant as well as the primary variant
makes sure noarch rpms are hardlinked and arch specific ones are as well.

Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2018-03-11 12:14:33 -05:00
Dusty Mabe
ceac7427a0
nightly.sh: Fixup syncing for Cloud/CloudImages change
Signed-off-by: Dusty Mabe <dusty@dustymabe.com>
2018-03-10 13:17:28 -05:00
Dusty Mabe
aca3898446
nightly.sh: update ostree summary file after sync
Signed-off-by: Dusty Mabe <dusty@dustymabe.com>
2018-03-09 12:34:31 -05:00
Dusty Mabe
cf4bbe8124
fedora.conf: atomic: move to unified ostree repo structure
We move to /compose/atomic/repo for the compose time repo and to
/atomic/repo for the production/user repo. See [1].

[1] https://lists.fedoraproject.org/archives/list/rel-eng@lists.fedoraproject.org/thread/KLN5L33BIR3ZEHC5RIG4NXGO7LT6HBXJ/

Signed-off-by: Dusty Mabe <dusty@dustymabe.com>
2018-03-06 08:37:02 -05:00
Dusty Mabe
29a984ac28
remove unused variable from nightly.sh
Signed-off-by: Dusty Mabe <dusty@dustymabe.com>
2018-03-06 08:37:02 -05:00
Dusty Mabe
3c489e6d91
remove ostree pruning from nightly.sh
We'll do that now in a more centralized manner now that we are
moving to a unified ostree repo setup.

See https://pagure.io/releng/pull-request/7366

Signed-off-by: Dusty Mabe <dusty@dustymabe.com>
2018-03-06 08:36:59 -05:00
Mohan Boddu
aa12f364de Fixing syncing and aarch64 comment
Signed-off-by: Mohan Boddu <mboddu@redhat.com>
2018-03-05 15:08:38 -05:00
Dusty Mabe
ab51305963
sync AtomicWorkstation media
Signed-off-by: Dusty Mabe <dusty@dustymabe.com>
2018-03-02 16:03:41 -05:00
Dusty Mabe
42f90b2e42
rename atomic* variants
Move Atomic to AtomicHost and WorkstationOstree to
AtomicWorkstation. This is mostly to make things align
more with the names of the things we actually put out.

Signed-off-by: Dusty Mabe <dusty@dustymabe.com>
2018-03-02 15:13:45 -05:00
Patrick Uiterwijk
59f71680e9 Remove quotes so Bash does globbing
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2018-03-01 23:03:20 +01:00
Dennis Gilmore
a2a61c978d no longer sync blocking to docker tags, they are not used
Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2018-02-24 13:13:18 -06:00
Dennis Gilmore
d436118d7f spam-o-matic: make composes less noisy
spam-o-matic does not understand rich deps, lets run it stioll but not
have its output emailed out as it is broken

Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2018-02-20 16:28:35 -06:00
Dennis Gilmore
1bc7668da7 nightly.sh: update the syncing of composes
Sync the new Modular variant, 	primary aarch64, armhfp, x86_64
				alt: i386, ppc64, ppc64le, s390x
rename the syncing from Docker to Container for recent change

Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2018-02-20 16:13:30 -06:00
Peter Robinson
1218de2001 Sync the aarch64 Cloud installer to secondary rather than Alt
Signed-off-by: Peter Robinson <pbrobinson@fedoraproject.org>
2018-02-19 15:05:10 +00:00
Peter Robinson
d6c554ecdd aarch promtion covers cloud and containers as well, sync Cloud/Container images to primary, sync cloud installer to alt (like x86_64), sync remain bits to fedora-secondary
Signed-off-by: Peter Robinson <pbrobinson@fedoraproject.org>
2018-02-15 16:24:29 +00:00
Peter Robinson
487ab8083f drop legacy exclude updates, all arches are merged in F-27+
Signed-off-by: Peter Robinson <pbrobinson@fedoraproject.org>
2018-02-15 16:24:29 +00:00
Dennis Gilmore
e743f5af8a Sync aarch64 to primary for Everything and Server
This is for https://pagure.io/releng/issue/7243

Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2018-02-09 16:02:39 -06:00
Patrick Uiterwijk
b58f513d0e Fix permissions on grub output so the world can read it
Signed-off-by: Patrick Uiterwijk <patrick@puiterwijk.org>
2018-01-26 18:25:19 +01:00
Adam Williamson
9ce29f8d09 Avoid // in fedmsg location values
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-25 12:28:54 +01:00
Adam Williamson
e6fd5747a3 nightly: emit fedmsg keys for alt and secondary locations too
meta can't really use these, but hey, someone might want to, and
it can't hurt anything.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-25 12:22:44 +01:00
Adam Williamson
1a0a6bc08e nightly: variables to define the alt and secondary rsync targets
As an earlier commit did for the primary rsync target location,
define variables for the alt and secondary target locations for
nightly composes.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-25 12:19:16 +01:00
Adam Williamson
e82a95813c nightly scripts: Use $DESTDIR more
We set $DESTDIR in all these scripts, but then use its value
several times without just...using it. Let's use it!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-25 12:12:21 +01:00
Adam Williamson
93bf27c8f2 Emit 'location' key in fedmsgs, pointing to compose URL
For fedmsg_meta we have to provide a 'link'. At present we do
this with a rather large and icky pile of conditionals which
doesn't work properly. It's much simpler to figure out the URL
in the compose script and emit it in the fedmsg, then meta can
just...use it. For older fedmsgs we'll just point to the base
kojipkgs location for the link.

For synced composes, we use the synced URL on dl (this matches
what the meta stuff tried to do before). For non-synced composes
we just use the kojipkgs location.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-25 11:00:52 +01:00
Adam Williamson
ded7d70929 nightly: include shortname in fedmsgs, clean up version vars
The main point here is to include the compose 'shortname' in
compose fedmsgs, as #484 does for post-release compose types.
While doing this I noticed there's rather a lot of mess and
cruft in the various version-related variables here (and a few
others).

`GIT_BRANCH` variable is never used anywhere any more, so it's
removed.

`BRANCH` was never used anywhere, so it is gone. (It appears
to have been added in a25b08c7 but never used). There seemed
to be no useful distinction between `DIST` and `BRANCHED`, and
both actually seem to be used mainly to specify a release
version. The exception is that `BRANCHED` was set to
"Modular-Bikeshed" in nightly-modular.sh , but there is no
justification for this that I can find, and its only practical
use was as the value of the `branch` key in fedmsgs. So far as
I can figure out, the original purpose of the `branch` key was
for when we sent out `compose.branched.(foo)` fedmsgs - it
was e.g. 'f18' when Branched was Fedora 18. As we now don't
send out `compose.branched` messages any more, but include the
release number in the message topic for Branched messages
(e.g. `compose.27`), this purpose no longer applies. So the
key just doesn't seem to have any particular use at all any
more, and I don't think changing its value will have any real
consequences.

Thus, `BRANCH`, `BRANCHED` and `DIST` are replaced by `RELEASE`
and `RELEASE_TITLE`, which specify the release version. Their
values will be identical for numerical release versions, but
for Rawhide and Bikeshed we need to know both the lower-case
and title-case versions of the name; RELEASE_TITLE is the
title-case version.

We use `$SHORT-$RELEASE_TITLE` to replace several instances
of hardcoding in the scripts (e.g. Fedora-Modular-Bikeshed).

The `ATOMIC`, `ATOMICREPO` and `ATOMICDEST` variables that were
blindly copied from nightly.sh to nightly-modular.sh, but never
actually used in it, are also removed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2017-12-04 17:57:16 -08:00
Kevin Fenzi
755b505664 Merge #457 Revert "Do not block retired packages for now" 2017-11-28 18:23:18 +00:00
Mohan Boddu
b5869f393a Revert "Do not block retired packages for now"
We have a release now, so we can revert this commit and start
blocking retired packages

This reverts commit 35bc52d14b.

Signed-off-by: Mohan Boddu <mboddu@redhat.com>
2017-11-15 10:48:45 -05:00
Robert Marshall
53f131ee82 Let pungi produce comps file in rawhide composes
- change comps_file setting in the fedora.conf to use the new scm_dict
  type from the latest pungi release
- remove the make step from the nightly shell script

Signed-off-by: Robert Marshall <rmarshall@redhat.com>
2017-11-13 16:31:50 -05:00
Patrick Uiterwijk
35bc52d14b Do not block retired packages for now
Signed-off-by: Patrick Uiterwijk <patrick@puiterwijk.org>
2017-11-03 19:22:15 +01:00
Till Maas
a5a1994895 Explicitly select koji profile
This is required to adjust to
https://pagure.io/releng/pull-request/7059

Signed-off-by: Till Maas <opensource@till.name>
2017-09-28 23:15:46 +02:00
Lubomír Sedlář
968f8fdf52 Wait for ostree to be signed before using it
Images should include signed bits, so we need to block the compose until
the commit is signed.

Related: https://pagure.io/pungi/issue/650
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-09-21 07:52:33 +02:00
Dusty Mabe
ea7b045988
nightly: prune atomic workstation
This adds pruning for atomic workstation. We don't yet rsync atomic
workstation out like we do for atomic host. I'm not sure why but didn't
want to add that as part of this commit.

Signed-off-by: Dusty Mabe <dusty@dustymabe.com>
2017-09-15 08:40:17 -04:00
Dusty Mabe
2726280e0c
nightly: use Atomic Host in variables
Signed-off-by: Dusty Mabe <dusty@dustymabe.com>
2017-09-15 08:37:56 -04:00
Lubomír Sedlář
45e48488f4 Fix broken deps e-mail header for future releases
Instead of having to add the `--treename` argument after each branching,
let the script compute it automatically.

Relates: https://pagure.io/pungi-fedora/issue/350
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-09-11 11:10:34 +02:00
Mohan Boddu
eec91246d4 Calling rawhide instead of branched for rawhide nightly composes
Signed-off-by: Mohan Boddu <mboddu@redhat.com>
2017-08-21 16:27:43 -04:00
Dan Horák
36994aeda7 sync s390x to fedora-secondary
Signed-off-by: Dan Horák <dan@danny.cz>
2017-08-16 10:05:36 +02:00
Lubomír Sedlář
4f15d62cdd Define start fedmsg json value
The nightly scripts try to send an announcement about compose starting.
As this happens before Pungi even started, the compose ID is not known
and can not be included in the message. The message about starting rsync
sent later will contain the ID correctly.

Without the json defined there is a traceback in the cron output, but
the errors are not logged anywhere else (but don't actually block
anything in the compose process).

Relates: https://pagure.io/pungi/issue/698
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-08-08 08:54:27 +02:00
Adam Miller
ae2f611637 Switch from docker to container namespace
Fedora Atomic WG has decided to move from the "docker" namespace to
the "container" namespace for the sake of making it more generic in
order to target all OCI Compliant container runtimes instead of
a specific implementation. This update changes what is necessary for
to the base image metadata as well as add a transitional second call
to handle both the docker and container namespace for block_retired.

Signed-off-by: Adam Miller <maxamillion@fedoraproject.org>
2017-04-26 17:16:16 -05:00
Bill Peck
c5bb3f0ed1 Fix bad copy/paste path.
This fixes the missing .composeinfo for secondary arches.

Signed-off-by: Bill Peck <bpeck@redhat.com>
2017-04-03 13:57:29 -04:00
Adam Miller
a5a8e39c73 Call block_retired.py with --namespace=docker
Need to have an extra call to the block_retired.py releng script in
order to also handle the docker namespace of "packages" from pkgdb

Signed-off-by: Adam Miller <maxamillion@fedoraproject.org>
2017-03-24 16:45:28 -05:00
Dan Horák
13af4ad3e6 nightly.sh: update arches for s390 koji
Signed-off-by: Dan Horák <dan@danny.cz>
2017-03-09 18:33:30 +01:00
Dan Horák
1aadaa9dca nightly.sh: update for updated srpm-excluded-arch.py
Signed-off-by: Dan Horák <dan@danny.cz>
2017-03-09 18:33:24 +01:00
Mohan Boddu
5e68322d22 Create dir if the dir not exists for syncing
Fix for one of the issues in #6676

Signed-off-by: Mohan Boddu <mboddu@redhat.com>
2017-03-04 12:44:37 -05:00
Lubomír Sedlář
b4670db118 Copy source data from compose
This will copy source packages as well when splitting the compose. All
stuff going to /pub/fedora will have sources.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2016-12-14 17:38:15 +01:00
Dennis Gilmore
9da45615e8 sync ppc64 and ppc64le to fedora-secondary
Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2016-10-29 17:06:12 -05:00
Dennis Gilmore
1caf794933 add excludes for the arches not in primary koji yet
Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2016-09-14 08:15:15 -05:00
Dennis Gilmore
9161baf281 sync the content to different locations
aarch64 and i386 to fedora-secondary
armhfp and x86_64 to alt for Cloud and Labs
everything else to /pub/fedora

Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2016-09-13 22:09:23 -05:00
Dennis Gilmore
9782d9d36b fix up the path to srpms for finding arch exluded packages
Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2016-09-13 21:58:46 -05:00
Lubomír Sedlář
c957262b5a If compose fails, stop running everything else
If a compose fails, we don't want to run any dependency checks nor send
any e-mails.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2016-08-22 11:06:18 +02:00
Lubomír Sedlář
91e76bb480 Use compose-utils to copy variants into public location
This requires compose-utils >= 0.1.7.

Currently only primary architectures are composed based on this config.
Once other arches are added, they can be filtered with `--arch` option.

To debug what will happen when the command is run, add `--dry-run`. It
will print the exact rsync commands that would be used. Appending `--
--dry-run` at the end of the command will pass the option to rsync and
give different debugging information.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2016-08-18 10:33:09 +02:00