This reverts commit 40a9622d77.
The URL for tss2 is not always working and this causes an
incomplete mirror in a clean environment.
Closes-bug:1816813
Change-Id: I9c8fa64e1f0f9154dd45a67088fdc27f4b8f8313
Signed-off-by: Marcela Rosales <marcela.a.rosales.jimenez@intel.com>
tss2 is the only tarball that is generated using git clone, this
commit makes the downloader get all the tarballs using wget.
Change-Id: Ib6009341f6b7c890f43962f2c24fc73e95ec81b7
Story: 2004413
Signed-off-by: Marcela Rosales <marcela.a.rosales.jimenez@intel.com>
The registry-token-server package relies on a set of dependencies,
downloaded at mirror-download time. This dependencies are snap-
shots of various git repos as of specific git commits. This
change downloads those snapshots as tarballs and makes them
available to the build-srpms phase of the build
Story: 2002840
Task: 22783
Change-Id: I4f7709516df81bb920ced124dfb0d1f5ffd87c81
Signed-off-by: Jerry Sun <jerry.sun@windriver.com>
Signed-off-by: Jason McKenna <jason.mckenna@windriver.com>
This commit adds helm-v2.12.1-linux-amd64.tar.gz to the list of
downloads, in order to upversion helm to v2.12.1.
This is necessary as support for kubernetes v1.12 support is only
introduced in helm v2.12.`
Story: 2004520
Task: 28774
Change-Id: I2501cd1174f85810892e51ac8a44746302eeb120
Signed-off-by: Joseph Richard <joseph.richard@windriver.com>
The go compiler supports "go get" to download dependencies, but
it will download the latest version of dependencies from the git
repository of the dependency. This could lead to non-reproducable
builds, or the potential of dependency API changes (including
deprecated features) to break the build of packages.
The "dep" tool allows for a lockfile to be created, which captures
the git commit ID of dependencies, and can restore dependencies to
the captured state.
Since no binary package containing "dep" is currently available for
CentOS, we need to build it from source. This change adds the
source tarball download to the list of source tarballs to be
downloaded.
Change-Id: I0ff821d780326212a3fc4408a6225752c0e9a9f4
Story: 2004617
Task: 28525
Signed-off-by: Jason McKenna <jason.mckenna@windriver.com>
Update the SHAs for new baseline of openstack-helm and
openstack-helm-infra charts.
Change-Id: Iedb814ce0c72a59ab0ce5e72e4601082b61f82b0
Story: 2003909
Task: 27632
Signed-off-by: Robert Church <robert.church@windriver.com>
Previous StarlingX API Reference documentation was hosted under
restapi-doc package and managed using maven and wadl files.
StarlingX has enabled the OpenStack API guideline to manage REST API
services allowing all previous restapi-doc references to be removed.
Maven is part of the restapi-doc requirements.
Depends-On: https://review.openstack.org/#/c/609714/
Change-Id: I007f8c7b8f736ab5b6c0b712f350d350df14744f
Signed-off-by: Abraham Arce <abraham.arce.moreno@intel.com>
Using the following SHAs which hava been tested by the StarlingX
container team.
openstack-helm:
(Sept 14, 2018) add7a9bc1175f6fafa8ea2918bc1d62209aaf243
openstack-helm-infra:
(Sept 17 2018) 5ec85a5d70fab468160d2fdafed1a2a7a5151405
Story: 2003909
Task: 27632
Change-Id: I57c5ec5f3565e9e585f0935af745e495699aa28c
Signed-off-by: Al Bailey <Al.Bailey@windriver.com>
StarlingX needs to download a variety of rpms and tarballs
from various upstream sources. Unfortunately the upstream sources
are not always dependable. Either servers go down, are unreachable,
or drop older content that we still depend on.
Our proposed solution is to run our own mirror to capture an
independent copy of the content needed by StarlingX.
For this purpose, a server has been set up at
http://mirror.starlingx.cengn.ca/mirror/centos
The mirror will use deterministic paths derived from the upstream
urls. Scripts will be used to convert an upstream url to
the mirror's equivalent url (see function url_to_stx_mirror_url in
url_utils.sh)
The mirror will be refreshed daily. New .lst entries will be
processed at that time. Processing of changes under yum.repos.d
is not automated by this update. Expect a follow-up update to
address this issue soon. These scripts are found under the
'stx_mirror_scripts' subdirectory.
Changes are made to the download_mirror.sh script, and it's
supporting scripts. New arguments have been added to each
script to select the download source.
-s StarlingX mirror only
-S StarlingX mirror, with upstream source as backup
-u Upstream source only
-U Upstream source, with StarlingX mirror as backup
You do not need to provide any of these flags. Continue to
us download_mirror.sh as you always have. The default
behavior is currently set to '-S', i.e. first try the
StarlingX mirror, with upstream source as backup.
If this proves to place to heavy a load on the existing
server, we might switch the default to '-U', i.e. first
try the upstream source, with StarlingX mirror as backup.
If poor download performance is seen, you might want to try
explicitly adding -U as an argument.
The remaining two options are not recommended for regular use.
Upstream only, i.e. '-u', restores original behaviour, but
you may once again encounter rpms that have aged out, and
been removed from their original repos. StarlingX only,
i.e. '-s', is vulnerable if a .lst file has been updated,
but the mirror has not yet processed it.
Change-Id: I7e0f3d9fb99253662f9f4bf12457d39250408c0b
Story: 2003906
Task: 26785
Signed-off-by: Scott Little <scott.little@windriver.com>
Adding openstack-helm and openstack-helm-infra as
tarball downloads based on their SHA.
Story: 2003909
Task: 27632
Change-Id: I0331bf409c25078bb61d6a9b09e3107366030c01
Signed-off-by: Al Bailey <Al.Bailey@windriver.com>
with ovs-dpdk enabled, starlingx are using dpdk 17.11 which comes
together with ovs in openvswitch-2.9.0-3.el7.src.rpm
Remove the obsolete packages in tarball lst to avoid confusion.
Story: 2004100
Task: 27506
Change-Id: I42b30ebfff91474ac8db0b5515a16cdbd03cf5e0
Signed-off-by: slin14 <shuicheng.lin@intel.com>
There was no src rpm for this kubernetes version,
therefore the build for kubernetes will be converted
from src rpm based to tarball based.
Story: 2002843
Task: 26751
Change-Id: I1ea17cc89d839e0ffa90459965c521e504695294
Depends-On: Ie43ff00da3518b04db8f32feafebd936ee9b6f8a
Signed-off-by: Al Bailey <Al.Bailey@windriver.com>
Updating the src tarball for helm from 2.9.1 to 2.11
Story: 2002843
Task: 26751
Change-Id: Ic6a75a2c89d6992433fe78407ff4464da339e776
Signed-off-by: Al Bailey <Al.Bailey@windriver.com>
Removed code for expect-lite as it is not used anymore in
stx-integ based in:
https://review.openstack.org/#/c/578113/
Change-Id: Ie3e6306b5e9008875e6d7c6ae18e78895b06781a
Signed-off-by: Abraham Arce <abraham.arce.moreno@intel.com>
This update adds the packages and tarballs needed to support the
introduction of gnocchi, including the dependencies of the new
packages.
Change-Id: I824564f9daea72612c6890ee9de1928a0fdda188
Story: 2002825
Task: 22871
Signed-off-by: Don Penney <don.penney@windriver.com>
Before opensource the code, the integrity kernel module source code
used to build was different from the available in upstream. In this
change the revision is changed to a valid revision.
Story: 2002964
Task: 22968
Depends-On: https://review.openstack.org/583019
Change-Id: Ifff3a78d80d3e5455f8bf48f56c56b4196c03e34
Signed-off-by: Erich Cordoba <erich.cordoba.malibran@intel.com>
As the code used to build TPM module wasn't in the kernel tree
a rebased in the patches is required. In this patch the download
is pointing to a valid revision.
Story: 2002945
Task: 22939
Required-By: https://review.openstack.org/581916
Change-Id: I80f61d068b30fbaefeefedd130511afdaddf8863
Signed-off-by: Erich Cordoba <erich.cordoba.malibran@intel.com>
A shell script to tell if your system is vulnerable against the several
"speculative execution" CVEs that were made public in 2018.
Depends-On: https://review.openstack.org/579409
Change-Id: Ic7d4bab49caaaa6b13e812a8c0a087ce88462a30
Signed-off-by: Abraham Arce <abraham.arce.moreno@intel.com>
Primary intention for this review is to get community feedback.
The build of StarlingX relies, besides RPM Binaries and Sources, in this
repository which is a collection of packages in the form of Tar Compressed
files and 3 RPMs obtained from a Tar Compressed file.
This script and a text file containing a list of packages enable their download
and the creation of the repository based in common and specific requirements
dictated by the StarlingX building system recipes.
The source of the packages are:
- Tar Compressed files
- Direct link: Getting them through a URL from a homepage
- Git: Getting them through the Github API to download a specific commit / tag
The 2 categories we can divide the list of packages in the output directory:
- General hosted under "downloads" output directory.
- Puppet hosted under "downloads/puppet" output directory.
The file tarball-dl.lst text file contains 3 columns separated by a character "#":
- Column 1, name of package including extensions as it is referenced by the build
system recipe, character "!" at the beginning of the name package denotes special
handling is required.
- Column 2, name of the directory path after it is decompressed as it is referenced
in the build system recipe.
- Column 3, the URL for the package download.
The file tarball-dl.sh script file will iterate over the tarball.lst text file and
execute specific tasks based on the name of the package:
- For the General category:
- Most of the packages have a common process: download, decompressed, change the
directory path and compressed.
- We have 6 packages starting with the character "!" that require special handling
besides the common process: remove directory, remove text from some files,
clone a git repository, etc.
- integrity-kmod-668a8270.tar.gz
- mariadb-10.1.28.tar.gz
- mvn.repo.tgz
- qat1.7.upstream.l.1.0.3-42.tar.gz
- tpm-kmod-668a8270.tar.gz
- tss2-930.tar.gz
- For the Puppet category:
- All packages have a common process: download, decompressed, change the directory
path and compressed
Change-Id: I9e8ab59b20347ea33cf63308c213d4199be0e4fc
Signed-off-by: Abraham Arce <abraham.arce.moreno@intel.com>
Co-authored-by: Mario Alfredo Carrillo Arevalo <mario.alfredo.c.arevalo@intel.com>
Signed-off-by: Abraham Arce <abraham.arce.moreno@intel.com>
Saul Wold