This change patches zmq GarbageCollector to use zmq.Context()
from eventlet.green instead of default zmq.Context().
It was identified that sysinv-agent process was hanged. It was blocked
on zmq garbage collector recv() call. Replacing the Garbage Collector to
use the green Context solves the issue.
Test Plan:
PASS: Build package with build-pkgs -p pyzmq
PASS: Build ISO
PASS: Install on lab, configure ACC100, backup system
PASS: Reinstall and restore system, then host-unlock
Closes-Bug: 2060867
Change-Id: I229a8a4c70ebb4d7056fa2ff60bfc910bf12b257
Signed-off-by: Alyson Deives Pereira <alyson.deivespereira@windriver.com>
Even after disabling python3.9 specific test we are
seeing the build process getting stuck on the test run again.
On previous run all the test took less then 3 minute, this
change aim to set a timeout of 4 minutes to every test
run by regrtest.py.
Test Plan:
PASS: Build the package with build-pkgs -c -p python3.9 successfully
Partial-Bug: 2009722
Signed-off-by: Dostoievski Batista <dostoievski.albinobatista@windriver.com>
Change-Id: Ibf286223e5c2cd6616f7cc1c98b6953808d774b1
When building python3.9 the process still getting
stuck on running unit tests process. This change
disable test_builtin and test_openpty that have
been the ones hanging in the latest build runs.
Test Plan:
PASS: Build the package with build-pkgs -c -p python3.9
Partial-Bug: 2009722
Signed-off-by: Dostoievski Batista <dostoievski.albinobatista@windriver.com>
Change-Id: I27a6a01f35345bc5353bf8041a45d5f2a500dded
When building python3.9 the process get stuck on
running self-test process. Will disable it as we
investigate further.
Partial-Bug: 2009722
Signed-off-by: Dostoievski Batista <dostoievski.albinobatista@windriver.com>
Change-Id: I868e53fc2aa5b8f769ccea4d4cb14470213cfcf7
This commit fixes lint errors identified by Zuul after stx-integ-pylint
job is executed.
Test Plan:
PASS: stx-integ-pylint job is executed successfully.
PASS: Run "yamllint ." command on integ repo base directory. Observe
that no lint errors of line-length, truthy, indentation,
new-line-at-end-of-file and document-start are listed.
PASS: build-pkgs -a -c
Closes-Bug: 2011632
Change-Id: I4d8229b5de8c9d88ff2aab6169521ab377b5866c
Signed-off-by: Manoel Benedito Neto <manoel.beneditoneto@windriver.com>
For components that contain additional contents, the Debian
packaging has been changed to reflect all the git commits
under the directory, and not just the commits to the
metadata folder.
This ensures that any new code submissions under those
directories will increment the versions.
Some components were defining PKG_GITREVCOUNT but were
missing the boolean value of 'true'.
Note: Empty value or 'True' value are treated the same as
'true' for PKG_GITREVCOUNT calculation, but have been
updated for consistency with the rest of StarlingX.
Updated debian packages for:
- centos-debian-compat (1.0.stx.4 -> 1.0.stx.17)
- kpatch (0.9.5-1.stx.7 -> 0.9.5-1.stx.8)
- libfdt (1.4.4-1.stx.3 -> 1.4.4-1.stx.4)
- puppet-module-puppetlabs-postgresql
(8.0.0-1.stx.1 -> 8.0.0-1.stx.2)
- python-nss (1.0.1-1.stx.1 -> 1.0.1-1.stx.2)
Test Plan:
PASS: downloader && build-pkgs -c -p centos-debian-compat
PASS: downloader && build-pkgs -c -p libftd
PASS: downloader && build-pkgs -c -p kpatch
PASS: downloader && \
build-pkgs -c -p puppet-module-puppetlabs-postgresql
PASS: downloader && build-pkgs -c -p python-nss
This review also references tasks for components that were
initially tasked to be updated, however have now been
verified to 'NOT' require changes.
Tasks: 47421..47446
This verification included in some cases adding files
under debian sub directories and observing the increment.
Verification command to build these is
downloader && build-pkgs -c -p <the module>
Components verified to not require meta_data changes:
- dh-python (4.20201102+nmu1.stx.2)
- dnsmasq (2.85-1.stx.2)
- facter (3.14.12-1.stx.2)
- haproxy (2.2.9-2+deb11u3.stx.1)
Note: 'files' directory exists but is unused
- isc-dhcp (4.4.1-2.3.stx.5)
- lsb (11.1.0.stx.1)
- lvm2 (2.03.11-2.stx.2)
- nsenter (0.2.stx.1)
- puppet (5.5.22-1.stx.5)
- puppet-boolean (2.0.2-0.stx.2)
- puppet-dnsmasq (1.1.0-0.stx.2)
- puppet-lvm (1.4.0-1.stx.5)
- puppet-module-nanliu-staging (1.0.4-2.stx.2)
- puppet-module-oslo (17.4.0-2.stx.3)
- puppet-module-puppetlabs-firewall (1.12.0-1.stx.1)
- puppet-module-puppetlabs-haproxy (2.1.0-3.stx.2)
- puppet-module-puppetlabs-mysql (8.1.0-5.stx.1)
- puppet-module-puppetlabs-rabbitmq (8.5.0-6.stx.6)
- puppet-module-puppetlabs-stdlib (5.0.0-1.stx.2)
- puppet-puppi (2.2.11-0.stx.2)
Note: puppet_downloader.sh exists but is unused
- setuptools (52.0.0-4.stx.1)
Story: 2010550
Task: 47424
Task: 47427
Task: 47436
Task: 47442
Task: 47446
Signed-off-by: Al Bailey <al.bailey@windriver.com>
Change-Id: I7c5402d232d39d2bda053542a3cb48719e98a0e0
There are lots of exceptions reported in gunicorn.log.
That error was due to a bug present on SysLogHandler
that was reported on cpython repo but was not fixed for python3.9.2.
This change adds python3.9 package to the build system and patches
it in order to update SysLogHandler to fix the reconnection bug.
Test Plan:
PASS: Build python3.9 package. Install
libpython3.9-minimal_3.9.2-1.stx.1_amd64.deb and verify that the
exceptions are no longer present.
Depends-On: https://review.opendev.org/c/starlingx/root/+/873159
Closes-bug: 2006623
Signed-off-by: Enzo Candotti <enzo.candotti@windriver.com>
Change-Id: I6eb44544da5c05e712bc89e69193548667c8ab28
After ZeroRPC finishes the handle of the call, it will try to reply OK
event to the caller. In fanout_cast/cast messages in sysinv-conductor
and sysinv-agent, there is no one registered to receive the response,
so it is expected to be discarded.
Change this log from warning to debug, since it occurs frequently and
is misleading log analysis in case of real issues.
TEST PLAN:
PASS: Verify STX Debian builds properly
PASS: Verify STX Debian deploys properly
PASS: Verify zerorpc-python package was properly installed
PASS: Verify syinv processes runs properly
Story: 2010087
Task: 46794
Signed-off-by: Alyson Deives Pereira <alyson.deivespereira@windriver.com>
Change-Id: Ie92671d06c7c8cda4d557c3a9a7859bad457231b
The zerorpc package is a light-weight, reliable and language-agnostic
library for distributed communication between server-side processes.
It builds on top of ZeroMQ and MessagePack.
This package is required for sysinv ZeroMQ-based RPC backend [1].
TEST PLAN:
PASS: Verify STX Debian builds properly
PASS: Verify STX Debian deploys properly
PASS: Verify zerorpc-python package was properly installed
PASS: Verify syinv processes runs properly
[1] https://review.opendev.org/c/starlingx/config/+/859571
Story: 2010087
Task: 46794
Signed-off-by: Alyson Deives Pereira <alyson.deivespereira@windriver.com>
Change-Id: I62565e2ce39c0bed63506bfcabf909d5cf186ec1
The nsenter package is used in the scope of the k8s coredump handler.
This package is required so the handler is able to specify separate
namespaces for the applications when they generate a coredump.
Story: 2010261
Task: 46159
Depends-On: https://review.opendev.org/c/starlingx/tools/+/854684
Test Plan:
PASS: Verify STX Debian builds properly
PASS: Verify STX Debian deploys properly
PASS: Verify python3-nsenter package was properly installed
PASS: Verify k8s-coredump runs properly
Signed-off-by: Adriano Oliveira <adriano.oliveira@windriver.com>
Change-Id: Idf0ebb90e1c91ae4f83fb7c6a85039e57e4f80bb
Python NSS module is not buildable by pip on Debian/bullseye and
requires patches. The debian package for this module contains the
required fixes, but contains 2 other problems:
- it builds only the PY3-version of itself
- it (incorrectly) doesn't install pip metadata, making it "invisible"
by pip
Solution: import python-nss from debian/bullseye + add patches that fix
the above problems.
TESTS
================
Build package in debian environment
Story: 2009897
Task: 44691
Signed-off-by: Davlet Panech <davlet.panech@windriver.com>
Change-Id: I65ab9b967e38340939bd99c389b72820ee17571b
This is a transient work that enables us to progress Debian
integration. This work affects only Debian.
Sysinv loads stevedore plugins. The logic is based on the fact that
the source files are listed in SOURCES.txt which is included in the
egg. The package that provides a plugin is determined by parsing
entry_point and distribution data. Distribution data loads
information from SOURCES.txt.
dh-python is used during build and silently removes the file that
sysinv expects to be present.
Patch the package to keep the file.
Skip CentOS tests because this is a Debian only package.
Debian tests:
PASS: build python package, build non-package python
PASS: SOURCES.txt present in .egg-info in python package
Partial-Bug: https://bugs.launchpad.net/starlingx/+bug/1955648
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: Id45b1ba93f9ee88cc01a9cb1fb25527b8a5f1e19
This is a transient work that enables us to progress Debian
integration. This work affects only Debian.
Sysinv loads stevedore plugins. The logic is based on the fact that
the source files are listed in SOURCES.txt which is included in the
egg. The package that provides a plugin is determined by parsing
entry_point and distribution data. Distribution data loads
information from SOURCES.txt.
Setuptools doesn't copy the desired file to egg.
Patch python3-setuptools so it copies the file to egg.
Skip CentOS tests because this is a Debian only package.
Debian tests:
PASS: build python package, build non-package python
PASS: SOURCES.txt present in .egg-info in python package
Partial-Bug: https://bugs.launchpad.net/starlingx/+bug/1955648
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: Ia318aa0ca6825adfa3d23159691486067d96d475
Patch the python2-kubernetes-8.0.0-8.el7.noarch.rpm with recent
bug fix commits required for proper kubernetes watch functionality.
Patches watch.py up to commit 10ae476 in the 'base' repo
(kubernetes-client/python-base).
Commits are taken from the cloned github repo, saved in patch format,
and applied as a patch to the source RPM.
Reference:
https://github.com/kubernetes-client/python-base/commits/master/watch/watch.py
This patch includes commits beginning with d56fdbc, up to and including 10ae476
Testing:
- Built and testing on local distributed cloud system
- Similar testing to this patch but ased on locally modified package
has been done on 1000 subcloud system
- Examine/compare contents of installed package vs. expected
- Generating events which trigger the watch conditions
- Monitor watches for proper behaviour on expiry
Story: 2008960
Task: 43053
Signed-off-by: Kyle MacLeod <kyle.macleod@windriver.com>
Change-Id: I7ad78957b6ef61e7204c45f482f201d5c281385b
This update makes use of the PKG_GITREVCOUNT variable
to auto-version the packages in this repo.
Story: 2007750
Task: 39951
Change-Id: I854419c922b9db4edbbf6f1e987a982ec2ec7b59
Signed-off-by: Dongqi Chen <chen.dq@neusoft.com>
This reverts commit fc125a7a24.
pkg logmgmt upgraded to python3 requires python3 model "daemon",
and no pkgs in Centos7 offical repo provide it.
this patch refer to the python3-daemon pkg build by rdo
for CentOS 8: python-daemon-2.2.3-7.el8.src.rpm
disable the rpm check part which is not required in stx to
reduce python3 dependencies that not supported by CentOS 7
Depends-on: https://review.opendev.org/#/c/728324/
Depends-on: https://review.opendev.org/#/c/729635/
Depends-on: https://review.opendev.org/#/c/728326/
Change-Id: Iad2e4bb2f2087f46b7c27e80a9423cd5cc1e0517
Story: 2007106
Task: 39291
Signed-off-by: SidneyAn <ran1.an@intel.com>
pkg logmgmt upgraded to python3 requires python3 model "daemon",
and no pkgs in Centos7 offical repo provide it.
this patch refer to the python3-daemon pkg build by rdo
for CentOS 8: python-daemon-2.2.3-7.el8.src.rpm
disable the rpm check part which is not required in stx to
reduce python3 dependencies that not supported by CentOS 7
Depends-on: https://review.opendev.org/#/c/727657/
Depends-on: https://review.opendev.org/#/c/727662/
Change-Id: Ie08ea9c7adf830ad4e8e924fa69352fb2a923a6f
Story: 2007106
Task: 39291
Signed-off-by: SidneyAn <ran1.an@intel.com>
The lst files which stage the downloaded tarballs were altering the
internal directory structure during the mirror download phase, which
meant the %setup commands in the spec files were failing.
This change adapts the spec files to the files downloaded from
the mirror.
Change-Id: I8031c8af0f424a8e19bee062a4df6ddf3383f38d
Closes-Bug: 1866133
Signed-off-by: albailey <Al.Bailey@windriver.com>
The oidc-auth CLI requires the libraries python-mechanize,
python-html5lib and python-webencodings.
These libraries do not have RPMs available therefore they
need to be packaged here.
Story: 2006711
Task: 38919
Depends-On: https://review.opendev.org/#/c/710991/
Change-Id: Ife8719a70388bc9a0e96149059fd5cc2c1fb232a
Signed-off-by: Teresa Ho <teresa.ho@windriver.com>
The python-smartpm module is no longer used by the patching framework.
This commit removes it from the build.
Change-Id: I8b3dbffeb9db7675aa545ec674b9193a1b2a1bc5
Story: 2006227
Task: 35828
Signed-off-by: Don Penney <don.penney@windriver.com>
We are currently carrying patches for python-eventlet and
python-requests that are over three years old and were
created to "fix" a nova issue. Now that nova is in a
container, it no longer uses our eventlet or requests so
these patches do not have any effect.
The patches need to be removed to allow eventlet to be
upversioned, which is being done in another commit.
Change-Id: I730ba86d8f6ec8b88b060ada324cfd268af24b35
Story: 2006781
Task: 37583
Depends-On: https://review.opendev.org/#/c/700071/
Depends-On: https://review.opendev.org/#/c/700054/
Signed-off-by: Bart Wensley <barton.wensley@windriver.com>
For the source patch 0001-add-worker-abort-hook.patch, it is not used.
For the 3 meta patches, only 0001-TIS-gunicorn-19-upgrade.patch is
applied to srpm. And this meta patch just add tis version, and disable
python3 compilation. So it is ok to drop all these patches, and use
rpm to replace srpm.
Story: 2005484
Task: 30578
Depends-On: https://review.opendev.org/653908
Change-Id: I5805cce1dc64dd41be9f415bab985b34791f1506
Signed-off-by: Shuicheng Lin <shuicheng.lin@intel.com>
We have switched to using vanilla django 1.11, and no longer require
these patches
Change-Id: I5830615bf357e9a06a4518adaccd2bcffb7d00be
Story: 2004765
Task: 28883
Depends-On: https://review.openstack.org/#/c/642797
Signed-off-by: Tyler Smith <tyler.smith@windriver.com>
One fuzzy issue introduced in
https://review.openstack.org/#/c/597433/
smart-recommends.patch line 1164
It will cause build issue!
Change patch error and build pass
Closes-Bug: 1801685
Change-Id: I31d23a6287f8eff53fa26c95914ed8b80a8ed7a9
Signed-off-by: zhipengl <zhipengs.liu@intel.com>
In Python 3 print is a function.
Especially for multiple string print, need to import
print_function from __future__.
Story: 2002909
Task: 24560
Signed-off-by: zhangyangyang <zhangyangyang@unionpay.com>
Change-Id: Ie31eb59368af57776eb9785dba494432111cd250
When do Centos 7.5 upgraded, some patches didn't resolve and cause
the fuzzy in the line numbers of the patches. And it may cause
.orig file is created when do patch. And this .orig file will lead
to rpm packaging failure due to the unexpected and unpackaged .orig
file.
Please visit below link to get more detail info:
https://bugs.launchpad.net/starlingx/+bug/1794611
Solution:
Safest solution is to de-fuzz our patches.
Story: 2003389
Task: 26755
Change-Id: Iaf55ba860a02ea096b7cfbfd9b810cc51de18580
Signed-off-by: slin14 <shuicheng.lin@intel.com>
Alyson Deives Pereira