Commit Graph

34 Commits

Author SHA1 Message Date
Scott Little 4ed6cd1d49 Subdirectories 'virt/qemu virt/libvirt ' relocated to repo 'virt'
Required all reviews in the topic:
   https://review.opendev.org/q/topic:virt-repo

Testing:
build-pkgs -c -a: pass
build-pkgs -p libvirt,qemu: pass

Story: 2010317
Task: 47780
Signed-off-by: Scott Little <scott.little@windriver.com>
Change-Id: Ia6138b2042fb344de3c2dadd4ce18f78ac2bf7d2
Depends-On: If81d59698b97e27a8013b2a0b93e2fadc0186205
2023-04-12 15:23:10 -04:00
Rafael Falcao 9ffeea6a76 Update debian package versions to use git commits
The Debian packaging has been changed to reflect all the
git commits under the directory, and not just the commits
to the metadata folder.

This ensures that any new code submissions under those
directories will increment the versions.

- The commit "Add debian package for virt/cloud-init"
  (SHA 6d1244bda9) was choosen to be the SRC_BASE_SRCREV
  of the cloud-init's metadata because is the commit that
  creates the debian directory with build files structure.

- The commit "Add debian package for virt/kvm-timer-advance"
  (SHA 4cb5d17a7f) was choosen to be the SRC_BASE_SRCREV
  of the kvm-timer-advance's metadata because is commit
  creates the debian directory with build files structure.

- The commit "Add debian package for virt/libvirt-python"
  (SHA 6420a976d3) was choosen to be the SRC_BASE_SRCREV
  of the libvirt-python's metadata because is the commit that
  creates the debian directory with build files structure.

- The commit "Debian: Add build structure for virt/libvirt"
  (SHA 1f37f8b5d4) was choosen to be the SRC_BASE_SRCREV
  of the libvirt's metadata  because is the commit that
  creates the debian directory with build files structure.

- The commit "Debian: Add build structure for virt/qemu"
  (SHA 75a234904f) was choosen to be the SRC_BASE_SRCREV
  of the qemu's metadata because is the commit that
  creates the debian directory with build files structure.

Test Plan:
PASS: build-image
PASS: build-pkgs -c -p cloud-init
PASS: build-pkgs -c -p kvm-timer-advance
PASS: build-pkgs -c -p libvirt-python
PASS: build-pkgs -c -p libvirt
PASS: build-pkgs -c -p qemu
PASS: commit a file change under cloud-init, rebuild and
      see that the cloud-init version has increased.

Story: 2010550
Task: 47468

Signed-off-by: Rafael Falcao <rafael.vieirafalcao@windriver.com>
Change-Id: Ica6638b220e6366a9fb1be47d5380fa44046ed84
2023-02-22 15:11:29 -03:00
Thales Elero Cervi f06abbb557 Port stx-libvirt base image to stx-debian
This change enables building the stx-libvirt Docker image within the
Debian build framework. It is now based on stx-debian and
following the new convention for StarlingX images.

Test Plan:
PASS - Build libvirt debian package
PASS - Build stx-libvirt image
PASS - Manually upload built image to a system, use helm-override to
       change the libvirt container image and apply stx-openstack
PASS - Ensure the libvirt Pod successfully starts and is running
PASS - Ensure libvirt Pod Liveness and Readiness probes are healthy

Story: 2010072
Task: 46974

Closes-Bug: 1998630

Depends-On: https://review.opendev.org/c/starlingx/tools/+/866411

Signed-off-by: Thales Elero Cervi <thaleselero.cervi@windriver.com>
Change-Id: I10112a0f1ab3a1f880ebc8b162c42b7b131d6aad
2022-12-14 11:05:01 -03:00
Thales Elero Cervi 1f37f8b5d4 Debian: Add build structure for virt/libvirt
This change adds the necessary files for the libvirt package to be built
for Debian.
This change is the new approach for porting this package and will be
replacing an old change that will no longer be valid [1].

All the libvirt related packages (rpm) delivered on CentOS builds of
starlingx were verified to exist or have an equivalent package for the
Debian Bullseye (deb) distro [2], which is based on libvirt 7.0.0.

The upstream Debian packaging, patches and configuration will be used as
is, although the deb_patches directory will contain a patch to add few
starlingx specific files that are required, based on how stx-libvirt [3]
was previously built and delivered to CentOS.
This change will deprecate the starlingx-staging/stx-libvirt repository
and any future starlingx change to libvirt will now be placed here,
on top of debian/7.0.0-3 (bullseye) version.

Earlier (on CentOS) the base point was the libvirt 4.7.0 release and 17
starlingx specific commits were added to deliver new features or fix
bugs. Now, the base point will be the libvirt 7.0.0 release package
already prepared for Debian [4] and those 17 commits port will be
evaluated and done, in case they are still needed.

The patches dir will contain source code patches required for
stx-libvirt, that is, the code that was earlier added on top of 4.7.0
libvirt release to add StarlingX required functionalities.
The work done on this change is simply porting the code changes,
copying it and doing the minimum required updates when it is needed.
If more than one commit (from that list) can be placed on a single
patch, the patch description will contain all the necessary references.

The list of commits follow, where the "-" character indicates that the
commit was dropped now that we are based on 7.0.0:
-8c46e4 conf: Introduce VIR_DEFINE_AUTOPTR_FUNC for virStorageVolDef
-e8c2ae storage: add support for new rbd_list2 method
-dee98c storage: split off code for calling rbd_list
-956103 Revert "qemu: hotplug: Prepare disk source in..."
-97d02f STX: po make: limit thread creation ability of libgomp
-6e8f91 STX: Revert "vsh: Fix broken build on mingw"
 0d92d8 STX: pci-sriov perform limited retry on netlink failures
 c49366 STX: Increase timeout for connecting to monitor
 dedd07 STX: Stop processing memory stats if balloon info hard fails
-e0f897 STX: Allow vcpu pinning with TCG
 d8b544 STX: Adding systemd dependencies against pmon.service
-7bf5a9 STX: Set initial cpu affinity of qemu threads
 28b73b STX: Fixed default libvirtd systemd service
 e4c5a6 STX: DPDK parms handling
 fdf5e7 STX: Drop migration poll times to 10mS
 fbc79d STX: System Logging: set group read permission on log files
 2721c7 STX: CPU pinning not working over live-migration

[1] https://review.opendev.org/c/starlingx/integ/+/824928
[2] https://packages.debian.org/source/bullseye/libvirt
[3] https://github.com/starlingx-staging/stx-libvirt
[4] https://salsa.debian.org/libvirt-team/libvirt/-/tree/debian/7.0.0-3/debian

Test Plan:
PASS: Build the libvirt packages
PASS: Build Debian ISO with libvirt packages
PASS: Bootstrap Debian ISO on AIO-SX
PASS: Ensure libvirt packages are installed (apt list --installed)
PASS: Lock/Unlock AIO-SX *
* Future tests regarding the libvirt/qemu runtime features will be done
once all the pieces are in place in the ISO.

Depends-On: https://review.opendev.org/c/starlingx/root/+/865021

Story: 2010317
Task: 46391

Signed-off-by: Thales Elero Cervi <thaleselero.cervi@windriver.com>
Change-Id: Ib3da0e663336021fa2cfd6b400d1081fc0113348
2022-11-18 18:10:54 -03:00
Rafael Falcao 75a234904f Debian: Add build structure for virt/qemu
This change adds the necessary files for the qemu package to
be built for Debian. This review follows the same approach
used on the virt/libvirt [1].

The base version selected comes from the Debian archive [2] since the
salsa-debian [3] version was not fully compatible with stx build tools.
The full upstream build was quite long (time) and big (size) so we
patched the Debian files with debian_patches to drop unnecessary
packages, that is, packages that starlingx does not need.

The patches dir will contain source code patches required for
stx-qemu, that is, the code that was earlier added on top of 3.0.0
qemu release to add StarlingX required functionalities.
The work done on this change is simply porting the code changes,
copying it and doing the minimum required updates when it is needed.

The list of commits follow, where the "-" character indicates that the
commit was dropped now that we are based on 5.2:

 d3400d STX: virtio-serial: don't touch virtqueue if vm is stopped
 71dc08 STX: Modify live migration auto-converge threshold
 9be81b STX: Suspend/Resume for VMs with PCIPT+Virtio
 876a3c STX: realtime uses mlock instead of mlockall
 007444 STX: qemu dpdk custom config
 3f6344 STX: add libdl
 dbda73 STX: qemu: add compile define for CONFIG_DPDK
 626bfd STX: qemu: add -enable-dpdk runtime flag
 79ea26 STX: qemu dpdk changes for openvswitch dpdk
 9c83db STX: migration thread affinity and priority qmp
 e7fbe5 STX: Add support statement to -help output
-48de9c STX: Changes for running on CentOS
-32b6f0 Upstream: Workaround: make sure vdev->vq[i].inuse never goes
        below 0
-246b26 virtio: Return true from virtio_queue_empty if broken

[1] https://review.opendev.org/c/starlingx/integ/+/863561
[2] https://snapshot.debian.org/archive/debian/20221109T211529Z/pool/main/q/qemu/
[3] https://salsa.debian.org/qemu-team/qemu/-/tree/debian-bullseye

Test Plan:
PASS: Build the qemu packages
PASS: Build iso with qemu packages
PASS: Bootstrap Debian ISO on AIO-SX
PASS: Ensure qemu packages are installed (apt list --installed)
PASS: Lock/Unlock AIO-SX *
* Future tests regarding the libvirt/qemu runtime features will be done
once all the pieces are in place in the ISO.

Depends-On: https://review.opendev.org/c/starlingx/root/+/864942

Story: 2010317
Task: 46390

Signed-off-by: Rafael Falcao <rafael.vieirafalcao@windriver.com>
Co-Authored-by: Thales Elero Cervi <thaleselero.cervi@windriver.com>
Change-Id: I424debf7eb24c024ba82a490cda746dbd5af0019
2022-11-18 18:10:18 -03:00
Scott Little 01a95fc6ca Fix qemu and kubernetes build resource requirements
Qemu and kubernetes build failed to build under a 3 GB ramdisk.
The 6 GB ramdisk was ok.

Increase the minimum resources for these packages to 6 GB.

Closes-bug: 1964980
Signed-off-by: Scott Little <scott.little@windriver.com>
Change-Id: I6027a4c02c15ef87a405ad300e967499c103b452
2022-03-15 11:39:08 -04:00
Zuul f61b3d66b1 Merge "Add debian package for virt/kvm-timer-advance" 2022-01-22 21:01:36 +00:00
Zuul 4a022f667d Merge "Add debian package for virt/cloud-init" 2022-01-13 22:49:18 +00:00
Leonardo Fagundes Luz Serrano 6420a976d3 Add debian package for virt/libvirt-python
Add debian packaging infrastructure for virt/libvirt-python
to build a debian package.

Verification:
- Built pkg
- Built image

Story: 2009101
Task: 44082

Signed-off-by: Leonardo Fagundes Luz Serrano <Leonardo.FagundesLuzSerrano@windriver.com>
Change-Id: I98e92b0dc095013ba452ec6bcf525f0e977c721a
2022-01-11 23:23:00 +00:00
Leonardo Fagundes Luz Serrano 6d1244bda9 Add debian package for virt/cloud-init
Add debian packaging infrastructure for virt/cloud-init
to build a debian package.

Verification:
- Built package
- Built image

Story: 2009101
Task: 44025

Signed-off-by: Leonardo Fagundes Luz Serrano <Leonardo.FagundesLuzSerrano@windriver.com>
Change-Id: Ifaacdc067812503113fc52c81bcd3be68a17ae3e
2022-01-05 10:56:28 -03:00
Leonardo Fagundes Luz Serrano 4cb5d17a7f Add debian package for virt/kvm-timer-advance
Add debian packaging infrastructure for virt/kvm-timer-advance
to build a debian package.

Verification:
- build-pkgs;
- build-image;
- Same contents and permissions as RPM;

Story: 2009101
Task: 44038

Signed-off-by: Leonardo Fagundes Luz Serrano <Leonardo.FagundesLuzSerrano@windriver.com>
Change-Id: Ie5574facc36c37764c988809729dd0f30347cb72
2021-12-21 11:32:47 -03:00
Bin Qian 7b92dbb403 remove /data which is not being used
Remove /data dir.

Closes-Bug: https://bugs.launchpad.net/starlingx/+bug/1940088

Change-Id: Ief68967da15ef142b5a24b0fb3b6ca04ad5d939d
Signed-off-by: Bin Qian <bin.qian@windriver.com>
2021-08-16 09:50:38 -04:00
Dongqi Chen af359d4938 Add auto-versioning to starlingx/integ packages
This update makes use of the PKG_GITREVCOUNT variable
to auto-version the packages in this repo.

Story: 2007750
Task: 39951
Change-Id: I854419c922b9db4edbbf6f1e987a982ec2ec7b59
Signed-off-by: Dongqi Chen <chen.dq@neusoft.com>
2020-06-24 09:48:28 +08:00
Zuul 52807307ce Merge "Add back kvm_timer_advance_setup.service" 2019-07-30 20:28:33 +00:00
Al Bailey 56c534ad98 Add back kvm_timer_advance_setup.service
The kvm_timer_advance_setup service was packaged and
installed as part of nova-compute package prior to
containerizing nova.

The service file has been updated to start before kubelet.

The service becomes enabled by puppet which writes a
config file containing the vcpu_pin_set information.

The utility script has been updated.
The .sh extension has been added, and it passes bashate.

Updated the license to GPLv2 since the tuned package
where the script was dervied from is GPLv2.

Change-Id: Iff90c46826a88283e42a980e7823593599f03206
Closes-Bug: 1823751
Signed-off-by: Al Bailey <Al.Bailey@windriver.com>
2019-07-24 16:04:58 -05:00
Sun Austin 3d5300ec25 change tis patch version to 101 for below PR
https://github.com/starlingx-staging/stx-libvirt/pull/6

Revert "qemu: hotplug: Prepare disk source in
qemuDomainAttachDeviceDiskLive"
This reverts commit 192fdaa614e3800255048a8a70c1292ccf18397a.
According to https://bugzilla.redhat.com/show_bug.cgi?id=1672620
reverting this commit  will fix
https://bugs.launchpad.net/starlingx/+bug/1834194 and
reverting is official merged in libvirt-4.9.0 too.

Partial-Bug: #1834194

Change-Id: I0ea21e0b39ef016ecff113bb107b0667a2105424
Signed-off-by: Sun Austin <austin.sun@intel.com>
2019-07-05 18:46:51 +08:00
Jim Somerville f83c44e4ad libvirt and qemu patch reduction
Changes to support removing the RHEL patches include:
- drop systemtap from the spec file for qemu
- leave the man page name as qemu vs. qemu-kvm, man pages are not
  installed into containers anyway

Change-Id: I230f7213f9de50fc94b4ddbbb0ebd6581ee1f5a1
Story: 2005212
Task: 29990
Depends-On: https://review.opendev.org/#/c/655235/
Signed-off-by: Jim Somerville <Jim.Somerville@windriver.com>
2019-04-23 15:37:42 -04:00
Don Penney 1b78769ed5 Remove pike/master files
This update removes pike and master wheel and/or image files,
as these have been replaced with stable/dev.

Change-Id: I02dfdd799c62f0b4028606b04ad6f125865769d9
Story: 2005248
Task: 30321
Signed-off-by: Don Penney <don.penney@windriver.com>
2019-04-03 22:30:59 -04:00
Don Penney b6d2f1d9ae Create the stable/dev wheel and image build files
This update supports the migration to stable/dev build streams by
setting up the stable/dev wheels.inc and image build files.

Change-Id: I2330be8a910245d434a9e0a116fa4db65f7212e8
Story: 2005248
Task: 30100
Depends-On: Ib5dc9a7c1d8c37368d073e28d83eeb883766ee3f
Signed-off-by: Don Penney <don.penney@windriver.com>
2019-03-20 14:09:34 -04:00
Chris Friesen 3d2642e639 Formatting cleanups in libvirt hook bash script
Just doing some whitespace and variable expansion cleanups in the
bash script that were highlighted while doing a previous review.

Change-Id: I6a5a1e80057fbf6cb292fc0ed5415a26fb780958
Signed-off-by: Chris Friesen <chris.friesen@windriver.com>
2019-03-13 09:50:35 -06:00
Chris Friesen f2e4b83ed2 clean up unused libvirt hooks for emulated vTPM
The final upstream implementation for emulated TPM support in libvirt
has merged, and as such we no longer need to maintain our own hooks.

Let's clean up this code as it's no longer relevant.

Change-Id: I1c1ee1fa9f53c6c4cdaecc102bb05fe548ba9fb7
Story: 2005213
Task: 29991
Signed-off-by: Chris Friesen <chris.friesen@windriver.com>
2019-03-13 09:47:47 -06:00
Daniel Chavolla 1e9f9ff1f4 Add low latency per-cpu power management
Refactor low latency compute per-cpu power management
out of stx-nova into libvirt qemu hook

Story: 2004610
Task: 28508

Change-Id: I80432b36c4e71d957db51f1742ef87fb519acce2
Signed-off-by: Daniel Chavolla <daniel.chavolla@windriver.com>
2019-02-01 14:27:10 -05:00
Jim Somerville adf64cb917 Upgrade qemu to version 3.0.0
Note that it now uses keycodemapdb source which was upgraded
earlier.

Story: 2003395
Task: 24521

Change-Id: I551d654c4b5d7c923911d8c33f0b5fca022d1dda
Signed-off-by: Jim Somerville <Jim.Somerville@windriver.com>
2018-12-04 15:24:11 -05:00
Robert Church 3761b07ee7 Rebase openstack-helm and openstack-helm-infra
The latest upstream libvirt helm chart now requires the cgexec binary
which is part of the libcgroup-tools package.

Change-Id: I6f5398a2788174f800612bc42226e8fdd26ab83f
Story: 2003909
Task: 27632
Signed-off-by: Robert Church <robert.church@windriver.com>
2018-11-15 23:55:58 -05:00
Don Penney 3edcba1d55 Create stx-integ docker image directives file
This update adds the docker image build directives file for
stx-libvirt and creates the centos_pike_docker_images.inc.

Change-Id: I72409f0f321b6c315a62e540e79e5d716eb023ed
Story: 2003907
Task: 26788
Signed-off-by: Don Penney <don.penney@windriver.com>
2018-11-14 15:16:18 -06:00
Al Bailey b9d034298f libvirt-python spec was failing to build
The py2_build_wheel macro was evaluating to a command
that failed to build libvirt-python.

libvirt-python has its own set of CFLAGS so those are
being used.

This also fixes the scenario where a non centos build env
would have been missing the BuildRequires for the wheel command.

Closes-Bug: 1799735
Change-Id: Ib9cf8a120069fa15f1832c925c2ba56c6ee8e971
Signed-off-by: Al Bailey <Al.Bailey@windriver.com>
2018-10-24 15:05:34 -05:00
Don Penney a89aee499a Add hooks for python wheel generation
This update adds hooks to the spec files for the following packages
to generate wheels for the python modules:
- ceph-manager
- libvirt-python
- logmgmt
- platform-util
- python-3parclient
- python-cephclient
- python-lefthandclient
- python-ryu
- vm-topology

Change-Id: Ia63291e686818d19d0df52ff26b5f0bb3812b8ce
Story: 2003907
Task: 26787
Signed-off-by: Don Penney <don.penney@windriver.com>
2018-10-23 10:35:32 -04:00
Jim Somerville 13d7498325 Upgrade libvirt to version 4.7.0
Includes the libvirt-python package upgrade as well.  Note
that the generated package is now called python2-libvirt.

Story: 2003339
Task: 24377
Story: 2003396
Task: 24522

Depends-On: https://review.openstack.org/#/c/605230/

Change-Id: Iad2c521c2f2fc871589f793c5902555d3c3c41f4
Signed-off-by: Jim Somerville <Jim.Somerville@windriver.com>
2018-09-25 17:41:05 -04:00
Dean Troyer fe26a0ff84 Merge remote-tracking branch 'origin/master' into f/centos75
Change-Id: I166b99c4ce2ed458ac79ce686064ab05ad3ca198
Signed-off-by: Dean Troyer <dtroyer@gmail.com>
2018-09-15 01:18:37 -05:00
Dean Troyer e3b649669c Merge remote-tracking branch 'origin/master' into f/centos75-merge
Change-Id: Idf04b651ea1301745ad429a423b09d93543012e3
2018-09-02 15:42:07 -05:00
Sun Austin 847cf1e92f Fix linters issue E002 and E003 and linters check (none-voting)
E002 Tab indents
E003 Indent not multiple of 4

Story: 2003366
Task: 24424

Change-Id: Ie063ccfe346489f08c4752adaa344f5919db0378
Signed-off-by: Sun Austin <austin.sun@intel.com>
2018-08-31 04:08:52 +00:00
zhipengl ca1afed947 [upstream] Remove stx-integ/virt/libvirt/libvirt-2.0.0
Removing this directory because it is no longer used, as we are currently on libvirt-3.5.0

Story: 2003409
Task: 24550

Change-Id: Ic88c2d54df41c4ca271ef8db482e7226ba37d80f
Signed-off-by: zhipengl <zhipengs.liu@intel.com>
2018-08-28 03:14:34 +08:00
zhipengl c232a9a018 upgrade cloud-init to CentOS 7.5 version
Story: 2003389
Task: 24501

Change-Id: I25f889252a23963fe55f719778aaa9840bd1152b
Signed-off-by: zhipengl <zhipengs.liu@intel.com>
2018-08-27 05:13:10 +00:00
Scott Little bab9bb6b69 Internal restructuring of stx-integ
Create new directories:
   ceph
   config
   config-files
   filesystem
   kernel
   kernel/kernel-modules
   ldap
   logging
   strorage-drivers
   tools
   utilities
   virt

Retire directories:
   connectivity
   core
   devtools
   support
   extended

Delete two packages:
   tgt
   irqbalance

Relocated packages:
   base/
      dhcp
      initscripts
      libevent
      lighttpd
      linuxptp
      memcached
      net-snmp
      novnc
      ntp
      openssh
      pam
      procps
      sanlock
      shadow
      sudo
      systemd
      util-linux
      vim
      watchdog

   ceph/
      python-cephclient

   config/
      facter
      puppet-4.8.2
      puppet-modules

   filesystem/
      e2fsprogs
      nfs-utils
      nfscheck

   kernel/
      kernel-std
      kernel-rt

   kernel/kernel-modules/
      mlnx-ofa_kernel

   ldap/
      nss-pam-ldapd
      openldap

   logging/
      syslog-ng
      logrotate

   networking/
      lldpd
      iproute
      mellanox
      python-ryu
      mlx4-config

   python/
      python-2.7.5
      python-django
      python-gunicorn
      python-setuptools
      python-smartpm
      python-voluptuous

   security/
      shim-signed
      shim-unsigned
      tboot

   strorage-drivers/
      python-3parclient
      python-lefthandclient

   virt/
      cloud-init
      libvirt
      libvirt-python
      qemu

   tools/
      storage-topology
      vm-topology

   utilities/
      tis-extensions
      namespace-utils
      nova-utils
      update-motd

Change-Id: I37ade764d873c701b35eac5881eb40412ba64a86
Story: 2002801
Task: 22687
Signed-off-by: Scott Little <scott.little@windriver.com>
2018-08-01 10:06:31 -04:00