Commit Graph

602 Commits

Author SHA1 Message Date
OpenDev Sysadmins 95d8cd4b20 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:52:29 +00:00
Dean Troyer 78ba5bf422 Update .gitreview for f/ceph_mimic_upgrade
Change-Id: I912bbe3dab0aaafcf29b43cfb3f2e3334f5a21d0
Signed-off-by: Dean Troyer <dtroyer@gmail.com>
2019-01-30 08:07:58 -06:00
Zuul e76af6d929 Merge "Uprev kubernetes to 1.12.3" 2019-01-24 16:01:06 +00:00
Zuul 0e94333b17 Merge "build mariadb docker image with galera arbitrator added" 2019-01-23 23:43:07 +00:00
Chris Friesen 8b811b39a8 build mariadb docker image with galera arbitrator added
In order to support running the galera arbitrator we need to add
it to the openstack-helm mariadb docker image.  This means building
our own docker image for now.

I've talked with "jayahn" on the openstack-helm IRC channel, and they
said they had no objection to adding galera-arbitrator to their mariadb
image, so we should upstream it as soon as possible.  Once it's
upstreamed we can remove this.

Change-Id: I6ab2607abcd8e0d130ef80fbd1979c62a20a6ff4
Story: 2004712
Task:  29053
Signed-off-by: Chris Friesen <chris.friesen@windriver.com>
2019-01-23 17:11:45 -06:00
Wei Zhou ed8655fa77 Move STX specific files from stx-ceph to stx-integ
By moving STX specific files from stx-ceph to stx-integ, we
decouple STX code from the upstream ceph repo. When making
changes in those STX files, we don't need to make "pull
request" in stx-ceph repo any more.

Change-Id: Ifaaae452798561ddfa7557cf59b072535bec7687
Story: 2002844
Task: 28993
Signed-off-by: Wei Zhou <wei.zhou@windriver.com>
2019-01-23 10:05:40 -05:00
Al Bailey 76989227c7 Uprev kubernetes to 1.12.3
Rather than storing a diff file of the spec file changes,
the original spec file is included for easier comparison.

Story: 2002843
Task: 28909
Change-Id: I11b327e292e9acdeee66d0869f2b159698e40706
Depends-On: Ifb2ca9f36ae2a2f69038f0aad05a4af93eaaa5ad
Signed-off-by: Al Bailey <Al.Bailey@windriver.com>
2019-01-22 09:39:50 -06:00
Zuul e12b3a436f Merge "Remove alarm query before clear in NTP plugin" 2019-01-21 14:59:56 +00:00
Eric MacDonald abaff6b275 Remove alarm query before clear in NTP plugin
Issue titled 'NTP 100.14 alarm is not cleared' exposed
an issue where the NTP plugin alarm clear operation is
circumvented when its pre-curser fm_api.get_fault call
returns None if the fm process is not running.
From the callers point of view the None return suggests
that the alarm to be cleared does not exist so the code
skips the call to clear.

This update works around this by simply issuing the
clear without the query.

Change-Id: Idcc05bb0e7e1aa1082af1e8ecdcb1a5463b19440
Closes-Bug: 1812440
Signed-off-by: Eric MacDonald <eric.macdonald@windriver.com>
2019-01-18 16:32:53 -05:00
Jerry Sun 7bb43963d3 Build registry-token-server without dep
This change reworks the registry-token-server package spec with
go dependencies downloaded at mirror-download time, rather than
at build time.  The dependencies (at fixed revisions) are
extracted into the package's build tree for compilation.

Story: 2002840
Task: 22783
Depends-On: https://review.openstack.org/#/c/631001/
Change-Id: Ib7d745c6469beacf029195c3e6eaa4935f398483
Signed-off-by: Jerry Sun <jerry.sun@windriver.com>
Signed-off-by: Jason McKenna <jason.mckenna@windriver.com>
2019-01-18 09:36:15 -05:00
Zuul 9fe8574234 Merge "Helm repository replication" 2019-01-17 15:40:23 +00:00
Ovidiu Poncea 6db8e31b21 Add StarlingX specific restart command for Ceph monitors
Since we don't use systemd to manage Ceph and we have pmon monitoring we
have to make sure that:
1. Restarting is properly handled as "systemctl restart" will return
   error and manifest will fail;
2. Pmon does not check ceph-mon status during restart. Otherwise we risk
   getting into a race condition between the puppet restart and pmon
   detecting that ceph is down and trying a restart.

Both are resolved when using /etc/init.d/ceph-init-wrapper restart.

Change-Id: Ie316bb611a006bbbc92ac22c52c3973cc9f15109
Co-Authored-By: Ovidiu Poncea <ovidiu.poncea@windriver.com>
Implements: containerization-2002844-CEPH-persistent-storage-backend-for-Kubernetes
Story: 2002844
Task: 28723
Signed-off-by: Ovidiu Poncea <Ovidiu.Poncea@windriver.com>
2019-01-16 17:05:57 +02:00
Angie Wang d2a4c3d012 Helm repository replication
This updates the helm-upload to stop syncing charts to standby
controller as charts are changed to store in drbd fs.

Story: 2004520
Task: 28343
Depends-On: https://review.openstack.org/#/c/630763/
Change-Id: I12f17fae6124650d878ba7a560f94b7a8ed36e56
Signed-off-by: Angie Wang <angie.wang@windriver.com>
2019-01-14 15:05:47 -05:00
Zuul 5d7ebb734c Merge "change 'compute' to 'worker' in collect utils" 2019-01-10 15:12:24 +00:00
Zuul 1ac4479e80 Merge "Add NTP server monitoring as a collectd plugin" 2019-01-10 15:11:53 +00:00
Eric MacDonald 4d7c958711 Add NTP server monitoring as a collectd plugin
This update replaces the currently existing but disabled
ntpq.py plugin with one that does not rely on an external
query_ntp_servers.sh.

This new ntpq.py is an entirely new self contained
implementation of what rmon and query_ntp_servers.sh
was doing but now more efficiently all in one python
plugin file.

Story: 2002823
Task: 22859

Test Plan:
PASS: Verify handling of one and two unreachable NTP servers.
PASS: verify handling of pingable but not an NTP server.
PASS: Verify NTP server re-provisioning from unreachable to reachable server.
PASS: Verify NTP server re-provisioning from reachable to unreachable server.
PASS: Verify NTP server alarms suppressed while controller is locked.
PASS: Verify NTP asserted alarms show up on unlock until cleared.
PASS: Verify NTP server monitoring occurs on controller only.
PASS: Verify NTP unreachable server alarms are cleared over a collectd restart
PASS: Verify NTP minor IP alarms are cleared on process startup
PASS: Verify NTP minor IP alarm clear retries when FM call fails on process startup.
PASS: Verify NTP alarm assertion retry while FM call fails at runtime.
PASS: Verify NTP alarm clear retry while FM call fails at runtime.
PASS: Verify NTP monitoring after controller Swact.
PASS: Verify NTP monitoring cadence is every 10 minutes.
PASS: Verify NTP plugin logs are useful and assist debug without flooding.

Change-Id: I67c4c5518a6e5dec64b4e419ab7ee2ffcefb9bf3
Signed-off-by: Eric MacDonald <eric.macdonald@windriver.com>
2019-01-09 12:47:00 -05:00
Zuul 40905d8dd8 Merge "Adding a pylint tox and zuul job for stx-integ" 2019-01-08 22:24:24 +00:00
Jerry Sun bfca86f5d9 Remove Docker Registry Token Server From Build
Remove Docker Registry Token Server from build for now. Currently,
it needs network access to build, which doesn't work for some people.
Removing it from the build for now to decide how we want to rework
this.

Story: 2002840
Task: 22783

Change-Id: I7991f68288b45255ea850110ce24087297c185ca
Signed-off-by: Jerry Sun <jerry.sun@windriver.com>
2019-01-08 15:24:27 -05:00
Zuul 0dcd28bea1 Merge "Upversion helm spec to v2.12.1" 2019-01-08 17:18:10 +00:00
Al Bailey 7fbddc4096 Adding a pylint tox and zuul job for stx-integ
The failing pylint warnings and errors are currently
suppressed.  They will be fixed by subsequent commits.

Story: 2004515
Task: 28791
Change-Id: I93a89554bf2dfbd9d1cbd96728a7663c408a79b1
Signed-off-by: Al Bailey <Al.Bailey@windriver.com>
2019-01-08 11:14:46 -06:00
Zuul 293f483aea Merge "Add Docker Registry Token Server" 2019-01-08 17:12:22 +00:00
Jerry Sun 6714d6b8d7 Add Docker Registry Token Server
As part of setting up Keystone authentication with Docker registry,
a token server needs to be deployed and managed by SM. This commit
adds the source code and spec files to build the token server used by
Docker registry for authentication with Keystone. The token server is
a modified version of the example token server provided by Docker
Distribution. The changes uses the Gophercloud library to communicate
with Keystone as opposed to checking the user credentials against an
existing HTPASSWD file.

Story: 2002840
Task: 22783
Depends-On: https://review.openstack.org/#/c/625335/

Change-Id: I00f5aa1073d496aa0b08223c6fa1fcbaf9d5b89b
Signed-off-by: Jerry Sun <jerry.sun@windriver.com>
2019-01-08 11:42:04 -05:00
Joseph Richard d3ff5a1c77 Upversion helm spec to v2.12.1
This commit upversions helm from v2.11.0 to v2.12.1.
This is necessary as support for kubernetes v1.12 support is only
introduced in helm v2.12.

Story: 2004520
Task: 28777
Depends-on: I2501cd1174f85810892e51ac8a44746302eeb120
Change-Id: I605f1ba2c7fda52d9e0bf84b6132314efad15b24
Signed-off-by: Joseph Richard <joseph.richard@windriver.com>
2019-01-08 15:55:37 +00:00
Zuul bd98266efd Merge "Scope parameter in ifup-aliases network script" 2019-01-07 20:08:46 +00:00
Teresa Ho b0f2a8f808 Scope parameter in ifup-aliases network script
The management interface uses the loopback interface for AIO-SX.
For the containerized deployment, the cluster-host interface shares
the same interface with management by default. It would need to be
scoped to host instead of global as it is an alias to the loopback
interface.
The scope parameter is added for the ifup-aliases to set scope
to host if the parent device is the loopback interface.

Story: 2004273
Task: 28590

Change-Id: Iee62c825ed1650b6cfdb0d4e5eb43b4a635e819a
Signed-off-by: Teresa Ho <teresa.ho@windriver.com>
2019-01-07 19:09:53 +00:00
Sun Austin af4879fb68 change 'compute' to 'worker' in collect utils
command 'collect' in worker node will be stuck since
node_type has been changed from 'compute' to 'worker'

Closes-bug: 1810478

Change-Id: I4547bae650b8bb56110eb145e0aca0d49496c793
Signed-off-by: Sun Austin <austin.sun@intel.com>
2019-01-05 09:35:04 +08:00
Zuul 0f5ee1bcb1 Merge "Fix: "import" issue for Python 2/3 compatible code" 2019-01-04 07:50:49 +00:00
Zuul b9015e3d67 Merge "Fix: "tuple_params" issue for Python 2/3 compatible code" 2019-01-04 07:50:47 +00:00
Zuul 05e2acc9c9 Merge "Clean up and standardize landing pages" 2019-01-03 15:25:39 +00:00
Zuul 4afa59f82a Merge "Fix: "map" issue for Python 2/3 compatible code" 2019-01-02 16:52:36 +00:00
Eric MacDonald c8f39de9a0 Implement collectd startup in manifest apply post stage
Starting collectd too early in the manifest apply is seen
to occasionally fail due to a dependency configuration on
hostname resolution in FQDNLookup not being complete.

Since influxdb is used by collectd and is a controller
only service this update moves it to the manifest apply
post stage as well and is filtered out from non
controller load types.

This issue is fixed by the following multi-git changes.

stx-metal:
   Filter influxdb out of storage and compute only loads.
   No real inter git merge dependency

stx-integ: This update.
   Add startup Before=pmond dependency

stx-config:
   Move collectd config and startup to manifest apply post stage
   Move influxdb config and startup to manifest apply post stage

Test Plan:
PASS: Build iso
PASS: verify install storage system and collectd startup
PASS: Verify Storage system DOR
PASS: Verify influxdb and extensions excluded in non-controller loads
PASS: Verify collectd starts properly on all nodes (CC,DOR,UNLOCK)
PASS: Verify influxdb starts properly on controller nodes (CC,DOR,UNLOCK)
PASS: Verify collectd pmond process monitoring and recovery
PASS: Verify influxdb pmond process monitoring and recovery

PEND: Verify collectd statistics storage and fetch to/from influxdb
PEND: Install AIO DX and verify collectd and influxdb startup

Change-Id: I47d70b05bdbdd22f8fce2f56fcc287fac7371ace
Closes-Bug: 1797909
Signed-off-by: Eric MacDonald <eric.macdonald@windriver.com>
2019-01-02 10:21:06 -05:00
Zuul 0fdb9019d6 Merge "rebase e1000e driver patch from 3.4.1.1 to 3.4.2.1 version" 2019-01-02 06:24:22 +00:00
Zuul d423779dc2 Merge "rebase drbd drver patch to 8.4.11-1 version" 2019-01-02 06:23:14 +00:00
slin14 d33383743e rebase drbd drver patch to 8.4.11-1 version
"compat-Statically-initialize-families.patch" is already contained in
the new version, so delete it.
Reset TIS_PATCH_VER to 0 since version is upgraded.

Depends-On: https://review.openstack.org/605292
Story: 2003597
Task: 26588

Change-Id: I628f5b0497df188ea9fa7b7860b56de78382c510
Signed-off-by: slin14 <shuicheng.lin@intel.com>
2018-12-29 02:01:02 +08:00
Kristal Dale 95d66cbd26 Clean up and standardize landing pages
doc index.rst:
1. Update intro sentence to read as a complete sentence
2. Remove unused toctree
3. Correct heading levels (impacting side nav and correct rendering of content)
4. Remove "Indices and Tables" section: genindex page not used, search searches
only index (not useful here)

releasenotes index.rst:
1. Standardize page title reST markup
2. Remove search (make consistent with other openstack release note pages)

Change-Id: I42e5b160336baf8498a83a5414a6e353cc529c5c
Signed-off-by: Kristal Dale <kristal.dale@intel.com>
2018-12-27 17:06:20 -08:00
Sun Austin 79c3a1b255 Fix: "import" issue for Python 2/3 compatible code
use proper absolute path to import modules

remove ignore case 'H301: one import per line'

Story: 2002909
Task:  24886

Change-Id: I1d72e68ead64492ff0c74f8c1bf1b460b573bc1e
Signed-off-by: Sun Austin <austin.sun@intel.com>
2018-12-26 09:19:59 +08:00
Sun Austin 4d9e712c78 Fix: "tuple_params" issue for Python 2/3 compatible code
change "lambda (i, x): i - x" to "lambda i_x: i_x[0] - i_x[1]"
change "def func((tuple))" to "def func(params): (tup_params) = params"

Story: 2002909
Task: 24568

Change-Id: I071be0ab525a580fe6ef201c4f71fa92e8b8b09b
Signed-off-by: Sun Austin <austin.sun@intel.com>
2018-12-26 09:19:59 +08:00
Sun Austin fc9b6f94a8 Fix: "map" issue for Python 2/3 compatible code
Replace map(func, data) with [func(item) for item in data]

Story: 2002909
Task: 24563

Change-Id: I83004eeba036908da483b247093818a6ac3f19c1
Signed-off-by: Sun Austin <austin.sun@intel.com>
2018-12-26 09:19:31 +08:00
Sun Austin 707a12317b Fix: "dict" issue for Python 2/3 compatible code
Replace dict.iteritems() with dict.items()
Replace dict.iterkeys() with dict.keys()
Change dict.keys() to list(dict.keys())

Story: 2002909
Task: 24564

Change-Id: Icf5ef6cc9947a87ee8e013d1225b3f36914e6678
Signed-off-by: Sun Austin <austin.sun@intel.com>
2018-12-25 16:52:30 +08:00
Sun Austin d1dc7bdf90 FIX: oct number issue for Python 2/3 compatible code
change 00xxx or 0xxx to 0oxxx

Story: 2002909
Task:  24561

Change-Id: I1e1ab809a6a1f68a7a1d20e13add314cda554ba5
Signed-off-by: Sun Austin <austin.sun@intel.com>
2018-12-25 16:52:30 +08:00
Zuul 710d6ea19d Merge "Refactor motd patch for crontabs" 2018-12-21 19:16:25 +00:00
Zuul 93c828ed46 Merge "Add go "dep" tool to support lockfiles in go pkgs" 2018-12-21 19:15:50 +00:00
Zuul 502792b995 Merge "typo fix: check right dir before starting ceph-manager" 2018-12-20 20:51:04 +00:00
Changcheng Liu bbd655d23c typo fix: check right dir before starting ceph-manager
It should be "/proc" instead of "/prod"

Change-Id: Ibba46e69f69aca82698f51c31496dbe4c3a39eb5
Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
2018-12-20 10:33:53 +08:00
Zuul f94d8044b4 Merge "Advance PLATFORM_RELEASE to 19.01" 2018-12-19 18:38:21 +00:00
Zuul d26aa62eb0 Merge "Refactor source code patches for dhcp package" 2018-12-19 17:30:24 +00:00
zhipengl acc1863b26 Refactor source code patches for dhcp package
3 source patches can be removed.
2 patches adds support for wrs_install_uuid in the dhclient script.
This added script part just copy the whole content of dhclient-enter-hooks.
Following this script part, it will call this hook script if the hook
exist under /etc/. However, our hook file existed in /etc/dhcp/ folder will
be called by sbin/dhclient-script as well. I'd like to use dhcp config
package to creat /etc/dhclient-enter-hooks soft linked to
/etc/dhcp/dhclient-enter-hooks, so that it can call dhclient script and
no need to add this 2 patches.

Support-disable-nsupdate.patch can be removed as we already fixed port
conflict issue in https://review.openstack.org/#/c/622711/

Deployment test pass and related script file check pass!

Story: 2004473
Task: 28164

Change-Id: If50ae697062a7d0c8a2831fbcc0f5641aaa41ec7
Signed-off-by: zhipengl <zhipengs.liu@intel.com>
2018-12-19 01:24:07 +00:00
Jason McKenna 38613cac94 Add go "dep" tool to support lockfiles in go pkgs
The go compiler supports "go get" to download dependencies, but
it will download the latest version of dependencies from the git
repository of the dependency.  This could lead to non-reproducable
builds, or the potential of dependency API changes (including
deprecated features) to break the build of packages.

The "dep" tool allows for a lockfile to be created, which captures
the git commit ID of dependencies, and can restore dependencies to
the captured state.

Since no binary package containing "dep" is currently available for
CentOS, this change adds the package and compiles it from source.

Depends-On: https://review.openstack.org/625333

Story: 2004617
Task: 28525

Change-Id: Ic3bfad6a419b344e7c147c3839d16956c432a99e
Signed-off-by: Jason McKenna <jason.mckenna@windriver.com>
2018-12-18 09:26:20 -05:00
zhipengl c658f53d02 Refactor motd patch for crontabs
According to analysis from Saul in task 26455, we can remove motd
patch for crontabs and then use RPM instead of SRPM for it.
We also need to remove usage of --without-progname in utilities/
update-motd/files/motd-update.

Story: 2003765
Task: 28181 & 28182
Depends-on: https://review.openstack.org/#/c/623385/

Change-Id: I4be7d47ee77ac07eb24f5b88cd707c29b595df7a
Signed-off-by: zhipengl <zhipengs.liu@intel.com>
2018-12-18 02:37:55 +00:00
Steven Webster 61b8055a14 Fix remote logging traffic control filter priority
Previous commit 01f5fdd made a required change to filter
infrastructure traffic on the management interface with an 802.1q
protocol in the case of a consolidated interface.

However, this has caused the remote logging tc script to have a
failure.  The script tries to install 'ip' protocol filters at the
same priority as the 802.1q filters, which is rejected by the
kernel.

This commit detects a consolidated interface situation and bumps
the priority of the remote logging tc filter priority on the
management interface, similarly to what is done in the main
cgcs_tc_setup script.

The file has also been cleaned up to pass bashate.

Related-Bug: #1807055
Change-Id: Id11625c0f9bcbf109f574563ff284d4a36bc6377
Signed-off-by: Steven Webster <steven.webster@windriver.com>
2018-12-17 15:40:54 -05:00