Commit Graph

33 Commits

Author SHA1 Message Date
Scott Little e80813bb81 Relocated some packages to repo 'config-files'
List of relocated subdirectories:

base/centos-release-config
base/dhcp-config
base/dnsmasq-config
base/haproxy-config
base/initscripts-config
base/lighttpd-config
base/net-snmp-config
base/openssh-config
base/setup-config
base/systemd-config
config-files/audit-config
config-files/docker-config
config-files/io-scheduler
config-files/iptables-config
config-files/memcached-custom
config-files/ntp-config
config-files/pam-config
config-files/rsync-config
config-files/shadow-utils-config
config-files/sudo-config
config-files/syslog-ng-config
config-files/util-linux-config
filesystem/filesystem-scripts
filesystem/iscsi-initiator-utils-config
filesystem/nfs-utils-config
ldap/openldap-config
logging/logrotate-config
networking/mellanox/mlx4-config
networking/openvswitch-config

Story: 2006166
Task: 35687
Depends-On: I665dc7fabbfffc798ad57843eb74dca16e7647a3
Change-Id: I3dc0fc9f88931c5e0963d00274408ff7a16fae3a
Signed-off-by: Scott Little <scott.little@windriver.com>
Depends-On: I761b0f76150881c765b70b2ccd255244c754bd5d
2019-09-05 20:32:09 -04:00
Andy Ning 5ec956fff5 dcdbsync for containerized openstack services - logging
This updates syslog-ng configuration for logging of openstack dcdbsync
instance.

Story: 2004766
Task: 36097
Change-Id: If72df22b9200445f95a6894df73fad1cfffa7944
Signed-off-by: Andy Ning <andy.ning@windriver.com>
2019-08-07 13:39:29 -04:00
zhipengl 20d9a7a754 Fix System account doesn't block after invalid login attempts
Need install openssh before install pam-config package as pam-config
package will change ssh related pam config file.

Verified below issue!
When trying to login invalid password attempt 5 times using
ssh, the user account is not locked out.

Closes-Bug: #1814345

Change-Id: I4d973dac88dba3133cfcc92a96fba7918d674e79
Signed-off-by: zhipengl <zhipengs.liu@intel.com>
2019-07-24 02:21:04 +00:00
Don Penney 13ecf0f821 Update log file permissions to 640 for specific log files
Log files that may contain secure information should have
restricted permissions. This includes all -api log files,
as well as log files in which the operator login and
authententication attempts are logged.

Change-Id: I56ef476609d65991529ba0a6311ebd29a7710386
Closes-Bug: 1836632
Signed-off-by: Don Penney <don.penney@windriver.com>
2019-07-17 18:15:01 -04:00
zhipengl 202ad050a8 Fix System account doesn't block after invalid login attempts
Move ssh.pam from openssh-config to pam-config

Verified below issue!
When trying to login invalid password attempt 5 times using
ssh, the user account is not locked out. 
/etc/pam.d/sshd is expected in controller node as well.

Closes-Bug: #1814345

Change-Id: I8fae8782cbd491c6efe8631f04c2728a531bc4ca
Signed-off-by: zhipengl <zhipengs.liu@intel.com>
2019-07-09 02:40:01 +00:00
Saul Wold 83c6575d51 integ: Convert wrsroot -> sysadmin
This also changes the group wrs_protected to sys_protected
to de-brand the user and group names.

Depends-On: I887464a20fc17d66529caea03be2b445156f9426
Change-Id: Ic2ea06d3ac15c31854a604af5f4cecf9094fcaea
Story: 2004716
Task: 28748
Signed-off-by: Saul Wold <sgw@linux.intel.com>
2019-06-14 15:09:09 -07:00
Kristine Bujold 7e56b74ee8 Add /var/log/armada/ to logrotate
This commit adds /var/log/armada, which stores application related
logs generated by Armada service, to logrotate.

Story: 2003908
Task: 28267
Depends-On: https://review.opendev.org/663347

Change-Id: I98c7caf85cfecf4de1f55be69a00697f9073a1a8
Signed-off-by: Kristine Bujold <kristine.bujold@windriver.com>
2019-06-06 13:43:05 -04:00
Zuul dcbe61a3f0 Merge "Docker logs are not rotating" 2019-05-08 19:01:12 +00:00
Kristine Bujold 7b98e2679a Docker logs are not rotating
Add docker logs to logrotate.

Change-Id: Icd765ebdad1bad0ab53fdeafae6a447dde318c96
Closes-Bug: 1827322
Signed-off-by: Kristine Bujold <kristine.bujold@windriver.com>
2019-05-08 13:55:42 -04:00
Al Bailey 481f78f5bf Remove unused openstack references from patch-restart and syslog
Most of the openstack processes are containerized so there is no
need for them to be included in the patch restart scripts, or
the syslog configuration and log rotation files.

Story: 2004764
Task: 30668
Change-Id: Ib342fa7b594cdafa5d7c7575044ea28783daf9d0
Signed-off-by: Al Bailey <Al.Bailey@windriver.com>
2019-05-08 08:01:59 -05:00
Andy Ning 976942fb75 Keystone DB sync - update syslog-ng for logging
This commit updates syslog-ng configuration to support dcorch dbsync
service logging.

Story: 2002842
Task: 22787

Signed-off-by: Andy Ning <andy.ning@windriver.com>
(cherry picked from commit 38a07c1bda)

Depends-On: https://review.opendev.org/#/c/655768
Change-Id: I2db9f911d2c5ec979e32f30497d6e72337741cdc
2019-04-30 14:34:37 -04:00
Zuul 7ae7690285 Merge "Add notices to Intel authored files." 2019-03-22 07:04:27 +00:00
Erich Cordoba 6bfca507bd Add notices to Intel authored files.
Story: 2005265
Task:  30090

Change-Id: I7cc22cf39d971fbf7fa149b89a892de27b8e6b64
Signed-off-by: Erich Cordoba <erich.cordoba.malibran@intel.com>
2019-03-20 10:31:10 -06:00
Eric MacDonald c0617ebb53 Remove Resource Monitor ; aka rmon, from the load
All rmon resource monitoring has been moved to collectd.

This update removes rmon from mtce and the load.

Story: 2002823
Task: 30045

Test Plan:
PASS: Build and install a standard system.
PASS: Inspect mtce rpm list
PASS: Inspect logs
PASS: Check pmon.d

Depends-On: https://review.openstack.org/#/c/643739
Change-Id: I927862895272fdd024d281ab49e0a128465b1b3f
Signed-off-by: Eric MacDonald <eric.macdonald@windriver.com>
2019-03-18 12:27:59 -04:00
Bin Qian 5d13b4c911 Set docker service monitored by pmond
override docker service so systemd:
1. to create/remove /var/run/dockerd.pid file at service start/stop.
2. not to restart automatically on exit or failure

deploy docker.conf for pmond to monitor docker service

Story: 2002843
Task: 29391

Change-Id: I3595d0d4f97d90e4119fc1455bcf164aebc5d6ec
Signed-off-by: Bin Qian <bin.qian@windriver.com>
2019-02-19 11:33:00 -05:00
Eric MacDonald e8c9676d98 Add network interface monitoring plugin to collectd
This update introduces interface monitoring for oam,
mgmt and infra networks as a collectd plugin.

The interface plugin runs and queries the new maintenance
Link Monitor daemon for Link Model and Information every
10 seconds.

The plugin then manages alarms based on the link model similar
to how rmon did in the past ; port and interface alarms.

Severity: Interface and Port levels

Alarm Level  Minor        Major              Critical
-----------  -----  ---------------------    ----------------------------
Interface     N/A   One of lag pair is Up    All Interface ports are Down
     Port     N/A   Physical Link is Down    N/A

Degrade support for interface monitoring is add to the mtce
degrade notifier. Any link down condition results in a host
degrade condition like was in rmon.

Sample Data: represented as % of total links Up for that network interface
100 or 100% percent used - all links of interface are up.
 50 or  50% percent used - one of lag pair is Up and the other is Down
  0 or   0% percent used - all ports for that network are Down

The plugin documents all of this in its header.

This update also

1. Adds the new lmond process to syslog-ng config file.
2. Adds the new lmond process to the mtce patch script.
3. Modifies the cpu, df and memory threshold settings by -1.
   rmon thresholds were precise whereas collectd requires
   that the samples cross the thresholds, not just meet them.
   So for example, in terms of a 90% usage action the
   threshold needs to be 89.

Test Plan: (WIP but almost complete)

PASS: Verify interface plugin startup
PASS: Verify interface plugin logging
PASS: Verify interface plugin Link Status Query and response handling
PASS: Verify monitor, sample storage and grafana display
PASS: verify port and interface alarm matches what rmon produced
PASS: Verify lmon port config from manifest configured plugin
PASS: Verify lmon port config from lmon.conf
PASS: Verify single interface failure handling and recovery
PASS: Verify lagged interface failure handling and recovery
PASS: Verify link loss of lagged interface shared between mgmt and oam (hp380)
PASS: Verify network interface failure handling ; single port
PASS: Verify network interface degrade handling ; lagged interface
PEND: Verify network interface degrade handling ; vlan interface
PASS: Verify HTTP request timeout period and handling
PASS: Verify link status query failure handling - invalid uri (timeout)
PASS: Verify link status query failure handling - missing uri (timeout)
PASS: Verify link status query failure handling - status fail
PASS: Verify link status query failure handling - bad json resp

Change-Id: I2e2dfe6ddfa06a46770245540c7153d330bdf196
Story: 2002823
Task: 28635
Depends-On: https://review.openstack.org/#/c/633264
Signed-off-by: Eric MacDonald <eric.macdonald@windriver.com>
2019-02-06 14:18:14 -05:00
Tao Liu d4fec24f6c Change compute node to worker node personality
The compute personality & subfunction has been changed to
worker, and compute_reserved.conf has been rename to
worker_reserved.conf. Compute configuration flags have
been updated to worker flags.

This update changes misc dependencies to compute
personality, compute_reserved.conf and configuration
flag files.

It aslo removed puppet-nova dependencies to
compute_reserved.conf.

Tests Performed:
Non-containerized deployment
AIO-SX: Sanity and Nightly automated test suite
AIO-DX: Sanity and Nightly automated test suite
2+2 System: Sanity and Nightly automated test suite
2+2 System: Horizon Patch Orchestration

Kubernetes deployment:
AIO-SX: Create, delete, reboot and rebuild instances
2+2+2 System: worker nodes are unlock enable and no alarms

Story: 2004022
Task: 27013

Depends-On: https://review.openstack.org/#/c/624452/

Change-Id: Iccf5584058a2154f1c4ffdb061938e76b9965861
Signed-off-by: Tao Liu <tao.liu@windriver.com>
2018-12-12 15:09:04 -05:00
Sun Austin ff360aa30a update /etc/pam.d/system-auth content with system-auth.pam
LDAP sudo user is not able to login by password.
root cause is that password rules in system-auth is not updated
correctly because system-auth.apm in pam-config is missed to be
copied to /etc/pam.d/system-auth

copy system-auth.pam in pam-config to /etc/pam.d/system-auth to
solve this issue.

Closes-Bug: #1806977

Change-Id: Ic646e30d06bcbe8cf3bf66c903942e4240bd23bd
Signed-off-by: Sun Austin <austin.sun@intel.com>
2018-12-10 10:36:19 +08:00
Alex Kozyrev cdc60aac81 Barbican integration into logging/patching mechanisms.
- add barbican logs in syslog
- support no reboot patching for barbican processes
- get information about barbican in collect script

Change-Id: I75557a2d35d3861c2dee3d0a5a0960bebc6d0e48
Story: 2003108
Task: 27700
Depends-On: I6b0b0c90456627bebde2b834b339bc968100b6f9
Signed-off-by: Alex Kozyrev <alex.kozyrev@windriver.com>
2018-11-30 13:23:13 -05:00
zhipengl 0599e8e58e Refactor patches for setup package
Use setup-config package to package config files for setup package.
Merge all passwd, group, uidgid patches to one patch.

Deployment test and ping test between VMs pass
Config and service files check pass.

Story: 2003768
Task: 27592

Change-Id: I98da90695c8184261279b27b4ede63fd7951babf
Signed-off-by: zhipengl <zhipengs.liu@intel.com>
2018-11-30 08:41:36 +08:00
zhipengl 3406431fc5 Refactor patches for util-linux package
Use util-linux-config package to package config files for util-linux.
Remove util-linux package folder and use RPM instead of SRPM for
util-linux.

Deployment test and ping test between VMs pass
Config file check pass.

Story: 2003768
Task: 27595
Depends-on: https://review.openstack.org/#/c/618943/

Change-Id: If90ed6df4a875a576c7ac709589ac221bb0fa2e3
Signed-off-by: zhipengl <zhipengs.liu@intel.com>
2018-11-22 18:17:53 +08:00
zhipengl 2bd19e3f8f Refactor patches for pam package
Use pam-config package to package config files for pam package.
We can remove related patch of pam and use RPM instead of SRPM
for pam.

Deployment test and ping test between VMs pass
Config files check pass.

Story: 2003768
Task: 27589
Depends-on: https://review.openstack.org/#/c/617454/

Change-Id: Ib19aa8ef023c184c7dcf0e4086adb516be0d947d
Signed-off-by: zhipengl <zhipengs.liu@intel.com>
2018-11-20 18:21:35 +08:00
zhipengl 9a10fe4a2f Refactor patches for rsync package
Use rsync-config package to package rsyncd.conf file for rsync
package.
Remove rsync package folder and use RPM instead of SRPM for rsync.

Deployment test and ping test between VMs pass
Config file check pass.

Story: 2003768
Task: 27590
Depends-on: https://review.openstack.org/#/c/617447/

Change-Id: Ic5aeec585774917bb4b25c08fe1a4fa5a3e7d77c
2018-11-19 18:58:45 +08:00
Zuul 4046c2ca47 Merge "refactor iptables" 2018-11-19 01:28:36 +00:00
Zuul efd96cd34c Merge "refactor syslog-ng" 2018-11-19 01:28:20 +00:00
slin14 2b5e63bc40 refactor iptables
Package iptables-config is created for iptables customized
config file. And there is no other change for iptables, so
we could replace iptables srpm with rpm directly.

iptables-config is set to depends on iptables, so iptables
could be installed automatically.

Test:
Pass build and multi node deploy test. Confirm iptables
config file is the same as before.

Story: 2003768
Task: 27600
Depends-On: https://review.openstack.org/617170

Change-Id: I08daae6f53de43688e9edb2506398e3391589fe0
Signed-off-by: slin14 <shuicheng.lin@intel.com>
2018-11-16 18:28:17 +08:00
slin14 be3514e25c refactor audit
Package audit-config is created to config customized config
file of audit. Since there is no other change for audit,
we could replace srpm with rpm directly.

audit-config is set to depends on audit, so audit rpm will be
installed automatically.

Test:
Pass build and multi node deploy test. Confirm syslog.conf is
the same as before in the deploy.

Story: 2003768
Task: 27602
Depends-On: https://review.openstack.org/617174

Change-Id: I6101142642dd21c35e7db1352cc8c9aa05fba923
Signed-off-by: slin14 <shuicheng.lin@intel.com>
2018-11-12 19:51:58 +08:00
slin14 fc4a7c9d49 refactor syslog-ng
Package syslog-ng-config is created to install customized
config file of syslog-ng. Since there is no source code change
in syslog-ng, we could replace the srpm with rpm directly.

syslog-ng-config is set to depends on syslog-ng. So syslog-ng
will be installed automatically.

Test:
Pass build and basic deploy test. Confirmed the related config
file is the same as before.

Story: 2003768
Task: 27599
Depends-On: https://review.openstack.org/616720

Change-Id: I2a4e15b9ffde92aa59072d590de2b56d239e29ad
Signed-off-by: slin14 <shuicheng.lin@intel.com>
2018-11-09 19:35:54 +08:00
slin14 644cb5ffa8 refactor ntp
Add ntp-config package to config the customized ntp.conf and ntpd.
With this change, ntp srpm is dropped to replaced by rpm.
ntp-config is configured to depend on ntp, so ntp will be included
in the ISO automatically.
ntp package will be installed in all type node, so no change to filter.

Test has been done:
build and deploy with multinode. confirm ntp.conf and ntpd is kept
the same as before.

Story: 2003768
Task: 27587

Change-Id: I795f0fd2b53c46c7302104a07c5d4cfe869d3c7b
Signed-off-by: slin14 <shuicheng.lin@intel.com>
2018-11-07 18:32:28 +08:00
slin14 90373272b8 refactor shadow-utils
The refactor task is to eliminate patch which is relate to configure
file modification. And we could replace srpm with rpm if all patches
could be eliminated, which will help save build time.
To eliminate the patch, a new config package or puppet file will be
created to do the configure file modification. Here is the general
guide for the refactor process:
https://review.openstack.org/612292

For shadow-utils, the configure file is moved to shadow-utils-config
package, so src rpm is replaced with rpm.
shadow-utils-config is configured to depend on shadow-utils, so
shadow-utils rpm will be picked automatically in ISO build.
File clear_shadow_locks and su under files folder is not used in build,
so just delete them.

This patch should has no function change from end user view.
Test has been done:
Done build and deploy test, and confirm login.defs and
clear_shadow_locks.service in the deploy node are the same as before.

Story: 2003768
Task: 27593

Change-Id: Ie62800c64aca54c39950266f8cf36e47cc1f55bd
Signed-off-by: slin14 <shuicheng.lin@intel.com>
2018-11-02 20:58:15 +08:00
zhipengl 9c13b8b88e Move memcached changes from platform-utils
Use mecached-custom package to package service file to system
folder instead of platform-utils.
Basic deployment test pass and service file status check pass.

Story: 2004108
Task: 27517
Depends-on: https://review.openstack.org/#/c/614085/

Change-Id: Ic66f077159be2f21caa6e8e68241aae65b9f2245
Signed-off-by: zhipengl <zhipengs.liu@intel.com>
2018-11-02 01:48:23 +00:00
slin14 6a6ea416e1 remove lshell
There is security related issue with lshell, and it is not
maintained now. So remove it from our system to avoid
security issue.

To remove lshell:
1. Package sudo-config is created for wrs.sudo configure file
following the refactor process.
2. ldapusersetup in ldapscripts is modified to use bash only.
lshell support is removed.

ldapusersetup related patches are merged into 1 for easy
maintenance.

Test has been done:
Build and deploy test is done, also unit tests for ldap are
executed with pass, except lshell related test.

Closes-Bug: 1795451

Change-Id: Ia5de1bc94d22eb6c9bea6d9a96e92564ad848b19
Signed-off-by: slin14 <shuicheng.lin@intel.com>
2018-10-30 02:22:54 +08:00
Scott Little f550b7e6c2 Relocate io-scheduler to stx-integ/config-files/io-scheduler
Move content from stx-utils into stx-integ or stx-update

Packages will be relocated to

stx-update:
    enable-dev-patch
    extras

stx-integ:
    config-files/
        io-scheduler

    filesystem/
        filesystem-scripts

    grub/
        grubby

    logging/
        logmgmt

    tools/
        collector
        monitor-tools

    tools/engtools/
        hostdata-collectors
        parsers

    utilities/
        build-info
        branding   (formerly wrs-branding)
        platform-util

Change-Id: Id6b1984eb421278610709eea54e055de5269bf18
Story: 2002801
Task: 22687
Signed-off-by: Scott Little <scott.little@windriver.com>
2018-08-01 12:23:51 -04:00