54868df244
Problem:
On node shutdown, ceph is getting shut down while it is still in use by
the pods/containers. This leads to hangs which eventually leads to the
hostwd service timing out and triggering a reboot.
Solution:
The old dependencies are not suitable for the current version of ceph
because we are now using the containerd docker runtime instead of
docker service. Meanwhile the ceph init script uses systemd-run to
launch the systemd scopes for ceph components(ceph-mon|osd|mds).
The script generates transient systemd scope files with basic
configuration.
This update patches the ceph init script to generate systemd overrides
config files for the ceph components that provide improved ordering
during shutdown. This ordering ensures kubelet and containerd services
are shut down first, then the ceph scopes and service management (SM).
As a result the timeout of hostwd service isn't triggered and the
shutdown now works properly.
TestPlan:
PASS: build-pkgs
PASS: build-image
PASS: Jenkins installation
PASS: kubectl create -f ceph-fuse.yaml
PASS: After checking the pod is running with 'kubectl get pods',
execute the command "sudo shutdown -hP now"
PASS: The shutdown works well without os reboot.
The yaml file is as follows:
$cat ceph-fuse.yaml
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: rwx-test-claim
spec:
accessModes:
- ReadWriteMany
resources:
requests:
storage: 10Gi
storageClassName: cephfs
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: wrx-centos
namespace: default
spec:
progressDeadlineSeconds: 600
replicas: 1
selector:
matchLabels:
run: centos
template:
metadata:
labels:
run: centos
spec:
affinity:
podAntiAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
- labelSelector:
matchExpressions:
- key: run
operator: In
values:
- centos
topologyKey: kubernetes.io/hostname
containers:
- name: centos
image: centos/tools
imagePullPolicy: IfNotPresent
command: [ "/bin/bash", "-c", "--" ]
args: [ "while true; do dd if=/dev/zero of=/mnt1/aaa bs=1K count=100 && sleep 1; done;" ]
volumeMounts:
- name: pvc1
mountPath: "/mnt1"
restartPolicy: Always
volumes:
- name: pvc1
persistentVolumeClaim:
claimName: rwx-test-claim
Closes-Bug: 2011610
Signed-off-by: Zhixiong Chi <zhixiong.chi@windriver.com>
Change-Id: I2c093c490ba177fbfc816e44dc227890270cac83
|
||
|---|---|---|
| base | ||
| bmc/Redfishtool | ||
| centos-debian-compat | ||
| ceph/ceph | ||
| config | ||
| database | ||
| devstack | ||
| doc | ||
| docker/python-docker | ||
| filesystem | ||
| golang-github-dev | ||
| gpu/gpu-operator | ||
| grub | ||
| kubernetes | ||
| ldap | ||
| livepatch/kpatch/debian | ||
| logging/logrotate/centos | ||
| networking | ||
| ostree | ||
| python | ||
| releasenotes | ||
| requests-toolbelt | ||
| security | ||
| storage-drivers | ||
| tools | ||
| virt | ||
| .gitignore | ||
| .gitreview | ||
| .yamllint | ||
| .zuul.yaml | ||
| CONTRIBUTORS.wrs | ||
| LICENSE | ||
| README.rst | ||
| bindep.txt | ||
| centos_build_layer.cfg | ||
| centos_extra_downloads.lst | ||
| centos_guest_image.inc | ||
| centos_guest_image_rt.inc | ||
| centos_iso_image.inc | ||
| centos_pkg_dirs | ||
| centos_pkg_dirs_installer | ||
| centos_pkg_dirs_rt | ||
| centos_srpms_3rdparties.lst | ||
| centos_srpms_centos.lst | ||
| centos_stable_docker_images.inc | ||
| centos_stable_wheels.inc | ||
| centos_tarball-dl.lst | ||
| debian_build_layer.cfg | ||
| debian_iso_image.inc | ||
| debian_pkg_dirs | ||
| debian_stable_docker_images.inc | ||
| distroless_stable_docker_images.inc | ||
| pylint.rc | ||
| test-requirements.txt | ||
| tox.ini | ||
README.rst
integ
StarlingX Integration