121 lines
3.4 KiB
Plaintext
121 lines
3.4 KiB
Plaintext
## See online installation and setup documentation at
|
|
|
|
http://ceph.com/docs/master/install/manual-deployment/
|
|
|
|
-------- -------- --------
|
|
|
|
## "systemd" requires manual activation of services:
|
|
|
|
## MON
|
|
# systemctl start ceph-mon
|
|
# systemctl enable ceph-mon
|
|
|
|
## OSD.0 (set other OSDs like this)
|
|
# systemctl start ceph-osd@0
|
|
# systemctl enable ceph-osd@0
|
|
|
|
## MDS
|
|
# systemctl start ceph-mds
|
|
# systemctl enable ceph-mds
|
|
|
|
## "ceph" meta-service (starts/stops all the above like old init script)
|
|
# systemctl start ceph
|
|
# systemctl enable ceph
|
|
|
|
The ceph cluster can be set in the "/etc/default/ceph" file
|
|
by setting the CLUSTER environment variable.
|
|
|
|
-------- -------- --------
|
|
|
|
## Upgrade procedure (0.72.2 to 0.80):
|
|
|
|
* Read "Upgrade Sequencing" in release notes:
|
|
|
|
http://ceph.com/docs/firefly/release-notes/
|
|
|
|
* Upgrade packages.
|
|
|
|
* Restart MONs.
|
|
|
|
* Restart all OSDs.
|
|
|
|
* Run `ceph osd crush tunables default`.
|
|
|
|
* (Restart MDSes).
|
|
|
|
* Consider setting the 'hashpspool' flag on your pools (new default):
|
|
|
|
ceph osd pool set {pool} hashpspool true
|
|
|
|
This changes the pool to use a new hashing algorithm for the distribution of
|
|
Placement Groups (PGs) to OSDs. This new algorithm ensures a better distribution
|
|
to all OSDs. Be aware that this change will temporarly put some of your PGs into
|
|
"misplaced" state and cause additional I/O until all PGs are moved to their new
|
|
location. See http://tracker.ceph.com/issues/4128 for the details about the new
|
|
algorithm.
|
|
|
|
Read more about tunables in
|
|
|
|
http://ceph.com/docs/master/rados/operations/crush-map/#tunables
|
|
|
|
Upgrading all OSDs and setting correct tunables is necessary to avoid the errors like:
|
|
|
|
## rbdmap errors:
|
|
libceph: mon2 192.168.0.222:6789 socket error on read
|
|
|
|
Wrong tunables may produce the following error:
|
|
|
|
libceph: mon0 192.168.0.222:6789 socket error on read
|
|
libceph: mon2 192.168.0.250:6789 feature set mismatch, my 4a042a42 < server's 2004a042a42, missing 20000000000
|
|
|
|
## MDS errors:
|
|
one or more OSDs do not support TMAP2OMAP; upgrade OSDs before starting MDS (or downgrade MDS)
|
|
|
|
See also:
|
|
|
|
http://ceph.com/docs/firefly/install/upgrading-ceph/
|
|
|
|
-------- -------- --------
|
|
|
|
Jerasure pool(s) will bump requirements to Linux_3.15 (not yet released) for
|
|
kernel CephFS and RBD clients.
|
|
|
|
-------- -------- --------
|
|
|
|
RBD kernel driver do not support authentication so the following setting
|
|
in "/etc/ceph/ceph.conf" may be used to relax client auth. requirements:
|
|
|
|
cephx cluster require signatures = true
|
|
cephx service require signatures = false
|
|
|
|
-------- -------- --------
|
|
|
|
> How to mount CephFS using fuse client from "/etc/fstab"?
|
|
|
|
Add (and modify) the following sample to "/etc/fstab":
|
|
|
|
mount.fuse.ceph#conf=/etc/ceph/ceph.conf,id=admin /mnt/ceph fuse _netdev,noatime,allow_other 0 0
|
|
|
|
This is equivalent of running
|
|
|
|
ceph-fuse /mnt/ceph --id=admin -o noatime,allow_other
|
|
|
|
as root.
|
|
|
|
-------- -------- --------
|
|
|
|
To avoid known issue with kernel FS client it is recommended to use
|
|
'readdir_max_entries' mount option, for example:
|
|
|
|
mount -t ceph 1.2.3.4:/ /mnt/ceph -o readdir_max_entries=64
|
|
|
|
-------- -------- --------
|
|
|
|
Beware of "mlocate" scanning of OSD file systems. To avoid problems add
|
|
"/var/lib/ceph" to PRUNEPATHS in the "/etc/updatedb.conf" like in the
|
|
following example:
|
|
|
|
PRUNEPATHS="/tmp /var/spool /media /mnt /var/lib/ceph"
|
|
|
|
-------- -------- --------
|