多云数据管理深度实践中 | 配置OpenSDS多后端（LVM、Cinder、Ceph）
- 2020 年 3 月 4 日
- 筆記
上篇文章我们通过Ansible安装了OpenSDS，本文我们继续深入了解OpenSDS，相信细心的童鞋会发现我们上篇在简短介绍OpenSDS的时候说到了可以纳管本地异构存储，所以我们本文将讲述如何配置多后端，为了充分展现我们选择了本地LVM，OpenStack的Cinder以及Ceph分布式存储作为多后端来测试。
LVM我们在上文安装的时候已经默认配置了，Cinder和Ceph的话必须保证两个存储环境已经存在，同时保证OpenSDS节点与他们能够网络互通。
配置多后端
vi /etc/opensds/opensds.conf
[ceph]
name = ceph
description = This is a ceph backend service
driver_name = ceph
config_path = /etc/opensds/driver/ceph.yaml
[cinder]
name = cinder
description = This is a cinder backend service
driver_name = cinder
config_path = /etc/opensds/driver/cinder.yaml
配置Ceph和Cinder的yaml文件
root@opensds:/etc/opensds/driver# cat ceph.yaml
# Copyright 2018 The OpenSDS Authors.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
configFile: /etc/ceph/ceph.conf
pool:
osdsrbd: # change pool name same to ceph pool
storageType: block
availabilityZone: default
extras:
dataStorage:
provisioningPolicy: Thin
compression: true
deduplication: true
ioConnectivity:
accessProtocol: rbd
maxIOPS: 6000000
minIOPS: 1000000
maxBWS: 500
minBWS: 100
latency: 100
advanced:
diskType: SSD
latency: 5ms
root@opensds:/etc/opensds/driver# cat cinder.yaml
# Copyright 2018 The OpenSDS Authors.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
authOptions:
noAuth: false
#endpoint: "http://{your_real_host_ip}/identity"
endpoint: "http://{your_real_host_ip}/v3"
#cinderEndpoint: "http://{your_real_host_ip}/v2"
cinderEndpoint: "http://{your_real_host_ip}/v2/7c56fea7577b41d880b51365a26fd220"
# domainId: "Default"
domainName: "Default"
# username: "cinder"
username: "admin"
password: "9t8FDKUoWzbxHm8EpttP7wh5saecp92SMlBj8iTh"
# password: "fwE#F7$cDd%43^2f"
#password: "aaaaaa"
# Whether to encrypt the password. If enabled, the value of the password must be ciphertext.
EnableEncrypted: false
# Encryption and decryption tool. Default value is aes. The decryption tool can only decrypt the corresponding ciphertext.
PwdEncrypter: "aes"
tenantId: "7c56fea7577b41d880b51365a26fd220"
tenantName: "admin"
pool:
"ceph@rbd-1#rbd-1":
# "rbd-1":
storageType: block
availabilityZone: default
extras:
dataStorage:
provisioningPolicy: Thin
isSpaceEfficient: false
ioConnectivity:
accessProtocol: iscsi
maxIOPS: 7000000
maxBWS: 600
advanced:
diskType: SSD
latency: 3ms
安装Ceph-Commd依赖
apt-get install ceph-common -y
#同时把Ceph环境的ceph.conf和ceph.client.admin.keyring拷贝到OpenSDS环境的/etc/ceph下
ceph -s
检测下是否成功
配置完成之后我们到Dashboard可以看到多个后端已经展示出来了，有时候可能不显示，但是数据已经显示了，这可能是个bug，我已经提交给社区了。
https://github.com/sodafoundation/opensds/issues/1240
接下来我们到Dashbord配置Cinder和Ceph的profile
创建Volume测试下是否可以
OK，可以看到我创建了三个测试的卷，均已成功，那个default就是lvm。
接下来我们在增加一个Ceph 对象存储,操作步骤是在首页点击那个添加按钮，然后配置rgw相关信息。
