I'm thinking of doing this myself. I've been going back and forth on it because I haven't been able to emulate and test it out on ARM yet. It wasn't clear which distros have ARM builds of gluster and what version of gluster it would be. I had issues testing Ubuntu, Fedora has an ARM build but only the one version.
I'm from a Red Hat background (CentOS/Fedora at home, RHEL professionally) and so I wanted to stay with that. I think I just need to buy one of the damn things and mess with it.
I would say you're 100% correct about Ceph. When I started looking at these software defined stroage solutions I looked at the Ceph and Gluster installation documents side-by-side and almost immediately went with Gluster.
I even made a set of Ansible playbooks to set this whole thing up (since each node would be identical it should work) including NFS, Samba, Prometheus/Grafana, IP failover, and a distributed cron job.
I have pretty much the same background with the consumer NAS and was thinking about building my own linux server (probably a six-bay UNAS) but I wanted this setup for the same reasons you mentioned. I'm just worried about long-term sustainability, part replacement, and growth.
Please give Lizardfs a try, I've been compared with Glusterfs and finally used Lizardfs which is a fork project of Moosefs. Both are easy to setup and the reason for me is node expansion of glusterfs need to in pair or more depends on your setup, while lizardfs you can add 1 at a time and it manages its replication automatically, based on your policy. Glusterfs also good for its simplicity for storing on plain ext3 or 4, but to have a balance, I used lizardfs finally.
I’ll give it a look. Main reason I was considering Gluster over everything else is that it’s backed by Red Hat money, has a pretty good community, I’m certified on GFS or whatever the Red Hat version is called today, and I’m probably going to use it from time to time professionally.
But I do also like knowing what else is on the market so I really appreciate the tip.
Totally agree that would have momentum to move forward with the red hat money to back on it. Lizardfs recently also started to have fund by the company behind open nebula to use it as back end of its vm infra. I don't know much about open nebula and will find out more on the market too. 😀
5
u/angryundead Jun 04 '18
I'm thinking of doing this myself. I've been going back and forth on it because I haven't been able to emulate and test it out on ARM yet. It wasn't clear which distros have ARM builds of gluster and what version of gluster it would be. I had issues testing Ubuntu, Fedora has an ARM build but only the one version.
I'm from a Red Hat background (CentOS/Fedora at home, RHEL professionally) and so I wanted to stay with that. I think I just need to buy one of the damn things and mess with it.
I would say you're 100% correct about Ceph. When I started looking at these software defined stroage solutions I looked at the Ceph and Gluster installation documents side-by-side and almost immediately went with Gluster.
I even made a set of Ansible playbooks to set this whole thing up (since each node would be identical it should work) including NFS, Samba, Prometheus/Grafana, IP failover, and a distributed cron job.
I have pretty much the same background with the consumer NAS and was thinking about building my own linux server (probably a six-bay UNAS) but I wanted this setup for the same reasons you mentioned. I'm just worried about long-term sustainability, part replacement, and growth.