Hi all, In case people have been wondering about the background of the various questions that I asked on these lists in the last few months: I've been experimenting with running ZFS-on-NBD as a cloud backup solution (and potential alternative to S3QL, which I am using for this purpose at the moment). In case someone is interested, here is the (rather long) write-up: https://www.rath.org/s3ql-vs-zfs-on-nbd.html Best, -Nikolaus -- GPG Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F »Time flies like an arrow, fruit flies like a Banana.«
Il 2022-09-12 22:30 Nikolaus Rath ha scritto:
Hi all,
In case people have been wondering about the background of the various questions that I asked on these lists in the last few months:
I've been experimenting with running ZFS-on-NBD as a cloud backup solution (and potential alternative to S3QL, which I am using for this purpose at the moment).
In case someone is interested, here is the (rather long) write-up: https://www.rath.org/s3ql-vs-zfs-on-nbd.html
Interesting reading, thanks! -- Danti Gionatan Supporto Tecnico Assyoma S.r.l. - www.assyoma.it email: g.danti@assyoma.it - info@assyoma.it GPG public key ID: FF5F32A8
just a few comments + using S3 as a block device will always suffer from the fact that it really isn’t a block device… hiding it behind any other block device interface won’t really help except in very constrained cases (basically, what you proved again) + ZFS aggregates writes, which further complicates fake block device interfaces + there is a dev effort to come up with an object-based vdev type, but I’m not aware of its current status + L2ARC is definitely not a write-through cache -- richard
On Sep 12, 2022, at 2:55 PM, Gionatan Danti <g.danti@assyoma.it> wrote:
Il 2022-09-12 22:30 Nikolaus Rath ha scritto:
Hi all, In case people have been wondering about the background of the various questions that I asked on these lists in the last few months: I've been experimenting with running ZFS-on-NBD as a cloud backup solution (and potential alternative to S3QL, which I am using for this purpose at the moment). In case someone is interested, here is the (rather long) write-up: https://www.rath.org/s3ql-vs-zfs-on-nbd.html
Interesting reading, thanks!
-- Danti Gionatan Supporto Tecnico Assyoma S.r.l. - www.assyoma.it email: g.danti@assyoma.it - info@assyoma.it GPG public key ID: FF5F32A8
------------------------------------------ zfsonlinux: Discuss Permalink: https://zfsonlinux.topicbox.com/groups/zfs-discuss/Tf25eefa7a2a2b7c5-M5c2f14... Delivery options: https://zfsonlinux.topicbox.com/groups/zfs-discuss/subscription
Isn't ZFS getting native object storage capability soon? It was showcased at the last OpenZFS summit. On Mon, 12 Sep 2022, 23:53 Nikolaus Rath, <nikolaus@rath.org> wrote:
Hi all,
In case people have been wondering about the background of the various questions that I asked on these lists in the last few months:
I've been experimenting with running ZFS-on-NBD as a cloud backup solution (and potential alternative to S3QL, which I am using for this purpose at the moment).
In case someone is interested, here is the (rather long) write-up: https://www.rath.org/s3ql-vs-zfs-on-nbd.html
Best, -Nikolaus
-- GPG Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F
»Time flies like an arrow, fruit flies like a Banana.«
*zfsonlinux <https://zfsonlinux.topicbox.com/latest>* / Discuss / see discussions <https://zfsonlinux.topicbox.com/groups/zfs-discuss> + participants <https://zfsonlinux.topicbox.com/groups/zfs-discuss/members> + delivery options <https://zfsonlinux.topicbox.com/groups/zfs-discuss/subscription> Permalink <https://zfsonlinux.topicbox.com/groups/zfs-discuss/Tf25eefa7a2a2b7c5-M63ad3646a9cbbcd7e07410ed>
Hi, Following up on my last post on this topic (since there seemed to be at least some interest): after evaluating the setup for a few weeks, I have decided that this is not as good a solution as I had hoped. In particular, the expected benefits of splitting data between a special vdev backed by a bucket with small object size and a normal vdev backed by a bucket with much larger object size did not materialize. More details (including histograms) are available at https://www.rath.org/zfs-on-nbd-my-verdict.html Best, -Nikolaus -- GPG Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F »Time flies like an arrow, fruit flies like a Banana.«
participants (4)
-
Gionatan Danti -
Gordan Bobic -
Nikolaus Rath -
Richard Elling