Posted on Jun 23, 2023 at 7:09 PM
MayaNAS provides the scalability and reliability of object storage with the flexiblity of POSIX file storage.
Pooled Storage - ZFS with its integrated volume management easily pools available storage drives into zpool for large-scale data storage and I/O performance using striping. If needed, more drives can be added to the zpool without downtime.
Data Integrity - ZFS is the best file system with numerous techniques to provide data integrity. The file system uses 256-bit checksum as part of its metadata to detect hardware, software related data corruption and accidental overwrites.
Copy on Write - With Copy-on-write feature ZFS ensures that data is always consistent on the disk as new data is always written to a new block with calculated checksum before block pointers are changed. The old data may be retained for snapshots of the file system. Further, ZFS writes are transactional as in database — either everything or nothing is committed to disk
Data scrubbing - ZFS can be configured to scrub all the data periodically to verify its integrity and detect any silent data corruption. If possible it can also correct such data errors if the storage pool is configured with data redundancy in a mirrored or RAIDZ type configuration.
Snapshots and Checkpoint - ZFS supports unlimited low-overhead efficient snapshots that can be configured to snapshot on a regular basis. These snapshots provide application level consistency and are rolled back to the previous state if needed. In addition ZFS has a pool checkpoint which can be viewed as a pool-wide snapshot and allow user to revert the entire pool to that state or discard it.
TRIM support - When data blocks are deleted ZFS can notify the SSD with TRIM command about these unused blocks. This helps SSD GC (Garbage Collection) management to function better thereby improving performance and lifespan of storage device.
MayaNAS architecture uses all the salient features of ZFS:
Pooled storage — Any number of cloud storage buckets can be added to storage pool for increased capacity and performance increases linearly with data blocks striped on all the buckets.
ZFS large recordsize — Large blocksize of 1MB helps in achieving great throughput and reduced S3 API costs.
TRIM feature of ZFS allows deleted data blocks to be deleted on the object storage bucket saving storage costs. Data management features including compression, snapshots, cloning are readily available.
fio --ioengine=sync --direct=0 --fsync_on_close=1 \ --randrepeat=0 --nrfiles=1 --name=seqwrite --rw=write --bs=1m --size=10G \ --end_fsync=1 --fallocate=none --overwrite=0 --numjobs=10 \ --directory=/testwasabi/testfs/test --loops=1 fio --ioengine=sync --direct=0 \ --fsync_on_close=1 --randrepeat=0 --nrfiles=1 --name=seqread --rw=read \ --bs=1m --size=10G --end_fsync=1 --fallocate=none --overwrite=0 --numjobs=10 \ --directory=/testwasabi/testfs --invalidate=1 --loops=1
|Write||354 MB/s||537 MB/s|
|Read||975 MB/s||945 MB/s|
|Write||849 MB/s||1367 MB/s|
|Read||2024 MB/s||2674 MB/s|
|Write||1321 MB/s||2073 MB/s|
|Read||2957 MB/s||3242 MB/s|
With MayaNAS experience great throughput using cost-effective cloud storage even on a single VM instance for your demanding file based workloads.
MayaNAS use of open source ZFS means no vendor lock in, and your data is protected with end-to-end data integrity. Further, use of highly-scalable, unlimited S3 storage results in tremendous cost savings without traditional block disks or SSDs.
If you would like to try MayaNAS, it is available on AWS, GCP and Azure as marketplace solutions.