Vitastor

Vitastor 0.9.5 released

A hotfix to 0.9.4 containing only one bugfix: 100% CPU usage in the new QEMU driver caused by the lack of eventfd reset on io_uring event handling :)

2023-07-20 Continue reading →

Vitastor 0.9.4 released

Improve QEMU driver performance by integrating io_uring in it (up to 1.5x total iops improvement)
Fix QEMU driver deadlocks which started to reproduce in qemu-img after iothread fixes
Fix vitastor-cli status reporting more etcds than actually exists (fix etcd address duplication in config on reload)
Fix vitastor-cli ls crashing on inodes in non-existing pools
Delete old garbage /pool/stats/ keys for non-existing (deleted) pools
Reduce memory usage of etcds initialized by make-etcd script
Fix OSDs almost always crashing on etcd restart due to “revisions were compacted” (support reloading state from etcd)
Fix a crash and a stall possible mostly in HDD setups with small journal and big (512k, 900k) random writes
Add notes about HDDs to documentation. You are officially allowed to use HDD-only Vitastor with HGST/Toshiba/EXOS :)

2023-07-18 Continue reading →

Vitastor 0.9.3 released

Add patch for libvirt 9.0
Add support for Proxmox VE 8.0
Fix compatibility of the QEMU driver with iothread (QEMU rebuilds are coming)
Fix vitastor-cli rm-data/rm/merge hanging when some OSDs are down. Allow deletions in unclean cluster at the cost of some data possibly “reappearing” when those OSDs start back. In that case you can just repeat the deletion request using rm-data.
A bunch of bug fixes for snapshots:
- Fix snapshot reads often not working at all with snapshot chain size > 2
- Fix optimized snapshot data merge (children to parent)
- Fix updating of image name index key during optimized merge
- Fix auto-selection preventing the use of optimized merge with only 1 snapshot
- Fix incorrect CAS retries during snapshot merge
- Fix snapshot merge progress reporting
Fix primary_read bitmap buffers use-after-free which could lead to incorrect allocation map reads
Remove /usr/local/bin path from make-etcd
Some documentation fixes

2023-07-01 Continue reading →

Vitastor 0.9.2 released

Measure and report scrub I/O statistics in vitastor-cli status
Make aggregated statistics in vitastor-cli status much smoother (first derive, then sum instead of first summing and then deriving)
Fix an old rare bug leading to journal corruption (try to use scrub if you think you’re affected…)
Do not start EC PGs without at least OSDs in each old set (prevents spurious read errors with EC during reconnections/restarts)
Fix failed assert(!scrub_list_op) on OSD restart with pending scrubs
Fix future planned scrubs not starting because of incorrect time comparison
Build packages for Debian 12 (Bookworm)

2023-06-18 Continue reading →

Vitastor 0.9.1 released

Fix “Client XX command out of sync” messages sometimes happening on OSD reconnections
Fix a bug where EC reads parallel with writes to the same object failed with -ERANGE error
Slightly reduce the amount of metadata writes during journal flushing
Correctly unmap NBD volumes when Proxmox forces map_volume use (with SWTPM and maybe some other cases)

2023-06-10 Continue reading →

Vitastor 0.9.0 released

New features

Scrubbing! Check documentation: auto_scrub
Document online-updatable configuration parameters

2023-05-21 Continue reading →

Vitastor 0.8.9 released

The tests are now stable and run in a CI system based on Gitea CI
The release includes final bug fixes for EC:
- Implement missing EC recovery of allocation bitmap when built with ISA-L
- Fix broken snapshot export with EC (allocation bitmap reads were giving incorrect results previously)
Also fixed bugs manifesting under heavy load:
- Fix monitor possibly applying incorrect PG history on retries
- Fix monitor incorrectly changing PG count when last_clean_pgs contains less PGs than the new number
- Allow writes to wait for free space again, but now correctly (previously dropped in 0.8.2)
- Fix a rare segfault in client (handle client stop during incoming stream handling in 1 more place)
- Make monitor correctly handle etcd connection errors - it could die instead of connecting to another etcd
- Fix OSD rarely being unable to report PG states after a PG was taken over by another OSD
Fixed return code for incomplete EC objects (now EIO) and made cluster client retry this error
Made other small changes for tests: timeouts, nice/ionice for etcd, waiting conditions, NBD device checks and so on

2023-05-14 Continue reading →

Vitastor 0.8.8 released

Fix vitastor-cli rm/rm-data broken in 0.8.6 (missing messenger initialization)
Prepare OSD read handler for upcoming version with scrub - allow “secondary reads” to return errors
Fix OSDs re-peering PGs infinitely with a big number of PGs (reproduced in test_add_osd)
Fix another variant of flusher sync-waiting stall (reproduced in test_write)
Fix other tests in tests/ (will add them to Gitea CI soon)
Add patches for QEMU 6.2-8.0
Fix QEMU driver compatibility with QEMU 8.0
Build packages for RHEL 9 clones (based on AlmaLinux 9)

2023-04-28 Continue reading →

Vitastor 0.8.7 released

This release includes a bunch of important bugfixes for erasure-coded setups with disabled immediate_commit. After these fixes, “test_heal” OSD killing test now passes fine with EC:

Fix cluster write stalls with “Error while doing flush on OSD xx: -16 (Device or resource busy)” in OSD logs possible in EC setups with disabled immediate_commit by selectively syncing nonsynced objects on STABILIZE/ROLLBACK (https://github.com/vitalif/vitastor/issues/51)
Fix other EC + disabled immediate_commit problems:
- Fix “opcode=5 retval=-2” errors happening on SYNC retries
- Fix non-working “pagination” during PG dirty object flushing
- Fix write operations not continued correctly after dirty object flushing
Fix incorrect parity read-modify-write calculation when writing into a lost chunk
Fix OSDs losing left_on_dead PG state of non-clean PGs and thus not removing junk data in the cluster
Fix a small memory leak caused by bad indexing of EC recovery matrices
Fix a rare use-after-free in cluster_client caused by a reenterability issue
Fix vitastor-cli create command syntax in the CSI driver
Allow to start OSDs without local store for tests
Fix memory allocation error in disk_tool_meta for non-standard metadata block sizes
Fix delete operations received before loading pool metadata crashing OSDs with “null pointer exception”
Improve “theoretical performance” Russian documentation