Sui's Tidehunter optimizes bin file management, significantly improving SSD performance

The Sui blockchain platform has announced a new Tidehunter database architecture designed to maximize the performance of modern SSD disks. This system innovates storage management using bin file formats and is engineered to minimize race conditions during write operations.

High-Speed Writing and Asynchronous Log Management

The approach to handling write operations has fundamentally changed. According to Foresight News, all write operations are executed through a high-speed, lock-free write-ahead log (WAL), capable of supporting millions of operations per second. Instead of traditional system calls, Tidehunter leverages writable memory-mapped files to enable direct access to bin file regions.

Performance Optimization with Memory Mapping and Bin Files

Data persistence is managed asynchronously by dedicated background threads. This architecture allows efficient management of bin file size and periodic disk synchronization tasks, reducing the load on the main write path. As a result, overall throughput is significantly improved, and storage I/O bottlenecks are eliminated.

Reduced Read Latency and Unified Index

Read performance has also been enhanced. Tidehunter features a specially designed unified lookup index that significantly reduces read latency on the critical path. Efficiently locating data within bin files dramatically increases access speed.

With the advent of Tidehunter, the Sui ecosystem has evolved toward next-generation storage technology, enabling optimal utilization of SSD performance.