High-performance data streaming for Solana validators
Ultra-low latency blockchain data streaming by Wind Network
Quick Start β’ Documentation β’ Benchmarks β’ Contributing
Tide revolutionizes Solana data streaming by bypassing traditional Geyser limitations
Tide achieves sub-millisecond latency through innovative architecture:
| Feature | Technology | Benefit |
|---|---|---|
| π Direct Access | Memory-mapped TPU/TVU pipelines | Zero intermediary overhead |
| β‘ SIMD Processing | Vectorized data operations | Maximum CPU efficiency |
| π¦ Zero-Copy | In-place serialization | Minimal memory allocation |
| π Flexible Output | JSON5 & Parquet formats | Debug-friendly & production-ready |
Targeting 100ms median latency with sub-millisecond peaks
JSON5 for debugging β’ Parquet for production β’ Configurable everything
Works seamlessly with Agave and Firedancer validators
Focused dependencies β’ Maximum performance per resource
# Clone the repository
git clone https://github.com/your-org/tide.git
cd tide
# Build optimized release
cargo build --releaseCreate your config.toml:
[output]
format = "parquet" # Options: "parquet" | "json5"
path = "/data/tide-output"
compression = "zstd"
[performance]
pipeline_stages = 4
batch_size = 1024
enable_simd = true
[validator]
tpu_address = "127.0.0.1:1024"
connection_timeout = "5s"As Geyser Plugin
solana-test-validator --geyser-plugin-config config.tomlStandalone Mode
tide-cli --config config.toml --verboseRun benchmarks locally:
cargo bench --features benchmarkView detailed results:
open target/criterion/report/index.html| Resource | Description |
|---|---|
| π API Docs | Complete API reference |
| π§ Configuration Guide | Detailed setup instructions |
| ποΈ Architecture | System design deep-dive |
| π¬ Performance Tuning | Optimization guidelines |
- Fork the repository
- Create a feature branch (
git checkout -b feature/amazing-feature) - Commit your changes (
git commit -m 'Add amazing feature') - Push to the branch (
git push origin feature/amazing-feature) - Open a Pull Request
Please read our Contributing Guidelines before submitting PRs.
Security is our top priority
Found a vulnerability? Please report it responsibly:
π§ Email: [email protected]
π GitHub: Create Security Issue
Made with β€οΈ for the Solana ecosystem
β Star us on GitHub if this project helped you!