Pose Estimation Tauri

Experiment — a desktop app built with Tauri v2 for real-time human pose estimation, created to compare with the Flutter implementation.

Stack

• Tauri 2 — desktop shell (Rust + WebView)
• Vite + TypeScript — frontend
• RTMPose (ONNX) — body keypoint detection model (COCO-17)
• WebAssembly — model inference in the browser context

Features

• Detects 17 body keypoints (COCO format)
• Renders skeleton with colored bones
• Android build support

Requirements

• Node.js 18+
• Rust (stable)
• wasm-pack

Getting Started

npm install

# Build the WASM module
npm run wasm:build

# Run in dev mode
npm run tauri:dev

# Build release
npm run tauri:build

Android

npm run android:init
npm run android:dev
npm run android:build

Project Structure

├── src/              # TypeScript frontend
│   └── pose.ts       # Skeleton rendering logic
├── src-tauri/        # Rust backend (Tauri)
├── src-wasm/         # WebAssembly module
└── models/           # ONNX models (rtmpose.onnx)