Skip to content

Conversation

@irjudson
Copy link
Member

Summary

Major documentation overhaul to reflect v2.0 completion and make the project easier for new developers to find, understand, and use.

Target Audience: Developers with existing BigQuery data who want to sync to Harper (not maritime-focused users)

Changes

Cleanup

  • ✅ Removed research artifacts (GLOBALS_LOGGING_RESEARCH.md, LOGGING_ANALYSIS_BY_FILE.md)
  • ✅ Gitignored historical docs (docs/plans/, docs/internal/)
  • ✅ Archived 4 completed design documents
  • ✅ Net reduction: -3,579 lines

Restructure

  • ✅ Renamed TODO.md → ROADMAP.md
  • ✅ Celebrates v2.0 completion with clear future vision

Content Updates

README.md - Complete rewrite (517 lines)

  • Leads with "Production-ready v2.0" messaging
  • Real-world examples first (user events, app logs, ecommerce)
  • Maritime positioned as optional test data
  • Comprehensive troubleshooting and operations sections
  • Clear configuration examples for actual use cases

CHANGELOG.md

  • Added v2.0.0 release entry with all completed features

ROADMAP.md

  • Highlights what shipped in v2.0 (multi-table, column selection, logging, etc.)
  • Clear v3.0 vision (multi-threaded, dynamic rebalancing)
  • Separates committed work from future considerations

CONTRIBUTING.md

  • Updated testing section (91 tests passing)
  • Current architecture and file structure
  • Contribution priorities reflect v2.0 completion

Impact

New developers with existing BigQuery data can now:

  1. Immediately see this is production-ready v2.0
  2. Find their use case in Quick Start (real data examples, not maritime)
  3. Understand clearly what works today vs. what's planned
  4. Access maritime when needed for testing/demos

Verification

  • ✅ All 91 tests pass
  • ✅ All documentation links verified
  • ✅ Lint and format checks pass
  • ✅ No breaking changes to functionality

Test Plan

  • All tests pass (91/91)
  • Documentation links verified
  • Maritime quickstart still works
  • Config examples are accurate
  • No references to deleted files

This design addresses documentation debt from v2.0 development by:
- Removing historical artifacts and research documents
- Reorganizing into user-facing, historical, and maintenance tiers
- Rewriting README to lead with production-ready v2.0
- Converting TODO.md to ROADMAP.md celebrating v2.0 completion
- Adding v2.0.0 CHANGELOG entry
Major documentation overhaul to reflect v2.0 completion:

**Cleanup:**
- Removed research artifacts (GLOBALS_LOGGING_RESEARCH.md, LOGGING_ANALYSIS_BY_FILE.md)
- Gitignored historical docs (docs/plans/, docs/internal/)
- Archived completed design documents

**Restructure:**
- Renamed TODO.md → ROADMAP.md
- Celebrates v2.0 completion with clear future vision

**Content Updates:**
- README.md: Complete rewrite leading with production-ready v2.0
  - Real-world examples first (user events, app logs)
  - Maritime positioned as optional test data
  - Comprehensive troubleshooting and operations sections
- CHANGELOG.md: Added v2.0.0 release entry
- ROADMAP.md: Highlights completed features, clear v3.0 vision
- CONTRIBUTING.md: Updated testing section, current architecture

**Impact:**
New developers with existing BigQuery data can now:
- Immediately see production-ready status
- Find their use case in Quick Start (not maritime)
- Understand what works today vs. what's planned
- Access maritime example when needed for testing

All tests pass (91/91). All documentation links verified.
@irjudson irjudson merged commit 0753b37 into main Dec 15, 2025
4 checks passed
@irjudson irjudson deleted the docs/cleanup-and-restructure branch December 15, 2025 21:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants