refactor: store logs as Redis hashes

[elfkuzco]

Rationale

This PR implements the functionality to save logs to Redis. By setting expiry on the logs while saving, we can be sure that logs are not saved for years and there is no need for reliance on a cron job to delete old logs.

Changes

• set up connection to Redis in BaseWPOneDbTest
• save logs to Redis as hashes instead of SQL DB
• use a key naming pattern which allows us to filter logs that match the pattern. This emulates SQL-like AND queries for logs
• update tests to use appropriate self.redis

Fixes

This fixes #778
This fixes #49

[elfkuzco]

If the PR is accpeted, there should be a newer PR to drop the logging table. This would be implemented if all the logs are moved from SQL to Redis in order to avoid data loss. Thus, I have avoided the need to include a migration in this PR.

[audiodude]

This looks great!

But I think we do need the migration in the same PR, because once this gets deployed, we will lose the logs from the past 7 days unless we migrate. We don't need to put the entire logging table into redis, just the logs from the past 7 days. Probably the easiest way to do it is as a YoYo migration, even though it doesn't actually touch the database. That is, we should not drop the logging table as part of the migration, that should be done as a separate manual step.

[audiodude]

If you like, I can write the migration and append it to this PR. Just let me know.

[elfkuzco]

If you like, I can write the migration and append it to this PR. Just let me know.

Okay. You can append it to the PR.

[audiodude]

Oh actually I don't think I can add to the PR because it's on a branch in your repo. I've opened #826

[codecov]

Codecov Report

Attention: Patch coverage is 97.87234% with 1 line in your changes missing coverage. Please review.

Project coverage is 91.57%. Comparing base (3bc5e88) to head (9bcd8e6).
Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
wp1/logic/log.py	96.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #823      +/-   ##
==========================================
+ Coverage   91.55%   91.57%   +0.02%     
==========================================
  Files          66       66              
  Lines        3575     3597      +22     
==========================================
+ Hits         3273     3294      +21     
- Misses        302      303       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.