Create harvest db

[Jin-Sun-tts]

Pull Request

Related to Create Harvest DB and Table Structure

About

• Defined Table Structure in SQLAlchemy
• Initialized this structure into a local Docker PostgresSQL container
• Created interfaces to interact with the DB
• Created Flask app (https://harvesting-logic.app.cloud.gov/) to test the harvester operations into the DB
• Created manifest file for deployment to cloud.gov with PostgresSQL aws-rds micro-sql service.
• Added tests with local PostgresSQL container.

[github-actions]

Coverage Report

File	Stmts	Miss	Cover	Missing
harvester
__init__.py	0	0	100%
ckan_utils.py	42	2	2	95%
harvest.py	411	67	67	84%
utils.py	43	7	7	84%
harvester/database
__init__.py	2	2	2	0%
init_db.py	10	10	10	0%
interface.py	60	60	60	0%
models.py	39	39	39	0%
TOTAL	607	187	69%

Tests	Skipped	Failures	Errors	Time
22	0 💤	0 ❌	0 🔥	2.381s ⏱️

[Jin-Sun-tts]

moved to datagov-harvest-orchestrator repo

[Jin-Sun-tts]

back from datagov-harvest-orchestrator repo, reopen this.

[jbrown-xentity]

Thanks @Jin-Sun-tts ! Some comments for your and the @GSA/data-gov-team 's awareness/review, some of these are general comments and some should be addressed before merging. I'm going to approve though, in case we need to get this merged and circle back to the improvements later.