Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
be1c3e5
migrating to the new sdk and preparing for usage of tiledb
HenryGeorgist Apr 4, 2025
0556f91
work in progress on the upgrade
HenryGeorgist Apr 4, 2025
d0d8f8e
working through the updates to the hms-mutator plugin for trinity wip
HenryGeorgist Apr 7, 2025
f324cfb
fleshing out the new sampling code, adding a coordinate list reader
HenryGeorgist Apr 8, 2025
f39751f
finishing the reading of fishnets from s3
HenryGeorgist Apr 8, 2025
088ea1b
adding a descrete emperical distribution
HenryGeorgist Apr 8, 2025
3e94b0b
fixing discrete emperical
HenryGeorgist Apr 8, 2025
f0e385b
parsing time, parsing seasonality distributions
HenryGeorgist Apr 8, 2025
b8bfce3
adding some helper code to adapt old actions, setting up reading from…
HenryGeorgist Apr 9, 2025
d65fcf4
adding a test to read seeds for this plugin alone from tiledb, succes…
HenryGeorgist Apr 9, 2025
5db0989
adding reading of blocks from tiledb
HenryGeorgist Apr 9, 2025
2706726
fixing missing error checking
HenryGeorgist Apr 9, 2025
691f04d
fleshing out the actual sampling
HenryGeorgist Apr 10, 2025
e3bdd48
more testing finising out compute and writing
HenryGeorgist Apr 10, 2025
57aa741
updating acceptance criteria for fisnet coordinates to not utilize cu…
HenryGeorgist Apr 11, 2025
c22d4c4
making the valid stratification locations work with the quick method …
HenryGeorgist Apr 11, 2025
04208aa
fixing bugs testing fishnets
HenryGeorgist Apr 18, 2025
116b6eb
testing sst full realization
HenryGeorgist Apr 21, 2025
0d8e1a2
testing writing storms to the eventstore
HenryGeorgist Apr 23, 2025
c085c88
passing tests for writing recordsets, completing upgrade to sdk.
HenryGeorgist Apr 23, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .devcontainer/devcontainer.json
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@
"context": "..",

// Update the 'dockerFile' property if you aren't using the standard 'Dockerfile' filename.
"dockerFile": "../Dockerfile",
"dockerFile": "../Dockerfile.dev",

// Set *default* container specific settings.json values on container create.
"settings": {},
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/go.yml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ jobs:
- name: Set up Go
uses: actions/setup-go@v3
with:
go-version: 1.18
go-version: 1.23.6

- name: Build
run: go build -v ./...
Expand Down
102 changes: 102 additions & 0 deletions .vscode/launch.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,102 @@
{
// Use IntelliSense to learn about possible attributes.
// Hover to view descriptions of existing attributes.
// For more information, visit: https://go.microsoft.com/fwlink/?linkid=830387
"version": "0.2.0",
"configurations": [
{
"name": "Launch Mutator",
"type": "go",
"request": "launch",
"mode": "test",
"program": "${workspaceFolder}",
"args": [
"-test.run",
"Test_Main"
],
"envFile": "/workspaces/.env"
},{
"name": "Test Fishnets",
"type": "go",
"request": "launch",
"mode": "test",
"program": "${workspaceFolder}",
"args": [
"-test.run",
"Test_Main"
],
"envFile": "/workspaces/.fishnets-env"
},{
"name": "Test Storms",
"type": "go",
"request": "launch",
"mode": "test",
"program": "${workspaceFolder}",
"args": [
"-test.run",
"Test_Main"
],
"envFile": "/workspaces/.storms-env"
},{
"name": "Test Storms Recordset",
"type": "go",
"request": "launch",
"mode": "test",
"program": "${workspaceFolder}/actions",
"args": [
"-test.run",
"Test_RecordSet"
],
"envFile": "/workspaces/.storms-env"
},{
"name": "Test ReadSeeds",
"type": "go",
"request": "launch",
"mode": "test",
"program": "${workspaceFolder}/utils",
"args": [
"-test.run",
"TestReadSeedsFromTDB"
],
"envFile": "/workspaces/.env"
},{
"name": "Test ReadBlocks",
"type": "go",
"request": "launch",
"mode": "test",
"program": "${workspaceFolder}/utils",
"args": [
"-test.run",
"TestReadBlocksFromTDB"
],
"envFile": "/workspaces/.env"
},{
"name": "Launch Package",
"type": "go",
"request": "launch",
"mode": "auto",
"program": "${fileDirname}",
"env": {
"CC_AWS_DEFAULT_REGION": "us-east-1",
"CC_AWS_ACCESS_KEY_ID": "AKIAIOSFODNN7EXAMPLE",
"CC_AWS_SECRET_ACCESS_KEY": "wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY",
"CC_AWS_S3_BUCKET": "cc-store",
"CC_ROOT": "cc_store",
"CC_MANIFEST_ID": "kanawha/hms-mutator",
"CC_EVENT_NUMBER": "298",
"CC_S3_ENDPOINT": "host.docker.internal:9000",
"CC_S3_MOCK": "true",
"CC_S3_DISABLE_SSL": "true",
"CC_S3_FORCE_PATH_STYLE": "true",
"FFRD_AWS_DEFAULT_REGION": "us-east-1",
"FFRD_AWS_ACCESS_KEY_ID": "AKIAIOSFODNN7EXAMPLE",
"FFRD_AWS_SECRET_ACCESS_KEY": "wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY",
"FFRD_AWS_S3_BUCKET": "model-library",
"FFRD_S3_ENDPOINT": "host.docker.internal:9000",
"FFRD_S3_MOCK": "true",
"FFRD_S3_DISABLE_SSL": "true",
"FFRD_S3_FORCE_PATH_STYLE": "true",
}
}
]
}
23 changes: 0 additions & 23 deletions Dockerfile

This file was deleted.

4 changes: 4 additions & 0 deletions Dockerfile.dev
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
FROM cc-tiledb

RUN apt update &&\
apt -y install gdal-bin gdal-data libgdal-dev
12 changes: 12 additions & 0 deletions actions/action.notes
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
//need to develop a strategy for rewriting this plugin

//steps:
1. read in all storm names (from files api just get the contents of the catalog.)
2. select a storm with uniform probability
3. define x and y location (predefine fishnet at 1km or 4km possibly, unique to each storm name.)
4. evaluate storm type (should be in the storm name from the selected storm.)
5. use f(st)=>date (should be a set of emperical distributions of date ranges per st)
6. sample year uniformly (should be based on a start and end date of the por, making sure the date is contained.)
7. sample calibration event id (should be 1-6 options.)
8. get basin file name (should be `44*6*365` combinations.)
9. store in tiledb database or dump to csv
Loading
Loading