Skip to content

Pre release/v1.0.0#285

Open
ideal93 wants to merge 65 commits intomasterfrom
pre-release/v1.0.0
Open

Pre release/v1.0.0#285
ideal93 wants to merge 65 commits intomasterfrom
pre-release/v1.0.0

Conversation

@ideal93
Copy link
Collaborator

@ideal93 ideal93 commented Dec 12, 2024 •
edited
Loading

  • Directory Restructuring
  • API CI Coverage
  • Documentation Reorganization
  • Helm chart

ideal93 and others added 3 commits December 10, 2024 19:30
@ideal93
ci: add GitHub Actions CI to master branch (#280)
ee2b11d
@xuzh2024 @ideal93
Bugfix/cover collect empty list (#281)
21bbf6a 
* ci: add GitHub Actions CI to master branch (#280)

* fix collect error while list is empty

---------

Co-authored-by: li xiang <leeideal93@gmail.com>
@ideal93
Refactor Package Directory(#282)
ba6b336
@codecov
Copy link

codecov bot commented Dec 12, 2024 •
edited
Loading

Codecov Report

Attention: Patch coverage is 56.37014% with 976 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
hemera_udf/aave_v2/export_aave_v2_job.py 11.5% 207 Missing ⚠️
hemera/indexer/utils/buffer_service.py 21.7% 191 Missing ⚠️
hemera/indexer/exporters/kafka_exporter.py 25.0% 87 Missing ⚠️
hemera/common/utils/db_utils.py 22.2% 77 Missing ⚠️
...mera/indexer/controller/scheduler/job_scheduler.py 56.6% 59 Missing ⚠️
...exer/jobs/export_contracts_from_transaction_job.py 34.1% 56 Missing ⚠️
hemera/indexer/utils/metrics_collector.py 29.1% 51 Missing ⚠️
hemera/indexer/utils/metrics_persistence.py 34.2% 48 Missing ⚠️
hemera_udf/aave_v2/aave_v2_processors.py 48.5% 36 Missing ⚠️
hemera/common/models/__init__.py 46.6% 24 Missing ⚠️
... and 28 more
Files with missing lines Coverage Δ
hemera/__init__.py 100.0% <100.0%> (ø)
hemera/api/app/address/__init__.py 100.0% <ø> (ø)
hemera/api/app/address/features.py 94.7% <ø> (ø)
hemera/api/app/address/models.py 100.0% <100.0%> (ø)
hemera/api/app/cache.py 60.0% <100.0%> (ø)
hemera/api/app/config.py 76.4% <ø> (ø)
hemera/api/app/contract/__init__.py 100.0% <ø> (ø)
hemera/api/app/contract/contract_verify.py 24.6% <100.0%> (ø)
hemera/api/app/db_service/af_token_deposit.py 27.7% <100.0%> (ø)
hemera/api/app/db_service/blocks.py 28.5% <100.0%> (ø)
... and 113 more
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

2024river and others added 26 commits December 12, 2024 18:39
@2024river
Adjust uniswapv2 (#286)
cd65477
@2024river @ideal93
Add thena 1.0.0 (#288)
98008a0 
Co-authored-by: ideal93 <leeideal93@gmail.com>
@zhufengthehemera
Add Base meme agent (#289)
1cefd9e
@ideal93
Add gitignore more pattern (#292)
e46ef04
@xuzh2024
Feature/dataclass from db (#290)
1ea3e4a
@ideal93
Support receipt_from_blocks_rpc (#295)
77de80c
@2024river
add arbitrum config (#296)
c402c3a 
* add arbitrum

* make format
@2024river
add bsc config (#297)
d440955 
* add bsc config

* add bsc config
@shanshuo0918
Add bob fbtc job config (#298)
4151264 
Co-authored-by: godshan.eth <shuo.shan@thehemera.com>
@xuzh2024
Feature/command line in diffirent scenarios (#267)
50de78a 
* util: generate job base code

* util: get project root and case convert

* new command line: init

* update template

* util: generate job base code

* util: get project root and case convert

* new command line: init

* update template

* add truncate table in db command line

* encapsulate command options

* update init_db command

* move logo printer

* bug fix

* use encapsulate command options

* encapsulate stream process

* backtest use different default value

* make format

* merge and deal conflict

* make format

* update makefile

* update makefile

* path change

* update job init template

* make format

* update custom template

* fix db command

* fix stream_process parameter list

* Compatibility changes with entity_type

* import clean

* detail rename
@2024river
add teahouse (#293)
b8dd8b0 
* add teahouse

* make format
@xuzh2024
fix export bug (#299)
8618566 
* fix export bug

* make format
@xuzh2024
proper prompt when job-scan fail (#300)
3dc5d78
@xuzh2024
Feature/read write separation from 1.0.0 (#294)
74ae59d 
* origin buffer service

* buffer service for BaseJob._data_buff

* fix import

* model completion

* bug fix

* remove auto clear after export

* update test

* make format

* compatibility for unit test

* make format

* Increase security between global locks and row locks

* fix unit test

* fix error coverage when merging code

* config rename

* fix error coverage when merging code

* enable crash instantly

* fix dead lock

* fix dead lock

* fix type compare

* complete after buffer_service shutdown

* fix read env

* fix read env

* remove flush op when shutdown

* export threads have limited growth

* accurate sync_recorder in async mode
@xuzh2024
Fixed the issue where the ‘in’ operator gets stuck when acting on Buf…
585101c 
…ferService (#306)
@xuzh2024
Fixed the issue that Indexer gets stuck when deal with empty list (#307)
e6030fa
@xuzh2024
Optimize/default config in diffirent scenario (#303)
6a10a69 
* Uniform management of environment variables

* Force type conversion when getting environment variables

* remove default value

* update backtest

* add shortcut for quickly running the indexer in asynchronous mode

* change default value

* update docker

* change default value

* rename package, commands -> options

* log warning while environment variable checking
@2024river
Add mantle config 1.0.0 (#302)
d027b91
@will0x0909
add aave_v2 lending (#201)
88516e7 
support aave_v2 supply & borrow
@ideal93
Fix aave Format (#313)
68b26c3
@xuzh2024
improve BufferService compatibility (#314)
4cae50e
@will0x0909
runnable api (#316)
84fee2a 
adjust api
@xuzh2024
Feature/update pg source support for all job (#315)
9768fa6 
* pg source support all jobs

* cover unexpected timestamp type

* Dealing with conflicts when running PGSourceJob and ExportBlocksJob at the same time

* bug fix

* add pg source accuracy control

* deal compatibility between PGSource and BufferService
@will0x0909
Migrate UDF api (#317)
54715f2
@ideal93
Fix poetry version (#319)
9187aa9
@xuzh2024
remove handle_success rewrite (#322)
852ad3b
ideal93 and others added 30 commits January 13, 2025 17:58
@ideal93
Feat/add kafka exporter (#329)
5d73edc 
* Add kafka exporter
@will0x0909
Add Story Odyssey Testnet Config (#328)
9f9987d
@ideal93
Add Parser Contract From Transaction (#318)
810a4dd
@xuzh2024
Feature/add prometheus client (#310)
f5a59e3 
* add prometheus monitor

* update dependency

* make format

* MetricsCollector integrated into BufferService

* code clean & roll back

* add environment control

* metrics update

* fix auto clean

* make format

* update metrics

* add --job-name option

* update metrix

* change environment control

* bugfix

* change clean up strategy

* add lock for threading safe

* simpler metrics

* rename option, change --job-name to --instance-name

* update metrics

* persistence table

* add option --persistence-type

* clean import

* add feature, error counter metrics can persist by postgres and file

* reassemble metrics's options

* add initialization operations for metrics

* update metrics

* update option detail

* update poetry dependency

* add more shutdown collect point

* add prometheus-client port mapping

* clean test code

* deal poetry conflict

* deal poetry conflict
@xuzh2024
new reorg version for v1.0.0 (#308)
33c8e00
@2024river
add block_timestamp as pk and improve v2 total supply (#331)
6cb4548 
* add block_timestamp as pk and improve v2 total supply

* make format
@2024river
add block_timestamp (#332)
42249be
@ideal93
Fix kafka mapping error
89f7bcb
@2024river
add empty-judgement (#334)
946acf7
@2024river
add UniswapV2PoolFromSwapEvent type to __init__ (#335)
68d4f6d
@2024river
fix get_missing_pools_by_rpc (#336)
aeeebcd
@2024river
fix bug for stable_token_balance_limit (#337)
6bae24a
@ideal93
fix(token_transfer): handle erc404 token transfer distinction (#338)
1fe5121
@zhufengthehemera
Token holder metrics (#330)
d873318
@ideal93
Fix address token balance conflict and kafka output (#339)
da63515
@ideal93
Fix/token symbol (#340)
c971720 
* Try fix data.token_symbol

* delete token_symbol

* Fix
@xuzh2024
refresh metrics in time (#343)
b72d10a
@will0x0909
fix token mark (#342)
895beb3 
add retry on 429
@ideal93 @zhufengthehemera
Fix token symbol & Add DexBlockTokenPrice dependency(#344)
7db05b2 
* Try fix data.token_symbol

* delete token_symbol

* Fix

* add log

* add log

* update

* add log

* add DexBlockTokenPrice dependency

* delete log

* lint fix & depend resolved

---------

Co-authored-by: zhufeng <zhufeng@thehemera.com>
@will0x0909
Reduce muti_call error log (#345)
b302dfe
@2024river
add uniswap v2 pools filter logic for NONE decode data (#346)
74f7e17
@ideal93
refactor(web3): remove receipt log sync to Kafka
a7fa062
@zhufengthehemera
export erc20 token transfer with price (#341)
15cd96c
@will0x0909
monad config
ff119f1
@2024river
Adjust wbnb filter logic (#355)
cc4877a
@2024river
improve sql for get_token_price (#356)
9e405b3
@zhufengthehemera
Fix realized pnl (#351)
7c5b826
@zhufengthehemera
Optimize metrics prices (#361)
cb56ac9
@zhufengthehemera
Feature/uniswap v4 (#358)
3e89473 
* stash uniswap v4

* update

* update

* format

* update

* update

* format

* update

* update
@zhufengthehemera @2024river
Feature/four meme (#362)
9554473 
* four meme

* four meme config

* update

* dex token price

* fix

* format

* update

* add sql

* update

---------

Co-authored-by: river <river.zeng@thehemera.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@ideal93 @xuzh2024 @2024river @zhufengthehemera @shanshuo0918 @will0x0909