Skip to content

Commit 9d36df3

Browse files
xuzh2024xuzh2024
authored
Feature/add pg source (HemeraProtocol#159)
* new feature: read data from postgres * new feature: pg_source_job can use filter to specify required data * bug fixed and performance optimized * make format * fix dict_to_dataclass error * fix iterator error * fix iterator error * merged cli load and stream & add limit reader & add param --source-type * optimize code, set default value to --source-types * optimize code logic, to prevent unexpected error * add partition key to enhance query performance. * bug fixed * fixed data convert error * Changes the sort operation from the database to memory * add logger info * fix rpc_limit_reader & parameter required * fix filter logic * fix filter logic * make format * resolved conflict * resolved conflict * make format * deal conflict * separate filter query * Optimize query filter order * Optimize code
1 parent 54d4719 commit 9d36df3

27 files changed

+773
-387
lines changed

‎cli/__init__.py

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,6 @@
55
from cli.aggregates import aggregates
66
from cli.api import api
77
from cli.init_db import init_db
8-
from cli.load import load
98
from cli.reorg import reorg
109
from cli.stream import stream
1110
from indexer.utils.logging_utils import logging_basic_config
@@ -27,7 +26,6 @@ def cli(ctx):
2726

2827

2928
cli.add_command(stream, "stream")
30-
cli.add_command(load, "load")
3129
cli.add_command(api, "api")
3230
cli.add_command(aggregates, "aggregates")
3331
cli.add_command(reorg, "reorg")

‎cli/load.py

Lines changed: 0 additions & 329 deletions
This file was deleted.

0 commit comments

Comments
 (0)