mirror
/
moonstream
kopia lustrzana https://github.com/bugout-dev/moonstream
1
0
Forkuj 0
Kod Zgłoszenia Projekty Wydania Wiki Aktywność
3 687 Commity
121 Gałęzie
76 Tagi
29 MiB
Wykres commitów

949 Commity (add-b3)

Autor SHA1 Wiadomość Data
Andrey 51359548e4 Add changes. 2023-11-06 20:10:45 +02:00
Andrey befeb057cf Add changes. 2023-11-06 18:50:14 +02:00
Andrey 3ce6cf70c6 Add changes. 2023-11-06 11:54:29 +02:00
Sergei Sumarokov 559c51b2d6
Merge pull request #939 from moonstream-to/removed-outdated-crawlers 
Cleaned from unused crawler services
 2023-11-07 15:02:11 +03:00
kompotkot c196c9e0d2 Crawlers systemd monitoring 2023-11-02 11:59:31 +00:00
Andrey 1397f87d54 Add changes. 2023-11-01 13:22:20 +02:00
Andrey c192f278ac Add logs changes. 2023-10-25 14:27:45 +03:00
Andrey 017154207c Add changes. 
Delete object log.
 2023-10-25 14:21:24 +03:00
kompotkot fa3caefe06 Fixed naming of systemd service to correlate with files and deploy 2023-10-19 13:20:09 +00:00
kompotkot 8051e78f5b Cleaned from unused crawler services 2023-10-19 12:00:52 +00:00
Andrey 105f29dfbe Reduce max blocks batch. 2023-10-18 07:48:45 +03:00
Andrey 21a0fc4157 Fix lint.. 2023-09-11 19:30:00 +03:00
Andrey bb4bc7f778 Add improvments. 2023-09-11 17:27:03 +03:00
Andrey d07ec13bf6 Add Shadowcorns. 2023-09-11 16:53:14 +03:00
kompotkot 4c5e6cc327 Requirements update and deployment zksync mainnet scripts 2023-08-30 13:11:17 +00:00
kompotkot ec918609db ZkSync mainnet support changes 2023-08-30 12:58:50 +00:00
Andrey adea116388 Fix missing networks for blockchains. 2023-08-29 20:33:38 +03:00
Andrey 3d85f1767d Bump version replace networks. 2023-08-29 07:19:25 +03:00
Andrey f49b7c4a78 zkSync in crawlers. 2023-08-29 06:41:47 +03:00
Andrey 95439825a3 Add changes. 2023-08-18 19:33:48 +03:00
Andrey a991549ea6 Add status check of running task. 2023-08-16 05:21:44 +03:00
Andrey 1ae366ab7d Update bugout version. 2023-08-10 16:29:37 +03:00
Andrey c4b18145b0 Merge branch 'main' into historical-crawl-fixes 2023-08-03 02:30:43 +03:00
Andrey 9246950293 Merge branch 'main' into historical-crawl-fixes 2023-08-03 02:25:56 +03:00
kompotkot 92dbfe5576 Mooncrawl entity migration to spire 2023-08-01 08:58:36 +00:00
Andrey 6462d84d65 Add missing parameter. 2023-07-28 08:28:14 +03:00
Andrey Dolgolev f820129205
Merge pull request #873 from moonstream-to/leaderboard-generator 
Leaderboards worker
 2023-07-27 19:00:17 +03:00
Andrey 323784f8b2 Fix function filter degradetion. 2023-07-27 09:22:23 +03:00
Andrey f2f078b9c3 add variable to sample.env 2023-07-27 07:06:14 +03:00
Andrey be7a7e0267 fix typo. 2023-07-27 07:01:11 +03:00
Andrey bf7f6497c5 Add changes. 2023-07-27 06:59:01 +03:00
Andrey 3215e5d719 Add leaderboards dir. 2023-07-26 23:52:35 +03:00
Andrey 4d1d242c81 Add loggers and fixes. 2023-07-26 23:51:15 +03:00
Andrey 6c11fb3d0f Add working leaderboard update. 2023-07-26 20:20:17 +03:00
Andrey 88d0f91706 Add new metadata method. 2023-07-26 16:31:10 +03:00
Andrey cb1137fd39 Add init version. 2023-07-26 16:21:56 +03:00
Andrey 9f38e19d9d Fix URI method name. 2023-07-25 10:29:37 +03:00
Andrey 4891f1b5fe Add erc1155 token_ids. 2023-07-25 09:41:41 +03:00
Andrey Dolgolev 24aeada59c
Merge pull request #867 from moonstream-to/add-new-metadata-state-task 
Add new address in tasks.
 2023-07-25 14:36:54 +03:00
kompotkot 3bbc47a36d ZkSync historical crawlers 2023-07-24 15:28:07 +00:00
Andrey 60d98a8627 Add historical crawl worker. 2023-07-24 17:20:18 +03:00
Andrey 78bc0770f5 Add new address in tasks. 2023-07-24 16:59:58 +03:00
kompotkot f768369f05 ZkSync Era testnet moonworm crawler deployment 2023-07-20 10:38:43 +00:00
Andrey e16558bd9e Refactor connection managers. 2023-07-16 09:06:28 +03:00
Andrey 40f498e5a9 Remove local session. 2023-07-14 23:49:27 +03:00
Andrey 0d6259a52d Fix metadata session managment. 2023-07-14 19:42:59 +03:00
Andrey 177c2caf28 Add changes. 2023-07-13 15:00:40 +03:00
Andrey 22f4af26a2 Fixes. 2023-07-13 14:27:16 +03:00
Andrey 9fa794a856 Remove print. 2023-07-13 12:33:52 +03:00
Andrey ff3899d8d5 Add changes. 2023-07-13 12:32:17 +03:00
kompotkot 5bd81bfefa Fixed int parse for zksync model 2023-07-13 11:05:37 +00:00
kompotkot a9186181d8 Basic zksync sync and missing services 2023-07-13 08:52:30 +00:00
kompotkot fefd11a5d3 Bumped version of mooncrawl 2023-07-13 08:35:43 +00:00
kompotkot aa5f0b2891 ZkSync era support for crawlers 2023-07-12 12:31:53 +00:00
Andrey f7aec850de Add changes. 2023-07-10 14:59:46 +03:00
Andrey e329a807b6 Remove prints. 2023-07-10 14:48:41 +03:00
Andrey 93a620dd67 Remove import. 2023-07-10 14:42:53 +03:00
Andrey 41ef7eaa61 Remove prints and breackpoints. 2023-07-10 14:38:03 +03:00
Andrey fc168a619e Add changes. 2023-07-10 14:32:44 +03:00
Andrey 67de697270 Add queryAPI job type. 2023-07-01 14:28:35 +03:00
Andrey Dolgolev d3b2e350f5
Merge pull request #820 from moonstream-to/queries-template 
Queries template
 2023-06-19 16:16:39 +03:00
Andrey 9dbd3b2871 Delete queries templates from report_crawler. 2023-06-19 14:13:16 +03:00
Andrey 0a7a5a7d99 Add changes. 2023-06-19 01:19:10 +03:00
Andrey d473db954c Add changes. 2023-06-19 00:05:45 +03:00
Andrey 4788a3d8a7 Add changes. 2023-06-16 18:15:39 +03:00
Andrey b2bf46ad7e Add changes. 2023-06-16 18:08:56 +03:00
Andrey 3560be1e55 Add changes. 2023-06-12 23:43:15 +03:00
Andrey d4e32b520f Fix function crawl. 2023-06-12 22:42:20 +03:00
Andrey 264955a2e3 Add changes. 2023-06-09 01:11:55 +03:00
Andrey de7f01e7f0 Add changes. 2023-06-09 00:15:20 +03:00
Andrey e1e8a4e45c Merge branch 'main' into add-lands-tasks 2023-06-08 18:48:21 +03:00
Andrey eb20013588 Change to 50. 2023-05-31 18:27:41 +03:00
Andrey 1eb263b071 Change polygon crawler parameters. 2023-05-31 18:25:57 +03:00
Andrey 243338705c Fix history to historical. 2023-05-31 17:49:13 +03:00
Andrey 479ad41184 Fix deploy script run parameters. 2023-05-31 17:35:04 +03:00
Andrey c697aad609 Change error to logger. 2023-05-31 17:30:10 +03:00
Andrey ee8d1cf457 Add changes. 2023-05-31 17:22:56 +03:00
Andrey 2e211a6b18 Use mappings instead hardcode. 2023-05-31 17:06:49 +03:00
Andrey 96af5d950c Fix typo. 2023-05-31 16:59:59 +03:00
Andrey 9f82dc3b7f Add changes. 2023-05-30 17:34:49 +03:00
Andrey 8f5ab20ed2 Add lands contracts. 2023-05-30 17:21:52 +03:00
Andrey ee9fba7469 Add fix for end_block. 2023-05-30 17:13:18 +03:00
Andrey 13fc900bc1 Add deployments. 2023-05-30 17:10:03 +03:00
Andrey 839622df10 Add changes. 2023-05-29 17:12:57 +03:00
Andrey 43e0367f17 Add changes. 2023-05-29 16:29:45 +03:00
Andrey de39b35f69 Bump versions. 2023-05-25 16:44:10 +03:00
Andrey bcc9897fb1 Add fixes. 2023-05-25 16:06:33 +03:00
Andrey cf93f99fb1 Add initial working state. 2023-05-23 13:56:38 +03:00
Andrey 07ad71fd9c Add initial version. 2023-05-11 17:20:34 +03:00
Sergei Sumarokov f6992a5af7
Updated entity client version 2023-05-02 17:57:45 +03:00
Andrey fd9495340a Bump version. 2023-04-27 20:28:38 +03:00
Andrey 14ed5325df Change env name in sample.env 2023-04-27 19:13:49 +03:00
Andrey 1c0a6dd467 Bump versions. 2023-04-27 19:07:18 +03:00
Andrey 222581f1d0 Fix names of env variables. 2023-04-27 19:04:07 +03:00
Andrey bf2716cfd0 Add changes in enviroments. 2023-04-26 18:08:17 +03:00
Andrey d7c8a13ba1 Add suggested changes. 2023-04-26 17:38:32 +03:00
Andrey f83aec9166 Fix mypy. 2023-04-26 16:37:19 +03:00
Andrey 8f36278f1b Remove prints. 2023-04-26 16:30:54 +03:00
Andrey e2c50c26b9 Remove missmappng and remove cu-watch fix. 2023-04-25 18:39:25 +03:00
Andrey ad06bf947f Fix merging duplicates. 2023-04-25 17:50:46 +03:00
Andrey 447763ca85 Fix dashboards cache. 2023-04-25 17:41:18 +03:00
Andrey da905d8ced Add fixes. 2023-04-25 17:10:46 +03:00
Andrey 231382422e Changes: 
Add cli step command
Fix actions tokens in moonstream
Fix dashboards API
Fix dashboard resources reconection.
Fix mooncrawl dashboards generation workflow.
 2023-04-25 16:49:01 +03:00
Andrey 42cca77868 Add min-blocks-batch 1 for wyrm chain. 2023-04-12 15:23:10 +03:00
Andrey c2a02eb70a Mumbai moonworm-crawler conformations set to 40 2023-04-11 15:28:01 +03:00
kompotkot 8b95f6cece Set confirmation blocks for mumbai crawler 20 2023-04-10 18:24:01 +00:00
Andrey 6c8e9bbb5b Add fixes. 2023-04-06 19:46:10 +03:00
Andrey 9ab9e7fd1f Fix query template. 2023-04-06 19:18:10 +03:00
Andrey ada492e372 Add equal to. 2023-04-06 15:42:44 +03:00
Andrey 91ca3d15bf Add same version as moonworm. 2023-04-06 15:40:28 +03:00
Andrey ff6a2ed5d5 Fix env name. 2023-04-05 19:23:26 +03:00
Andrey a0b1ee7770 Fix service. 2023-04-05 19:02:54 +03:00
Andrey 30a9bf9951 Add fixes. 2023-04-05 19:01:10 +03:00
Andrey d2cef2b637 Add deploy scripts. 2023-04-05 18:38:05 +03:00
Andrey b441e316a0 Create orange dao pipeline. 2023-04-05 18:22:40 +03:00
kompotkot f2a69072e0 Full args name for easy maintenance 2023-03-15 09:58:55 +00:00
kompotkot fd652092cc Set polygon confirmations to sync crawler to 40 2023-03-15 09:57:06 +00:00
Andrey Dolgolev eb350bd7ec
Merge pull request #767 from bugout-dev/wyrm-blocks-transactions 
Wyrm blocks transactions
 2023-03-14 18:31:03 +02:00
Andrey 0e3b4928a7 Add changes. 2023-03-14 14:24:28 +02:00
Andrey 534004851f Add deploy.bash commands and deploy scripts. 2023-03-14 14:16:17 +02:00
Andrey e76669921e Add full args names. 2023-03-14 12:20:52 +02:00
Andrey d910f1bfa7 Add start block as 0. 2023-03-14 00:23:37 +02:00
Andrey 4c36794d79 Update versions. 2023-03-09 19:59:08 +02:00
Andrey 612da984a7 Add sorted keys and change get_links endpont to POST. 2023-03-09 19:45:44 +02:00
Andrey f2bc8dfd17 Merge branch 'main' into add-parameters-in-s3-path 2023-03-09 18:41:50 +02:00
Andrey e885cf5fe2 Fix block crawler and missing block crawler. 2023-03-09 14:12:25 +02:00
Andrey 082ca2b867 Add fix for transaction type. 2023-03-09 11:32:54 +02:00
kompotkot 99a608c6dc Custom engine for all crawlers with specific timeout 2023-03-09 07:28:34 +00:00
Andrey aef0e4743e Update version. 2023-03-08 22:00:27 +02:00
Andrey abe8c17e8c Add textual clause for slqalchemy. 2023-03-08 21:59:30 +02:00
Andrey a6184b725d Fix text clause miss for sqlalchemy 2.0.4 and dict converting. 2023-03-08 21:09:06 +02:00
kompotkot 59e4ce36fb Fixed typo in deploy crawlers and version of moonworm 2023-03-08 17:55:07 +00:00
Andrey Dolgolev e8a97406d3
Merge pull request #761 from bugout-dev/add-coldera-blockcahin 
Add Wyrm blockchain support
 2023-03-08 19:13:12 +02:00
Andrey 3a8069e976 Update moonworm and moonstreamdb versions. 2023-03-08 19:04:40 +02:00
kompotkot a51a275daa Bumped versions of moonstreamapi and mooncrawl 2023-03-08 07:59:31 +00:00
Andrey c23afaa6de update deploy.bash. 2023-03-07 17:48:12 +02:00
Andrey 695c3e646a Add service. 2023-03-07 17:45:02 +02:00
Andrey 2b646b200a Remove [tester](not available) for web3 dependemcy. 2023-03-07 17:00:25 +02:00
Andrey 9b56b4d991 Add --no-confirmations parameter. 2023-03-07 16:16:01 +02:00
Andrey 887114b7a5 Add missing mappings. 
Remove debug information outputs.
 2023-03-07 13:47:14 +02:00
Andrey 16a0a804fd Add MOONSTREAM_WYRM_WEB3_PROVIDER_URI to sample env. 2023-03-07 13:35:58 +02:00
Andrey 3b0eb01c0c Fix lint and conformation can set as 0. 2023-03-06 19:28:08 +02:00
Andrey d2836d7d41 Add Wyrm chain. 2023-03-06 17:58:25 +02:00
Andrey 002a1ad88c Add json upload. 2023-03-02 15:08:21 +02:00
Andrey 1e60876519 Add tested version. 2023-03-02 14:26:36 +02:00
Andrey b04506dbb6 Remove switch to ubuntu user from service script. 2023-02-28 16:32:44 +02:00
Andrey 8745dd1153 Add changes. 2023-02-28 16:22:04 +02:00
Andrey 60e96f5ad6 Add nft dashboard generation and deploy script. 2023-02-28 15:39:19 +02:00
Andrey cbccf12b56 Add new env variable MOONSTREAM_CRAWLERS_DB_STATEMENT_TIMEOUT_MILLIS. 2023-02-14 19:49:37 +02:00
Andrey d7e108a1c5 Add fix of metadata crawler for more optimized writing to database. 2023-02-14 19:26:49 +02:00
Andrey 6d7cbb0139 Fix if condition with leak_rate. 2023-02-13 14:32:41 +02:00
Andrey 1b1e6d6930 Max_recrawl have not strict. 2023-02-13 14:11:12 +02:00
Andrey 6381e29d7a Remove argument. 2023-02-13 14:06:08 +02:00
Andrey 8947f4249e Add fix of recrawl. 2023-02-13 14:04:25 +02:00
Andrey 3cc202b88b Add fixes. 2023-02-13 14:00:49 +02:00
Andrey 84ec8c80a8 black formating. 2023-02-10 12:04:34 +02:00
Andrey a3038b1f88 Add changes. 2023-02-10 00:17:34 +02:00
Andrey 4c7a7fdaf6 Add deletion step. 2023-02-07 17:30:58 +02:00
Andrey 556e91fba9 Add fixes and logging. 2023-01-31 15:12:57 +02:00
Andrey 9bdd7b504e Merge branch 'main' into leaking-cache-in-metadata-crawler 2023-01-31 14:14:37 +02:00
Andrey f9c6d29561 Extend leak logic with getting all tokens which have tx_calls except transfers after latest metadata crawl. 
Leak-rate calculating in code depends on amount maybe updated tokens and max-recrawl cli argument.
 2023-01-31 14:09:03 +02:00
kompotkot fd134352a1 Use 0.2.4 moonworm for watch-cu crawler 2023-01-30 09:58:01 +00:00
kompotkot 43c7df5ecf Fixed file mode in deploy 2023-01-30 08:49:00 +00:00
kompotkot c53c4f3648 Moonworm watcher for cu 2023-01-26 14:31:18 +00:00
kompotkot e5ef9cfe5e Support of systems deployment 2023-01-26 13:41:36 +00:00
Andrey 69cfe4069b Add leak of parsed data. 2023-01-19 16:39:44 +02:00
Andrey 6ec956c723 Merge branch 'main' into add-parameters-in-s3-path 2023-01-17 13:37:46 +02:00
Andrey fa7c0f9ba1 Add deploy changes. 2022-12-15 20:17:00 +02:00
Andrey 2691409022 Merge branch 'main' into metadata-crawler-improvements 2022-12-15 20:14:31 +02:00
Andrey 338b321b1f Add deploy changes 2022-12-15 20:09:27 +02:00
Andrey c7cfe7a160 Fix service and timer to mumbai name. 2022-12-15 19:43:43 +02:00
Andrey e5b864d9c0 Rename to mumbai. 2022-12-15 19:40:49 +02:00
Andrey 5ec46a6a2f Remove log. 2022-12-15 19:34:39 +02:00
Andrey b16a4ff1a1 Add fixes. 2022-12-15 19:31:24 +02:00
Andrey e1aafd7552 Add fixes 2022-12-15 18:58:54 +02:00
Andrey 9cfd12dc8d Add state cleaner. 2022-12-15 17:34:49 +02:00
Andrey e64bb7fcad Add deploy services and fix if condition. 2022-12-15 17:27:51 +02:00
Andrey f68ab988c9 Add jobs folder. 2022-12-15 16:18:44 +02:00
Andrey a4dd79a663 Add read tasks from json file and custom web3 provider. 2022-12-15 15:45:41 +02:00
Andrey 6a379c1b55 Merge branch 'main' into fix-state-crawler 2022-12-15 14:26:00 +02:00
kompotkot 36e58c7275 Fix deprecated keys for gnosis 2022-12-14 13:47:57 +00:00
Andrey 36888404ef Add rollback. 2022-12-05 13:56:22 +02:00
Andrey f0857b4d73 Move hash generation to actions. 2022-11-30 17:31:19 +02:00
Andrey 0aeae49c97 Merge branch 'main' into add-parameters-in-s3-path 2022-11-30 17:14:37 +02:00
Andrey Dolgolev e917d9361d
Merge pull request #721 from bugout-dev/fix-passing-list-as-sql-parameter 
Fix passing list as sql parameter
 2022-11-29 17:15:31 +02:00
Andrey 5b4ddc6feb Fix pass params. 2022-11-29 17:05:22 +02:00
Andrey e34f544099 Add converting from json types. 2022-11-29 15:06:27 +02:00
kompotkot f3347224c9 Moonworm crawlers for ethereum 2022-11-28 17:35:18 +00:00
Andrey c7e8402785 remove comment. 2022-11-28 17:18:27 +02:00
Andrey 6c8046908d Black formating. 2022-11-28 17:16:53 +02:00
Andrey f60fe8693c Fix route. 2022-11-28 16:52:30 +02:00
Andrey b44881a28d Refactor code.. 2022-11-24 15:40:26 +02:00
Andrey a66039ad38 Move db state information. 2022-11-24 15:13:15 +02:00
Andrey 7bf1ef00af Move hash generation in api handler. 2022-11-24 15:02:32 +02:00
Andrey 3800c558b8 Move push to bucket in actions.py 2022-11-24 14:42:52 +02:00
Andrey e8a1187889 Add hash of parameter to s3 route. 
Add fix for list support.
 2022-11-24 14:40:39 +02:00
Andrey b8b72ea35d Remove refetch add later after apear hash of paramaters in s3 route. 2022-11-17 18:20:33 +02:00
Andrey f54c113e65 Bigger await for results. 2022-11-17 17:42:10 +02:00
Andrey 1a3509d554 Replace prints via logger. 2022-11-16 15:50:44 +02:00
kompotkot 8f98d5feba Updated service file for cu queries crawler 2022-11-16 13:36:36 +00:00