mirror
/
moonstream
kopia lustrzana https://github.com/bugout-dev/moonstream
1
0
Forkuj 0
Kod Zgłoszenia Projekty Wydania Wiki Aktywność
313 Commity
111 Gałęzie
50 Tagi
21 MiB
Wykres commitów

66 Commity (2d513800aa8e970843d5d7bc643f6dc5e601c733)

Autor SHA1 Wiadomość Data
Neeraj Kashyap 2d513800aa Displaying WEI values as ints (not floats) 
Also changed "metric" to "statistic" in the output for `mooncrawl
ethcrawler trending`.
 2021-08-09 06:01:28 -07:00
Neeraj Kashyap e5226b8a8b Working implementation of "ethcrawlers trending" 
The 24 hour queries take a LONG time but the 1 hour queries execute in 4
seconds.
 2021-08-09 05:55:10 -07:00
Neeraj Kashyap ea1a714e9b Scaffolding for "mooncrawl ethcrawler trending" 2021-08-09 04:58:47 -07:00
Neeraj Kashyap b0dc2c9e9c Added MOONSTREAM_HUMBUG_TOKEN environment variable 
The ethereum trending addresses crawler will be the first one to report
data through a Humbug journal. This requires us to accept a Humbug token
as configuration.
 2021-08-09 04:36:52 -07:00
Neeraj Kashyap 019da38ed2 Improved exception reporting for ethereum crawler 
Introduced `EthereumBlockCrawlError` and raising it whenever there is an
issue crawling blocks.
 2021-08-05 17:11:07 -07:00
Neeraj Kashyap 2f481c0c81 --confirmations argument to "ethcrawl synchronize" 2021-08-05 16:11:10 -07:00
Neeraj Kashyap 82b425da01 Had to save setup.py 
Also updated README to reflect name change.
 2021-08-05 15:54:19 -07:00
Neeraj Kashyap 44cbbc7a17 Version number import fixed 
Renamed version variable.

Bumped version to 0.0.2
 2021-08-05 15:53:03 -07:00
Neeraj Kashyap 4438324e05 Renamed moonstreamcrawlers -> mooncrawl 
Other name was a mouthful.
 2021-08-05 15:52:10 -07:00
Sergei Sumarokov b29e1b04da
Merge pull request #45 from bugout-dev/improved-missing-check 
Improved speed for missing blocks command check
 2021-08-03 16:14:52 +03:00
kompotkot 3c5a2929b7 Fixed args after review 2021-08-03 16:13:32 +03:00
kompotkot b969e01b1c Black format 2021-08-03 12:31:46 +00:00
kompotkot dc08573174 Github workflows 2021-08-03 12:22:06 +00:00
kompotkot 68d5c3755a Simplified bool args 2021-08-03 12:17:08 +03:00
kompotkot 45455a6ac2 Improved speed for missing blocks command check 2021-08-03 11:41:51 +03:00
Neeraj Kashyap 8955c29a64 Removed sleep after processing block 2021-08-02 12:04:09 -07:00
Neeraj Kashyap 6801fb5019 Changed sleeps to 5 seconds 2021-08-02 12:01:19 -07:00
Neeraj Kashyap 84a7a6acaf Added --jobs argument to "blocks synchronize" 2021-08-02 11:57:08 -07:00
Neeraj Kashyap 5ebb4491d0 Fixed CLI 2021-08-02 11:50:56 -07:00
Neeraj Kashyap 66a9b9a80f Actually use --order argument when running sync jobs 
Was not hooked up the the `crawl_blocks_executor` before.

Also removed branching for whether to run `crawl_blocks` or
`crawl_blocks_executor` in the CLI handler. Added `num_processes`
arguments to `crawl_blocks_executor` that callers can use to specify
whether or not to create subprocesses.
 2021-08-02 11:46:50 -07:00
Neeraj Kashyap 50cad0f17f Added --order argument to "blocks synchronize" 
This specifies if you want to crawl blocks in ascending or descending
order.
 2021-08-02 11:36:57 -07:00
Neeraj Kashyap b9d878a033 Fixed get_latest_block 2021-08-02 07:15:01 -07:00
Neeraj Kashyap 04383c11c3 Added support for HTTPProviders 2021-08-02 06:21:37 -07:00
Neeraj Kashyap 7f3fb3b8f9 Added --start argument to "blocks synchronize" 
Also black formatting
 2021-08-02 06:15:33 -07:00
kompotkot 39ff5e0b10 Small fix for CLI crawler sync command 2021-08-02 15:38:25 +03:00
kompotkot a7e2035273 Merge branch 'main' into clean-ethcrawler 2021-07-30 19:16:16 +03:00
Neeraj Kashyap 56e19b153b Merge branch 'main' into crawl-smart-contract-addresses-from-transaction-receipts 2021-07-30 05:39:53 -07:00
kompotkot 7950c04e41 Added TODO for handling errors for crawler 2021-07-29 22:08:26 +03:00
kompotkot 71d1f6c9b8 Added len check 2021-07-29 22:06:55 +03:00
Neeraj Kashyap d809d9b3d5 Error handling for crawlers 2021-07-29 11:52:37 -07:00
Neeraj Kashyap cbd9c2ccf1 Wait for crawling futures to return 2021-07-29 11:41:37 -07:00
Neeraj Kashyap 5ec29305d7 Cleaned up a little the worker submissions for ethcrawler 2021-07-29 11:36:19 -07:00
Neeraj Kashyap c6ddfb464c Updated .gitignore 2021-07-29 11:32:59 -07:00
kompotkot 4f8f589df2 Small updates 2021-07-29 21:09:53 +03:00
Neeraj Kashyap d2c30256b3 Merge branch 'main' into crawl-smart-contract-addresses-from-transaction-receipts 2021-07-29 09:42:55 -07:00
kompotkot 163c8ff350 Added verbose option 2021-07-29 17:01:39 +03:00
Neeraj Kashyap ad37dbd464 Made contract update crawler idempotent 
Had forgotten to add a check before so that it wouldn't reprocess old
transactions. Fixed now.
 2021-07-28 23:26:39 -07:00
Neeraj Kashyap 67e3135386 Latest commit for moonstreamdb requirement 2021-07-28 21:37:12 -07:00
Neeraj Kashyap 03a9295681 Ethereum smart contract registry updater 2021-07-28 21:35:49 -07:00
Neeraj Kashyap 1a749fe736 Added most recent revision of moonstreamdb 2021-07-28 21:00:10 -07:00
Neeraj Kashyap c5422c920d More prep work 2021-07-28 20:45:19 -07:00
Neeraj Kashyap 0f2d50a475 Updated commit hash for moonstreamdb 2021-07-28 20:26:50 -07:00
Neeraj Kashyap f027f6bc6b Moved esd.py into the moonstreamcrawlers package 
Also removed requirements.txt - it had windows-specific pywin32 that
just failed to load on Linux.

`moonstreamcrawlers` environments should be set up using `setup.py`.
 2021-07-28 20:22:25 -07:00
Neeraj Kashyap 5c6dc77392 Made esd a submodule of the crawlers 2021-07-28 20:14:10 -07:00
kompotkot c1c554d759 Fixes for transactions writing to db 2021-07-29 01:49:31 +03:00
kompotkot 048ff0fe23 Break for unnecessary synchronization 2021-07-29 01:02:33 +03:00
kompotkot c6f50a6f61 Lazy crawl block during missing check 2021-07-29 00:57:30 +03:00
kompotkot 73da2e430a Sync latest blocks and optimized blocks list gen 2021-07-29 00:43:35 +03:00
Neeraj Kashyap b9c828fc7f Merge branch 'main' into smart-contract-crawlers 2021-07-28 10:34:55 -07:00
Neeraj Kashyap 1a99d6b778 Merge branch 'main' into smart-contract-crawlers 2021-07-28 10:02:53 -07:00