mirror
/
moonstream
kopia lustrzana https://github.com/bugout-dev/moonstream
1
0
Forkuj 0
Kod Zgłoszenia Projekty Wydania Wiki Aktywność
546 Commity
118 Gałęzie
61 Tagi
22 MiB
Wykres commitów

102 Commity (12f590a19abdfde3d2d047c1e6f5a3d930601f3f)

Autor SHA1 Wiadomość Data
kompotkot eea2ce8f8b Using ValueError 2021-08-24 15:43:04 +00:00
kompotkot 6c7d0a783b Using exception instead of empty return with print 2021-08-24 15:42:00 +00:00
kompotkot 6f0a224562 Fixes for crawler mypy 2021-08-24 14:13:20 +00:00
yhtiyar 0ef9f5e06c removed AWS_BUCKET_PREFIX 2021-08-18 19:18:28 +03:00
yhtiyar 44e95bb008 fixed index printing 2021-08-18 18:37:22 +03:00
yhtiyar 2d37e71a89 fixed typo 2021-08-18 18:03:17 +03:00
yhtiyar 21d48bc81d fixed typo 2021-08-18 17:51:23 +03:00
yhtiyar b21eb73376 updated version 2021-08-18 17:50:12 +03:00
yhtiyar c642742a7a Fixed required changes in PR 2021-08-18 17:24:09 +03:00
yhtiyar d54c6d854f Changet ETHSCAN_TOKEN name to MOONSTREAM_ETHSCAN_TOKEN 2021-08-18 14:16:56 +03:00
yhtiyar 57260b7ea4 Made crawler work 2021-08-18 14:12:53 +03:00
yhtiyar df39564db9 Merge branch 'main' into ethscan-crawler 2021-08-18 11:52:48 +03:00
yhtiyar c7794a964c removed unneeded crawl call 2021-08-18 11:52:18 +03:00
kompotkot 1ff4a887ce cmc url for each label in parsed token from cmc 2021-08-16 15:37:39 +00:00
kompotkot fcdd501261 Changed labele name for cmc parser 2021-08-16 15:19:11 +00:00
yhtiyar e929a3e72f Merge branch 'main' into ethscan-crawler 2021-08-16 17:26:33 +03:00
yhtiyar b0d545eb32 using datetime.now() instead of time.time() 2021-08-16 17:24:24 +03:00
yhtiyar 24253f8bb7 removed csv from repo, added it to s3 bucket 2021-08-16 17:09:23 +03:00
kompotkot 257405fd47 Fixed parser to work with labels properly to get coinmarketcap 2021-08-16 11:16:54 +00:00
yhtiyar 068941c163 Merge branch 'main' into ethscan-crawler 2021-08-10 17:21:49 +03:00
yhtiyar 5b90ed8832 temporary fix 2021-08-10 17:20:03 +03:00
Neeraj Kashyap 70adccdebb Updated "ethcrawler trending" result body 
Added `crawler_version:<version>` tag to Humbug report.
 2021-08-09 19:45:20 -07:00
Neeraj Kashyap ca6a5b2b70 "ethcrawler trending": default start, end 2021-08-09 19:37:57 -07:00
Neeraj Kashyap 0e98794db9 "ethcrawler trending" humbug token from env 
This makes life easier when using it as a systemd service.

Also added systemd service and timer for trending addresses crawler.
 2021-08-09 18:58:43 -07:00
Neeraj Kashyap bd49b2956b Slight renaming for clarity of internal args 2021-08-09 09:30:08 -07:00
Neeraj Kashyap 5084f7f32f Merge branch 'main' into crawlers-ethereum-trending 2021-08-09 09:17:40 -07:00
Neeraj Kashyap 272fabfd18 Black formatting 2021-08-09 09:13:08 -07:00
kompotkot de972d6722 Modified git commit hash to work with new labels table 2021-08-09 16:06:17 +00:00
yhtiyar b3e3c0d85f Merge branch 'main' into ethscan-crawler 2021-08-09 17:46:57 +03:00
yhtiyar d5aa127843 added ethscan smart contract source crawler 2021-08-09 17:41:13 +03:00
yhtiyar fb5b6fd56b added boto3 requirment 2021-08-09 17:40:02 +03:00
yhtiyar 3c479a37b4 added env variables for ethscan crawler 2021-08-09 17:39:28 +03:00
kompotkot 55ac27689c Working migration smart_contr -> address 2021-08-09 14:04:17 +00:00
Neeraj Kashyap d9d863e742 Functionality to publish JSON results to Humbug 
For `mooncrawl ethcrawler trending`
 2021-08-09 06:33:56 -07:00
Neeraj Kashyap 2d513800aa Displaying WEI values as ints (not floats) 
Also changed "metric" to "statistic" in the output for `mooncrawl
ethcrawler trending`.
 2021-08-09 06:01:28 -07:00
Neeraj Kashyap e5226b8a8b Working implementation of "ethcrawlers trending" 
The 24 hour queries take a LONG time but the 1 hour queries execute in 4
seconds.
 2021-08-09 05:55:10 -07:00
Neeraj Kashyap ea1a714e9b Scaffolding for "mooncrawl ethcrawler trending" 2021-08-09 04:58:47 -07:00
kompotkot ce1d114e14 Merge branch 'main' into address-identity 2021-08-09 11:39:51 +00:00
Neeraj Kashyap b0dc2c9e9c Added MOONSTREAM_HUMBUG_TOKEN environment variable 
The ethereum trending addresses crawler will be the first one to report
data through a Humbug journal. This requires us to accept a Humbug token
as configuration.
 2021-08-09 04:36:52 -07:00
kompotkot 26573fecf8 Initial version of eth address model with labels 2021-08-06 12:05:59 +00:00
Neeraj Kashyap 019da38ed2 Improved exception reporting for ethereum crawler 
Introduced `EthereumBlockCrawlError` and raising it whenever there is an
issue crawling blocks.
 2021-08-05 17:11:07 -07:00
Neeraj Kashyap 2f481c0c81 --confirmations argument to "ethcrawl synchronize" 2021-08-05 16:11:10 -07:00
Neeraj Kashyap 82b425da01 Had to save setup.py 
Also updated README to reflect name change.
 2021-08-05 15:54:19 -07:00
Neeraj Kashyap 44cbbc7a17 Version number import fixed 
Renamed version variable.

Bumped version to 0.0.2
 2021-08-05 15:53:03 -07:00
Neeraj Kashyap 4438324e05 Renamed moonstreamcrawlers -> mooncrawl 
Other name was a mouthful.
 2021-08-05 15:52:10 -07:00
Sergei Sumarokov b29e1b04da
Merge pull request #45 from bugout-dev/improved-missing-check 
Improved speed for missing blocks command check
 2021-08-03 16:14:52 +03:00
kompotkot 3c5a2929b7 Fixed args after review 2021-08-03 16:13:32 +03:00
kompotkot b969e01b1c Black format 2021-08-03 12:31:46 +00:00
kompotkot dc08573174 Github workflows 2021-08-03 12:22:06 +00:00
kompotkot 68d5c3755a Simplified bool args 2021-08-03 12:17:08 +03:00