mirror
/
moonstream
kopia lustrzana https://github.com/bugout-dev/moonstream
1
0
Forkuj 0
Kod Zgłoszenia Projekty Wydania Wiki Aktywność
3 102 Commity
117 Gałęzie
60 Tagi
22 MiB
Wykres commitów

82 Commity (deduplicate-cli-moonworm-crawler)

Autor SHA1 Wiadomość Data
Neeraj Kashyap c0b315ddae --derive_functions -> --derive-functions 2021-10-05 11:33:00 -07:00
Andrey Dolgolev 9605f4ef52 Add transfer_statistics_by_address. 2021-10-05 19:49:30 +03:00
Andrey Dolgolev 1b69699fde Add simpler solution for distribution. 2021-10-05 19:37:28 +03:00
Andrey Dolgolev b635412a3d Remove comments. 2021-10-05 19:36:14 +03:00
Andrey Dolgolev 45b84785e3 Add ability copy sqlite3 database with aplling filter. 2021-10-05 19:33:53 +03:00
yhtiyar 6ed3bc3122 added enrich 2021-10-05 15:29:17 +03:00
yhtiyar 9dea56b84c Merge branch 'dataset-nfts' of github.com:bugout-dev/moonstream into dataset-nfts 2021-10-04 19:29:57 +03:00
yhtiyar c543ab92f5 added enrich command 2021-10-04 19:24:11 +03:00
Neeraj Kashyap 9a8c6444f7 Merge branch 'dataset-nfts' of github.com:bugout-dev/moonstream into dataset-nfts 2021-10-04 08:30:23 -07:00
Neeraj Kashyap 6794cbf74b Fixed import data column order 
This was a nasty bug.
 2021-10-04 08:26:33 -07:00
Andrey Dolgolev b51922c13f Merge branch 'dataset-nfts' of github.com:bugout-dev/moonstream into dataset-nfts 2021-10-04 16:52:51 +03:00
Andrey Dolgolev 3e4acd4d5c Add distribution values request. 2021-10-04 16:49:35 +03:00
Neeraj Kashyap f8fb803fd4 Handle checkpoints correctly when importing data 
Also added "nfts" command as a console script in setup.py
 2021-10-02 12:22:24 -07:00
Neeraj Kashyap 2f3978d416 Added "nfts import-data" command 
Tested on small databases. Yet to test on real datasets.

First test will be merge of @Yhtiyar's dataset with transfers and my
dataset with mints.
 2021-10-02 11:16:16 -07:00
yhtiyar 3dec9fc5f6 removed calling enrich from web3 2021-10-02 16:46:28 +03:00
yhtiyar da3db29e0a added qurying over created adds, and other fixes 2021-10-02 03:03:08 +03:00
yhtiyar cb2c65b0ed added crawling of erc721 2021-09-30 17:35:05 +03:00
Neeraj Kashyap 4be1fe4d7a Added "nfts derive" command 
Removed old web3 provider code in favor of @Andrei-Dolgolev's batching
interface.
 2021-09-29 12:56:39 -07:00
yhtiyar c0d3f23500 removed unique constraint 2021-09-29 20:47:36 +03:00
yhtiyar fe4fa6c6fd temporary fix 2021-09-29 15:41:50 +03:00
yhtiyar 405aa3871e added checkpoint 2021-09-29 14:44:57 +03:00
yhtiyar 9a16ad207b added batching support for request to node 2021-09-29 00:25:01 +03:00
Andrey Dolgolev c4db62be65 Remoce import. 2021-09-28 16:52:32 +03:00
Andrey Dolgolev e4f1fc2d15 Add init version off jrps requests class. 2021-09-28 16:50:02 +03:00
Neeraj Kashyap 897bfda684 Working version of "nfts initdb" and "nfts materialize" 
Started a job to collect NFT mints from production to a local SQLite
datastore.

It looks like it will take a few hours to complete.
 2021-09-26 13:06:09 -07:00
Neeraj Kashyap 6439324aba Added some datastore (to SQLite) functionality 
Set up CLI framework, as well.
 2021-09-26 11:14:40 -07:00
Neeraj Kashyap be63141b14 MOONSTREAM_IPC_PATH -> MOONSTREAM_WEB3_PROVIDER 
Updated sample.env, too
 2021-09-26 09:34:14 -07:00
yhtiyar 098aea7d20 Made preprocess method that will add missing fields to NftEvent from web3 2021-09-25 22:44:41 +03:00
Neeraj Kashyap 072a86c8fc Got started on materialization code for intermediate datasets 
These are the steps required to produce the raw dataset referenced here:
https://github.com/bugout-dev/moonstream/issues/272#issuecomment-926087702

Intermediate steps:
https://github.com/bugout-dev/moonstream/issues/272#issuecomment-927144872
 2021-09-25 10:23:33 -07:00
Neeraj Kashyap abae67143a Bumped nfts version to 0.0.2 2021-09-25 09:50:43 -07:00
Neeraj Kashyap d22c0c6929 Set up Python package 2021-09-25 09:39:30 -07:00
Neeraj Kashyap f481d28050 Started on code for NFTs dataset 2021-09-25 09:29:20 -07:00