mirror
/
moonstream
kopia lustrzana https://github.com/bugout-dev/moonstream
1
0
Forkuj 0
Kod Zgłoszenia Projekty Wydania Wiki Aktywność
853 Commity
121 Gałęzie
76 Tagi
29 MiB
Wykres commitów

853 Commity (2f3978d4165e4189206e79bb45ebf2e71eba4fb8)

Autor SHA1 Wiadomość Data
Neeraj Kashyap 2f3978d416 Added "nfts import-data" command 
Tested on small databases. Yet to test on real datasets.

First test will be merge of @Yhtiyar's dataset with transfers and my
dataset with mints.
 2021-10-02 11:16:16 -07:00
yhtiyar 3dec9fc5f6 removed calling enrich from web3 2021-10-02 16:46:28 +03:00
yhtiyar da3db29e0a added qurying over created adds, and other fixes 2021-10-02 03:03:08 +03:00
yhtiyar cb2c65b0ed added crawling of erc721 2021-09-30 17:35:05 +03:00
Neeraj Kashyap 4be1fe4d7a Added "nfts derive" command 
Removed old web3 provider code in favor of @Andrei-Dolgolev's batching
interface.
 2021-09-29 12:56:39 -07:00
yhtiyar c0d3f23500 removed unique constraint 2021-09-29 20:47:36 +03:00
yhtiyar fe4fa6c6fd temporary fix 2021-09-29 15:41:50 +03:00
yhtiyar 405aa3871e added checkpoint 2021-09-29 14:44:57 +03:00
yhtiyar 9a16ad207b added batching support for request to node 2021-09-29 00:25:01 +03:00
Andrey Dolgolev c4db62be65 Remoce import. 2021-09-28 16:52:32 +03:00
Andrey Dolgolev e4f1fc2d15 Add init version off jrps requests class. 2021-09-28 16:50:02 +03:00
Neeraj Kashyap 897bfda684 Working version of "nfts initdb" and "nfts materialize" 
Started a job to collect NFT mints from production to a local SQLite
datastore.

It looks like it will take a few hours to complete.
 2021-09-26 13:06:09 -07:00
Neeraj Kashyap 6439324aba Added some datastore (to SQLite) functionality 
Set up CLI framework, as well.
 2021-09-26 11:14:40 -07:00
Neeraj Kashyap be63141b14 MOONSTREAM_IPC_PATH -> MOONSTREAM_WEB3_PROVIDER 
Updated sample.env, too
 2021-09-26 09:34:14 -07:00
yhtiyar 098aea7d20 Made preprocess method that will add missing fields to NftEvent from web3 2021-09-25 22:44:41 +03:00
Neeraj Kashyap 072a86c8fc Got started on materialization code for intermediate datasets 
These are the steps required to produce the raw dataset referenced here:
https://github.com/bugout-dev/moonstream/issues/272#issuecomment-926087702

Intermediate steps:
https://github.com/bugout-dev/moonstream/issues/272#issuecomment-927144872
 2021-09-25 10:23:33 -07:00
Neeraj Kashyap abae67143a Bumped nfts version to 0.0.2 2021-09-25 09:50:43 -07:00
Neeraj Kashyap 3fe06ee194 Set up moonstreamdb/setup.py for distribution to PyPI 2021-09-25 09:42:22 -07:00
Neeraj Kashyap d22c0c6929 Set up Python package 2021-09-25 09:39:30 -07:00
Neeraj Kashyap f481d28050 Started on code for NFTs dataset 2021-09-25 09:29:20 -07:00
Neeraj Kashyap 98ab736ef4
Merge pull request #279 from bugout-dev/token-screen 
Token screen
 2021-09-25 09:00:00 -07:00
Neeraj Kashyap 1517605a57
Merge pull request #236 from bugout-dev/erc721-labels 
Erc721 labels
 2021-09-25 08:59:21 -07:00
Neeraj Kashyap 6ae67d7a75
Merge pull request #283 from bugout-dev/fixing_nft_crawler 
added reporter to nft crawler, removed global cache for addresses
 2021-09-25 08:57:36 -07:00
Neeraj Kashyap d5eecf100f Fixed mypy issue 2021-09-25 08:56:22 -07:00
Neeraj Kashyap 126090ab54 Handled unicode code points that can't be stored in Postgres 
Also applied MOONSTREAM_SPIRE_API_URL configuration to mooncrawl
reporter so that we can report to non-production Spire APIs.
 2021-09-25 08:51:03 -07:00
yhtiyar 4bf2b5311d fix typo 2021-09-24 23:00:10 +03:00
yhtiyar 5f83b7edf4 added reporter 2021-09-24 22:58:17 +03:00
Sergei Sumarokov c35354be04
Merge pull request #282 from bugout-dev/block-tx-checker 
Threads instead of pools, missing block cmd check num of transactions
 2021-09-24 19:15:28 +03:00
kompotkot 7d6853d0c8 tqdm bar for block crawlers 2021-09-24 14:31:34 +00:00
kompotkot 7e4f0f6ce0 Threads instead of pools, missing block cmd check num of transactions 
While we have a troubles with Pool execution calls with psycopg2,
using Threads executor instead.
 2021-09-24 13:28:41 +00:00
Neeraj Kashyap 03eecd2e93
Merge pull request #280 from bugout-dev/removing-tx-fkey 
Removing tx fkey
 2021-09-23 11:41:22 -07:00
yhtiyar 3d7f1e0a7a alembic migration 2021-09-23 21:38:12 +03:00
yhtiyar 9430d383d4 fixed required changes 2021-09-23 21:37:55 +03:00
Andrei-Dolgolev 0bf949efa8
Merge pull request #278 from zomglings/docs 
Moonstream architecture documentation
 2021-09-23 21:35:31 +03:00
yhtiyar a7c785e751 upgrade of moonstreamdb version 2021-09-23 21:28:36 +03:00
Tim Pechersky 77fec65f07 improve styling 2021-09-23 20:26:42 +02:00
yhtiyar a005d92fc2 removed hash foreign key from ehtereum_labels tabel 2021-09-23 21:09:05 +03:00
Tim Pechersky 03804a185e sorting and filtering 2021-09-23 20:07:49 +02:00
Tim Pechersky 26bcab4d02 corrected rotation of sorting arrows 2021-09-23 19:19:51 +02:00
Tim Pechersky 567a80029c added sorting selection by label and date 2021-09-23 19:18:49 +02:00
Tim Pechersky 8f52a11b15 add sorting, remove disabling on isLoading 2021-09-23 18:33:34 +02:00
Neeraj Kashyap 60b85a94f2 Added Moonstream architecture documentation 2021-09-23 07:49:29 -07:00
Tim Pechersky 639a366b80
Merge pull request #276 from bugout-dev/token-screen 
Token screen
 2021-09-23 15:11:07 +02:00
Tim Pechersky 0927a24ae7 remove unused definition 2021-09-23 15:08:07 +02:00
Tim Pechersky c3d1f50806 corrected argument 2021-09-23 15:07:14 +02:00
Tim Pechersky 1283896a30 filter for current frontend token 2021-09-23 15:02:21 +02:00
Tim Pechersky 30241242a0 layout and ux improvements 2021-09-23 14:58:48 +02:00
Tim Pechersky 644699f86c fix backend bug wrong token note 2021-09-23 14:57:46 +02:00
Tim Pechersky 4b90c46476 Access tokens - API tokens 2021-09-23 14:57:29 +02:00
Sergei Sumarokov 1d3c4c5d41
Merge pull request #263 from bugout-dev/nft-explorer 
Improvements to "nft ethereum" crawlers
 2021-09-23 13:15:35 +03:00