[Utopian-data] Python Tool integrated with MongoDB database for Utopian related data collection.

in #utopian-io6 years ago (edited)

img.jpg
source

Utopian-data

github repository

What is the project about?

This tool uses https://api.steemit.com and https://api.utopian.io/ as well as coinmarketcap to fetch all the interesting Utopian related data that could in future be tied to it's growth and properly analyzed. It was created out of curiosity, but per demand of @wehmoen has now been rewritten to handle more data with a better database (MongoDB over SQLite), as well as save more data than just liquid steem value of all Utopian accounts. As such, the code is now a part of the official Utopian-io company on Github.

Furthermore, the code is easily editable and can be a baseline for any API to Database crawler. The database can also easily be switched (to MySQL for example) by just replacing 2 functions.

This tool currently tracks the following data:
  • General stats

image.png

  • Income (in steem & delegations) of all Utopian accounts

image.png

  • Category specific stats

image.png

This project is soon to be developed further, making the data visible for everyone over at https://utopian.info, thanks to @wehmoen who will (hopefully after talking to our boss) let me use Utopian servers for this project. If not, the income from this post will go towards the server fund.

Technology Stack
  • MongoDB
  • Python 3.6

The github repository contains a requirements.txt file that can be used to install necessary python libraries with pip.

Roadmap
  • The project will receive a web interface that allows for viewing any data stored in the utopian_data MongoDB function.
  • The project will possibly switch to MySQL so a more broad open-source audience can modify it for their needs.
How to contribute?

You can contribute by Pull Requests on the official Github repository. You can also contact me on Discord at Jestemkioskiem#5566 to ask questions about this project and/or the code.



Posted on Utopian.io - Rewarding Open Source Contributors

Sort:  

Coin Marketplace

STEEM 0.17
TRX 0.13
JST 0.028
BTC 59596.75
ETH 2659.83
USDT 1.00
SBD 2.45