[Utopian-data] Python Tool integrated with MongoDB database for Utopian related data collection.
Utopian-data
What is the project about?
This tool uses https://api.steemit.com and https://api.utopian.io/ as well as coinmarketcap to fetch all the interesting Utopian related data that could in future be tied to it's growth and properly analyzed. It was created out of curiosity, but per demand of @wehmoen has now been rewritten to handle more data with a better database (MongoDB over SQLite), as well as save more data than just liquid steem value of all Utopian accounts. As such, the code is now a part of the official Utopian-io company on Github.
Furthermore, the code is easily editable and can be a baseline for any API to Database crawler. The database can also easily be switched (to MySQL for example) by just replacing 2 functions.
This tool currently tracks the following data:
- General stats
- Income (in steem & delegations) of all Utopian accounts
- Category specific stats
This project is soon to be developed further, making the data visible for everyone over at https://utopian.info, thanks to @wehmoen who will (hopefully after talking to our boss) let me use Utopian servers for this project. If not, the income from this post will go towards the server fund.
Technology Stack
- MongoDB
- Python 3.6
The github repository contains a requirements.txt
file that can be used to install necessary python libraries with pip.
Roadmap
- The project will receive a web interface that allows for viewing any data stored in the utopian_data MongoDB function.
- The project will possibly switch to MySQL so a more broad open-source audience can modify it for their needs.
How to contribute?
You can contribute by Pull Requests on the official Github repository. You can also contact me on Discord at Jestemkioskiem#5566 to ask questions about this project and/or the code.
Posted on Utopian.io - Rewarding Open Source Contributors
Nice, I am interested, will get in touch with you on discord for some questions.
Is above image most recent Utopian logo? The purple theme?
Nope, just a variation of it.
Source
Good Post
Thank you for the contribution. It has been approved.
You can contact us on Discord.
[utopian-moderator]
Hey @jestemkioskiem I am @utopian-io. I have just upvoted you!
Achievements
Community-Driven Witness!
I am the first and only Steem Community-Driven Witness. Participate on Discord. Lets GROW TOGETHER!
Up-vote this comment to grow my power and help Open Source contributions like this one. Want to chat? Join me on Discord https://discord.gg/Pc8HG9x