Block.ops - An Analysis Tool - Tags, Links, Transfers, Delegations and some New Analyses!

Three block operations were tackled this week as I work down the list; each adds new analysis capabilities to the database.
A host of new analysis functions were constructed based on the additional data.

Block operations added

  • Transfers.
  • Delegations.
  • Tags and links to allow community analyses (update to "comment" block operation)

Development of analyses

  • New Utopian analysis! A breakdown of Utopian-io voting by type (steemstem, utopian contribution, mspwaves, comment etc), by contribution type, and by author.
  • Bid-bot profitability analysis: Links transfers (in transfers collection) to bid-bot votes (in comments collection). Enables profitability of vote at vote purchase and vote at post payout to be calculated.
  • Transfer summary: Analysis which summarises transfers made to and from account, sorted by party and/or time.
  • Delegation summary: Analysis which summarises delegations made to and from account in specific time/block range.

gears_blockops_pink.png

For the last year I have carried out a monthly analysis of the Steem blockchain activity by application (i.e. by the different websites and applications through which you can post to the Steem blockchain - often termed dApps).

My aim is now to build a tool that can automate such complex analyses of Steem data, providing both historic time series and rapidly updatable real-time results. In addition to the dApp analysis there are many other projects for which such a system could be useful.

This tool is Block.ops.

You can read all about block.ops (including the project aims, technology stack, roadmap and how to contribute) in the introductory post here:
https://steemit.com/utopian-io/@miniature-tiger/block-ops-an-analysis-tool-1537300276791


Repository

https://github.com/miniature-tiger/block.ops


New Features

Tags and links and Utopian analysis

Post / comment tags can allow analyses to be carried out for different Steem communities. Comment links can provide useful additional details on the posts (for example Utopian moderator comments contain specific links). These elements are now added as arrays into the "comments" documents collection of Mongo.

Using this new information I created an analysis for the Utopian community. The Utopian analysis aggregates Utopian-io voting percent by:

  • Type of vote (contribution, moderator comment, steemstem, mspwaves, steemmakers, other)
  • Contribution type (analysis, translation etc)
  • Author

Below are some example charts from the analysis, showing the overall breakdown of Utopian-io voting and a further separation of contributions by type (1000 on the y-axis is 1000% i.e. a day's full 10 votes).

utopianAll.png

utopianContributions.png

The code changes are here:
https://github.com/miniature-tiger/block.ops/commit/84996ad18518e4f7eb61a761f5d9e53bc64c2efc

Transfer operations and summary of transfers

Transfer operations cover movement of SBD and liquid Steem between Steem user accounts. These operations are now captured by the data loading process for each block.

Transfers are stored within a separate "transfers" collection. Succesful data capture is logged in the blocksProcessed collection.

I also created an analysis which summarises transfers made to and from a chosen account, sorted by party and/or time. This can serve as a starting point for more complex analyses involving transfers.

The code changes are here:
https://github.com/miniature-tiger/block.ops/commit/bd71beefb24468f78d8deafdd4ab3e5d59d070b7

Bid-bot profitability analysis

Bid-bots allow Steem users to purchase upvotes based on an auction system, typically with maximum and available minimum returns.

An analysis of bid-bot profitability (for users) requires linking the transfer payments (in the transfers collection of the MongoDB) to the bid-bot votes (found in the comments collection using the author/permlink in the transfer memo and filtered out from other votes) and the fx rates (in the prices collection).

The analysis allows the ratio of the vote value on the post (after curation) to the transfer payment amount to be calculated.

Separate fx rates are applied to captures the vote value at vote purchase and the vote value at post payout to illustrate differences in that arise due to price movements and reward pool movements. The following chart shows a day of vote purchasing which was followed by falls in the value of rshares (reward pool emptying) leading to unprofitable purchases:

bidbots.png

The code changes are here:
https://github.com/miniature-tiger/block.ops/commit/e0c22c3f930a98a30d00698fc4e3ca5a234991b9

Delegation operations and summary of delegations

Delegation operations cover "loans" of Steem Power between Steem user accounts. These operations are now captured by the data loading process for each block.

Delegations are stored within a separate "delegation" collection. Succesful data capture is logged in the blocksProcessed collection.

I also created an analysis which summarises delegations made to and from an account in a specific time/block range. This can serve as a starting point for more complex analyses involving delegations.

The code changes are here:
https://github.com/miniature-tiger/block.ops/commit/0e4949efd17e005c78450b5ecf11cf401d01313e

Progress!


GitHub Account

My account on github is here:
https://github.com/miniature-tiger

Sort:  

Coin Marketplace

STEEM 0.17
TRX 0.15
JST 0.028
BTC 62007.73
ETH 2389.39
USDT 1.00
SBD 2.49