@utopian-io: Approval/Vote Analysis - 25th - 31st May 2018

in #utopian-io7 years ago (edited)

Repository

https://github.com/utopian-io/api.utopian.io

This is an analysis of the Contribution types, Scores, Moderators, and @utopian-io votes for the 25th - 31st May 2018 inclusive.

Contents

General / Assumptions

  1. Contributions Summary

  2. 'Video Tutorials' make good progress

  3. All contribution Types

  4. Category Vote Weighing

  5. Summary Analysis

  6. Tools used to gather data and compile report


title.png


General

@utopian-io is the open source project for open source projects, housed on the Steem Blockchain.

Currently, @utopian.io holds 3.6 million Steem power through delegations from its kind sponsors.

To become a sponsor and view the current standings visit https://utopian.io/sponsors

This report is an analysis of the number and type of contributions sent for review, and the success/fail rate of each contribution type. Also included is a review of the Vote Weight for each category and a look at the effect the new methods of contributing is having on submission totals and approval percentages.

NOTE: During the data collection week of 25th - 31st May, contributions were made using alternative interfaces than utopian.io. Due to this, 'review' data including 'scores' are not included and approvals are based on Votes given by @utopian-io.

If a contribution has been positively voted, it is assumed approved.

Recent reports of this type are listed here.

OCT 2017: October 2017

NOV 2017: Week 1 - Week 2 - Week 3 - Week 4

DEC 2017: Week 1 - Week 2 - Week 3 - Week 4

JAN 2018: Week 1 - Week 2 - Week 3 - Week 4 - Week 5

FEB 2018: Week 1 - Week 2 - Week 3 - Week 4

MAR 2018: Week 1 - Week 2 - Week 3 - Week 4

APRIL 2018: Week 1 - Week 2 - Week 3 - Week 4

MAY 2018: Week 1 - Week 2 - Week 3 - Week 4


I will aim to provide this report on a weekly basis, with a look at the previous weeks data and more historical data to compare and contrast.

This will allow contributors and employees of utopian.io to keep in touch with how the platform is progressing, such as the approval percentages and number of Contribution Types being submitted. It is hoped that this analysis will provide information that can add value to decision making processes at utopian-io.


1. Contributions Summary

For the week, 25th - 31st May 2018 inclusive, the SteemSQL DataBase holds a total of 613 potential contributions to utopian-io. This is 154 fewer contributions than the previous weeks' total which was 767.

This is the 4th week of analysis in which the utopian.io application was not used to submit approvals.

status.png

312 of these contributions have been up-voted, 7 fewer than the previous weeks total of 319.

The voted on/approval percentage of 42% is a 3% fall on the previous analysis.


The Contributions offered can be any one of the following types:

catsnotrans.png

Note: 'Translation' contributions are currently on hold (25th - 31st May 2018)



This weeks data, split into Contribution types is shown in the pie chart below:


allconts.png
Key ordered by largest to smallest contribution category

For the 8th week in a row, 'Bug-hunting' is the largest contribution category (379 submissions) with 60% of all contributions - 113 fewer contributions and a 4% less overall share than the previous week

The 2nd and 3rd most popular categories are still 'Development' and 'Graphics' which have swapped places again this week. Both categories combined have gained 1% of the overall contribution share, as they did previously also.

These three largest categories again account for 82% of all contributions - A 3% fall on the previous weeks analysis.


2 'Video Tutorials' make good progress

In recent months, the overall approval percentage of contributions to utopian-io have fallen. One category that has not followed this trend though is 'Video Tutorials'.

Over the past 12 weeks, the average total of contributions for this category each week has been 24, and on average, 15 of those 24 have been approved.

In percentage terms, this looks better each month moving forward. In March, 49.5% of contributions to 'Video-Tutorials' were approved, and in April this rose to 76.75%. May is the best month so far for the category with 78.25% of all contributions being approved.

The total contributions do not match the figures of old, but the approval percentages show encouraging signs that the quality of contributions to 'Video-Tutorials' is of a high standard.


3. All contribution types

The following table shows all types and totals of contributions submitted, with their approval percentage in the end column.

This week, there were no categories that fell below one in four contributions receiving approval. 'Development' fared best of the popular contribution categories, and 'task-development' supported projects with all 7 submissions being approved.

Contributions to 'Ideas' stepped up markedly on last week with a 44% approval rate, up 26% on the previous week.

'Analysis' submissions fell to just 4, with 2 approvals. Work is needed here to encourage more contributions to this category.


4. Category Vote Weighting

Each approved contribution is likely (but not guaranteed) to receive a vote from utopian-io to support the work carried out. Each category has a range of weight that can be attributed to the vote depending on the answers provided during the review process.

'Analysis' turns the tables with 'Development' as the category receiving the highest vote weight. This is likely to be due to the huge difference in the number of contributions and approvals in each category.

'Bug-hunting' has replaced 'Ideas' as the category with the lowest vote percentage average of the more popular contribution categories. The vote weight average for 'Ideas' as tripled over the last three weeks, which is a good sign for contributors to this category.

With vote weight data now being collected each week, we can look back at previous analysis and summarize these values.

The chart above covers the past 7 weeks. This week shows a high for the 'Video-tutorials' category which has steadily risen to surpass 'Graphics' as the 3rd highest average vote weight. 'Graphics' has also been overtaken by 'Blog' for which the average vote weight percentage has grown almost 500% in the past 7 weeks - impressive.


5. Summary Analysis

The number of contributions has fallen quite sharply this week. The only conclusion is that the price of STEEM has had an effect on the submissions as it has continued to fall over the past few months.

An 8% upswing in the overall contribution approval percentage is a welcome relief, and 49% is the best approval percentage total since the the 1st week of March.


Summary

Contributions fall but the approval percentage is the best in months.

'Blog' becomes the 3rd highest average vote weight category, behind 'Development', and 'Analysis' - which tops the list.

However, just 4 contributions and 2 approvals to the 'Analysis' category - a new low.

No categories fared particularly badly this week as far as approval % went, as they all achieved a better strike rate of 1 in 3.


6. Tools used to gather this data and compile report

The charts used to present the data were produced using MS Excel.

The data is sourced from SteemSQL - A publicly available SQL database with all the blockchain data held within.

The SQL queries to extra to the data have been produced in both SQL Server Personal Edition and LINQPAD 5. Some of the code used for these results is as follows:


-------------------------------
-- MAIN INSERT START
-------------------------------

SET NOCOUNT ON
Declare @permlink Varchar(2000)
Declare @author Varchar(50)
Declare @contributionType Varchar(50)
Declare @moderator Varchar(50)
Declare @reviewed_approved Varchar(50)
Declare @flagged Varchar(50)
Declare @score Varchar(50)
Declare @influence Varchar(50)
Declare @staffpick Varchar(50)
Declare @utopian_vote Varchar(50)
Declare @sql_vote Varchar(50)
Declare @weight Varchar(50)
Declare @created datetime

DECLARE APPROVALS_CURSOR CURSOR FOR

SELECT [permlink]
      ,[author]
      ,JSON_VALUE(json_metadata,'$.tags[1]') as contribution_type
      ,JSON_VALUE([json_metadata],'$.moderator.account') as moderator
      ,JSON_VALUE([json_metadata],'$.moderator.reviewed') as reviewed_approved
      ,JSON_VALUE([json_metadata],'$.moderator.flagged') as flagged
      ,JSON_VALUE([json_metadata],'$.score') as score
      ,JSON_VALUE([json_metadata],'$.total_influence') as influence
      ,JSON_VALUE([json_metadata],'$.staff_pick') as staff_pick
      ,"Utopian_vote" = 
  CASE 
    WHEN JSON_QUERY([active_votes],'$') like '%utopian-io%' THEN 'Yes'
    ELSE 'No'
 END
  , null as SQL_VOTE
  , null as [WEIGHT]
      ,[created]
FROM [SQL.STEEMSQL.COM].[DBSteem].[dbo].[Comments] WITH (NOLOCK)
WHERE 
created BETWEEN '05/25/2018 00:00:00' AND '05/31/2018 23:59:59' 
and depth = 0 
and category = 'utopian-io'
and ISJSON([active_votes])>0
and ISJSON(json_metadata) > 0  
and JSON_VALUE(json_metadata,'$.tags[1]') in ('bug-hunting','development','analysis','visibility','tutorials','video-tutorials',
'graphics','copywriting','ideas','documentation','task-development','blog','task-graphics','task-documentation''task-ideas','task-social')
order by contribution_type, [created] asc

OPEN APPROVALS_CURSOR
FETCH NEXT FROM APPROVALS_CURSOR
INTO  @permlink, @author, @contributionType, @moderator, @reviewed_approved, @flagged, @score, @influence, @staffpick, @utopian_vote, @sql_vote, @weight, @created 

WHILE (@@FETCH_STATUS = 0)
BEGIN

Insert into utopian_authors_may_2018_week5
SELECT @permlink, @author, @contributionType, @moderator, @reviewed_approved, @flagged, @score, @influence, @staffpick, @utopian_vote, NULL, NULL, @created

FETCH NEXT FROM APPROVALS_CURSOR
INTO @permlink, @author, @contributionType, @moderator, @reviewed_approved, @flagged, @score, @influence, @staffpick, @utopian_vote, @sql_vote, @weight, @created 
END

CLOSE APPROVALS_CURSOR
DEALLOCATE APPROVALS_CURSOR

SET NOCOUNT OFF

-------------------------------
-- MAIN INSERT COMPLETE
-------------------------------

-- First UPDATE CURSOR

SET NOCOUNT ON
Declare @permlink Varchar(2000)
Declare @author varchar(50)
Declare @weight int

DECLARE UPDATE_CURSOR CURSOR FOR
SELECT permlink, author, WEIGHT from utopian_authors_may_2018_week5 FOR UPDATE OF WEIGHT

OPEN UPDATE_CURSOR
FETCH NEXT FROM UPDATE_CURSOR
INTO  @permlink, @author, @weight

WHILE (@@FETCH_STATUS = 0)
BEGIN

UPDATE [dbo].[utopian_authors_may_2018_week5]
SET WEIGHT = (select TOP 1 [weight] FROM [SQL.STEEMSQL.COM].[DBSteem].[dbo].[Txvotes] with (nolock)
WHERE [voter] = 'utopian-io' 
and [permlink]+[author] = @permlink+@author 
ORDER BY [timestamp] desc)

WHERE CURRENT OF UPDATE_CURSOR

FETCH NEXT FROM UPDATE_CURSOR
INTO @permlink, @author, @weight
END

CLOSE UPDATE_CURSOR
DEALLOCATE UPDATE_CURSOR

SET NOCOUNT OFF

-------------------------------

-- SECOND UPDATES
UPDATE  [SteemSQL].[dbo].[utopian_authors_may_2018_week5]
SET SQL_VOTE = 'Yes' WHERE (WEIGHT <> NULL or WEIGHT > 0)

UPDATE  [SteemSQL].[dbo].[utopian_authors_may_2018_week5]
SET SQL_VOTE = 'No' WHERE (WEIGHT IS NULL or WEIGHT = 0)


-------------------------------


-- CHECK THE NUMBERS
select * from [dbo].[utopian_authors_may_2018_week5]  order by created asc -- 631 (767)
select * from [dbo].[utopian_authors_may_2018_week5] where SQL_VOTE = 'Yes' -- 312 (319) (326)
select * from [dbo].[utopian_authors_may_2018_week5] where reviewed_approved is null -- 
select * from [dbo].[utopian_authors_may_2018_week5] where SQL_VOTE = 'No' or (reviewed_approved = 'false' or reviewed_approved is NULL)  -- 548 (435)
select * from [dbo].[utopian_authors_may_2018_week5] where SQL_VOTE = 'No' and reviewed_approved = 'true' -- 1 (Approved then unvoted) 2 Approved not voted)
select * from [dbo].[utopian_authors_may_2018_week5] where SQL_VOTE = 'Yes' and reviewed_approved = 'false' -- 0 (Approved but later rejected)


-- RAW DATA FOR EXCEL
select contribution_type as Category, reviewed_approved as Approved from [dbo].[utopian_authors_may_2018_week5]
where contribution_type is not NULL --and reviewed_approved = 'true'
order by [contribution_type] asc

-- RAW DATA FOR EXCEL - AFTER THE CRASH - USED FOR 2nd WEEK MAY
select contribution_type as Category, SQL_VOTE as Approved from [dbo].[utopian_authors_may_2018_week5]
where contribution_type is not NULL --and SQL_VOTE = 'Yes'
order by [contribution_type] asc


---------------------------

-- COUNT WHEN APPROVED
select contribution_type, count(contribution_type) from [dbo].[utopian_authors_may_2018_week5]
--where reviewed_approved = 'true'
where SQL_VOTE = 'Yes'
group by [contribution_type]
order by [contribution_type] asc

--select * from [utopian_authors_may_2018_week5] where [contribution_type] = 'ideas'


-----------------------------


-- VOTE WEIGHT
select contribution_type, avg(cast(WEIGHT as INT)) from [dbo].[utopian_authors_may_2018_week5]
group by contribution_type


This data was compiled on the 15th June 2018 at 7 am (UCT)



Thanks

Asher @abh12345

Sort:  

Great thing you are doing here Asher!
Just amazed by the analysis!
Cheers,
Peter

Cheers Peter!

The most time-consuming post of the week, but one I've been happy producing to see how the project has developed over the past 7/8 months.


How was the first game for you yesterday? The Saudi's were awful eh!

They were. Didn’t see much if it because I was in a traffic jam and the match wasn’t so appealing. Looking forward to Spain vs Portugal.
Just mentioned you a in comment to get a 1K delegation. Hope you don’t mind!

Looked like an under 17's international at times!

Just seen it and given you and the leagues an additional plug :)

Thanks for that. Appreciate it!
Cheers,
Peter

Hi @abh12345, excellent analysis as always! Seems like we reached a comparably stable contribution rate over the last couple of weeks. However, the switch of bug-hunting to TR-only might pull this down for the next report. Analysis needs to grow, and analysis contributions are very well rewarded - you can make this happen! :)

Your contribution has been evaluated according to Utopian policies and guidelines, as well as a predefined set of questions pertaining to the category.

To view those questions and the relevant answers related to your post, click here.


Need help? Write a ticket on https://support.utopian.io/.
Chat with us on Discord.
[utopian-moderator]

Thank you! 😁

Yes a very steady few weeks. I think we need a move in price to encourage more contributions, but as it stands I believe the reward is worth the time.

Hopefully I can help over the coming months - without buying 3m STEEM 😁

Hey @abh12345 / Asher,

I was wondering if you could take me out of your Curation League? It's an awesome program and I love that it exists, but I'm moderating for Steemhunt and really pushing out a trillion comments, but it's not proper engagement and super not fair on everyone else in your league. Thanks! Keep up the amazing work!

Hey

That's no problem. I had noticed that this was your role after I checked on your score last week :)

I placed you in the league, but didn't give a prize for the reasons you mention above. It might be better just to take you out, sorry, and thanks for the message.

Hey @abh12345
Thanks for contributing on Utopian.
We’re already looking forward to your next contribution!

Contributing on Utopian
Learn how to contribute on our website or by watching this tutorial on Youtube.

Want to chat? Join us on Discord https://discord.gg/h52nFrV.

Vote for Utopian Witness!

Excellent article. Thank you for making STEEM the best. Good luck and love!

Отличная статья. Спасибо, что делаете STEEM лучшим. Удачи вам и любви!

thanks for your kind information
information

Sorry for 2 comment.

Hello, as a member of @steemdunk you have received a free courtesy boost! Steemdunk is an automated curation platform that is easy to use and built for the community. Join us at https://steemdunk.xyz

Upvote this comment to support the bot and increase your future rewards!

Well done @abh12345! You successfully guessed the match result.

Group Phase - France vs Australia
Click on the badge to view your Board of Honor.

Do not miss the last post from @steemitboard!

Hi @abh12345, in order to come to the conclusion that this is useful insight :), am i right in understanding the the 10 categories you mentioned are categories within dev projects on steemit blockchain that are getting the highest number of upvotes? If i read the first few lines of your post -

This report is an analysis of the number and type of contributions sent for review, and the success/fail rate of each contribution type.

I am little confused reading the above. Is this specific to dev projects on steemit blockchain that utopian io is reveiwing? Are these the only categories? Also is there a way to see what kind of projects are being reveiwed?

Hi @karamyog

@utopian-io is a good place to start. Unfortunatly the main site is still being re-developed and it is here that you would be able to find more information to help with your queries.

utopian-io accepts open source related contributions to any of the main categories above. This can be anything related to Steem, but also any other open source project.

if you take a look down the recent contributions this should give you a bit more of an idea of what is being submitted.

https://steemit.com/trending/utopian-io

https://steemit.com/hot/utopian-io

A moderator may be able to shed further light on your questions later today/tomorrow. Thanks for your interest :)

Thanks a lot mate! I will look into it. :)

Hi @karamyog, Utopian is a project built on top of the Steem blockchain to reward contributions to open source projects. Users can describe the work they've done for open source projects with posts on the Steem blockchain and eventually get an upvote from the @utopian-io account. Contributions can be in one of the mentioned categories. For details and rules please check https://join.utopian.io or join us on discord.

Hi @crokkon! Thank you. That helps me understand @abh12345's post better.

Coin Marketplace

STEEM 0.12
TRX 0.34
JST 0.033
BTC 123368.81
ETH 4501.36
SBD 0.78