Curation Rewards and Voting Incentive
![](https://steemitimages.com/640x0/http://www.bitcoinisle.com/wp-content/uploads/2016/03/02dealprof-master675.jpeg)
To continue with my discussion on voting I would like to review the incentive structure created by curation rewards. This topic is highly controversial. Everything I say in this post is just my personal opinion and does not represent the opinion of Steemit, Inc. First lets review the game as it exists today.
Rewarding Voting
Voting is something you can do almost as often as you like. Once you reach a certain level of Steem Power, almost every vote puts money in your pocket. When I up vote something, I give the author $150 and I get to pocket $50. That is a huge incentive for me to up vote everything I see.
It gets even more interesting if I up vote something that becomes extremely popular. Suppose the post I up voted went on to earn $10,000, then my initial curation payout of $25 would grow to something like $1500. The difference between a $25 payout and a $1500 payout is what motivates me to pick good content rather than bad content. After all I have a limited number of high powered votes that I can cast.
Lets suppose that each week I pick 1000 posts to vote on within the first 30 minutes. Assuming none of the posts get down votes I would pocket about $25,000. For every post that goes on to earn $1000 or more, I can have 10 posts that get zeroed out. Bottom line is that I could be pocketing $25,000 or more per week (paid out over 2 years) with an unsophisticated bot.
It Pays to be First
Suppose that another whale of my stature were to vote just seconds before me. My curation rewards would be dramatically reduced. Instead of getting $1500 on a popular post, I would be lucky to get $200. As a whale I lose significant money any time another whale beets me to a popular post.
Even though it pays to vote before other whales, it certainly doesn’t pay to vote too quickly. If I voted on a popular article 15 minutes after it was posted and before any whales, then my reward might be $750 instead of $1500. Every minute I wait to vote (up to 30 minutes) earns me $50, but if I wait too long some other whale will vote and I will lose money.
Whales are in Competition
The whales are in competition to up vote quality content first. Each minute they must choose whether to vote on a post or wait. Any whale who chooses not to play this game gets diluted by whales who do play (when Steem Power is more than 90% of supply).
Strategy
Each whale has to develop a strategy and the strategy will ultimately depend upon a statistical analysis of what posts tend to do well. The simplest strategies include measuring the median time until a whale up votes a post by each author. This statistic will tell a whale who to vote on and when.
If all whales played by this strategy then certain authors would end up getting guaranteed votes as early as 10 minutes after they post. Smart whale bots would avoid voting after other whales and instead look for other content to up vote first.
In the hunt for better content whale bots can gather statistics on which minnows (or combinations of minnows) are the best early-predictors of popular content. Once these statistics are gathered the whale bot would vote on everything that shows that indicator.
Emergent Behavior
If we assume all whales are actively working on algorithms to ferret out the best content early, then quality authors will develop guaranteed patrons. Each whale has to make a decision on whether it is more profitable to be a patron to a particular author or to move on in search of another author.
There is little financial incentive to “pile on” after other whales. Doing so will increase rewards to the author and to the other whales. It makes little financial sense to dog-pile unless there is a very high probability that many more whales will follow. With each additional dog that piles on the incentives fall dramatically. The first whale generally gets 80% of the curation rewards.
There is a complex incentive curve. If I vote on 1000 things each day without much thought I can have an almost unchallengeable return on my steem power. If I work slightly smarter I can increase my return. The bigger a whale is, the larger this base rate of return becomes.
Think of this as a mining war where whales are incentivized to implement advanced AI curators that are able to quickly identify gems that have not yet been identified by other whales. Any whale that does not vote to the maximum extent possible is wasting potential income opportunities.
Smoothing the Reward Curve
Assuming more whale bots start operating then chances are that more people will get up voted by at least one whale. Because everyone is sharing a single reward pool, this means the overall payout curve will get flatter.
As the overall payout curve changes the expected value of an individual whales vote falls dramatically. My up votes that are worth $250 when I vote a couple dozen times per day could fall to $100 if other whales started voting 1000 times per day.
Curation Rewards Require Whales to use Bot Algorithms
A so-called “evil-whale” is really nothing more than a curator “miner” making easy profits due to lack of competition. If all whales were competing as actively as the “evil whale” then things would get far more challenging. Market competition would force the return earned by whales toward some kind of natural equilibrium.
Voting bots would become as prevalent as trading bots on the exchanges. Each whale would attempt to customize / tweak their bot to earn the greatest income by curating the most popular content. Their bot will need to be unique and unpredictable or others will “front run” them and take all of their rewards.
No whale that remains passive will be able to maintain the same stake in the system. No selfish whale would ever want to use a down vote because it has a real cost to them and a socialized benefit to everyone else.
Role of Dolphins and Minnows
Bots need data, minnows generate data. When bots are attempting to identify content to up vote they will take clues from minnows. Good dolphins can even start to earn curation rewards when whale-bots pick up on their usefulness as an early indicator.
![](https://steemitimages.com/640x0/http://mammajammaride.org/wp-content/uploads/2014/07/ButterflyEffect3.jpg)
It may appear that minnows have no influence, but they become the butterfly in Africa that triggers a category 5 hurricane. Minnows that consistently pick out winners before they are winners will eventually attract a multitude of whale and dolphin bots who follow their every vote.
While a minnow vote may not appear to give authors much directly, they can have a massive impact indirectly.
Risk of Self Fulfilling Prophesy?
Most existing robots (except cheetah) do not look at the content, but instead attempt to guess on what other robots and voters will do. There is some risk that the game could evolve in such a way that content is ignored completely as bots up vote based upon what other bots do.
I think this undesirable outcome is unlikely because a large number of normal users and altruistic whales will bias the final result based upon the quality of the content. If the whale bots win the curation game but lose the quality content game, then all the Steem Power earned from curation will become worthless.
Everyone loses if quality content doesn’t rise to the top. This means that whale bots will develop a minimum quality threshold.
Over time there is financial incentive to write bots that parse content looking for signs of quality including:
- images
- outbound links to reputable domains
- headers
- length
- reading level
People will deploy “reverse spam filters” that learn to identify quality content just like email spam filters learn to identify spam. It won’t take long for bots that look at content to become more profitable than bots that ignore it.
Monstro the Evil Whale
![](https://steemitimages.com/640x0/http://vignette1.wikia.nocookie.net/disney/images/e/e0/MOONSTRO.png)
Whales earning curation rewards are not a problem if all whales participate in a healthy manner to curate. The influence of any individual whale is minimized when dozens of whales and dolphins are actively competing for curation rewards.
An evil whale is one who is actively looking to harm the platform. They would start down voting quality content, burning the reputation of users, and up voting garbage content. The good whales would have to act selflessly to counteract the behavior of an Evil whale.
Whales that make money from legitimately voting as best they can (even using simplistic bots) are not any more evil than authors that take advantage of human nature to score votes.
Conclusion
The existing curation rewards algorithm, once properly understood, will spawn an arms race to build better bots. This means Steem will motivate the development of the decentralized autonomous curator. It will spawn research into advanced artificial intelligence algorithms that are able to predict viral content early.
Curation is a game for whales and dolphins. Minnows are unlikely to earn any significant return on their votes. Minnows should stick to posting and commenting.
People will buy Steem Power just for the opportunity to apply their own curation reward algorithm in an attempt to out-earn other Steem Power holders. Algorithm development will advance like ASIC development.
That’s the theory. What do you think?
What a great article. As a minnow It certainly motivates me to produce good quality content with images and links to external reputable sources. I am determined to get better and better. Thanks for your insight!
The fact that this comment got the most upvotes totally highlights @dantheman 's point.
Please don't upvote this post!
Anyway, what is done is done...
Because my post doesn't deserve the cash, I will give the SBD earned from it to @katyakov for her charity as I already did before.
We all should give undeserved money.
PROOF:
https://steemd.com/tx/0553d183c1e4b29d22a71f59404be62ab348fb37
I think I have the right to upvote it :)
Thanks again for believing in our project!
You will see in the end of the month in my Charity post how your transfers reach the goal!
Happy to help honest and generous people.
I know it is NOT a lot. But I hope I'll be able to give more later. I need to build a bit of steem power first.
Count on me on the long run.
back when you were a minnow @kus-knee haha , teach me the ways!
Haha wow! Thanks for the find! Actually here's on of the keys. Do lots of commenting!
will do! i have lots to say ;)
Well it is obvious that while this platform is a potentially revolutionary social media platform as well as an economic one it is also a "game". This is not bad or good just the way it is. Ultimately when dealing with humans there is no way to have any "fair" system because humans try and manipulate it in the many ways they do and this influences everyone else. SO all we can really do is the best we can do. If playing the game to make as much money is possible is your purpose then go for it. Or like my self I can curate the most valuable content I can and hope I get compensated. If not I am fine with it because I am living the truth of my ideals~
I wish everyone here the best as this truly is an awesome platform to be playing on!
I think @dantheman was demonstrating that living the truth of your ideas and earning money in this context through understanding the system is not necessarily tautological. It's the beauty of steemit that we will have great bots sifting posts for us. Some people get richer than others, but they are the ones that understand the way to do so or the bright sparks [they have appeal in some way that others have less of] ... and if the system of the platform benefits, I'm ok with that.
I've just seen someone arrive and post about things I wouldn't usually read and yet I found her writing captivating and her first posts [within 2 days of joining] were receiving payouts in the $100 region and she already had a rep score in the 50s. I'm fascinated by what it is that she has about her that is causing this when most within 2 days are getting 27c payout on posts with a rep score still of 25.
I find the whole platform and how it works fascinating.
Yeah, the links thing is news to me. I'm glad there's a movement to promote original and properly licensed content. (I keep seeing posts about getting people to only use images they're legally allowed to use. I applaud that.)
A part of me (the human part) is saddened that bots are taking over the functions that used to be performed by old-fashioned work. But the part of me that writes little programs to make everyday tasks easier, and uses spreadsheets to win at fantasy sports, sees endless possibilities with bot algorithms. This is a cat and mouse game that will never end, no one will be able to rest easy and say "I've created a perfect bot". Bots will have to be constantly perfected and tweaked to achieve maximum results, so the very act of tweaking the bots keeps the human factor in play and makes the whales work for their status.
How can you have a bot predict content? By using post details to determine popularity? This sound very stupid, if you want people to keep motivated to write good content you need to hide these details , many will become lazy and post less and less quality content because they know they will get upvoted by whales, this is already happening if you look at people's reward they are extremely regular for each post which means it's roughly the same people voting for them regardless of what they post, this is sucking all the rewards away from newbies who have a very hard time getting their content out because the site works like an echochamber where if you are not popular you get ignored, no wonder why the attrition rate is so high. Again author should not be displayed, there is no need for that what matters is actual content. Also it's silly to think that whales are gonna be the only one voting because their power is decreasing every day and if the site gets mainstream they would represent a very small portion of all voting power
I am fine that the site wants to support and even encourage bots as a form of content curation. I do see the value that it adds, especially as the site continues to grow, and there is more and more content to sift through.
While we should design the curation algorithm with bots in mind, do we want to design it specifically for the bots - or do we want to try and think how to design it for good human curators too?
I think the formula for curation needs to be discussed further. What are we trying to encourage?
Right now it encourages curators to vote on what they think will become popular; not what they think is good content. While there is a relationship between the two, they are not one and the same.
Finding a way to tweak it so that more good/undiscovered content bubbles up is not being considered as much as it should be.
I think the general sentiment from a lot of the minnows right now is that the current system is hopeless.
If we want the site to grow in popularity and turn into a 'mainstream' social media site, new users need to feel like they can join up, post good content, and get rewarded for it based on the quality of what they produce.
Which is why post details needs to be removed especially author as they negatively influence curators.
If you look at reddit, the voting mechanism works well, the content that gets on top is the content that gets the more upvote. Why does it work well? Because redditors speak with their heart not with their pocket, steemit should hide the money aspect as much as possible from the site if they want people to behave naturally.
I don't know why people are upvoting the already trending threads so much, as dan said there is no incentives to do so, its the sheep effect i guess. If you remove post informations ( amount vote and author) then people will only have content to decide whether they want to upvote or not which is exactly how it is supposed to be.
I don't know if I 100% agree with the idea to remove that information. Authors that are building a following will want people to know it is them who are posting. Some people do use other people's ratings to help figure out what they want to spend time reading. Also, that information is still available on the blockchain, so removing it from the site would not prevent bots from using it.
The fact that people are voting on what the think will be popular vs. what they think is good is one of the main problems.
That, and there is not much incentive to search out 'undiscovered' content that won't be getting upvoted by a bunch of whales.
Hi @dantheman,
Glad to see you’re keeping a close eye on the curation rewards and your analysis is a very fair reflection of the current landscape.
I agree with your assessment that curating for profit isn't the province of 'minnows' and is really only viable for whales and dolphins. Those with low SP should post and comment for profit and vote for pleasure. However even as a dolphin, it is difficult for real life human curators to compete with bots and make the enterprise profitable. I've spent the last two weeks curating incessantly and experimenting with ways that human curators can earn decent rewards. I may post on it at a later date.
All I will say for now is, it isvery hard work and takes a certain mindset to be able to consume content (early and fast) and execute a strategy to stay one step ahead of the bots. I was "winning" (if that's the correct way of looking at it) up until a few days again, however some of the bots have revised their strategy are putting on 'the squeeze' (you may notice some bots voting earlier on content today than they did say last week).
As a human curator, I have human commitments and limitations that make it hard to compete with a well created bot. I'm resisting the temptation to go down the route of 'coded curation' (even though I'm confident I could define and refine rules to maximise rewards programmatic-ally). To my mind that would defeat the purpose.
I'm still clinging to the ideal that humans can use their own senses to curate content and profit from it. However I fear you may correct and this may become the province of bots and algorithms. If true, the issue I have with this, is that algorithmic curating could lead to algorithmic content creating, with people tailoring their creativity to feed the bots. We could then get into some weird AI loop of manufactured content creation and curation that is divorced from the artist/ emotional/ intellectual expression and enjoyment that makes us human. This would be undesirable in my view.
I hope I'm wrong. Wherever you have human activity it seems it can be invariably done more efficiently by robots. Maybe we are dawning the new age of 'bot art' that actually enriches our human existence, who knows. Or maybe more simply, bot creation and curation can co-exist with its human counterpart with both sides being able to prosper and grow. I'm hoping the latter.
Excellent comment. This idea of algorithmic content creating is a potentially huge problem, surely. It's possibly analagous to the high frequency trading on the exchanges, which has fundamentally altered the nature of the markets. To everyone's detriment. Whenever you remove the human emotion from something, and replace it with automated efficiency, you lose something important. You lose the soul of that thing. An automated bot creation/curating system would get boring very quickly, and that would be the end of that. Except for the bot owners.
I'm going to follow you, and I hope you consider writing a story based on this single quote to elaborate. It's a lot of food for thought that can guide us out of this smoke.
Thanks. Hmm... maybe I will see if I can pull something together. The problem I see here is the conventional 'logical' brain ruling over the 'heart' of a subject. We are in an epoch where logic triumphs, but the price we pay for this efficiency is brutal. Not always, but often. The pendulum will swing back. Eventually. :)
The other issue is that bots can't give FEEDBACK. WHY is a post not good? That information is invaluable.
Exactly right. I've seen this happen twice before on other sites that I wrote for, several years ago, that no longer exist today because once everyone learned the process, the sites became nothing but link spam. I think its important for Dan and the other whales to make sure that this does not happen.
Creating bots for curation rewards seems to me to be the exact opposite of seeking value-generating, "quality content." We're already seeing how whale votes and bots are creating and skewing "trending" content. I'd really hate to see what happens when most users start posting simply to attract bots for rewards because their original - actual quality - content has been consistently ignored or buried by actual low quality content. Assuming that such users even stick around for that kind of potential atrocity.
Well it is obvious that while this platform is a potentially revolutionary social media platform as well as an economic one it is also a "game". This is not bad or good just the way it is. Ultimately when dealing with humans there is no way to have any "fair" system because humans try and manipulate it in the many ways they do and this influences everyone else. SO all we can really do is the best we can do. If playing the game to make as much money is possible is your purpose then go for it. Or like my self I can curate the most valuable content I can and hope I get compensated. If not I am fine with it because I am living the truth of my ideals~
I wish everyone here the best as this truly is an awesome platform to be playing on!
Dan you are sure good at confusing the hell out of me, no offence intended. One day bots are evil, one day bots are good. I spent weeks making an author list to support and update on constant basis, then came the evil bots posts and I turned it off, then bots are ok, back on, then off, now "on" I guess ?
Also the initial auto vote for self, that turned into an option, and now people think if you vote for yourself it's a bad thing. I know the game is changing but can we have a constant set of rules that do not get us flagged at least. Another issue is the tags, I tried to help on the tag spam yesterday, the 5 tag limit is a mess, instead of having 5 tags that fall into 5 major categories, why not create sub categories, like this post would fall into steem as parent category and steem/curation steem/voting as sub categories that way we prevent spam into other main categories, so first tag would specify the main category and the rest of the tags will be sub category, that will create more depth and and clean up cross category spam. It will also make spam detection much easier.
All this talk of bots and whales does not feel good to me, I prefer the idea of people reading blogs and voting, and I mean hundreds of regular people instead of 1 whale with a bot. That's what I think.
I agree, we shouldn't design for whales, but with regular users in mind.
There's the sybil-attack problem. In other words, people creating hundreds if not thousands of fake IDs to manipulate the voting and claim the voting rewards for bogus articles. Invested vote solves this but, with the reward structure as it is, it creates the problems discussed.
Totally agree craig ...votes of 'regular folk' just have to carry more UMPF! .. if we can get to a time when every modestly well received post ..every deserving post, could earn someone $10, with as few as 20-40 or so upvotes, then the future is assured.
I think your ideals are fine but Dan is discussing the very nature of a decentralized system, it will get gamed by machine learning sooner or later. This is how Target knew some guy's daughter was pregnant before he did. Everyone is exploiting machine learning to find and recognize patterns that would otherwise be EXTREMELY hard to identify. There is no getting around this, I believe he is predicting the future very well here.
So where does that leave us and how do we move forward? Listen to him carefully, you will still have a roll here...
Yeah but the role left to us is feeding whales and hoping they pat us on the head now and then? "Bots need data, minnows generate data".
If you have money to invest in such a scale, you should be able to generate a profit. One way or another. I rather get rewarded for being useful for whale bots, and therefore steemit and myself, instead of an investor spending his money elsewhere.
On a really decentralized bots will emerge in a sophisticated manner soon. I totally see being a good minnow getting rewarded.
Ah... but @jsteck, I think you're missing the real point here. What he's saying is if you're a 'good' minnow, i.e. you can spot winners first and vote early, then the clever bots will follow you, and that means your rewards are increased significantly. However if you're not good enough to spot content that is going to go viral, then stick to commenting and posting. Makes a kind of interesting concept.
I am going to keep on re-reading the original post until I see a better point of view. Not seeing it yet but not done trying.
I've thought it over and I am back to where I was a month ago. I'll vote for things I like. I'll comment when I can add to a conversation. And I'll post when I have value to share.
Everybody on Steemit has to take any human personality into consideration - including the 5-10% psychopaths (depending which statistic you prefer).
It would be naive to assume that any alphabet soup group or hacker group of any large GDP country would not at one point try to game the system in their favor. Who knows who really controls the biggest stakes right now behind the anonymous bitcoin wall. We don't even know who Satoshi is - Dan might have a better idea about Satoshi than anyone in here as I am pretty sure NONE of us has interacted as much with Satoshi or the Satoshi group as he did.
From what I have seen so far or researched about Dan he is more altruistic than many on here that complain - mostly for egotistical reasons - being it from a narcisstic angle or just pure profit motive.
It does not matter - the platform will survive and thrive from very sophisticated foresight - coupled with integrating the best feedback from the free market. I feel at this point that the core group around Dan does an excellent job at that.
Who can know that much less altruistic forces are already prepping a not so benign Steemit alternative? Who will stick here if Zucky uses some of his billions to build a Steemit clone with more fiat incentives? Hard questions to answer as nothing conceivable is impossible in principle ;-)
Yes I agree @craig-grant. I touched on this below, but wanted to respond to you as well
But I think we should not try to get into "bot wars" where someone will try to tweak a bot to vote .00001 seconds faster than person b's bot, when the content may just be an average post by a highly valued user. No one person deserves every post to do well.
So would everyone, now what are you proposing?
I'm somebody that wants to 'be a part of something' and 'earn my keep'. That's why I think my best value come as responses to other people's posts. I earn much more from those overall than I do from my own posts, which is interesting enough.
I don't worry about curation rewards at all, and I always leave my 'auto-upvote' box unchecked, so somebody that enjoys those things can get a shot.
Also, I don't know if this is on purpose, but the post is showing 35 comments, but none are visible - is it possible to hide all comments now or 'privatize' the comments?
Thanks for everything you do Dan, and ROCK ON!!
-bigedude
@dantheman in case you didn't noticed...
After brainstorming with @smooth we concluded that a good idea about curation rewards is to ...
we have already lot's of positive feedback!
for more read here...
https://steemit.com/steemit-ideas/@liondani/don-t-remove-curation-rewards-just-stop-them-when-the-post-reach-the-trending-page?sort=created#comments
It is interesting how much you can earn as a whale off curation and what I have been trying to figure out is if that even entices most of the whales to interact with the platform as much as the minnows are. The biggest problem with Steemit right now is that the Whales aren't actually voting and engaging on a large scale like us minnows who are pushing hard. If you look on CatchAWhale.com the entire first page of whales have voting power of usually 99% or 100%. I'm constantly engaging and voting and my voting power is usually between 60% and 80%. I'm not saying the curation reward should be increased but I have a feeling the whales are too busy or uninterested in spending the time engaging with the community like those who are new to the platform. This will cause the attrition level of good new content creators to be pretty extreme. Good content goes unnoticed by the whales and then users just leave.
The steems that go out to rewards are the same each day! So even if all whales would not participate on curation that would just mean that the decision for who gets paid comes from dolphins and minnows !!!
Maybe it would be a nice experiment whales don't participate at all !!! Maybe we would have much better curation results !!!! (more high quality content on the trending page)
I agree we should try this for one week and see what he valuable post are when only Dolphins and minnows are curating. It would also speed redistribution.
telling minnows ( still 90+% of steemit's userbase) that their votes don't count and they shouldn't even bother voting I don't think is a good idea.
I'm still on the fence on whether curation bots are good for steemit or should be banned.
in any case steemit needs to create a system where great content can be found easier, for example introducing retweets like on twitter, and other user experience improvements that will help content which is really popular get more exposure. then instead of the "follow the whale" effect we might even see the opposite: some whale bots upvoting posts as soon as they start getting massively retweeted, therefore following "wisdom of the crowds".
then minnows voting/retweets might still be financially insignificant but at least have some importance in determining what is popular content.
This just sounds like a soulless hell. It might be interesting to some, but this completely defeats the SOCIAL aspect of the network. People come to social networks to connect with, talk, and be inspired by PEOPLE. Having your fate/success determined by completely opaque bots is disheartening.
I'd rather we handle some of the voting problems in a more human centric way:
https://steemit.com/steemit/@rampant/how-to-fix-downvoting-a-set-of-proposals-for-a-solution
I agree with you. This sounds like some sort of joke.
You hit the nail on the head. It lacks soul. It's what happens when technologists put their logical brain to work creating something. They forget emotional intelligence and simply hunt for 'efficiency'. It's this kind of attitude that is slowly but surely 'efficiently' disrupting communities, industries and everything else that can be 'disintermediated', as they so artfully call it. The trouble with any universe dominated by AI, is it lacks soul, and that's a BIG problem.
Unfortunately, but the fact of life, is that technologists generally are the only ones technogically capable of creating these things. But all they do is create the framework. It is up to the rest of us to "bend" the framework, and the technologists will tweak the system to meet user demand and the greater good accordingly.
I think the root problem is we need to have some way of forcing (enouraging?) technologists to subordinate the tech to a higher good. And I'm not convinced that's in their DNA. For them, the 'idea' is the thing, and creating that idea - rather like creating the first A Bomb - takes precedence over any ethical or moral imperative. They talk a lot about changing the world - cf Bill Gates, Steve Jobs et al - but in the end what they really mean is 'making cool stuff that gets me admired'. It's not a sustainable means of evolving the species because it comes with no responsibility baked in. Unfortunately.
Forcing anyone is wrong
It makes one slave to the throng
Everyone should have a choice to express their will
If something FEELS good doesn't mean it will work still
Computer programs follow logic not feeling
Which is what "technologists" are dealing