[SentiSteem report #2] Twitter popularity analysis of the word "Trump" from 2013-01-01 till 2017-12-31

in #steemstem5 years ago (edited)

sentiment.png

Hello world! Welcome to report where I'm using machine learning to analyze tweets about specified topic and present results in form of various and easy to understand charts. The sentiment analysis algorithm has been developed as part of my Master Thesis in 2017/2018.

This report is currently being published exclusively on Steemit and Whaleshares.

Power House Creatives Logos FINAL.png

Parameters

Today's analysis has been executed on tweets which contain word "trump" and were published between 2013-01-01 and 2017-12-31. Detailed specification of the data is shown in the following list:

  • Keyword: trump
  • From: 2013-01-01
  • To: 2017-12-31
  • Number of analyzed tweets: 25000
  • Tweets per week: 95
  • Language: en
  • Geographical location: Not specified

text16.png

Results

Sentiment

After downloading 25000 tweets between the specified dates, sentiment analysis has been executed on each and every one of those tweets. Sentiment score has been then aggregated over weeks and months, to lower the granularity of results on the time axis and then plotted as a following linechart.

sentiment.png

Sentiment of tweets for keyword "trump"

My subjective comment on the chart: It's very clear his popularity is slowly getting lower and lower

Aggregation using heatmaps

To show the general trend/pattern in the sentiment, linechart works great. We can see the bigger timeframe and estimate the long-term direction. But if you're interested in particular month or week, it's hard and in case of weeks actually impossible to see the change. Has an athlete put the great performance in particular match? Has the brand/company released a new line of product? So see such low lever changes, following 2 heatmaps are to be used.

heatMap.png

Chart shows average sentiment per month where 0.54 is the worst and 0.72 the best achieved score

My subjective comment on the chart:We can clearly see a huge spike in October 2013. I've googled what happened back then and I believe it was caused by Trump's sudden appearance on Fox News to deliver his sage advice regarding government shutdowns. Click here for more info.

heatMapWeekly.png

Chart shows average sentiment per week where 0.00 is the worst and 0.75 the best achieved score

My subjective comment on the chart:Nothing especially new here. The score in last week in 2017 was probably caused by bug, will have a look on that :)

Most frequently used words


Another very interesting aspect to look into are the repeatedly used words using wordclouds. Even more interesting is to compare two wordclouds generated from different time - usually before and after some event/change happened. If you give this a second though, the problem here is that many short words (like "and", "or", "with" and so on) are used almost in every sentence and would also show up in wordclouds. To mitigate this, I've removed list of 153 so called stopwords. Additionally I've also removed words typical for this area listed in the end of the report*.

CommonWords.png

Most often used words in tweets containing word "trump" before and after 2015-10-10.

My subjective comment on the chart:I'd clear that his move to politics shows also in the social media sphere. Words like "Obama", "vote" or "president" weren't present before at all. Also, I'm sorry for the quality of the picture, since I've migrated to 18.04 Ubuntu, this happened. Will try to resolve it asap.

Most frequently used UNIQUE words

As we can see in the previous worldcloud, there are many words which are actually shared in both wordclouds. That makes all the sense as there are many areas which will be forever connected with trump. But I went one step further and decided to create wordclouds which contain only unique words with don't appear in the opposite wordcloud.

UniqueWords.png

Most often UNIQUE used words in tweets containing word "trump" before and after 2015-10-10.

My subjective comment on the chart: I love this chart. In the first cloud we can see the word "miller" which refers to rapper Mac Miller who made a song named Donald Trump. Also big word is "apprentice" which changes for "president" in the second cloud. His politics probably also caused words like "nazi" and "racist" to increase in popularity

* words excluded from all 4 wordclouds are: yii,bit.ly,.ly,donald,trump,donaldtrump

BONUS - shaped wordcloud from all words!

This one is just for fun :) It's generated from 1000 most popular words in all tweets, not divided into before and after groups. Click it to open.

shapedWords3.png

Power House Creatives Logos FINAL.png

About project

This series of posts shows the power of machine learning and it's application in the real life. It also makes kind of symbolical point of analyzing Twitter and publishing it here on Steemit. Technology of the future is being used on the social media of the future ;)

How to get your report


Twitter sentiment analysis reports are being sold for quite some dollars in the world outside of Steemit. In our tiny word of Steemit, such price would be way too much - that's why I'm offering to generate& send you a report with your chosen keyword and dates for a laughable price - 10 STEEM. Order 3 and get the fourth one for free :)

Interested in how's you favorite coin doing on Twitter? Or favorite athlete? Politician, actor or clothes company? . Just DM me on Discord (MatkoDurko#3758) and you'll get the full report under 48 hours :)

Power House Creatives Logos FINAL.png

Hope you enjoyed! Matko.

Power House Creatives Logos FINAL.png

You can find my latest posts here:

🏆 My STEEMMONSTERS trophies/scalps 🏆

ATS_NIGHT VIEW-2.jpg
Reached #16 in leaderboard
ATS_NIGHT VIEW.jpg
One-sided win over JoeParys
ATS_NIGHT VIEW.jpg
Proud owner of legendary Hydra

PHC-Footer-05.gif

Join me and learn new skills on Skillshare! :)

Sort:  





This post has been voted on by the SteemSTEM curation team and voting trail in collaboration with @utopian-io and @curie.


If you appreciate the work we are doing then consider voting all three projects for witness by selecting stem.witness, utopian-io and curie!


For additional information please join us on the SteemSTEM discord and to get to know the rest of the community!

Wow, this is cool! Thanks! Had no idea steemstem has such a strong backing, just knew it's for science oriented posts :)

Already voted for curie and utopian, now also for you :) Keep up nice support!

Geek... Hahaha jk, that was actually pretty interesting ! Good job!

Hahah :D thx!

Taking into consideration that almost 98% of the media are just constantly bashing on him it is a great result!!!!

Don't scream at me :D

Ještě bys mohl zdarma analyzovat slovo Steemit ;-)
Mohl bych ti za to poslat třeba 1 SBI ;-)

Jooj to je praveze jeden z mala keywords ktore maju aspon aku taku sancu ze si niekto kupi... pokial si to niekto vobec tie posty vsimne :D Taakze zatial nie, sorry :D Ak si to niekto kupi, tak ti dam vediet ze kto a mozes si precitat, ked to postne :)

Jasně, nebudu ti krátit kšeft ;) Každopádně díky, bude to zajímavé pro celou komunitu ;)

I have the best Twitter statistics. Believe me.

Is it what he says? :D

Hi, @matkodurko!

You just got a 0.56% upvote from SteemPlus!
To get higher upvotes, earn more SteemPlus Points (SPP). On your Steemit wallet, check your SPP balance and click on "How to earn SPP?" to find out all the ways to earn.
If you're not using SteemPlus yet, please check our last posts in here to see the many ways in which SteemPlus can improve your Steem experience on Steemit and Busy.

Hi @matkodurko!

Your post was upvoted by @steem-ua, new Steem dApp, using UserAuthority for algorithmic post curation!
Your UA account score is currently 3.594 which ranks you at #5879 across all Steem accounts.
Your rank has improved 7 places in the last three days (old rank 5886).

In our last Algorithmic Curation Round, consisting of 148 contributions, your post is ranked at #61.

Evaluation of your UA score:
  • You're on the right track, try to gather more followers.
  • The readers like your work!
  • Good user engagement!

Feel free to join our @steem-ua Discord server

Hi @matkodurko!

Your post was upvoted by Utopian.io in cooperation with @steemstem - supporting knowledge, innovation and technological advancement on the Steem Blockchain.

Contribute to Open Source with utopian.io

Learn how to contribute on our website and join the new open source economy.

Want to chat? Join the Utopian Community on Discord https://discord.gg/h52nFrV

This is an excellent post. I love the analysis. Very interesting. And that's a good price on the analysis. I almost wish I had a use for it right now.

Coin Marketplace

STEEM 0.30
TRX 0.11
JST 0.033
BTC 63968.82
ETH 3136.80
USDT 1.00
SBD 4.28