Machine learning ecosystem overview
This post is an attempt at a high level drone's view of the machine learning ecosystem and an experimental educational post format. Machine learning evolution is a significant contributor to tectonic shifts in the structure of social and economic systems. You should pay attention.
Machine learning ecosystem is huge and amorphous, it has no well defined boundaries and machine learning can be found in many facets of our hypermodern life.
ML computer scientists and developers
Machine learning specialists are in high demand and their salaries are among the highest in the computer science industry in the USA: $120k - $180k per year.
Researchers and academy
Due to the superior salary and benefits offered by tech companies, there is a leakage of researchers and scientists from the academy. This is not that great and can lead to progress slowdown in the field due to the reduction of openly published studies.
Learning platforms
I find it telling that two (Coursera, Udacity) of the three (edX) largest massively open online courses platforms have some machine learning related history.
Initially, Udacity was launched by Sebastian Thrun and Peter Norvig as an experimental course at Stanford University on artificial intelligence. Udacity launched as a generic courses platfrom but since evolved to specialize in courses related to machine learning and artificial intelligence. A return to its' roots so to say.
Sebastian Thrun has contributed in such projects as Google Self Learning Car, DAPRA Self Driving Car, Challenge Ways, Google Street View, Google Glass, Google X.
Coursera was co-founded by Andrew Ng, an American-Chinese scientist, who led the Artificial Intelligence Group as part of Baidu, a professor at Stanford University. One of the first courses launched on Coursera was Machine Learning taught by Andrew Ng.
Startups and megacorporations
Machine learning is embedded in the organizational DNA of megacorporations. In many respects, megacorporations are the driving force behind most recent machine learning advancements. Megacorps also capture a lot of value created by ML systems. As a prominent example, at Sundar Pichais' Google, artificial intelligence (but it's really machine learning) is everywhere.
The angel.co startup database has [2057] entries (https://angel.co/machine-learning) for startups working on machine learning related products and services.
There were 24 machine learning start up acqusitions by megacorps in 2016 tracked by index.co. At the end of March 2017, 9 ML startups have been acquired.
Investments in the ML industry have also shown a significant increase.
Machine learning in online search
RankBrain is a machine learning system that helps Google to process search results and provide more relevant search results for users. The main objective of this algorithm is to help to provide quality results for rare or even one-of-a-kind queries. If the machine sees an unknown request before it, it tries to extrapolate what the user had in mind or which words or phrase have a similar meaning.
Machine learning in communications
Google's Neural Machine Translation System is a current Google Translate algorithm that is based on neural networks and represented a new approach to automated translation.
Skype Translator is an automated real time translation system available for 8 languages in a voice mode enabled by machine learning algorthims.
Machine Learning in Finance
Machine learning in finance is applied, among other usecases, to increase the accuracy of price predictions if assets, stocks and currencies. A lot of hedge funds are betting on machine learning based trading vs human traders. According to market research firm Preqin, 1,360 hedge funds make a majority of their trades with the help from computer models.
An interesting fact: about a third of Goldmans Sachs employees are developers. Though only some of them are working with machine learning, it's an important indicator of how computer science and finances are intertwined with each other in the hypermodern world.
Machine Learning in politics
Cambridge Analytica is a relevant example of application of machine learning algorithms for political purposes and propaganda.
Crypto currency
Machine learning and crypto currenciea are mostly orthogonal. Though there are most certainly a lot of attempts to predict exchange rate fluctuations using machine learning.
Chip manufacturers
Machine learning is done with GPUs (graphics processing units). The CPU architecture has a set of tradeoffs that are not suitable for massively parallelized computations (as used in machine learning). Unlike the CPU, the exponential growth of GPU performance per 1 conventional unit of money continues. Nvidia and AMD are two major players in this field with Nvidia having a significant lead.
The latest trend of interest is Google adding ASICs to the Google Cloud platform specifically designed for machine learning.
Cloud solutions
Large cloud services companies are providing specialized GPU servers that mainly used for machine learning: Amazon, Google.
Megacorporations and startups provide MLaaS (machine learning as as service): preinstalled, preconfigured, optimized systems that can reduce initial time and effort investment by an order of magnitude.
Open source
A non-exhaustive list of popular programs and libraries for machine learning:
- Tensorflow by Google
- Keras
- NTLK
- Scikit-learn
- Prediction.io
I am huge fan of machine learning algorithms! Machine learning project in communication and finance would be great on top of Steem.
From your interests, perhaps you have some ideas on that front ? 😊
What a trove of resources! this is the sort of post that takes days to read through every linked article and still realized there is much to learn!
I dont know why but i find it very funny. I dont know how to put it into words but i feel like something as computer-run as crypto currencies should be easy for a machine AI, but what was initially designed to automate finance is apparently the "last bastion" of machine learning.
Although i do agree it's orthogonal. Nothing about cryptocurrency is human, and so means nothing can be learned.
A. I in the end will destroy us all. Maybe not, but will take a hell of alot of our jobs. Just what we need more couch potatoes.
Great resources here!
Thanks for this informative post!
I think there are going to be massive opportunities to use ML with PeerPlays - imagine analyzing the past thousand rock-paper-scissor games of a competitor & getting predictions of their moves.. potentially profitable!
And not only that but ... war games can be derived from a sufficiently complex model (video game) so it could be essentially... reprogramming the game reprograms the way the deep neural model teaches itself (learns) and the subsequent artificial intelligence's thumbprint
If players behaviours are not strictly random, ML-powered players should have an advantage over human players and yes, it's potentially profitable :D
Really interesting though most of it goes over my head!
A lot of it goes over my head, too :D
I know how u feel
Love the post, I'm learning fast and so excited to share in knowledge like this. People are soon going to wake up to the positive Singularity.
The salaries are not bad. I can't imagine how difficult it is to build such machines and software. Another level of technological breakthrough )) And it is very popular these days. Every big company is doing it Microsoft, Apple, Samsung, Yandex and thats only the ones I have heard about.
oh man, the tech in the works... this society is going to be unrecognizable decades from now...
yeah, I believe even humans are going to be unrecognizable decades from now