9 Ways to Become the MacGyver of Deep Learning

You are not a data scientist nor machine learning programmer. But your boss wants an AI project started in the next three months.

Mastering deep learning in a next few weeks is impossible. Nor, you have the budget to hire a consultant to help.

What do you do?


Surely there is a hack to all of this.

If you find yourself taking a project management role to implement a deep learning initiative in your organization, but have zero knowledge, it’s time to tap on your grit. Let us explore the ways on how you (a guy with zero ML skills) can make it work.


Understand the concept of Neural Nets

First, understand the concept of Neural Nets. Just like the human brain, deep learning is composed of neurons which receive signals from inputs and connect it to an answer.

Biological Neurons and Perceptrons

Source: Jia-Bin Huang, Assistant Professor, University of Illinois


There are two ways in which neurons process inputs. The first one focuses on linear combinations of weighted inputs (i.e., linear neuron).  While the second one uses weighted sum to feed into the logistic function (i.e., sigmoidal neuron). The logistic function then returns a value between 0 and one which in turn makes deep learning a more straightforward process. A neural network happens when these neurons link to each other to answer the learning problem.

Know how to train Neural Nets

Training neural networks can be viewed as a sort of optimization problem. The goal is to minimize the error of neural nets through constant training. Use training data to form weights for the neural networks that will produce the desired output.

Artificial Neural Networks and Training

Source: Dipendra Jha, Northwestern University

Typical training of neural networks with TensorFlow uses a batch data. The primary goal is to train the machine to get intended results. Weight assignments define these results. The batch data will be fed to the network and from there, determine how accurate the neural network is through looking at its percentage of error in relation to initially set weights. The goal is to minimize the error through continually training the neural nets to arrive at the pre-set weights.

There are a couple of ways to do this. The first one is through gradient descent. This uses derivatives and calculus techniques through back propagation, resilient propagation and Manhattan propagation and other optimization techniques based on gradient calculations.


Grasp Mathematical Foundations of Data Science and Machine Learning

Algebra and calculus is the foundation of the deep neural nets. Self-studying deep learning is no longer new. There are a lot of free courses online from top universities such as Stanford and Harvard that help professionals transition.

  1. Andrew Ng’s linear algebra review videos and reference guide is an excellent place to start.
  2. Professor Leonard’s Introduction to the Derivative of a Function also gives a succinct understanding of backpropagation.
  3. Finally, jump right into deep learning through this Quoc Le’s (a Google research scientist) Deep Learning Tutorial.

Know about Deep Learning Software Tools and Platforms

The field of deep learning is growing fast. KD Nuggets compiled a comprehensive list of 50 deep learning software tools and platforms. These platforms can be used in natural language processing, speech recognition, image recognition and the likes.

Top Deep Learning Libraries in 2018

Source: Dan Clarke, KD Nuggets


Keep Deep Learning Cheat Sheets

Keeping quick reference guides is an excellent way to remember things you just learned.

A mostly complete chart of neural networks

An informative chart to build neural network graphs

Source: Fjodor van Veen, Asimov Institute


Also a linear algebra cheat sheet for deep learning

Jason Brownlee compiled this comprehensive linear algebra cheat sheet for machine/deep learning. In here, he talks about arrays, vectors, matrices, matrix operations and factorization and statistics.


Take free deep learning courses

There are a lot of good free courses on machine and deep learning via Coursera, Udacity, and EdX. For instance, Andrew Ng’s Introduction to Machine Learning is always the topmost recommendation among practitioners. Deep Learning Specialization is also available Coursera. It has both a free and paid option focusing on major areas of deep learning.

Free machine learning course by Andrew Ng

Source: Coursera

Some AI companies also offer free webinars on deep learning in the enterprise. WorkFusion provides a webinar called Forecasting the Future of Enterprise AI to teach how companies can solve common roadblocks and issues. Taught by its co-founder and CTO, it maps our advancements in AI and how to benefit from robotic process automation (RPA) that runs under deep learning.

WorkFusion also offers a free version of their product called  RPA Express. RPA Express is free and easy to use. It enables automation of common applications even without coding. It is perfect for companies who wanted to start on RPA without having to tie themselves to multi-million dollar contracts.


Use deep learning in your personal life

Applying deep learning on problems that are close to you is the best way to learn it. To keep yourself motivated on your self-study, Jason Brownlee recommends working on problems that have an impact. For example, using machine learning at home for personal finance, tracking your food intake and even how much TV or Netflix you are consuming in a week. He broke down machine learning into a 5-step tutorial process  that you can take for free on his website.


When not to use deep learning

The decision to use deep learning should be more than the hype. There are instances where a simple statistical and rule-based model is enough.

Alan Turing about deep learning

Source: Andrew Fogg

For example, establishing causal mechanisms such as knowing if two molecules work in a cellular environment can benefit more from old-style Bayesian methods. Using deep learning on unstructured data such as natural language processing might not work because of the lack of context to which word embedding can anchor on.

Diving head-on into deep learning is no easy feat. Before you start self-studying your way into this, warm up with this brief history.

Passionate about agile, innovation and data science. As an agile project manager and technology writer, I get to combine the best of both worlds: the moonshot ideas of technology disruptors and the value-driven mindset of businesses. Follow me at http://cogitoph.com