Skip to content

Data Stories

Primary Menu

  • Home
  • All Posts
  • About Blog
  • Contact
  • Portfolio

Tag backpropogation

Derivation of backpropogation

November 25, 2017May 10, 2020Archit Vora Leave a comment

Quick Summary:

 

fig
summary

 

back_prop

 

Detailed Derivation:

 

1
2
3

 

Even if you look at gradient descent below, error is multiplied by previous value. When input is higher it’s contribution to error is higher and will needs to change more.

gd

 

Derivation Of Backpropagation – 2

November 5, 2017November 25, 2017Archit Vora Leave a comment

 

References :

  • Pattern Recognition and Machine Learning by Bishop [Page no 244]
  • Andrew NG’s course by deeplearning.ai
  • https://sudeepraja.github.io/Neural/

Welcome!

Hi, welcome to the data stories blog. My name is Archit and these are my notes/ mathematical summary for machine learning and statistics.

Search

Recent Posts

  • Power Analysis
  • Anomaly Detection Basics
  • Recommendation System Fundamentals
  • Elimination with matrices

Categories

  • Case Studies (1)
  • Deep Learning (9)
    • NLP (2)
  • High School Math (7)
  • Information Retrieval (1)
  • Machine Learning (33)
    • Supervised (24)
    • Unsupervised (9)
  • Metrics & Measurement (3)
    • Measurement (2)
    • Metrics (1)
  • Optimization (8)
  • Papers (2)
  • Reinforcement learning (4)
  • Statistics (28)
    • Hypothesis Testing (4)
    • Regression (4)
    • Time Series (6)
  • Uncategorized (2)

Tags

adaboost analysis anomaly detection auto correlation autoregressive process backpropogation boosting Classification convex optimization correlation cross-entropy decision tree Deep Learning dimentionality reduction distributions evaluation metrics exponential family gaussian geometry gradient gradient descent gym hypothesis independence Information Retrieval interpretation k-means linear algebra linear equations linear regression logistic regression Machine Learning maths matrices multiclass neural networks newton's method openai Optimization probability python Regression Reinforcement learning softmax Statistics tests Time Series trends Unsupervised yule walker

Enter your email address to follow this blog and receive notifications of new posts by email.

Create a website or blog at WordPress.com
  • Subscribe Subscribed
    • Data Stories
    • Already have a WordPress.com account? Log in now.
    • Data Stories
    • Subscribe Subscribed
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar

Loading Comments...