kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Distributed Services With Go - gogoproto on linux

page 20: … protoc command… I had to additionally run the following go get commands in order to be able to compile protobuf code using go...

#errata /book-distributed-services-with-go

14 2953 7

2020-10-16 05:21:10 UTC

New

PragProg Customers

Python Testing with pytest - Chapter 5 example c AttributeError: 'module' object has no attribute 'config'

Running the examples in chapter 5 c under pytest 5.4.1 causes an AttributeError: ‘module’ object has no attribute ‘config’. In particula...

#errata /book-python-testing-with-pytest

5 3582 1

2020-07-14 20:43:55 UTC

New

PragProg Customers

Concurrent Data Processing in Elixir: various errata

Hi @Margaret , On page VII the book tells us the example and snippets will be all using Elixir version 1.11 But on page 3 almost the en...

#errata /book-concurrent-data-processing-in-elixir

15 1549 13

2021-04-11 17:34:47 UTC

New

PragProg Customers

Web Development with Clojure, Third Edition (vB17.0): create table syntax invalid

Title: Web Development with Clojure, Third Edition, vB17.0 (p9) The create table guestbook syntax suggested doesn’t seem to be accepted ...

#errata /book-web-development-with-clojure-third-edition

0 1835 1

2021-08-13 23:56:52 UTC

New

PragProg Customers

Distributed Services With Go: Unable to pass readiness/liveness checks. (page 210, 215)

I’m not quite sure what’s going on here, but I’m unable to have to containers successfully complete the Readiness/Liveness checks. I’m im...

/book-distributed-services-with-go

5 1420 5

2022-08-31 00:14:29 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition: error when running tox in parallel (page 151)

When trying to run tox in parallel as explained on page 151, I got the following error: tox: error: argument -p/–parallel: expected one...

#errata /book-python-testing-with-pytest-second-edition

0 1111 1

2021-12-10 05:12:17 UTC

New

PragProg Customers

Powerful Command-Line Applications in Go: Exercise Solutions (many pages)

Is there any place where we can discuss the solutions to some of the exercises? I can figure most of them out, but am having trouble with...

#question /book-powerful-command-line-applications-in-go

17 1396 9

2022-02-09 15:00:31 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: error concerning function getCurrentStandings in BaseballDao.java

@mfazio23 I’m following the indications of the book and arriver ad chapter 10, but the app cannot be compiled due to an error in the Bas...

#question /book-kotlin-and-android-development-featuring-jetpack

1 3397 6

2022-07-22 14:06:06 UTC

New

PragProg Customers

PragProg Customers Kotlin and Android Development: pg. 8 Build Gradle error: Could not get unknown property 'kotlin_version'

I am using Android Studio Chipmunk | 2021.2.1 Patch 2 Build #AI-212.5712.43.2112.8815526, built on July 10, 2022 Runtime version: 11.0....

#question /book-kotlin-and-android-development-featuring-jetpack

0 1456 2

2022-08-29 14:30:50 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: End Ch. 11 app runs but consistently crashes

I’ve got to the end of Ch. 11, and the app runs, with all tabs displaying what they should – at first. After switching around between St...

#question /book-kotlin-and-android-development-featuring-jetpack

0 936 8

2024-01-05 05:43:55 UTC

New

Other popular topics

Linux>Questions

AMD or Intel for Programming with Linux as the OS?

I am thinking in building or buy a desktop computer for programing, both professionally and on my free time, and my choice of OS is Linux...

#mobile #android #web-development #linux #desktop-computer #mobile-development

36 6006 10

2020-07-12 20:50:05 UTC

New

General Dev>Dev Chat

Which vertical monitor do you use?

I’m thinking of buying a monitor that I can rotate to use as a vertical monitor? Also, I want to know if someone is using it for program...

#monitors #programming

51 4892 20

2023-06-28 07:23:42 UTC

New

General Dev>Hardware

Poll: Which keyboard layout do you use?

poll poll Be sure to check out @Dusty’s article posted here: An Introduction to Alternative Keyboard Layouts It’s one of the best write-...

colemakmods.github.io

#polls /keyboards

10 6048 11

2020-10-31 23:12:33 UTC

New

General Dev>Hardware

Keyboard thock (sound)

I’ve been hearing quite a lot of comments relating to the sound of a keyboard, with one of the most desirable of these called ‘thock’, he...

/keyboards #mechanical-keyboards

14 11197 8

2020-11-11 11:59:23 UTC

New

General Dev>Code Editors

Onivim 2 Code Editor

Thanks to @foxtrottwist’s and @Tomas’s posts in this thread: Poll: Which code editor do you use? I bought Onivim! :nerd_face: https://on...

#code-editors /onivim /revery

88 6144 32

2023-05-15 07:32:26 UTC

New

Backend>Chat

How to install Ruby 3 with ASDF

In case anyone else is wondering why Ruby 3 doesn’t show when you do asdf list-all ruby :man_facepalming: do this first: asdf plugin-upd...

/ruby #asdf

11 5961 4

2021-02-02 08:02:13 UTC

New

Backend>Chat

Data Structures and Algorithms with Elixir

This is going to be a long an frequently posted thread. While talking to a friend of mine who has taken data structure and algorithm cou...

/elixir #algorithms #data-structures

108 11869 31

2024-11-14 02:14:00 UTC

New

Community>In The Spotlight

Spotlight: Jamis Buck (Author) Interview and AMA!

Author Spotlight Jamis Buck @jamis This month, we have the pleasure of spotlighting author Jamis Buck, who has written Mazes for Prog...

#author-spotlight /ruby /book-the-ray-tracer-challenge /book-mazes-for-programmers

21 6352 9

2022-09-28 18:21:15 UTC

New

General Dev>In The News

Zig now has built-in HTTP server and client in std

zig/http.zig at 7cf2cbb33ef34c1d211135f56d30fe23b6cacd42 · ziglang/zig. General-purpose programming language and toolchain for maintaini...

github.com

/zig #http

0 5624 0

2023-05-19 00:35:41 UTC

New

AI>Questions

What are the best text-to-speech ai generation tools that you can run locally?

Background Lately I am in a quest to find a good quality TTS ai generation tool to run locally in order to create audio for some videos I...

#ai #text-to-speech

6 8411 3

2025-03-24 16:48:39 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Distributed Services With Go - gogoproto on linux

Python Testing with pytest - Chapter 5 example c AttributeError: 'module' object has no attribute 'config'

Concurrent Data Processing in Elixir: various errata

Web Development with Clojure, Third Edition (vB17.0): create table syntax invalid

Distributed Services With Go: Unable to pass readiness/liveness checks. (page 210, 215)

Python Testing with pytest, Second Edition: error when running tox in parallel (page 151)

Powerful Command-Line Applications in Go: Exercise Solutions (many pages)

Kotlin and Android Development featuring Jetpack: error concerning function getCurrentStandings in BaseballDao.java

PragProg Customers Kotlin and Android Development: pg. 8 Build Gradle error: Could not get unknown property 'kotlin_version'

Kotlin and Android Development featuring Jetpack: End Ch. 11 app runs but consistently crashes

Other popular topics