NIYAMA-VIDYĀ Resources | Learn | Module 4

Neural Networks Resources

A resource directory for the Neural Networks module: neuron mathematics, forward/backward computation, optimisation, regularisation, debugging and PyTorch implementation references.

Use This as the Module Resource Layer

The full Module and Chapter lessons remain the authoritative learning content. This directory surfaces the Key Terms, References & Further Reading, official documentation and high-value supporting sources already connected to the module—without duplicating the lessons themselves.

Resource Focus

Core mechanics

Revisit perceptrons, architectures, forward propagation, activations and loss functions.

Learning mathematics

Use gradient-descent and backpropagation chapters as the core computational reference.

Training discipline

Return to optimisation, initialisation, regularisation, reproducibility and debugging guidance.

Implementation

Bridge the mathematics into PyTorch with official module, autograd, optimiser and tutorial documentation.

Chapter Resource Map

Every chapter in this Module already contains its own Key Terms and References & Further Reading collections. These links open the relevant chapter and automatically expand the requested resource section.

Neurons, Architecture & Forward Computation

Chapter 1 — From Biological Inspiration to Artificial Neurons

Use the chapter resource layer to revise terminology or open the source list used for deeper verification and study.

Open Key Terms →
Open References & Further Reading →

Chapter 2 — The Perceptron

Use the chapter resource layer to revise terminology or open the source list used for deeper verification and study.

Open Key Terms →
Open References & Further Reading →

Chapter 3 — Neural Network Architecture

Use the chapter resource layer to revise terminology or open the source list used for deeper verification and study.

Open Key Terms →
Open References & Further Reading →

Chapter 4 — Forward Propagation

Use the chapter resource layer to revise terminology or open the source list used for deeper verification and study.

Open Key Terms →
Open References & Further Reading →

Chapter 5 — Activation Functions

Use the chapter resource layer to revise terminology or open the source list used for deeper verification and study.

Open Key Terms →
Open References & Further Reading →

Chapter 6 — Loss Functions

Use the chapter resource layer to revise terminology or open the source list used for deeper verification and study.

Open Key Terms →
Open References & Further Reading →

Learning, Gradients & Optimisation

Chapter 7 — Gradient Descent

Use the chapter resource layer to revise terminology or open the source list used for deeper verification and study.

Open Key Terms →
Open References & Further Reading →

Chapter 8 — Backpropagation

Use the chapter resource layer to revise terminology or open the source list used for deeper verification and study.

Open Key Terms →
Open References & Further Reading →

Chapter 9 — Optimisation and Parameter Initialisation

Use the chapter resource layer to revise terminology or open the source list used for deeper verification and study.

Open Key Terms →
Open References & Further Reading →

Generalisation, Debugging & Building

Chapter 10 — Regularisation and Generalisation

Use the chapter resource layer to revise terminology or open the source list used for deeper verification and study.

Open Key Terms →
Open References & Further Reading →

Chapter 11 — Training, Debugging and Evaluating Neural Networks

Use the chapter resource layer to revise terminology or open the source list used for deeper verification and study.

Open Key Terms →
Open References & Further Reading →

Chapter 12 — Building a Neural Network

Use the chapter resource layer to revise terminology or open the source list used for deeper verification and study.

Open Key Terms →
Open References & Further Reading →

Curated External Reference Shelf

This shelf surfaces a small set of high-value references already used by the Module. The complete chapter-specific source lists remain inside the individual chapters.

Neural Networks Resources: reference resources, why each is useful, and where it supports the curriculum.
ResourceWhy it is usefulUsed in
PyTorch DocumentationPrimary framework reference across the moduleChapters 1–12
PyTorch — torch.nnLayers, activations, losses and neural-network building blocksChapters 1, 3, 5, 6, 10
PyTorch — Automatic DifferentiationAutograd and gradient computationChapters 1, 4, 8
PyTorch — Autograd MechanicsDetailed automatic-differentiation behaviourChapters 1–12
PyTorch — torch.optimOptimisers and parameter updatesChapter 9
PyTorch — torch.nn.initParameter-initialisation referenceChapter 9
PyTorch — Reproducibility NotesDeterminism and reproducibility considerationsChapter 11
Deep Learning — online bookFeedforward networks, regularisation and optimisation theoryChapters 1–12

Continue the Learning Journey

Return to Neural Networks

Continue the full 12-Chapter learning sequence rather than using the resource directory as a substitute for the lessons.

Open the Module →

Next: Deep Learning

Continue into the next logical learning area when you are ready.

Continue Learning →

NIYAMA-VIDYĀ Resources

Return to the permanent site-wide directory for Learn, Explore, Applied AI and transparency resources.

Back to Resources →

Reference Transparency

External documentation and publications remain the property of their respective owners and are provided for attribution, verification and further learning. See Third-Party Rights & Attribution and the Website Disclaimer for the site-wide transparency framework.