Curiosity · Syllabus

Gradient Descent and Optimization in a B.Tech — syllabus & what you learn

Gradient descent iteratively moves model parameters down the slope of a loss function; variants such as SGD, momentum and Adam control how large and how noisy those steps are. Every trained model in modern AI comes out of some version of this loop. Inside a four-year B.Tech, Gradient Descent and Optimization arrives in layers: programming and mathematics foundations in years one and two, core methods next, and applied depth concentrated in years three and four plus the capstone. Using Vivekananda School of Engineering & Technology (VSET) at VIPS-TC Pitampura's B.Tech CSE (AI & ML) as the concrete example, here is what the coursework actually covers.

At a glance

Topic
Gradient Descent and Optimization
VSET programme
B.Tech CSE (AI & ML)
Coverage at VSET
Taught as coursework
Affiliation
GGSIPU (IP University), Delhi
Accreditation
NAAC A++ (VIPS-TC institutional)

How VSET teaches Gradient Descent and Optimization

Gradient descent iteratively moves model parameters down the slope of a loss function; variants such as SGD, momentum and Adam control how large and how noisy those steps are. Every trained model in modern AI comes out of some version of this loop. At VSET this maps to documented coursework depth inside B.Tech CSE (AI & ML).

  • Optimisation is the engine underneath the machine learning and deep learning material published at learn.engineering.vips.edu.
  • Learning-rate behaviour, convergence and loss landscapes are taught before the transformer content that depends on them.
  • The same optimisation loop reappears in the fine-tuning material, where only adapter weights are updated.
  • Delivered inside the B.Tech CSE (AI & ML) track, one of VSET's seven GGSIPU-affiliated B.Tech programmes.

Labs and infrastructure

  • Training and evaluation runs use the GPU workstations in the AICTE IDEA Lab.
  • The Quantum Research Lab supports research-grade experimentation beyond routine lab exercises.

What students actually build

  • Training-run diagnosis — learning rate, convergence, overfitting — is part of every model-building capstone.
  • LoRA fine-tunes of open-weight models are a named capstone deliverable.

Frequently asked questions

When does Gradient Descent and Optimization content actually start in a B.Tech?

Meaningful Gradient Descent and Optimization content typically ramps up from the second or third year, after programming and mathematics foundations. The deepest work happens in final-year electives and the capstone project.

Is optimisation taught as theory or practice at VSET?

Both: it underpins the machine learning and deep learning material published at learn.engineering.vips.edu, and students meet it directly in training runs on the IDEA Lab GPU workstations.

Which optimisers do students actually use?

The standard gradient-descent family used in current deep learning practice, including in the LoRA and QLoRA fine-tuning capstones.

Do I need strong mathematics for this?

Calculus and linear algebra are the working tools here; VSET also runs a B.Tech CSE (Applied Mathematics) track for students who want that side deepened.

Sources

  1. VSET — Artificial Intelligence department — accessed 2026-08-31
  2. VSET — B.Tech CSE (AI & ML) — accessed 2026-08-31
  3. GGSIPU — IP University — accessed 2026-08-31