Skip to Content

Ai

Reinforcement Learning Part 15: The Surrogate Objective Function
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 15: The Surrogate Objective Function

Concept
August 27, 2026
Reinforcement Learning Part 14: Baselines, the Advantage Function, and Actor-Critic
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 14: Baselines, the Advantage Function, and Actor-Critic

Concept
August 19, 2026
Reinforcement Learning Part 13: Policy Gradient Causality Trick and REINFORCE
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 13: Policy Gradient Causality Trick and REINFORCE

Concept
August 11, 2026
Reinforcement Learning Part 12: The Policy Gradient
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 12: The Policy Gradient

Concept
July 24, 2026
Reinforcement Learning Part 11: Deep Q-Networks (DQN)
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 11: Deep Q-Networks (DQN)

Concept
July 14, 2026
Reinforcement Learning Part 10: Q-Learning
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 10: Q-Learning

Concept
July 8, 2026
Reinforcement Learning Part 9: TD(λ) and Eligibility Traces
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 9: TD(λ) and Eligibility Traces

Concept
July 2, 2026
Reinforcement Learning Part 8: Temporal-Difference (TD) Learning
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 8: Temporal-Difference (TD) Learning

Concept
June 23, 2026
Reinforcement Learning Part 7: Monte Carlo Methods
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 7: Monte Carlo Methods

Concept
June 16, 2026
Reinforcement Learning Part 6: Dynamic Programming
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 6: Dynamic Programming

Concept
June 9, 2026
Reinforcement Learning Part 5: The Bellman Optimality Equations
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 5: The Bellman Optimality Equations

Concept
June 4, 2026
Reinforcement Learning Part 4: Expected Return, Value Functions, and Bellman Equations
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 4: Expected Return, Value Functions, and Bellman Equations

Concept
May 26, 2026
Reinforcement Learning Part 3: Policies, Markov Decision Processes (MDPs), and Trajectories
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 3: Policies, Markov Decision Processes (MDPs), and Trajectories

Concept
May 19, 2026
Reinforcement Learning Part 2: Rewards, Returns, and the Discount Factor
AI generated balance bot for reinforcement learning

Reinforcement Learning Part 2: Rewards, Returns, and the Discount Factor

Concept
May 12, 2026
What is Reinforcement Learning?
AI generated balance bot for reinforcement learning

What is Reinforcement Learning?

Concept
May 5, 2026
How to Get an Embedded Job When AI Is Taking Junior Programming Work
Engineer looking confused or sad using computer mouse

How to Get an Embedded Job When AI Is Taking Junior Programming Work

Opinion
April 21, 2026
AI in Engineering Education: Lessons from ECEDHA 2026
AI brain

AI in Engineering Education: Lessons from ECEDHA 2026

Opinion
March 31, 2026
AI in the Classroom (And What You Can Do About It)
Student using smartphone in classroom

AI in the Classroom (And What You Can Do About It)

Opinion
March 24, 2026
An Idea I’m Exploring: Reinforcement Learning for a Balance Robot
AI generated balance bot for reinforcement learning

An Idea I’m Exploring: Reinforcement Learning for a Balance Robot

Opinion
March 17, 2026
What is Physical AI?

What is Physical AI?

Concept
March 10, 2026
Before I Speak to ECE Department Heads About Edge AI, I Want Your Input
College lecture on data

Before I Speak to ECE Department Heads About Edge AI, I Want Your Input

Opinion
March 3, 2026
State of Edge AI on Microcontrollers in 2026

State of Edge AI on Microcontrollers in 2026

Opinion
January 6, 2026
Deep Learning on Microcontrollers: The State of Embedded ML in 2025

Deep Learning on Microcontrollers: The State of Embedded ML in 2025

Opinion
October 28, 2025
The Wrong Way to Use AI (and How to Actually Write Better Code with LLMs)
Claude 4 refactored my code and it did not work

The Wrong Way to Use AI (and How to Actually Write Better Code with LLMs)

Opinion
June 3, 2025
Getting Started with NVIDIA Jetson Orin Nano
NVIDIA Jetson Orin Nano

Getting Started with NVIDIA Jetson Orin Nano

Tutorial
June 4, 2024