momentum, 60 steps: loss = 0.005930 w1 = −2.6398 b1 = −4.6398 w2 = 0.2008 b2 = 1.9230 plain SGD, 30 steps: loss ≈ 0.000000 w1 = 1.2415 b1 = −0.7585 w2 = 2.6270 b2 = 0.7313