SGD lr=0.01 : w1 moved 0.0028 b1 moved 0.2808 (ratio 100) Adam lr=0.01 : w1 moved 0.2207 b1 moved 0.2207 (ratio 1)