An agent takes action a in state s, receives r=2, and lands in s′. Current estimates:
Q(s,a)=4.0,Q(s′,up)=3.0,Q(s′,down)=−1.0,Q(s′,right)=7.0,Q(s′,left)=0.0
The ε-greedy behaviour policy explores at s′ and selects down. With α=0.5 and γ=0.9, what is Q(s,a) after this transition under Q-learning and under Sarsa?