I believe the Question of Exercise 2.2: Bandit Example is incorrect. The R1 value and R3 values should be -1 and -2 respectively as per the second edition of the book.

[C3Suryansu]

[BenfenYU]

Agree