Mix olive oil, lemon juice and all spices in a small bowl.
Put chicken and vegetables (except olives) together in a large bowl until and toss with the olive oil/lemon juice mixture until well combined. Transfer mixture to a large sheet pan and spread into a single layer. Add Kalamata olives.
Bake at 400 degrees until potatoes are fork-tender and chicken breasts are no longer pink in the center and the juices run clear, about 25 minutes. A thermometer inserted into the center of the chicken breasts should read 165 degrees.