Preheat oven to 350 degrees.
In a small bowl, combine first 7 ingredients (cheese through black pepper); place 2 tablespoons of this mixture under the skin of each chicken breast half.
Heat the olive oil in a medium ovenproof skillet over medium heat. Add chicken and cook for 5 minutes per side; transfer the skillet to the preheated oven and bake for 10 minutes or until juices run clear.