Wash the mushrooms and pat them dry. Remove the stems and the gills. Scoop the herb-y goat cheese into the mushroom caps, and place mushrooms on a parchment-lined baking sheet. Bake for 30 to 40 minutes, or until juices are seeping out of the mushrooms, and the goat cheese is crisp and golden brown on top. For extra crispy goat cheese, you can put your oven on the high broil setting, and broil for a couple of minutes at the end.