Of course peeling is good. I don't know which skin you are talking about. Generally, fresh ginkgo has a layer of skin, a shell inside and a coat inside.
Ginkgo biloba is poisonous. To peel off the outermost skin, it is best to cook it in a pot with the lid open, and that will be fine.
Ginkgo biloba is good, but you can't eat more, or your mouth will get numb.