The rubber pad between the lamp cord and the lampshade can be removed. Pull it toward the cord, and then pull the lamp out from the opening above. The cord is still in the hole. Install the lamp and pull it back.
That's it.
But be careful when installing the lamp holder to the lampshade. The round hole is easy to break, but it usually won't.