You must show him your attitude now: you can buy chocolate if you want, and it's not valuable.
Second, such a man is unreliable. You should persuade him to turn back in time and explain your position. What you want is aboveboard love, not this obscene love. He shouldn't bother you. Once you two have something, you are both embarrassed. He is sorry for you, his wife and children, his family, and so are you. There are many good boys. He is just a finished product cultivated by others, which is why he attracts you so much.
Keep a simple friendship or colleague relationship. At this time, you can't be vague. You must stand firm in your words so that you won't be bothered.
I hope I can help you, thank you!