No, I think it's just like how white clothes look better on fair-skinned people. But you can choose clothes with brighter colors to match your skin tone better.

If you like yellow clothes, then you can usually go out and put on some appropriate light makeup, so that the face does not look yellow, you can rub CC or BB.

And mustard yellow clothes color is too bright, you can pick up some darker accessories with the use of, so that it will not be very prominent contrast.