If your kettle is brand new it should be boiled and refilled three times before use. If it is an older kettle descaling with white vinegar may help.
To establish where the taste is coming from it may be worth making two hot drinks – one from your kettle and one using water from a saucepan and comparing the two.
water taste can be affected by many factors.