When is the Right Time to Replace your Hot Water System? When it becomes time to replace your hot water system, you will need to do so when your water starts to smell bad, or when it starts to leak. The best time to replace your hot water system is when they are not functioning properly