A rusty bicycle not only looks bad but it can be squeaky and not perform at its best. There is no set-in-stone way to remove rust from a bicycle or its components, but several home methods can help you clean up your bike.