Even though silicone is very soft and non reacting, the skin needs to breath. Exessive wear might lead to skin irritation. Every skin reacts different.

It is important to know that silicone is less stretchy than latex.
therefore, to avoid tearing, you should not stretch the sleeve with force to put it on,  use a skin or lubricant to slide it over the penis.