As far as I can tell, Icarus still treated the woman he supposedly loved as beneath him, just like the other magic users. I don't think we saw a single time where he took into account what she was thinking/feeling.
He gave her his eyes and abandoned her without asking her what she preferred, stalked her whenever he felt lonely, prevented her memories from being raised when he got emotional, didn't listen to her wishes for years, and then finally gave up her memories and got her killed in the process.
The other magic users are pretty horrible, but I still think most of the blame lies with Silent Rock/Icarus.