Took me quite some time to defeat him. I could never get him hit by all the pillars, and if I got one of the two at the top I'd usually miss one of the others.
You can hit him once or twice when he sends fire down the room too, helping a bit.