kwin: Refactor the window transformation code

Move the code that computes the transformation matrix into its own
method, and rewrite it to improve readability.