The following doesn't rotate a rectangle, just shifts it a bit:
compose(
context(rotation=Rotation(π/3)),
rectangle(0.2w, 0.2h, 0.6w, 0.6h),
fill(colorant"orange"))
For ellipse the same code produces an expected result.
Julia version 1.6.0, Compose v0.9.2.