Although it rained heavily, they went on working

In spite of the rain heavily, they went on working.

In spite of the raining heavily, they went on working.

Despite the heavy rain, they went on working.

Though the fact that it rained heavily, they went on working.