What is the force that pushes coloured solution up the celery?

It's a combination of transpiration and capillary action. The leaves lose water due to transpiration, so the water molecules "behind" them move up the xylem tubes. The adhesion of the water molecules keeps them forming one long "water chain" a they move up the celery.