The timer starts immediately when you open a puzzle and continues running while the puzzle is open. The timer cannot be paused - if you leave the puzzle open while taking a break, the timer will continue to run. If you close the puzzle and return later, the timer will continue from where you left off.
You can choose whether to display the timer from the Settings menu, although hiding the timer does not stop it from running, it only removes it from view.