If the timer runs out in a breachstone do you lose?

Bought 4 breachstones to get some atlas passives, playing minions so clear speed is in the absolute dumpster compared to stuff like spark. My timer went down to 3 seconds in 2 of the 4 runs, so if that went to 0 does that brick my stone and kick me out with no more portals?

The run to the boss was legitmately harder than the boss himself even the last run for the 8th passive.