The way it works honestly, is you get 5 minutes per level, but if you do not spend the full 5 minutes of a level the time you have remaining stacks onto the next level. So say you get to level 4 within 5 minutes total, you'd have 15 minutes to complete level 4, and so on. Your situation definitely sounds like the time limit expired!