One way to handle this is combine those two mechanics: the quorum gets lower the more time has passed. When I was playing GitHub Nomic [1] we decided you needed one fewer player to vote for each day that had passed since the proposal was initiated.

[1] https://www.jefftk.com/news/nomic