You do like to bring things back to your concept of time, don't you? :)
Your speculative extrapolations here seem to me good examples of the non-mathematical basis of the creation of new math. New math can even start from harebrained conceptions of possible worlds, which the mathematician dutifully explores, rather like how the Money Python comedians take the most absurd situations with utter seriousness, which makes for the comedy. Some of those farfetched formal explorations end up being useful to physics, because of the counter-intuitiveness of nature's mindless operations.
Your point about negative numbers and debt is interesting. The question would be whether debt is real or is as imaginary as moral obligations. That question might be worth a follow-up article.