That is the part of the point I was making. I have no idea what that would look like. Maybe something like simple proofs from Number Theory or Abstract Algebra? I read up a little on Lisp family of languages on Wiki and they look vaguely close to being 100% purely mathematical, syntax-wise. I wonder what it's like doing graphics/objects(?) work in Lisp.
It's interesting that graphics and objects are so connected, in your posts. I'll say that in general, EVERYTHING in Python is objects, and they're an extremely general programming paradigm. It sounds like Haskell might be a language you'd like, if you're into abstract algebra (although I don't think Haskell's graphics support is super great).
Bluntly put, Haskell's graphics support sucks. There are different libraries with different levels of support, but none are complete or high level. There are also Haskell like alternatives like Elm and PureScript, but they're experimental. And finally there are some Haskell to JavaScript compilers, but I'm not sure what DOM manipulation is like with them (and they're all experimental).
I'm building a Haskell desktop app over winter break (DMX and light show controls), but after a fair bit of research, I came to the conclusion that its best to do the GUI in JavaScript and speak with a Haskell server over a WebSocket.
For 2D, I don't see how Gloss[0] isn't complete or high level (what are you comparing it to?). There's a cool example of drawing a clock[1] as well as others[2].
The package is on hackage[3] and has a website[4], but the github seemed more approachable/clear to me. There's also an awesome tutorial on making tic tac toe[5] by ocharles of the 24 days of hackage fame.
Ok, I was asking because if you meant "math" as in "geometry" you could just go directly into how OpenGL does his stuff or many of the higher level graphics languages like (the preivously mentioned) Processing or three.js.
BUT, if you mean "math" as in "abstract math" (which I believe is what you do) I don't think there's anything suitable for that ATM. You see, the thing is that computers behave in a certain way and languages/libraries are pretty much just tools that help you abstract away all the boilerplate associated to the many common tasks that you may want to do in a particular subject. That said, you can't easily escape the underlying paradigm, the "way of the machine"; which in this is case is pretty much "light on and off particular pixels on the screen in order to create shapes/effects".
There is not, however, anything stopping you from creating a new set of tools designed to do exactly whatever you'd imagine these tools should be. For what I see, you are at one of the most important stages anyone has throughout his life in order to innovate, that is, when you're barely starting and your mind is full of your ideas instead of someone else's. Take note of everything that comes up to your head and try to find a way to code it later, my only suggestions would be:
1) Don't give up, it's gonna be a very long and tedious process but don't give up.
2) Try to find the tools you feel are helping you in solving this problem, never the other way around (i.e. trying to adapt the problem to the tools). If you ever feel that you are not making any more progress with the toolset that you chose and have better options in mind just go for it; even if you have to recode everything from zero again just rinse and repeat until it's perfect.
You could be at the start of somethin very interesting, who knows; best of luck and don't forget to post your progress back here.