Given your restrictions I would say you're just about there.
I'd place "modo" before "modum" and add "quod".
Magia modo modum quod nondum conceptum est.
Of course, you want to have someone else review this before
committing it to a tattoo.