Update tokenize to strip permissions correctly

[hammo92]

The current tokeniser doesn't correctly remove the permission clause from the definition, move the permissions check to the top of the function and use regex to correctly remove it after it has been matched. Fixes #70

[hammo92]

Need to fix the biome checks

[hammo92]

So instead of our previous regex approach I think a more robust method would be to use the field clauses as limiters, as we know that they serve as separation points for the clauses, this way we're less likely to have clauses ending up merged.

[sebastianwessel]

we should add some tests, as it becomes complex @hammo92 ?

[hammo92]

sure can't hurt to add some additional tests; I'll put some together

[hammo92]

We have pretty comprehensive tests already on the tokeniser, I think fine to merge to fix the current issues. I will be adding a couple of new updates to handle some issues with array schema generation and for literals so will check again then.