SmaCC: Returning part of a token value in the scanner

[joelreymont]

I have a hex number rule that looks like this

<hex_int>
    : 0x <hexdigit>+
    ;

My token value will then become 0xAA.

How can I make my token value become everything BUT the 0x, that is just AA? @j-brant

[j-brant]

You can't using the standard code. You could create a hex_int method in the scanner that created the token without the 0x, but I would recommend having the tokens have the whole value. If I just needed the value without the 0x, then I'd probably create a method on the node that stripped the first two characters. Another approach would be to define two tokens: one for the 0x and another for the AA. The problem with that approach is that if you have a whitespace or comment tokens that are ignored, then you can have a comment or whitespace between the 0x and AA.