Code Token Inspector
Explore how a code highlighter labels words and symbols. See which parts are keywords, strings, comments and other code types.
Is a highlighter's token tree the same as a compiler AST?
No. This tree describes visual syntax classes such as keywords, strings, and comments. Expand its nodes to see which spans receive highlighting and download the token structure.
Your result
A little clarity, right here.
Start with your own content or load the example. Your result will appear here.
Three simple steps
How to use Code Token Inspector
Choose your input and adjust the options.
Review the preview and run the tool.
Download the result and keep your original.
Common questions
Good to know
Understand the result.
Keep the original.
Is this tool free, and are my files uploaded?
This tool is free with no account required. The work happens in your browser. Your input and files are not sent to a processing server.
What are the limits and details?
The tree reflects the highlighter's grammar, not semantic type information or a complete compiler parse. Unsupported language choices return an explicit error.
Limits: 500,000 characters per text field; files up to 20 MB each, 10 files and 50 MB total. Processing stops after 30 seconds.