bench-lexer.md

1. before storing .string

---------------------------------------------------------------------------- benchmark 'large-file': 2 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_winnow_lexer         12.1443 (1.0)      12.7692 (1.0)      12.3517 (1.0)      0.1291 (1.0)      12.3384 (1.0)      0.1820 (1.0)          24;1  80.9605 (1.0)          74           1
test_python_tokenizer     78.0517 (6.43)     83.8988 (6.57)     80.6329 (6.53)     2.4971 (19.35)    79.2772 (6.43)     4.7992 (26.36)         5;0  12.4019 (0.15)         12           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

2. there is not much change in performance even if we are storing TokenInfo.String