Lysandros Nikolaou cbf0afd8a1 gh-97973: Return all necessary information from the tokenizer (GH-97984) ... Right now, the tokenizer only returns type and two pointers to the start and end of the token. This PR modifies the tokenizer to return the type and set all of the necessary information, so that the parser does not have to this.		2022-10-06 16:07:17 -07:00
..
action_helpers.c
asdl_c.py	GH-91079: Decouple C stack overflow checks from Python recursion checks. (GH-96510)	2022-10-05 01:34:03 +01:00
asdl.py
myreadline.c
parser.c	gh-91210: Improve error message when non-default param follows default (GH-95933)	2022-09-17 10:09:28 -07:00
peg_api.c
pegen_errors.c	gh-97973: Return all necessary information from the tokenizer (GH-97984)	2022-10-06 16:07:17 -07:00
pegen.c	gh-97973: Return all necessary information from the tokenizer (GH-97984)	2022-10-06 16:07:17 -07:00
pegen.h
Python.asdl
string_parser.c	gh-94869: Fix the location in some expressions for multi-line f-string ast nodes (#94895)	2022-07-16 19:51:53 +01:00
string_parser.h
token.c
tokenizer.c	gh-97973: Return all necessary information from the tokenizer (GH-97984)	2022-10-06 16:07:17 -07:00
tokenizer.h	gh-97973: Return all necessary information from the tokenizer (GH-97984)	2022-10-06 16:07:17 -07:00