nushell/src/parser
Yehuda Katz 6a7c00eaef Finish the job of moving shapes into the stream
This commit should finish the `coloring_in_tokens` feature, which moves
the shape accumulator into the token stream. This allows rollbacks of
the token stream to also roll back any shapes that were added.

This commit also adds a much nicer syntax highlighter trace, which shows
all of the paths the highlighter took to arrive at a particular coloring
output. This change is fairly substantial, but really improves the
understandability of the flow. I intend to update the normal parser with
a similar tracing view.

In general, this change also fleshes out the concept of "atomic" token
stream operations.

A good next step would be to try to make the parser more
error-correcting, using the coloring infrastructure. A follow-up step
would involve merging the parser and highlighter shapes themselves.
2019-10-22 16:19:22 -07:00
..
hir Finish the job of moving shapes into the stream 2019-10-22 16:19:22 -07:00
parse Finish the job of moving shapes into the stream 2019-10-22 16:19:22 -07:00
deserializer.rs Stream support (#812) 2019-10-13 17:12:43 +13:00
hir.rs Stream support (#812) 2019-10-13 17:12:43 +13:00
parse_command.rs Finish the job of moving shapes into the stream 2019-10-22 16:19:22 -07:00
parse.rs Replace crate visibility identifier with pub(crate) 2019-08-29 13:09:09 +02:00
registry.rs Stream support (#812) 2019-10-13 17:12:43 +13:00