mirror of
https://github.com/nushell/nushell.git
synced 2024-10-18 00:04:34 +02:00
1ad9d6f199
The main thrust of this (very large) commit is an overhaul of the
expansion system.
The parsing pipeline is:
- Lightly parse the source file for atoms, basic delimiters and pipeline
structure into a token tree
- Expand the token tree into a HIR (high-level intermediate
representation) based upon the baseline syntax rules for expressions
and the syntactic shape of commands.
Somewhat non-traditionally, nu doesn't have an AST at all. It goes
directly from the token tree, which doesn't represent many important
distinctions (like the difference between `hello` and `5KB`) directly
into a high-level representation that doesn't have a direct
correspondence to the source code.
At a high level, nu commands work like macros, in the sense that the
syntactic shape of the invocation of a command depends on the
definition of a command.
However, commands do not have the ability to perform unrestricted
expansions of the token tree. Instead, they describe their arguments in
terms of syntactic shapes, and the expander expands the token tree into
HIR based upon that definition.
For example, the `where` command says that it takes a block as its first
required argument, and the description of the block syntactic shape
expands the syntax `cpu > 10` into HIR that represents
`{ $it.cpu > 10 }`.
This commit overhauls that system so that the syntactic shapes are
described in terms of a few new traits (`ExpandSyntax` and
`ExpandExpression` are the primary ones) that are more composable than
the previous system.
The first big win of this new system is the addition of the `ColumnPath`
shape, which looks like `cpu."max ghz"` or `package.version`.
Previously, while a variable path could look like `$it.cpu."max ghz"`,
the tail of a variable path could not be easily reused in other
contexts. Now, that tail is its own syntactic shape, and it can be used
as part of a command's signature.
This cleans up commands like `inc`, `add` and `edit` as well as
shorthand blocks, which can now look like `| where cpu."max ghz" > 10`
141 lines
3.6 KiB
Rust
141 lines
3.6 KiB
Rust
#[macro_use]
|
|
pub(crate) mod macros;
|
|
|
|
pub(crate) mod args;
|
|
pub(crate) mod autoview;
|
|
pub(crate) mod cd;
|
|
pub(crate) mod classified;
|
|
pub(crate) mod clip;
|
|
pub(crate) mod command;
|
|
pub(crate) mod config;
|
|
pub(crate) mod cp;
|
|
pub(crate) mod date;
|
|
pub(crate) mod debug;
|
|
pub(crate) mod echo;
|
|
pub(crate) mod enter;
|
|
pub(crate) mod env;
|
|
pub(crate) mod exit;
|
|
pub(crate) mod fetch;
|
|
pub(crate) mod first;
|
|
pub(crate) mod from_bson;
|
|
pub(crate) mod from_csv;
|
|
pub(crate) mod from_ini;
|
|
pub(crate) mod from_json;
|
|
pub(crate) mod from_sqlite;
|
|
pub(crate) mod from_toml;
|
|
pub(crate) mod from_tsv;
|
|
pub(crate) mod from_url;
|
|
pub(crate) mod from_xml;
|
|
pub(crate) mod from_yaml;
|
|
pub(crate) mod get;
|
|
pub(crate) mod help;
|
|
pub(crate) mod last;
|
|
pub(crate) mod lines;
|
|
pub(crate) mod ls;
|
|
pub(crate) mod mkdir;
|
|
pub(crate) mod mv;
|
|
pub(crate) mod next;
|
|
pub(crate) mod nth;
|
|
pub(crate) mod open;
|
|
pub(crate) mod pick;
|
|
pub(crate) mod pivot;
|
|
pub(crate) mod plugin;
|
|
pub(crate) mod post;
|
|
pub(crate) mod prev;
|
|
pub(crate) mod pwd;
|
|
pub(crate) mod reject;
|
|
pub(crate) mod reverse;
|
|
pub(crate) mod rm;
|
|
pub(crate) mod save;
|
|
pub(crate) mod shells;
|
|
pub(crate) mod size;
|
|
pub(crate) mod skip_while;
|
|
pub(crate) mod sort_by;
|
|
pub(crate) mod split_column;
|
|
pub(crate) mod split_row;
|
|
pub(crate) mod table;
|
|
pub(crate) mod tags;
|
|
pub(crate) mod to_bson;
|
|
pub(crate) mod to_csv;
|
|
pub(crate) mod to_json;
|
|
pub(crate) mod to_sqlite;
|
|
pub(crate) mod to_toml;
|
|
pub(crate) mod to_tsv;
|
|
pub(crate) mod to_url;
|
|
pub(crate) mod to_yaml;
|
|
pub(crate) mod trim;
|
|
pub(crate) mod version;
|
|
pub(crate) mod where_;
|
|
pub(crate) mod which_;
|
|
|
|
pub(crate) use autoview::Autoview;
|
|
pub(crate) use cd::CD;
|
|
pub(crate) use command::{
|
|
per_item_command, whole_stream_command, Command, PerItemCommand, RawCommandArgs,
|
|
UnevaluatedCallInfo, WholeStreamCommand,
|
|
};
|
|
|
|
pub(crate) use classified::ClassifiedCommand;
|
|
pub(crate) use config::Config;
|
|
pub(crate) use cp::Cpy;
|
|
pub(crate) use date::Date;
|
|
pub(crate) use debug::Debug;
|
|
pub(crate) use echo::Echo;
|
|
pub(crate) use enter::Enter;
|
|
pub(crate) use env::Env;
|
|
pub(crate) use exit::Exit;
|
|
pub(crate) use fetch::Fetch;
|
|
pub(crate) use first::First;
|
|
pub(crate) use from_bson::FromBSON;
|
|
pub(crate) use from_csv::FromCSV;
|
|
pub(crate) use from_ini::FromINI;
|
|
pub(crate) use from_json::FromJSON;
|
|
pub(crate) use from_sqlite::FromDB;
|
|
pub(crate) use from_sqlite::FromSQLite;
|
|
pub(crate) use from_toml::FromTOML;
|
|
pub(crate) use from_tsv::FromTSV;
|
|
pub(crate) use from_url::FromURL;
|
|
pub(crate) use from_xml::FromXML;
|
|
pub(crate) use from_yaml::FromYAML;
|
|
pub(crate) use from_yaml::FromYML;
|
|
pub(crate) use get::Get;
|
|
pub(crate) use help::Help;
|
|
pub(crate) use last::Last;
|
|
pub(crate) use lines::Lines;
|
|
pub(crate) use ls::LS;
|
|
pub(crate) use mkdir::Mkdir;
|
|
pub(crate) use mv::Move;
|
|
pub(crate) use next::Next;
|
|
pub(crate) use nth::Nth;
|
|
pub(crate) use open::Open;
|
|
pub(crate) use pick::Pick;
|
|
pub(crate) use pivot::Pivot;
|
|
pub(crate) use post::Post;
|
|
pub(crate) use prev::Previous;
|
|
pub(crate) use pwd::PWD;
|
|
pub(crate) use reject::Reject;
|
|
pub(crate) use reverse::Reverse;
|
|
pub(crate) use rm::Remove;
|
|
pub(crate) use save::Save;
|
|
pub(crate) use shells::Shells;
|
|
pub(crate) use size::Size;
|
|
pub(crate) use skip_while::SkipWhile;
|
|
pub(crate) use sort_by::SortBy;
|
|
pub(crate) use split_column::SplitColumn;
|
|
pub(crate) use split_row::SplitRow;
|
|
pub(crate) use table::Table;
|
|
pub(crate) use tags::Tags;
|
|
pub(crate) use to_bson::ToBSON;
|
|
pub(crate) use to_csv::ToCSV;
|
|
pub(crate) use to_json::ToJSON;
|
|
pub(crate) use to_sqlite::ToDB;
|
|
pub(crate) use to_sqlite::ToSQLite;
|
|
pub(crate) use to_toml::ToTOML;
|
|
pub(crate) use to_tsv::ToTSV;
|
|
pub(crate) use to_url::ToURL;
|
|
pub(crate) use to_yaml::ToYAML;
|
|
pub(crate) use trim::Trim;
|
|
pub(crate) use version::Version;
|
|
pub(crate) use where_::Where;
|
|
pub(crate) use which_::Which;
|