A new type of shell
Go to file
Amin Yahyaabadi 260ff99710
feat: spawn the executables directly if possible (#3974)
* feat: spawn the executables directly if possible

This pull request changes nu-command so that it spawns the process directly if:
- They are a `.exe` on Windows
- They are not a `.sh` or `.bash` on not windows.

Benefits:
- As I explained in [this comment](https://github.com/nushell/nushell/issues/3898#issuecomment-894000812), this is another step towards making Nushell a standalone shell, that doesn't need to shell out unless it is running a script for a particular shell (cmd, sh, ps1, etc.).
- Fixes the bug with multiline strings
- Better performance due to direct spawning.

For example, this script shows ~20 ms less latency.
After:
```nu
C:\> benchmark { node -e 'console.log("sssss")' }
───┬──────────────────
 # │    real time
───┼──────────────────
 0 │ 63ms 921us 600ns
───┴──────────────────
```
Before
```nu
C:\> benchmark { node -e 'console.log("sssss")' }
───┬──────────────────
 # │    real time
───┼──────────────────
 0 │ 79ms 136us 800ns
───┴──────────────────
```

Fixes #3898

* fix: make which dependency optional

Also fixes clippy warnings

* refactor: refactor spawn_exe, spawn_cmd, spawn_sh, and spawn_any

* fix: use which feature instead of which-support

* fix: use which_in to use the cwd of nu

* fix: use case insensitive comparison of the extensions

Sometimes the case of the extension is uppercased by the "which_in" function

Also use unix instead of not windows. Some os might not have sh support
2021-09-01 09:38:52 -05:00
.azure Fix clippy lint and disable broken lint (#3865) 2021-07-30 08:11:47 +12:00
.cargo added .cargo/config.toml to build with bigger stack on windows (#2594) 2020-09-24 15:55:33 +12:00
.circleci Update config.yml 2020-08-28 06:02:06 +12:00
.github tweak the version | pivot instructions (#3964) 2021-08-24 19:03:07 -05:00
.theia [Gitpod] Refactor Gitpod configuration and add full Debugging support (#1728) 2020-05-09 05:41:24 +12:00
crates feat: spawn the executables directly if possible (#3974) 2021-09-01 09:38:52 -05:00
debian Transfered Docker to a plugin instead of a Command. 2019-09-24 20:42:18 -07:00
docker Remove it expansion (#2701) 2020-10-26 19:55:52 +13:00
docs bump to 0.36.1 (#3972) 2021-08-27 20:48:58 +12:00
images Delete nushell-demo.svg 2021-01-25 20:35:10 +13:00
pkg_mgrs/winget added pkg_mgr/winget + yaml (#2297) 2020-08-11 05:45:53 +12:00
samples/wasm Update wasm sample gitignore for node_modules. (#3747) 2021-07-07 07:48:32 -05:00
src Move sys, ps, fetch, post to internal commands (#3983) 2021-09-01 14:29:09 +12:00
tests nu-path crate refactor (#3730) 2021-08-28 15:59:09 +03:00
wix Move sys, ps, fetch, post to internal commands (#3983) 2021-09-01 14:29:09 +12:00
.dockerignore Move most of the root package into a subcrate. (#1445) 2020-03-04 13:58:20 -05:00
.editorconfig Build and publish docker img along with nu plugins 2019-09-08 21:38:25 +07:00
.gitignore Changes to allow plugins to be loaded in a multi-threaded manner (#1694) 2020-05-05 06:15:24 +12:00
.gitpod.Dockerfile Fix Gitpod dev setup by forcing a dev image rebuild (#2783) 2020-12-09 06:44:23 +13:00
.gitpod.yml [Gitpod] Don't test removed feature 'test-bins' (#2948) 2021-01-19 22:43:42 +13:00
Cargo.lock Move sys, ps, fetch, post to internal commands (#3983) 2021-09-01 14:29:09 +12:00
Cargo.toml Move sys, ps, fetch, post to internal commands (#3983) 2021-09-01 14:29:09 +12:00
CODE_OF_CONDUCT.md First pass at updating all documentation formatting and cleaning up output of examples (#2031) 2020-06-24 06:21:47 +12:00
CONTRIBUTING.md Update contributor-book url (#3198) 2021-03-20 23:09:17 +13:00
extra_features_cargo_install.sh Shellcheck (#3635) 2021-06-17 14:09:08 +12:00
LICENSE Update LICENSE 2021-05-13 07:44:36 +12:00
Makefile.toml --no-edit 2019-11-21 14:22:32 -08:00
README.build.txt Create README.build.txt 2020-10-14 07:14:47 +13:00
README.md Update README.md 2021-08-05 07:35:22 -05:00
rustfmt.toml Data flows across commands via streams now 2019-05-23 00:23:06 -07:00

README

Crates.io Build Status Discord The Changelog #363 @nu_shell GitHub commit activity GitHub contributors

Nushell

A new type of shell.

Example of nushell

Status

This project has reached a minimum-viable product level of quality. While contributors dogfood it as their daily driver, it may be unstable for some commands. Future releases will work to fill out missing features and improve stability. Its design is also subject to change as it matures.

Nu comes with a set of built-in commands (listed below). If a command is unknown, the command will shell-out and execute it (using cmd on Windows or bash on Linux and macOS), correctly passing through stdin, stdout, and stderr, so things like your daily git workflows and even vim will work just fine.

Learning more

There are a few good resources to learn about Nu. There is a book about Nu that is currently in progress. The book focuses on using Nu and its core concepts.

If you're a developer who would like to contribute to Nu, we're also working on a book for developers to help you get started. There are also good first issues to help you dive in.

We also have an active Discord and Twitter if you'd like to come and chat with us.

You can also find information on more specific topics in our cookbook.

Try it in Gitpod.

Open in Gitpod

Installation

Local

Up-to-date installation instructions can be found in the installation chapter of the book. Windows users: please note that Nu works on Windows 10 and does not currently have Windows 7/8.1 support.

To build Nu, you will need to use the latest stable (1.51 or later) version of the compiler.

Required dependencies:

  • pkg-config and libssl (only needed on Linux)
    • On Debian/Ubuntu: apt install pkg-config libssl-dev

Optional dependencies:

  • To use Nu with all possible optional features enabled, you'll also need the following:
    • On Linux (on Debian/Ubuntu): apt install libxcb-composite0-dev libx11-dev

To install Nu via cargo (make sure you have installed rustup and the latest stable compiler via rustup install stable):

cargo install nu

To install Nu via the Windows Package Manager:

winget install nu

You can also build Nu yourself with all the bells and whistles (be sure to have installed the dependencies for your platform), once you have checked out this repo with git:

cargo build --workspace --features=extra

Docker

Quickstart

Want to try Nu right away? Execute the following to get started.

docker run -it quay.io/nushell/nu:latest

Guide

If you want to pull a pre-built container, you can browse tags for the nushell organization on Quay.io. Pulling a container would come down to:

docker pull quay.io/nushell/nu
docker pull quay.io/nushell/nu-base

Both "nu-base" and "nu" provide the nu binary, however, nu-base also includes the source code at /code in the container and all dependencies.

Optionally, you can also build the containers locally using the dockerfiles provided: To build the base image:

docker build -f docker/Dockerfile.nu-base -t nushell/nu-base .

And then to build the smaller container (using a Multistage build):

docker build -f docker/Dockerfile -t nushell/nu .

Either way, you can run either container as follows:

docker run -it nushell/nu-base
docker run -it nushell/nu
/> exit

The second container is a bit smaller if the size is important to you.

Packaging status

Packaging status

Fedora

COPR repo: sudo dnf copr enable atim/nushell -y && sudo dnf install nushell -y

Philosophy

Nu draws inspiration from projects like PowerShell, functional programming languages, and modern CLI tools. Rather than thinking of files and services as raw streams of text, Nu looks at each input as something with structure. For example, when you list the contents of a directory, what you get back is a table of rows, where each row represents an item in that directory. These values can be piped through a series of steps, in a series of commands called a 'pipeline'.

Pipelines

In Unix, it's common to pipe between commands to split up a sophisticated command over multiple steps. Nu takes this a step further and builds heavily on the idea of pipelines. Just as the Unix philosophy, Nu allows commands to output to stdout and read from stdin. Additionally, commands can output structured data (you can think of this as a third kind of stream). Commands that work in the pipeline fit into one of three categories:

  • Commands that produce a stream (e.g., ls)
  • Commands that filter a stream (eg, where type == "Dir")
  • Commands that consume the output of the pipeline (e.g., autoview)

Commands are separated by the pipe symbol (|) to denote a pipeline flowing left to right.

> ls | where type == "Dir" | autoview
───┬────────┬──────┬───────┬──────────────
 # │ name   │ type │ size  │ modified
───┼────────┼──────┼───────┼──────────────
 0 │ assets │ Dir  │ 128 B │ 5 months ago
 1 │ crates │ Dir  │ 704 B │ 50 mins ago
 2 │ debian │ Dir  │ 352 B │ 5 months ago
 3 │ docker │ Dir  │ 288 B │ 3 months ago
 4 │ docs   │ Dir  │ 192 B │ 50 mins ago
 5 │ images │ Dir  │ 160 B │ 5 months ago
 6 │ src    │ Dir  │ 128 B │ 1 day ago
 7 │ target │ Dir  │ 160 B │ 5 days ago
 8 │ tests  │ Dir  │ 192 B │ 3 months ago
───┴────────┴──────┴───────┴──────────────

Because most of the time you'll want to see the output of a pipeline, autoview is assumed. We could have also written the above:

> ls | where type == Dir

Being able to use the same commands and compose them differently is an important philosophy in Nu. For example, we could use the built-in ps command to get a list of the running processes, using the same where as above.

> ps | where cpu > 0
───┬────────┬───────────────────┬──────────┬─────────┬──────────┬──────────
 # │ pid    │ name              │ status   │ cpu     │ mem      │ virtual
───┼────────┼───────────────────┼──────────┼─────────┼──────────┼──────────
 0435 │ irq/142-SYNA327   │ Sleeping │  7.5699 │      0 B │      0 B
 11609 │ pulseaudio        │ Sleeping │  6.5605 │  10.6 MB │   2.3 GB
 21625 │ gnome-shell       │ Sleeping │  6.5684 │ 639.6 MB │   7.3 GB
 32202 │ Web Content       │ Sleeping │  6.8157 │ 320.8 MB │   3.0 GB
 4328788 │ nu_plugin_core_ps │ Sleeping │ 92.5750 │   5.9 MB │ 633.2 MB
───┴────────┴───────────────────┴──────────┴─────────┴──────────┴──────────

Opening files

Nu can load file and URL contents as raw text or structured data (if it recognizes the format). For example, you can load a .toml file as structured data and explore it:

> open Cargo.toml
────────────────────┬───────────────────────────
 bin                │ [table 18 rows]
 build-dependencies │ [row serde toml]
 dependencies       │ [row 29 columns]
 dev-dependencies   │ [row nu-test-support]
 features           │ [row 19 columns]
 package            │ [row 12 columns]
 workspace          │ [row members]
────────────────────┴───────────────────────────

We can pipeline this into a command that gets the contents of one of the columns:

> open Cargo.toml | get package
───────────────┬────────────────────────────────────
 authors       │ [table 1 rows]
 default-run   │ nu
 description   │ A new type of shell
 documentation │ https://www.nushell.sh/book/
 edition       │ 2018
 exclude       │ [table 1 rows]
 homepage      │ https://www.nushell.sh
 license       │ MIT
 name          │ nu
 readme        │ README.md
 repository    │ https://github.com/nushell/nushell
 version       │ 0.32.0
───────────────┴────────────────────────────────────

Finally, we can use commands outside of Nu once we have the data we want:

> open Cargo.toml | get package.version
0.32.0

Configuration

Nu has early support for configuring the shell. You can refer to the book for a list of all supported variables.

To set one of these variables, you can use config set. For example:

> config set line_editor.edit_mode "vi"
> config set path $nu.path

Shells

Nu will work inside of a single directory and allow you to navigate around your filesystem by default. Nu also offers a way of adding additional working directories that you can jump between, allowing you to work in multiple directories simultaneously.

To do so, use the enter command, which will allow you to create a new "shell" and enter it at the specified path. You can toggle between this new shell and the original shell with the p (for previous) and n (for next), allowing you to navigate around a ring buffer of shells. Once you're done with a shell, you can exit it and remove it from the ring buffer.

Finally, to get a list of all the current shells, you can use the shells command.

Plugins

Nu supports plugins that offer additional functionality to the shell and follow the same structured data model that built-in commands use. This allows you to extend nu for your needs.

There are a few examples in the plugins directory.

Plugins are binaries that are available in your path and follow a nu_plugin_* naming convention. These binaries interact with nu via a simple JSON-RPC protocol where the command identifies itself and passes along its configuration, making it available for use. If the plugin is a filter, data streams to it one element at a time, and it can stream data back in return via stdin/stdout. If the plugin is a sink, it is given the full vector of final data and is given free reign over stdin/stdout to use as it pleases.

Goals

Nu adheres closely to a set of goals that make up its design philosophy. As features are added, they are checked against these goals.

  • First and foremost, Nu is cross-platform. Commands and techniques should carry between platforms and offer consistent first-class support for Windows, macOS, and Linux.

  • Nu ensures direct compatibility with existing platform-specific executables that make up people's workflows.

  • Nu's workflow and tools should have the usability in day-to-day experience of using a shell in 2019 (and beyond).

  • Nu views data as both structured and unstructured. It is a structured shell like PowerShell.

  • Finally, Nu views data functionally. Rather than using mutation, pipelines act as a means to load, change, and save data without mutable state.

Commands

You can find a list of Nu commands, complete with documentation, in quick command references.

Progress

Nu is in heavy development and will naturally change as it matures and people use it. The chart below isn't meant to be exhaustive, but rather helps give an idea for some of the areas of development and their relative completion:

Features Not started Prototype MVP Preview Mature Notes
Aliases X Aliases allow for shortening large commands, while passing flags
Notebook X Initial jupyter support, but it loses state and lacks features
File ops X cp, mv, rm, mkdir have some support, but lacking others
Environment X Temporary environment and scoped environment variables
Shells X Basic value and file shells, but no opt-in/opt-out for commands
Protocol X Streaming protocol is serviceable
Plugins X Plugins work on one row at a time, lack batching and expression eval
Errors X Error reporting works, but could use usability polish
Documentation X Book updated to latest release, including usage examples
Paging X Textview has paging, but we'd like paging for tables
Functions X Functions and aliases are supported
Variables X Nu supports variables and environment variables
Completions X Completions for filepaths
Type-checking X Commands check basic types, but input/output isn't checked

Officially Supported By

Please submit an issue or PR to be added to this list.

Integrations

Mentions

Contributing

See Contributing for details.

Thanks to all the people who already contributed!

License

The project is made available under the MIT license. See the LICENSE file for more information.