nushell/crates
Andrew Barnes 91e17d2f9f
Limit mem usage + back-pressure via bounded channels (#4986)
Prior to this change, a pipeline of externals would result in high memory
usage if any of the producers in the chain, produced data faster than
the consumers.

For example a pipeline:

  > fast-producer | slow-consumer

Would cause a build up of `Value::{String,Binary}`'s in the mpsc channels
between each command as values are added to the channels faster than they
are consumed, eventually OOM'ing depnding on system resources, the volume
of data and speed diff. between fast v's slow.

This change replaces the unbounded channels with bounded channels
to limit the number of values that can build up and providing
back-pressure to limit ram usage.
2022-03-27 15:34:34 +13:00
..
nu_plugin_example Bump to 0.60 (#4892) 2022-03-23 07:32:03 +13:00
nu_plugin_gstat Bump to 0.60 (#4892) 2022-03-23 07:32:03 +13:00
nu_plugin_inc Bump to 0.60 (#4892) 2022-03-23 07:32:03 +13:00
nu_plugin_python name change (#526) 2021-12-19 10:00:31 +00:00
nu_plugin_query Bump to 0.60 (#4892) 2022-03-23 07:32:03 +13:00
nu-cli Fix single quote environment values (#4960) 2022-03-26 09:14:48 +13:00
nu-color-config Add licenses (#4893) 2022-03-23 09:25:38 +13:00
nu-command Limit mem usage + back-pressure via bounded channels (#4986) 2022-03-27 15:34:34 +13:00
nu-engine Add parser keyword note to help and $nu.scope (#4978) 2022-03-26 21:22:45 +02:00
nu-glob Termux/Android target support for v0.60.0 (#4956) 2022-03-27 07:21:19 +13:00
nu-json align all of the serde_json crates to the same version (#4949) 2022-03-25 18:54:49 +13:00
nu-parser Improve escaping in string interpolation (#4982) 2022-03-27 12:52:09 +13:00
nu-path Don't include trailing separator when expanding tilde (#4974) 2022-03-27 06:28:31 +13:00
nu-plugin CantConvert improvements (#4926) 2022-03-24 07:04:31 -05:00
nu-pretty-hex Bump to 0.60 (#4892) 2022-03-23 07:32:03 +13:00
nu-protocol Add parser keyword note to help and $nu.scope (#4978) 2022-03-26 21:22:45 +02:00
nu-system Termux/Android target support for v0.60.0 (#4956) 2022-03-27 07:21:19 +13:00
nu-table Bump to 0.60 (#4892) 2022-03-23 07:32:03 +13:00
nu-term-grid Bump to 0.60 (#4892) 2022-03-23 07:32:03 +13:00
nu-test-support Bump to 0.60 (#4892) 2022-03-23 07:32:03 +13:00
nu-utils Bump to 0.60 (#4892) 2022-03-23 07:32:03 +13:00
old Bump to 0.60 (#4892) 2022-03-23 07:32:03 +13:00
README.md Remove old nushell/merge engine-q 2022-02-07 14:54:06 -05:00

Nushell core libraries and plugins

These sub-crates form both the foundation for Nu and a set of plugins which extend Nu with additional functionality.

Foundational libraries are split into two kinds of crates:

  • Core crates - those crates that work together to build the Nushell language engine
  • Support crates - a set of crates that support the engine with additional features like JSON support, ANSI support, and more.

Plugins are likewise also split into two types:

  • Core plugins - plugins that provide part of the default experience of Nu, including access to the system properties, processes, and web-connectivity features.
  • Extra plugins - these plugins run a wide range of different capabilities like working with different file types, charting, viewing binary data, and more.