Stefan Holderbach 3a82c6c88d Fix panic in unit parsing with non-UTF8 code (#16355) ...

# Description
Trying to parse non-UTF8 data as a value with unit (part of every
literal parse) introduced a replacement character which shifted the span
information so the indices where incorrect and triggered
a panic.

This has been resolved by removing a bad `String::from_utf8_lossy`

# User-Facing Changes
One less possible panic

# Tests + Formatting
Added a test with the original reproducer from fuzzing:

File with `0\xffB` where the `\xff` represents the non utf-8 char `FF`
run as a script to trigger

2025-08-05 22:08:33 +02:00

..

test_lex.rs

Rust 1.85, edition=2024 (#15741)

2025-05-13 16:49:30 +02:00

test_parser_unicode_escapes.rs

IO and redirection overhaul (#11934)

2024-03-14 15:51:55 -05:00

test_parser.rs

Fix panic in unit parsing with non-UTF8 code (#16355)

2025-08-05 22:08:33 +02:00