mpremote cp fails with apostrophe in destination filename
Port, board and/or hardware
Any platform (Windows, Linux, macOS) - affects mpremote tool when copying files with apostrophe (') in the filename.
MicroPython version
- mpremote 1.27.0
- Tested against MicroPython unix port and ESP32
The issue is in mpremote itself, not in MicroPython firmware.
Reproduction
-
Create a test file with an apostrophe in the name:
mkdir unicode_test echo "test" > "unicode_test\O'zbek_Ismoilov.txt" -
Attempt to copy to MicroPython device with the same destination name:
mpremote cp "unicode_test\O'zbek_Ismoilov.txt" ":/O'zbek_Ismoilov.txt" -
Observe the error.
Expected behaviour
mpremote cp should successfully copy files with apostrophes in filenames. The apostrophe should be properly escaped when constructing Python commands to send to the MicroPython REPL.
Observed behaviour
The command fails with a SyntaxError because the apostrophe breaks the Python string literal sent to the REPL.
PS D:\mypython\unicode_mpy> mpremote cp "unicode_test\O'zbek_Ismoilov.txt" ":/O'zbek_Ismoilov.txt"
cp unicode_test\O'zbek_Ismoilov.txt :/O'zbek_Ismoilov.txt
mpremote: Error with transport:
Traceback (most recent call last):
File "<stdin>", line 1
SyntaxError: invalid syntax
Additional Information
mpremote sends filenames to MicroPython's REPL as Python string literals using single quotes. When a filename contains an apostrophe ', it prematurely closes the string:
# What mpremote probably sends:
open('/O'zbek_Ismoilov.txt', 'wb')
# ^ This closes the string prematurely!
# Result is invalid Python syntax
Affected Characters
Any filename containing:
- Single quote / apostrophe:
'(U+0027) - Possibly other quote-like characters that need escaping
Suggested Fix
Properly escape quotes when constructing Python commands to send to the REPL:
Option A: Escape single quotes
# Instead of:
cmd = f"open('{filename}', 'wb')"
# Use:
escaped_filename = filename.replace("\\", "\\\\").replace("'", "\\'")
cmd = f"open('{escaped_filename}', 'wb')"
Option B: Use double quotes for filenames
cmd = f'open("{filename}", "wb")'
# Note: would then need to escape double quotes in filenames
Option C: Use repr() for proper escaping
cmd = f"open({repr(filename)}, 'wb')"
Found via : https://github.com/Josverl/unicode_mpy
Code of Conduct
Yes, I agree
tools/mpremote: Fix "fs cp -r" on Windows.
Currently when using mpremote fs cp -r _manifest : on windows, it does not correctly handle the \ path separator, resulting in things like
cp _manifest\config_def.mpy :_manifest/_manifest\art.mpy
which gets even worse on-device:
os.listdir("/_manifest")
['_manifest\x07rt.mpy', ...]
Changing to a simply '/',join() appears to fix this problem cleanly.