mpy-tool does not properly collect module names for imports
Consider an application that has the following module file:
foo/bar/quux.py
Put an import statement in some other file:
from foo.bar import quux
When freezing the module with mpy-tool.py, the names foo.bar and quux are collected. However:
foo.bar.quuxis not collected, which will be created as a qstr at runtime, becausesys.modulesuses it as a key- neither
foonorbaris collected.barwill be created as a qstr at runtime, because the dict offooneeds to insert it as a key
Of course, if we use relative imports, there's a similar problem: in foo/bar/baz.py, from . import quux should (but can't really know to) also collect foo.bar.quux despite the string not existing anywhere in the file.
I'm not sure if this is something to solve in mpy-tool itself, or whether there should be a separate step that collects symbols in this way. But it seems that using file names to generate both the fully qualified module name and the individual components would be the right thing to do. (that is basically the workaround i'm using: generate all_modules.py that walk the filesystem and convert every py file name to import that.file.name, which collects "that.file.name", and that.file.name which collects "that"", "file" and "name")
Implement modules as singletons Python semantics.
In Python, importing module several times returns same underlying module
object. This also fixes import statement handling for builtin modules.
There're still issues:
- CPython exposes set of loaded modules as sys.modules, we may want to
do that either. - Builtin modules are implicitly imported, which is not really correct.
We should separate registering a (builtin) module and importing a module.
CPython keeps builtin module names in sys.builtin_module_names .