deblobbify, replacing the system folder with several other components #72

robertkirkman · 2025-01-12T16:11:22Z

Solution to:

Summary of changes:

Deletes the entire system folder and replaces it with a script generate.sh that can regenerate the entire system folder.
The root filesystem, including system folder, is regenerated using purely a Termux bootstrap .zip, and .deb files that can be built using the termux-packages build and CD system, then retrieved from the termux.dev package host.
Adds an environment variable $TERM that is set to a value of "xterm" for the clear command to have convenient compatibility with most terminal emulators, and this has also been tested with Kitty and TTY.
Simplifies the instances of the string "com.termux" into a single instance for slightly more convenient use with custom bootstraps.
Fixes the existing docker.io/termux/termux-docker:aarch64 image not working on aarch64 devices that happen to have an esoteric "Cortex-A34"-type or similar processor due to the elimination of this 32-bit ARM binary blob, which Cortex-A34-like processors (including those in Apple Silicon devices) do not have hardware support for executing, unlike "Cortex-A72"-like processors.
Replaces Busybox with a real build of Toybox based on the source code of AOSP 9.0.0 that has been patched to meet the requirements of termux-docker, including providing su to log in as the system user within entrypoint.sh.
Uses mksh and bash alone to implement sh, instead of Busybox's sh.
Uses a build of iputils based on the source code of AOSP 9.0.0 to implement /system/bin/ping and /system/bin/ping6.
Uses the preexisting termux-packages root/dnsmasq to implement dnsmasq, which works after some adjustments to its invocations.
Adds libandroid-stub, which is described in multiple places as intended specifically for use with termux-docker.
- I have confirmed that it indeed makes ffmpeg work inside termux-docker, fixing this error: linker: CANNOT LINK EXECUTABLE "ffmpeg": library "libandroid.so" not found
- in its build.sh
- xtkoba believed that libandroid-stub should be preinstalled in termux-docker
Deletes /system/etc/ld.config.28.txt without replacing it with anything, since it does not appear to be necessary for anything in any test so far, but it could be easily re-added if it turns out that there is something that needs it.
- I think that ld.config.28.txt is probably only necessary on ROMs that have a /vendor folder and stuff inside ("VNDK"), termux-docker does not have a /vendor folder or support anything related to that so, for now it seems unnecessary
Adds a third method of working around the personality() system call permissions issue, a custom build of Docker, which is not required on all ARM devices, but which might be required sometimes, and is required on my armv7l device that the --privileged and --security-opt arguments both failed to work on.
Replaces the use of QEMU in GitHub Actions with the new official public GitHub ARM runner.
Enables updating the termux packages within the container before publishing the ARM images.
Changes latest tag to x86_64 instead of i686.
- requested by Ted and Biswa96
Refactors entrypoint_root.sh and entrypoint.sh to have more similar guard clause structure to each other, for readability.
Adds termux-pacman support

Tested both locally and in GitHub Actions:

aarch64: working
x86_64: working
arm: working, but in some (not all) cases, the custom build of Docker with modified personality() system call permissions is required. It is unknown how to predict whether a device will require that or not, but it is suspected it might have something to do with the host kernel, which is a factor whose properties it is understood tend to vary dramatically between different ARM devices.
i686: working

~~The "temporary" things like the temporary-package-storage folder and the blobs inside are only necessary for testing while this is not merged~~ done:

bionic-host: rename to aosp-libs, bump to 9.0.0-r76, add aosp-utils subpackage, revbump revdeps termux-packages#22906

The large amount of changes to the internal components of termux-docker could introduce unpredictable bugs or unexpected behavior that is not present with the current official termux-docker. For that reason, I hope to learn all of the current intended use cases that termux-docker is officially supposed to be used for, so that I can test my implementation with them and add additional software or fixes if needed.

Known Unique Limitations:

For some reason, the -c argument of toybox-su is currently non-functional. For the current featureset of termux-docker, both before and after this PR, that does not seem to be a major priority because termux-docker currently only supports the root user via the entrypoint_root.sh and not via su or tsu from within the default entrypoint.sh, i.e. most termux-packages root-packages cannot currently be conveniently tested using termux-docker anyway. If "proper simulation of a rooted device", so to speak, is desirable in the future, to facilitate more convenient testing of root-packages, if ever necessary, that could be investigated and handled by a different issue+PR at a later date.

PoC dependencies that would hypothetically be very helpful and idiomatic for termux/termux-docker#72

twaik · 2025-01-12T16:21:28Z

modifying the termux-packages bionic-host package is not acceptable

Nobody said it is not acceptable. I think nobody tried it.
I created the package as a solution for running android executables during regular building with toolchain to avoid using hostbuild step, but for some reason qemu does not want to run fine with aarch64 executables on amd64 host, at least in some cases.
Also it fits fine for using in termux-docker but it was not modified to use bionic-host package.

…st): 9.0.0-r76 PoC dependencies that would hypothetically be very helpful and idiomatic for termux/termux-docker#72

…st): 9.0.0-r76 Dependencies for termux/termux-docker#72

robertkirkman · 2025-01-22T05:54:42Z

for some reason qemu does not want to run fine with aarch64 executables on amd64 host, at least in some cases

I am not sure exactly what exact scenario you are talking about here, or what error it is you were seeing at the time, if you mean a scenario with a build.sh involving only the regular cross-compiling toolchain, then what I am about to say is probably not relevant,

But just in case knowing this helps you, there is a way to emulate an ARM processor on an x86 device that is very high in emulation accuracy and behaves almost identically to how real ARM devices behave.

When carefully configured, I have never seen qemu-system-aarch64 fail to execute ARM software on an x86 processor, as long as that same ARM software also works on real ARM devices. If I ever see frustrating errors while trying to use user-mode emulation of any kind, qemu-system-aarch64 is my go-to solution for accuracy to the exact behavior of real ARM devices, when I am in a place with only x86 devices and accessing real ARM devices is inconvenient.

Since there are very few good guides on the subject, and almost all other guides skip mentioning lots of necessary steps, leaving everything unexplained and causing most people to feel like qemu-system-aarch64 is much too tedious to consider using on a regular basis, I created this guide that covers every detail of the setup process in a very straightforward, completely explained, and future-proofed way based on the latest UEFI technology, which is also distro-agnostic to both the host and the guest, making it very clear what changes when the guest and host are mixed and matched.

twaik · 2025-01-22T06:03:59Z

I will just link this.
termux/termux-packages#18517 (comment)
I know it is not a simple scenario, but GIR-generated binary used for generating some XMLs for some reason hangs and CI is terminated with timeout after 6 hours so it is a no go for us. It was the very first and the last attempt (my attempt) to use cross-compiled binaries for building (to avoid using host_build step).

robertkirkman · 2025-02-03T12:04:21Z

GIR-generated binary used for generating some XMLs for some reason hangs and CI is terminated with timeout after 6 hours so it is a no go for us

I experimented with some local tests based on qemu-system technology (as opposed to qemu-user technology),

and while it can inherently avoid several of the issues described in that thread, such as the GIR hanging problem, the problems with any other binaries hanging, and the pid_max problem, due to the higher emulation accuracy and environment micromanagement of qemu-system compared to qemu-user,

very unfortunately, it cannot overcome the slowness problem that licy183 explained. Additionally, the higher emulation accuracy of qemu-system comes with a cost that the slowness is even more extreme, causing the build time for multiple things I need to build to go far over the 6 hours limit (my builds were successful locally, but took 16 hours). Even though that technically works for me locally, that makes it not viable for anything in GitHub Actions without also using the 6 hour limit bypass incremental build workaround technique every time.

I think the only efficient possible future plan on this topic, is to make use of termux-docker, or licy183's tur-avd, or another minimal android container, combined both with the new GitHub ARM runners and with the termux-packages clang package, to build some packages with cross compilation disabled and emulation also disabled.

I am already testing the GitHub ARM runner in this PR and it works for example here,
but since TUR has already been building packages in this same codepath using self-hosted ARM runners instead of cloud ARM runners, it is possible that maybe licy183 is already about to or in the process of adding the cloud ARM runners to TUR, which could serve as an example of how to proceed.
They had tested a PR using it a few months ago, but I did not see any other tests of it yet.
If they do not end up adding it soon, I could attempt my own way of adding support for it to the termux-packages repo, but first I need to finish the changes to termux-docker.

I cannot complete the changes to termux-docker without first removing blockers, like fixing the builds of pypy and pypy3 so that the dependency can be merged. Because of that, I think I am currently forced to first use the only workaround possible to force them to build in a single PR with the updated aosp-libs package, the pid_max change, then I could attempt to migrate the ARM builds of pypy and pypy3 to an actual ARM runner workflow some time afterward, after creating it. The pid_max change would remain required for running any 32-bit termux-docker-based workflows anyway, so it could be moved to the termux-docker-based workflow instead at the time that is finished. done

I have tested locally that pypy would build and work using termux-packages clang inside a complete termux-docker ARM system, it is just that there is no workflow set up for that yet. I would prefer waiting to try introducing termux-docker to such a workflow until after it has had the blobs removed.

robertkirkman · 2025-03-07T01:37:58Z

I have managed to encounter a test case where:

normal devices are negatively affected by having libandroid-stub installed
under equivalent conditions within termux-docker, libandroid-stub instead only helps, and the error from the normal device cannot be reproduced

That seems to support the assumption that the long-preexisting libandroid-stub package is probably entirely beneficial inside termux-docker with no anticipated downsides, so it makes sense to preinstall it.

How to reproduce the negative effect of `libandroid-stub` on a normal device

Use pkg install libandroid-stub
Use pkg install mpv
mpv

Result

CANNOT LINK EXECUTABLE "mpv": cannot locate symbol "AImageReader_newWithUsage" referenced by "/system/lib64/libhwui.so"...

How to reproduce the above conditions inside termux-docker and observe no error

Use pkg install libandroid-stub (if not already installed)
Use pkg install mpv
Work around [possibly not a bug] "mpv": library "libOpenSLES.so" not found #70 by installing unofficial package libopensles-standalone as explained in that issue
mpv

Result

mpv 0.39.0 Copyright © 2000-2024 mpv/MPlayer/mplayer2 projects
 built on Feb 26 2025 00:33:35
...

twaik · 2025-03-07T11:51:09Z

About libandroid-stub. Currently we package libandroid.so from NDK, but can we make our own version of libandroid which will dlopen+dlsym regular libandroid.so in the case if it exists and call it's methods and return some error code in the case if symbols are not present or libandroid is not available?

twaik · 2025-03-07T11:52:28Z

I mean in this case we will be able to ship libandroid-stub regardless of having android or docker and it should work fine on devices. But I am not sure about this.

robertkirkman · 2025-03-07T12:44:23Z

I am not sure, because I think I do not have one of the devices that (i assume) has a /system/lib64/libandroid.so, but where the libandroid-stub package is still needed, so I cannot test on that device.

If I can find a device or contact someone who owns such a device that contains a /system/lib64/libandroid.so but which does not work with the ffmpeg package unless libandroid-stub is installed, then maybe I could try to make code until I make it work on termux-docker, and also that device, and also normal devices all at the same time from one package.

Here was one of them [Bug]: OpenCV is not working termux-packages#20334 (comment)

Samsung Galaxy M52

robertkirkman · 2025-07-10T02:13:38Z

It has been a while and generate-bootstraps.sh has not changed yet, so I have decided that it's not really necessary to wait for it to change before applying this PR, because this PR contains its own copies of the https://packages-cf.termux.dev/apt/termux-main/dists/stable/main and https://packages-cf.termux.dev/apt/termux-root/dists/root/stable URLs, so as long as those URLs remain the same, changes to generate-bootstraps.sh will not externally affect this proposed termux-docker version's generate.sh.

robertkirkman · 2025-08-19T11:12:51Z

I am upgrading my use of 32-bit ARM termux-docker from Debian 12 to Debian 13, but in this PR I had already implemented it for Debian 12, which some people might still have, so it seems best not to squash the bump into other commits. This makes it easier for someone to get the Debian 12 version if they need.

Some BSD-based operating systems support Linux Docker images by implementing a `docker` command that has a backend powered by virtualization and an internal virtualized Linux kernel. The result is that all code running inside the container is only exposed to a Linux kernel and is unaware of BSD, but all code running outside the container is directly exposed to the BSD-based environment BSD-based operating systems used to develop this: - MacOS - FreeBSD - OpenBSD It's often hard to find where exactly the `gtar`, `gar`, and `bash`-version-4+ commands are on BSD-based operating systems, so if you see errors related to those, try to find and install the dependencies for your OS and then add them to `$PATH`.

robertkirkman added a commit to robertkirkman/termux-packages that referenced this pull request Jan 12, 2025

addpkg(main/{dnsmasq,iputils,mksh,toybox}-host): 8.0.0-r51

daeb42b

PoC dependencies that would hypothetically be very helpful and idiomatic for termux/termux-docker#72

robertkirkman mentioned this pull request Jan 12, 2025

bionic-host: rename to aosp-libs, bump to 9.0.0-r76, add aosp-utils subpackage, revbump revdeps termux/termux-packages#22906

Merged

robertkirkman changed the title ~~deblobbify~~ deblobbify, replacing the system folder with several other components Jan 21, 2025

robertkirkman changed the title ~~deblobbify, replacing the system folder with several other components~~ deblobbify, replacing the system folder with several other components Jan 21, 2025

robertkirkman force-pushed the deblobbify branch from b8bb468 to 0fd0f02 Compare January 21, 2025 01:20

robertkirkman force-pushed the deblobbify branch 5 times, most recently from 5169f1f to 3b99512 Compare January 21, 2025 12:35

robertkirkman mentioned this pull request Jan 21, 2025

Hostnames fail to resolve #63

Open

robertkirkman added a commit to robertkirkman/termux-packages that referenced this pull request Jan 21, 2025

bump(main/bionic-host),addpkg(main/{boringssl,iputils,mksh,toybox}-ho…

29bc357

…st): 9.0.0-r76 Dependencies for termux/termux-docker#72

robertkirkman force-pushed the deblobbify branch 2 times, most recently from baf1842 to 892023d Compare January 21, 2025 16:37

robertkirkman force-pushed the deblobbify branch 2 times, most recently from e2fabec to b5465ba Compare January 25, 2025 18:28

robertkirkman mentioned this pull request Feb 4, 2025

Failed to start dnsmasq, host name resolution may fail [ macos arm64 ] #68

Open

robertkirkman mentioned this pull request Mar 3, 2025

fix(ci): fixing package cleanup to work with toybox df. termux/termux-packages#23530

Merged

robertkirkman force-pushed the deblobbify branch from b5465ba to 70d77c2 Compare March 4, 2025 09:48

robertkirkman marked this pull request as ready for review March 4, 2025 09:49

robertkirkman force-pushed the deblobbify branch from 70d77c2 to 2dd3f4f Compare March 4, 2025 10:12

robertkirkman force-pushed the deblobbify branch 2 times, most recently from 3ca152c to 1e39090 Compare July 10, 2025 02:05

robertkirkman marked this pull request as ready for review July 10, 2025 02:08

robertkirkman force-pushed the deblobbify branch 3 times, most recently from d5a0fba to 320765e Compare July 12, 2025 16:37

robertkirkman force-pushed the deblobbify branch 4 times, most recently from 7ec9e71 to a566624 Compare August 9, 2025 07:33

robertkirkman force-pushed the deblobbify branch 5 times, most recently from d860fcb to 7dc0a17 Compare August 19, 2025 05:12

robertkirkman added 2 commits August 19, 2025 00:17

deblobbify, replacing the system folder with several other components

121ccb7

implement pacman support

34f5131

robertkirkman force-pushed the deblobbify branch from 7dc0a17 to 05e5d3d Compare August 19, 2025 05:17

robertkirkman mentioned this pull request Aug 19, 2025

Probably it will be a good idea to create installable script for using docker image #69

Open

robertkirkman force-pushed the deblobbify branch from 04953bb to 521f13d Compare August 19, 2025 11:02

robertkirkman added 2 commits August 19, 2025 07:31

bump custom-docker-with-unrestricted-personality.patch to Debian 13

390d673

robertkirkman force-pushed the deblobbify branch from 521f13d to 390d673 Compare August 19, 2025 12:47

robertkirkman mentioned this pull request Aug 28, 2025

[Bug]: Aspell Errors termux/termux-packages#25825

Closed

robertkirkman mentioned this pull request Sep 7, 2025

telegram-desktop: bump to 6.1.2 termux/termux-packages#25995

Merged

robertkirkman mentioned this pull request Sep 27, 2025

[Package]: "Blender" render tool (now that Blender has Vulkan version ported to Arm64) termux/termux-packages#26704

Closed

8 tasks

robertkirkman mentioned this pull request Oct 5, 2025

addpkg(x11/gnucash): 5.13 termux/termux-packages#25962

Merged

robertkirkman mentioned this pull request Oct 27, 2025

Fails to install on Android (Termux) openai/codex#2951

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

deblobbify, replacing the system folder with several other components #72

deblobbify, replacing the system folder with several other components #72

Uh oh!

robertkirkman commented Jan 12, 2025 •

edited

Loading

Uh oh!

twaik commented Jan 12, 2025

Uh oh!

robertkirkman commented Jan 22, 2025 •

edited

Loading

Uh oh!

twaik commented Jan 22, 2025

Uh oh!

robertkirkman commented Feb 3, 2025 •

edited

Loading

Uh oh!

robertkirkman commented Mar 7, 2025

Uh oh!

twaik commented Mar 7, 2025 •

edited

Loading

Uh oh!

twaik commented Mar 7, 2025 •

edited

Loading

Uh oh!

robertkirkman commented Mar 7, 2025

Uh oh!

robertkirkman commented Jul 10, 2025

Uh oh!

robertkirkman commented Aug 19, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

deblobbify, replacing the system folder with several other components #72

Are you sure you want to change the base?

deblobbify, replacing the system folder with several other components #72

Uh oh!

Conversation

robertkirkman commented Jan 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

twaik commented Jan 12, 2025

Uh oh!

robertkirkman commented Jan 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

twaik commented Jan 22, 2025

Uh oh!

robertkirkman commented Feb 3, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

robertkirkman commented Mar 7, 2025

How to reproduce the negative effect of libandroid-stub on a normal device

How to reproduce the above conditions inside termux-docker and observe no error

Uh oh!

twaik commented Mar 7, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

twaik commented Mar 7, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

robertkirkman commented Mar 7, 2025

Uh oh!

robertkirkman commented Jul 10, 2025

Uh oh!

robertkirkman commented Aug 19, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

robertkirkman commented Jan 12, 2025 •

edited

Loading

robertkirkman commented Jan 22, 2025 •

edited

Loading

robertkirkman commented Feb 3, 2025 •

edited

Loading

How to reproduce the negative effect of `libandroid-stub` on a normal device

twaik commented Mar 7, 2025 •

edited

Loading

twaik commented Mar 7, 2025 •

edited

Loading