Merge branch 'introduce-arena-library-and-runtime' Emil Tsalapatis says: ==================== Introduce arena library and runtime Add a new subdirectory to tools/testing/selftests/bpf called libarena, along with programs useful for writing arena-based BPF code. This patchset adds the following: 1) libarena, a subdirectory where arena BPF code that is generally useful to BPF arena programs can be easily added and tested. 2) An ASAN runtime for BPF arena programs. BPF arenas allow for accessing memory after it has been freed or if it is out of bounds, making it more difficult to triage bugs combined to regular BPF. Use LLVM's recently added support for address-space based sanitization to selectively sanitize just the arena accesses. 3) A buddy memory allocator that can be reused by BPF programs to handle memory allocation/deletion. The allocator uses the ASAN runtime to add address sanitization if requested. The patch includes testing for the new allocators and ASAN features that can be built from the top directory using "make libarena_test" and "make libarena_test_asan". The generated binaries reside in libarena/. The patch also adds test-progs-based selftests to the codebase for the libarena code, so the new tests are run by ./test_progs. The patchset has the following stucture: 1-3: Create basic libarena scaffolding and refactor existing headers. 4-5: Add the ASAN runtime and associated scaffolding. 6-8: Add the new buddy memory allocator along with selftests. Signed-off-by: Emil Tsalapatis <emil@etsalapatis.com> HISTORY ======= v8->v9 (https://lore.kernel.org/bpf/20260421165037.4736-1-emil@etsalapatis.com) - Added Matt's Acked-by for Patch 1 - Replaced open coded fls with __builtin based calculation (Matt) - Add comment explaining the reasoning behind the zero variable (Matt) - Remove the self-contained runner and present selftests as examples (Kumar). The reasoning is that including selftests with the library is not effective because the library will be sync'ed outside the tree infrequently, so it would be ineffective in catching issues before they land. - Adjust syscall API for clarity and forward compatibility (Matt) - Reset asan_validate state after failed check (Sashiko) - Fix printf format specifier (Sashiko) - Rename syscall to be generic arena_info (Matt) - Namespace libarena headers by moving them to their own directory - Rename selftest_helpers to libarena/userspace.h to reflect it is not just for selftests. v7->v8 (https://lore.kernel.org/bpf/20260412174546.18684-1-emil@etsalapatis.com) - Duplicate READ_ONCE/WRITE_ONCE instead of moving it to bpf_experimental.h to keep libarena self-contained (Kumar) - Add libarena_asan test to test_progs and conditionally compile it if suppported (Kumar) - Add stderr parsing for buddy tests when run under test_progs (Kumar) - Move all arena-related headers into libarena and add its include/ subdirectory in the standard include path (Kumar) - Remove silent-by-default ASAN, add help message on test_libarena explaining that -v emits the messages (Kumar) - Add run_prog_args as a libarena helper - Add explanation on the use of __weak for the spinlock qnodes v6->v7 (https://lore.kernel.org/bpf/20260412011857.3387-1-emil@etsalapatis.com) - Modify patch 1 to allow operations between PTR_TO_ARENA src_reg and dst_reg of any type. Adjust selftests accordingly (Alexei) - Remove unnecessary include in patch 5 (Song) - Removed unused definitions/assignments in patches 8/9, update patch descriptions v5->v6 (https://lore.kernel.org/bpf/20260410163041.8063-1-emil@etsalapatis.com) - Fix subreg_def management for SCALAR += PTR_TO_ARENA operations (AI) - Add more selftests for the SCALAR += PTR_TO_ARENA patch (Sashiko) - Adjust fls() operation to be in line with the kernel version (Sashiko) - Address Sashiko selftests and debugging nits - Add ASAN loadN and storeN _noabort variants and associated BTF anchor - Remove unnecessary bit freeing of buddies during block splitting v4->v5 (https://lore.kernel.org/bpf/20260407045730.13359-1-emil@etsalapatis.com) Omitting various nits and fixups. - Properly adjust subreg_def for scalar += ptr_to_arena calls (Sashiko) - Remove extraneous definition from prog_tests/arena_spin_lock.c (Song) - Trim extraneous comments from ASAN and buddy (Alexei) - Remove asan_dummy call and replace with function pointer array (Alexei) - Remove usersapi.h header and merge it into common.h (Alexei) - Replace ASAN macros with function calls (Alexei) - Embed buddy lock into the struct and move the buddy allocator to __arena_global (Alexei) - Add commenting for buddy allocator constants (Alexei) - Add default buddy allocator directly in common.bpf.c, so that the user does not need to define it. - Expand test harnesses to dynamically find individual selftests. Now the selftests also reports each test individually (e.g., 5 entries for the buddy allocator instead of 1). This brings them to par with the rest of the test_progs. v3->v4 (https://lore.kernel.org/bpf/20260403042720.18862-1-emil@etsalapatis.com) - Add Acks by Song to patches 1-4. - Expand the verifier's handling of scalar/arena operations to include all 3-operand operations in Patch 1 (Alexei) - Add additional tests for arena/arena (allowed) and arena/pointer (not allowed) operations in Patch 2 - Remove ASAN version of the library from default compilation since it requires LLVM 22 and up (CI) - Rework buddy allocator locking for clarity and add comments - Fix From: email to be consistent with SOB - Address (most) Sashiko comments v2->v3 (https://lore.kernel.org/bpf/20260127181610.86376-1-emil@etsalapatis.com) Nonexhaustive due to significant patch rework. - Do not duplicate WRITE_ONCE macro (Mykyta, Kumar) - Add SPDX headers (Alexei) - Remove bump/stack allocators (Alexei) - Integrate testing with test_progs (Kumar) - Add short description of ASAN algorithm at the top of the file (Alexei) v1->v2 (https://lore.kernel.org/bpf/20260122160131.2238331-1-etsal@meta.com/) - Added missing format string argument (AI) - Fix outdated selftests prog name check (AI) - Fixed stack allocation check for segment creation (AI) - Fix errors in non-ASAN bump allocator selftests (AI) - Propagate error value from individual selftests in selftest.c - Removed embedded metadata from bump allocator as it was needlessly complicating its behavior ==================== Link: https://patch.msgid.link/20260426190338.4615-1-emil@etsalapatis.com Signed-off-by: Alexei Starovoitov <ast@kernel.org>