Execution on Asahi Linux fails

[pansen]

Hey there,

this looks like a great tool, thank you.

Just tried to test in Asahi Linux (recent Fedora) on M2 Air. Unfortunately this fails with 0.0.7 (edit: same with 0.0.8).

curl -L https://github.com/monasticacademy/httptap/releases/download/v0.0.7/httptap_linux_x86_64.tar.gz | tar xzf -

./httptap --verbose -- curl -vL google.com
re-execing in a new user namespace...
error re-executing ourselves in a new user namespace: fork/exec /proc/self/exe: invalid argument

[alexflint]

Interesting. I'm guessing it's because Asahi Linux has a different /proc namespace. This is ultimately distro-specific, so this is good to know about. I don't have a running version of Asahi Linux. If you have a second, would you check whether there is a /proc dir at all? If there is, is there a /proc/self dir? If there is, what's in there? A dump of ls -la /proc/self/ would be extremely helpful.

[pansen]

Sure thing!

$ sudo ls -la /proc/self
lrwxrwxrwx. 1 root root 0 ene  1  1970 /proc/self -> 8928

This is attached

$ sudo find /proc > proc.txt

proc.txt

This is attached

$ ls -la /proc/self/ > proc_lsla.txt

proc_lsla.txt

[alexflint]

Fascinating. It looks like everything is in place. Could you try running /proc/self/exe on the terminal? FYI if everything is as expected then this will be equivalent to running bash or whatever shell you are using, so will land you in a nested shell.

Maybe there is something weird with overlayfs on Asahi Linux. Could you try

./httptap --no-overlay --verbose -- curl -vL google.com

Finally just to confirm that this is the only issue, would you try the following with sudo?

sudo ./httptap --no-new-user-namespace --verbose -- curl -vL google.com

[pansen]

Please see attached.

a@mbair:~$ echo $$
3900
a@mbair:~$ /proc/self/exe 
a@mbair:~$ echo $$
11450
a@mbair:~$ 
exit
a@mbair:~$ /proc/self/exe $(which env)
/usr/bin/env: /usr/bin/env: cannot execute binary file
a@mbair:~$ sudo /proc/self/exe $(which env)
COLORTERM=truecolor
HOSTNAME=mbair
HISTSIZE=1000
LANGUAGE=en_US
LC_ADDRESS=es_ES.utf8
LC_NAME=es_ES.utf8
LC_MONETARY=es_ES.utf8
XAUTHORITY=/run/user/1000/xauth_fqcvFZ
LC_PAPER=es_ES.utf8
LANG=en_US.utf8
LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;37;41:su=37;41:sg=30;43:ca=00:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.7z=01;31:*.ace=01;31:*.alz=01;31:*.apk=01;31:*.arc=01;31:*.arj=01;31:*.bz=01;31:*.bz2=01;31:*.cab=01;31:*.cpio=01;31:*.crate=01;31:*.deb=01;31:*.drpm=01;31:*.dwm=01;31:*.dz=01;31:*.ear=01;31:*.egg=01;31:*.esd=01;31:*.gz=01;31:*.jar=01;31:*.lha=01;31:*.lrz=01;31:*.lz=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.lzo=01;31:*.pyz=01;31:*.rar=01;31:*.rpm=01;31:*.rz=01;31:*.sar=01;31:*.swm=01;31:*.t7z=01;31:*.tar=01;31:*.taz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tgz=01;31:*.tlz=01;31:*.txz=01;31:*.tz=01;31:*.tzo=01;31:*.tzst=01;31:*.udeb=01;31:*.war=01;31:*.whl=01;31:*.wim=01;31:*.xz=01;31:*.z=01;31:*.zip=01;31:*.zoo=01;31:*.zst=01;31:*.avif=01;35:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.m4a=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.oga=01;36:*.opus=01;36:*.spx=01;36:*.xspf=01;36:*~=00;90:*#=00;90:*.bak=00;90:*.crdownload=00;90:*.dpkg-dist=00;90:*.dpkg-new=00;90:*.dpkg-old=00;90:*.dpkg-tmp=00;90:*.old=00;90:*.orig=00;90:*.part=00;90:*.rej=00;90:*.rpmnew=00;90:*.rpmorig=00;90:*.rpmsave=00;90:*.swp=00;90:*.tmp=00;90:*.ucf-dist=00;90:*.ucf-new=00;90:*.ucf-old=00;90:
TERM=xterm-256color
LC_IDENTIFICATION=es_ES.utf8
DISPLAY=:0
LC_TELEPHONE=es_ES.utf8
LC_MEASUREMENT=es_ES.utf8
LC_TIME=es_ES.utf8
MAIL=/var/spool/mail/a
LC_NUMERIC=es_ES.utf8
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin
LOGNAME=root
USER=root
HOME=/root
SHELL=/bin/bash
SUDO_COMMAND=/usr/bin/env
SUDO_USER=root
SUDO_UID=0
SUDO_GID=0
a@mbair:~$ sudo ./httptap --no-new-user-namespace --verbose -- curl -vL google.com
[sudo] password for a: 
running assuming we are in a user namespace...
created /tmp/4040912799/ca-certificates.crt
created /tmp/4040912799/ca-bundle.crt
created /tmp/4040912799/ca-certificates.pkcs12
SIGSEGV: segmentation violation
PC=0x4312ee m=2 sigcode=1 addr=0xffffffff5c0d4690

goroutine 0 gp=0xc0000068c0 m=2 mp=0xc000078708 [idle]:
runtime.netpoll(0xc000050000?)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/netpoll_epoll.go:166 +0x24e fp=0xc000097db8 sp=0xc000097730 pc=0x4312ee
runtime.findRunnable()
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:3581 +0x8c5 fp=0xc000097f30 sp=0xc000097db8 pc=0x43dec5
runtime.schedule()
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:3996 +0xb1 fp=0xc000097f68 sp=0xc000097f30 pc=0x43f431
runtime.park_m(0xc00009c700)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:4103 +0x1eb fp=0xc000097fc0 sp=0xc000097f68 pc=0x43f84b
runtime.mcall()
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/asm_amd64.s:459 +0x4e fp=0xc000097fd8 sp=0xc000097fc0 pc=0x471d0e

goroutine 1 gp=0xc0000061c0 m=nil [runnable, locked to thread]:
runtime.asyncPreempt2()
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/preempt.go:308 +0x39 fp=0xc00039a3b8 sp=0xc00039a398 pc=0x4367b9
runtime.asyncPreempt()
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/preempt_amd64.s:53 +0xdb fp=0xc00039a540 sp=0xc00039a3b8 pc=0x47511b
github.com/vishvananda/netlink/nl.(*RtAttr).Len(0xc00039a5b0)
        /home/runner/go/pkg/mod/github.com/vishvananda/netlink@v1.3.0/nl/nl_linux.go:407 +0xa fp=0xc00039a548 sp=0xc00039a540 pc=0x7ccdca
github.com/vishvananda/netlink/nl.(*RtAttr).Serialize(0xc000050440)
        /home/runner/go/pkg/mod/github.com/vishvananda/netlink@v1.3.0/nl/nl_linux.go:425 +0xbb fp=0xc00039a5d0 sp=0xc00039a548 pc=0x7ccf3b
github.com/vishvananda/netlink/nl.(*NetlinkRequest).Serialize(0xc00039a970)
        /home/runner/go/pkg/mod/github.com/vishvananda/netlink@v1.3.0/nl/nl_linux.go:460 +0x94 fp=0xc00039a628 sp=0xc00039a5d0 pc=0x7cd234
github.com/vishvananda/netlink/nl.(*NetlinkSocket).Send(0xc0001932c0, 0x47511b?)
        /home/runner/go/pkg/mod/github.com/vishvananda/netlink@v1.3.0/nl/nl_linux.go:806 +0x1b fp=0xc00039a670 sp=0xc00039a628 pc=0x7ce23b
github.com/vishvananda/netlink/nl.(*NetlinkRequest).ExecuteIter(0xc00039a970, 0x0?, 0x0, 0xc00039a820)
        /home/runner/go/pkg/mod/github.com/vishvananda/netlink@v1.3.0/nl/nl_linux.go:553 +0x253 fp=0xc00039a7e8 sp=0xc00039a670 pc=0x7cd7b3
github.com/vishvananda/netlink/nl.(*NetlinkRequest).Execute(0x0?, 0x4?, 0x20?)
        /home/runner/go/pkg/mod/github.com/vishvananda/netlink@v1.3.0/nl/nl_linux.go:497 +0x3d fp=0xc00039a840 sp=0xc00039a7e8 pc=0x7cd3fd
github.com/vishvananda/netlink.execGetLink(0xc0001ca1c0?)
        /home/runner/go/pkg/mod/github.com/vishvananda/netlink@v1.3.0/link_linux.go:1934 +0x1b fp=0xc00039a888 sp=0xc00039a840 pc=0x7d181b
github.com/vishvananda/netlink.(*Handle).LinkByName(0xf11ea0, {0x944efb, 0x7})
        /home/runner/go/pkg/mod/github.com/vishvananda/netlink@v1.3.0/link_linux.go:1869 +0x4a5 fp=0xc00039a9d0 sp=0xc00039a888 pc=0x7d16a5
github.com/vishvananda/netlink.LinkByName(...)
        /home/runner/go/pkg/mod/github.com/vishvananda/netlink@v1.3.0/link_linux.go:1846
main.Main()
        /home/runner/work/httptap/httptap/httptap.go:303 +0xe85 fp=0xc00039bf18 sp=0xc00039a9d0 pc=0x8db0c5
main.main()
        /home/runner/work/httptap/httptap/httptap.go:823 +0x3a fp=0xc00039bf50 sp=0xc00039bf18 pc=0x8dfeba
runtime.main()
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:272 +0x28b fp=0xc00039bfe0 sp=0xc00039bf50 pc=0x437c2b
runtime.goexit({})
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00039bfe8 sp=0xc00039bfe0 pc=0x473bc1

goroutine 17 gp=0xc00009c380 m=nil [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:424 +0xce fp=0xc00006e7a8 sp=0xc00006e788 pc=0x46bfce
runtime.goparkunlock(...)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:430
runtime.forcegchelper()
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:337 +0xb3 fp=0xc00006e7e0 sp=0xc00006e7a8 pc=0x437f73
runtime.goexit({})
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00006e7e8 sp=0xc00006e7e0 pc=0x473bc1
created by runtime.init.7 in goroutine 1
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:325 +0x1a

goroutine 18 gp=0xc00009c540 m=nil [GC sweep wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:424 +0xce fp=0xc00006ef80 sp=0xc00006ef60 pc=0x46bfce
runtime.goparkunlock(...)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:430
runtime.bgsweep(0xc0000aa000)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/mgcsweep.go:277 +0x94 fp=0xc00006efc8 sp=0xc00006ef80 pc=0x422874
runtime.gcenable.gowrap1()
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/mgc.go:204 +0x25 fp=0xc00006efe0 sp=0xc00006efc8 pc=0x416f85
runtime.goexit({})
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00006efe8 sp=0xc00006efe0 pc=0x473bc1
created by runtime.gcenable in goroutine 1
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/mgc.go:204 +0x66

goroutine 19 gp=0xc00009c700 m=nil [GC scavenge wait]:
runtime.gopark(0xc0000aa000?, 0xb24be0?, 0x1?, 0x0?, 0xc00009c700?)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:424 +0xce fp=0xc00006f778 sp=0xc00006f758 pc=0x46bfce
runtime.goparkunlock(...)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:430
runtime.(*scavengerState).park(0xf12f00)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc00006f7a8 sp=0xc00006f778 pc=0x4202a9
runtime.bgscavenge(0xc0000aa000)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/mgcscavenge.go:653 +0x3c fp=0xc00006f7c8 sp=0xc00006f7a8 pc=0x42081c
runtime.gcenable.gowrap2()
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/mgc.go:205 +0x25 fp=0xc00006f7e0 sp=0xc00006f7c8 pc=0x416f25
runtime.goexit({})
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00006f7e8 sp=0xc00006f7e0 pc=0x473bc1
created by runtime.gcenable in goroutine 1
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/mgc.go:205 +0xa5

goroutine 2 gp=0xc000006e00 m=nil [finalizer wait]:
runtime.gopark(0x490013?, 0xc000072660?, 0x1e?, 0xd2?, 0xffff5cd8fe08?)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:424 +0xce fp=0xc000072620 sp=0xc000072600 pc=0x46bfce
runtime.runfinq()
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/mfinal.go:193 +0x107 fp=0xc0000727e0 sp=0xc000072620 pc=0x416007
runtime.goexit({})
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000727e8 sp=0xc0000727e0 pc=0x473bc1
created by runtime.createfing in goroutine 1
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/mfinal.go:163 +0x3d

goroutine 33 gp=0xc000150000 m=nil [chan receive]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:424 +0xce fp=0xc000156718 sp=0xc0001566f8 pc=0x46bfce
runtime.chanrecv(0xc00014e000, 0x0, 0x1)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/chan.go:639 +0x41c fp=0xc000156790 sp=0xc000156718 pc=0x406c9c
runtime.chanrecv1(0x0?, 0x0?)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/chan.go:489 +0x12 fp=0xc0001567b8 sp=0xc000156790 pc=0x406852
runtime.unique_runtime_registerUniqueMapCleanup.func1(...)
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/mgc.go:1781
runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/mgc.go:1784 +0x2f fp=0xc0001567e0 sp=0xc0001567b8 pc=0x419faf
runtime.goexit({})
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0001567e8 sp=0xc0001567e0 pc=0x473bc1
created by unique.runtime_registerUniqueMapCleanup in goroutine 1
        /opt/hostedtoolcache/go/1.23.5/x64/src/runtime/mgc.go:1779 +0x96

rax    0x1
rbx    0x0
rcx    0x0
rdx    0xdf83edbf3
rdi    0x145e258
rsi    0xffffffff5c0d4680
rbp    0xc000097da8
rsp    0xc000097730
r8     0x77
r9     0x72
r10    0x1
r11    0x0
r12    0xc0000977b0
r13    0x1
r14    0xc0000068c0
r15    0x3
rip    0x4312ee
rflags 0x202
cs     0x33
fs     0x0
gs     0x0

[pansen]

Surprisingly the test goal works. :|

$ make test-with-curl-monasticacademy
rm -rf out
go run . -- bash -c "curl -sL http://monasticacademy.org > out"
---> GET http://monasticacademy.org/
<--- 308 http://monasticacademy.org/ (14 bytes)
---> GET https://monasticacademy.org/
<--- 308 https://monasticacademy.org/ (15 bytes)
---> GET https://www.monasticacademy.org/
<--- 200 https://www.monasticacademy.org/ (34135 bytes)

[alexflint]

I bet the issue here is that there is some difference between the code you downloaded from the httptap release tarball, and the code that gets built when you do "go run .", which is what's happening when you run the test goal. Most likely the Go installation on your machine is configured in some way to build code in a way that works properly on Asahi linux, whereas the release tarball from github was built with some kind of different config.

What happens if you run go build inside the httptap directory, and then run ./httptap -Lso /dev/null -- curl http://monasticacademy.org?

Can you post here the output of go env?

Thanks again for your help with debugging this - it's v helpful to track all these issues down.

[alexflint]

Hey @pansen what do you see as the output of uname -m? This may be as simple as installing the arm64 version rather than the x86_64 version. Try this:

curl -L https://github.com/monasticacademy/httptap/releases/latest/download/httptap_linux_$(uname -m).tar.gz | tar xzf -

I've put this install command in the main README for the repo now.