here's the list of bugs i found:
1. api.xxx.xxx HTTPS and TLS conflicted in the tenant-root's TenantGateway cozystack,
causing cilium-envoy refuses to accept and listen on the port.
i notice this by looking into cilium-envoy logs.
and actually this causes many other side effects, like port 80 failed to open for acme challenge.
2. dashboard.xxx.xxx HTTPRoute .status.parents reports HTTPRoute is not allowed to attach to this Gateway due to namespace selector restrictions,
in fact, the namespace cozy-dashboard already labelled with the expected label: namespace.cozystack.io/gateway: tenant-root.
but actually it's accessible after the cilium-envoy issue fixed, so it's not the root cause of causing connection failed.
3. cert-manager is started without - --enable-gateway-api=true, causing the HTTPRoute failed to get its own cert.
i manually add the flag to the deployment, and it's not being reconcile away.
i checked the packages/system/cert-manager/values.yaml, seems like no flag to turn this on.
hope my findings can help.
let me know if anything else that i can help.
@lexfrei @tym83