There are plenty of low end providers that support IPv6 only.

At that scale price of IPv4 is the highest cost of the VPS.

Here is a list of providers I created back in 2022.

https://blog.miyuru.lk/ipv6-hosting-2022/