Hello!
As a few people have figured it out the hard way, Godot 4 native physics is a little bit unstable in some situations. And there was even a petition π regarding returning Bullet physics back into Godot4 which as I understand has been rejected by the developers.
If anybody is interested, after struggling for about 2 weeks I've finally made Godot3 Bullet module compile in Godot4. I had to insert a number of dummy methods to just make it compile as physics_server_3d.h has no information related to what all the virtual methods are supposed to do.
Also Godot developers did excellent job renaming literally almost every single method, every single property, and every single data type. It really doesn't add reliability in the process of porting even the code I made myself from v3 to v4 not talking about something I didn't ever look into π
As far as I understand, there are a few people interested in Bullet working in Godot4. The big problem is that servers/physics_server_3d.h has absolutely no documentation. And it is not clear what all numerous new methods are supposed to do. If you have any insights or willing to help, please check out the code: https://github.com/z80/ignition/tree/bullet/godot.
Please let me know.