BP_WaterManager does the floating. You need one per level.
A floating object is any actor with a physics mesh, the actor tag Buoyancy and one or more BPC_Pontoon components.
Each pontoon is an invisible sphere. Its size comes from the component's scale.
Each pontoon pushes up where it sits in the water. Several pontoons let a box or a boat tilt and roll.
BP_BuoyantActor_Base is a ready base class. It comes with a physics mesh, the tag and replication on.
BP_BuoyantBox adds four corner pontoons with multiplier 2.5 and damping 300. Copy those values to start.
Three more ready-made floaters sit in Blueprints/Actors/BuoyantActors. The demo lagoon uses all three:
Each one floats on a hidden box, with the visible meshes attached to it. Copy that setup for meshes that have no simple collision.
Heads up: a mesh that only touches a water material doesn't float. It needs the physics mesh, the tag and the pontoons.