Alright I am making this topic as many don't seem aware of this issue. The reason this is happening is due to some accounts having really bad netsettings, hence people will see you much earlier than you can see them. I have this issue...

Created in blender, I setup a scene of how the A site of haven would look like if its night time https://preview.redd.it/m7opymfzvy491.png?width=1920&format=png&auto=webp&s=0a6f9c002d9f0c2ea931bfd9ae7d2d7bbe9f3093