Say you have two process running under the same Linux system and using UDP for the communication. The most obvious case for the packet loss is socket buffer size.
Say one process is sending at 10mbps and other is receiving at 5mbps so buffers will get full after sometime and packets will get dropped.
This I am just making a guess as a obvious problem, just try to adjust the send and recv buffer size both and see the impact...