This only indicates a lack of understanding of playing the board to your advantage. I often start out just as you say (4 gems far apart) and end up winning, even against opponents stronger than me (the usual case when I raid btw).
@NittanyLionRoar posts excellent videos on how to play the boards.