As the kaya is cooking in the pot, keep stirring so it cooks evenly.
Keep it on medium heat, and don't let the kaya boil. You can turn it down to low if you see it thickening way too fast. (You can usually tell from the amount of steam coming out of the liquid; you want gentle steam wisps not big puffs.)