height map jaggies

[shapelessform]

i can't seem to get rid of the jagged edges where land meets water.. i've blurred in photoshop like nobody's business, used the gradient tool, adjusted the 'smooth terrain' slider in-game, but nothing seems to work.

any hints?