After I laid out al the stones where I wanted them, I filled all the gaps with more dry mix.