Interim boss Anthony Storey cursed missed chances as Horsham were plunged back into the relegation mire on Saturday.
A goal in each half from Ben Brown and Michael Turner saw Herne Bay clinch their first win in seven to halt Hornets’ resurgence.
A 5-1 win for fellow strugglers Redhill away at Corinthian Casuals was another bitter blow to send Horsham five points adrift at the foot of the table.
Storey said: “In the first half we created three or four great chances and we did not take those chances. You know in football that if you do not take your chances then it comes back to bite you and that is exactly what happened.
“I am very disappointed as the feeling today was to get three points. We were at home and especially after the last performance against Carshalton.
“I felt like we should have gone in front in the first half as Tony had two great chances and then we went back out in the second half and Trevor should have scored. It would have been a different game if he had taken that and made it 1-1. It’s a game that we have lost 2-0, but had three great opportunities.
“Both of their goals came from individual mistakes. The first was when Tom Gilbert got caught and Gareth Williams for the second one, for me, he should have saved it comfortably. But if there is one player you cannot dig out this season, it’s Gareth as he has been in exceptional form this year.”
Storey is hopeful of adding two more faces before his side welcome 18th placed East Grinstead to Gorings Mead on Wednesday night.
Kick-off is 7.30pm.