Barney Boutwood struck in injury-time winner to dump Storrington out of the Sussex Senior Cup on Tuesday.
In a game of very few chances, Boutwood volleyed home at the far post on 90 minutes to give Arundel a narrow 1-0 win.
Swans had their goalkeeper Gary Elliott to thanks for not conceding earlier in the clash.
He pulled off a number of fine saves and had looked to have forced extra-time.
However, there was nothing he could do to prevent Boutwood volleying home Liam DaCosta’s free-kick late on.
Storrington boss Peter Matthews was pleased how his side fared against division-higher Arundel and said: “It wasn’t a great game but I’m pleased we matched them and the effort of the boys was excellent.
“Our keeper made some great saves but we were beaten by a terrific goal.”
On Saturday, Storrington won 5-1 away at Saltdean in Division 1 of the Southern Combination League to move back up to second.
Swans’ travel to Haywards Heath in the Division 1 Challenge Cup second round on Saturday.
Don’t miss out on all the latest breaking news where you live.
Here are four ways you can be sure you’ll be amongst the first to know what’s going on.
1 Make this website your homepage
2 Like our Facebook page at facebook.com/pages/Sport-Sussex
3 Follow us on Twitter @SportSussex
4 Register with us by clicking on ‘sign in’ (top right corner). You can then receive our daily newsletter AND add your point of view to stories that you read here.
And do share with your family and friends - so they don’t miss out!