What fruit could this be?

I too believe it could be a passion flower vine... I have a friend who grows them, and i wikied passion flower, their info described a fruit very much like what u have described. They do grow wild in your part of the US, and it even stated that they are refered to as "wild apricots".