It's never too late to make a change if your present situation isn't working...
I'd suggest just taking the summer "off" and deciding what you want to do in the fall.
In the meantime, read up on the different approaches to homeschooling. I'd suggest reading David & Micki Colfax, John Holt (absolutely not to be missed) and David Guterson (author of the novel "Snow Falling on Cedars," who is also a high school teacher and homeschooling dad). Also, Home Education Magazine is good. Check out the homeschooling section at your local library, skipping the piles of the fundy books and magazines. On the web, you might want to start with the National Home Education Network, which was started to serve the needs of ALL homeschoolers, not just those on the political and religious right. Their website is at
http://www.nhen.org/. I also like
http://www.unschooling.org/.Check out your local homeschool social scene. Try to find an "inclusive" organization, which should include people of a wide variety of backgrounds, not just conservative Christians. You may be surprised how much your son enjoys the other kids and how much YOU like them as well! In my community, you could literally spend 24/7 doing nothing but social activities with other homeschooled kids. There are groups doing bowling, skating (ice and roller), dances (from ballroom to jazz to regular "teen" social dances), fencing, dance, hiking, theater, lasertag, scouting, 4H, horseback, archery, rockhounding, political activism, lego robotics, foreign languages, science, book clubs, park days, beach days.... The list of possibilities is endless.
That being said, I've heard that, in some areas (red, red rural areas for example) there may be a fairly small number of "inclusive" homeschoolers around, so your results may vary. Of course, there is nothing to prevent your son from hanging out with the neighborhood kids after school. Three o'clock in the afternoon comes a lot faster when you're homeschooling than when you're sitting in class, in my experience.
Finally, you're not "married" to your decision to try homeschooling. If your son is miserable, the public system will still be there next semester or next year.