You probably already know that most peppers need a lot of sun and take 60 days or more to mature. If you live in a northern climate as I suspect ( I'm in zone 4), you should try starting them indoors possibly as early as March or April and transplant them outside after the last frost. You can even put seed in the ground (outside) quite early as long as the shoots don't sprout before the frost danger as passed.
Its a plant early, harvest early kinda deal and you want to give them plenty of time to soak up the sun and make more little seeds for next year as well as for making your healing potions.
Better luck next year,