The book mostly follows the lives of Plumfield boys who were introduced in Little Men, particularly Tommy, Emil, Demi, Nat, Dan, and Professor Bhaer and Jo's sons Rob and Teddy, although the others make frequent appearances as well, and Josie and Bess, two cousins of Demi and Daisy. The book takes place ten years after Little Men. Dolly and George become college students dealing with the temptations of snobbery, arrogance, self-indulgence, and vanity. Tommy becomes a medical student to impress childhood sweetheart Nan, but after trying to win her favor by "accidentally" falling in love with and proposing to Dora, he finds he is happier with her and quits medicine to join his family's business. Rob and Ted fall into a scrape with Dan's dog that draws them closer in the end.
Sections of Jo's Boys follow the travels of former students who have deep emotional ties to Plumfield and the Bhaers. Professor Bhaer's nephew Emil had become a sailor, encouraged by Mr. Bhaer, and works hard before being promoted and taking off on his first voyage as second mate, and gets a chance to shows his true strength when he is shipwrecked and the captain becomes badly injured, as he encourages and helps the sailors and the sick captain until they find refuge on a passing ship. Dan, after wandering as a sheep-herder in Australia and such, and still having the ever-present admiration of Teddy, he seeks his fortune in the West, but when Dan ends up committing the one sin he and Jo always feared he would, though it was in defense of both self and a younger boy, Blair, when he kills a man who cheats Blair in gambling, Dan is sentenced to a year in prison with hard labor, and resists a prison escape and perseveres. Josie ends up discovering her actress hero and eventually wins her support and becomes a great actress herself, while Bess remains the "Princess" throughout, showing an unhealthy passion in art, but encouraged by her father, leaves her clay more often for the sun. Nat begins a musical career in Europe that takes him away from Daisy, only to fall in with a frivolous crowd and unintentionally leads a young woman on, whom he then does not marry, but makes things right when he narrowly avoids debt and lives on the right path for the rest of his time there.
At the end of Jo's Boys, both Franz and Emil find their own wives, and Nat and Daisy are engaged by the end of the book. Nan remains single as a professional doctor, dedicated to her medical career. Jo discovers Dan's fancy for Bess, though she is not entirely surprised at this. Dan tells her of this fancy and that Bess seemed like the bright northern star which guided him. However, knowing that Amy and Laurie would never approve, Jo makes sure that the Laurences are away when Dan leaves again. Sadly, Dan dies protecting the Indians but lies in peace as if he, Aslauga's Knight had done his duty.