The book begins with the death of Helen Carey, the much beloved mother of nine-year-old Philip Carey. Philip has a club foot and his father had died a few months before. Now orphaned, he is sent to live with his aunt and uncle, Louisa and William Carey.
Early chapters relate Philip's experiences at his uncle's vicarage. Aunt Louisa tries to be a mother to Philip, but his uncle is coldly disposed towards him. Philip's uncle has a vast collection of books, and Philip enjoys reading to find ways to escape his mundane existence. Less than a year later, Philip is sent to a boarding school. His uncle and aunt wish for him to eventually attend Oxford. Philip's disability and sensitive nature make it difficult for him to fit in with the other students. Philip is informed that he could earn a scholarship for Oxford, which both his uncle and school headmaster see as a wise course, but Philip insists on going to Germany.
In Germany, Philip lives at a boarding house with other foreigners. He enjoys his stay in Germany. Philip's guardians decide to take matters into their own hands and they persuade him to move to London to take on an apprenticeship. He does not fare well there as his colleagues resent him, because they believe he is a "gentleman". He goes on a business trip with one of his managers to Paris and is inspired by the trip to study art in France.
In France, Philip attends art classes and makes new friends, including Fanny Price, a poor and determined but talentless art student who does not get along well with people. Fanny Price falls in love with Philip, but he does not know and has no such feelings for her; she subsequently commits suicide.
