Born in Egypt, Pagett spent most of her childhood in Japan and Hong Kong because of her father's job. As a teenager, she was sent back to the UK to attend a Catholic boarding school. Afterwards, her parents planned for her to attend a finishing school in Switzerland, but she chose to go to RADA.