Wyld, the elder was a cartographer and geographical publisher, was the son of Joseph Woolley Wyld, cheese monger, and his wife, Jane; his parents were both Scots, though they lived in London. James was apprenticed to the map publisher William Faden from 1804 to 1811, taking over the business when Faden retired.