Name origins Baker obvious but what had a Palmer done?

Question
Name origins Baker obvious but what had a Palmer done?
Answer
Pilgrimage returned with palm leaf