You could pay homage to the first bishop of Rome by naming your son after
St. Peter's Basilica, one of the most important Catholic pilgrimage sites. The first bishop of Rome was actually buried on the site where the Basilica is located today, and of course it's where pontiffs, past and present, have presided over many liturgies. Hopefully your own little Peter will be a rock to your own family.