Penitentially

Webster's Dictionary of the English Language

·adv In a penitential manner.