To add in a new public holiday date, you can navigate to Settings > Payroll Rules > Public Holiday Rules.
Then on the right click "Add Date" and type in the date you wish to add to the system.
Then when payroll is processed for that period of time the date will be treated as a public holiday.