The minister has publicly apologised following heavy backlash over his remarks to a journalist during a press conference.