Challenges facing the banking sector have taken a toll on businesses, with private sector credit dropping to a four-year low according to Bank of Ghana data.