Djokovic had a challenging mat