Muwatta Malik, Book 20, Hadith 126 (USC-MSA)

Yahya related to me from Malik that he had heard that if Sad ibn Abi Waqqas entered Makka late, he would go to Arafa before doing tawaf of the House and say between Safa and Marwa, and then do tawaf when he got back. Malik said, "The leeway is broad, if Allah wills." Malik was asked whether somebody that was doing obligatory tawaf could stop and talk with another man, and he said, "I do not like him to do that." Malik said, "Only someone who is pure (by being in wudu) should do tawaf of the House or say between Safa and Marwa."

وَحَدَّثَنِي عَنْ مَالِكٍ، أَنَّهُ بَلَغَهُ أَنَّ سَعْدَ بْنَ أَبِي وَقَّاصٍ، كَانَ إِذَا دَخَلَ مَكَّةَ مُرَاهِقًا خَرَجَ إِلَى عَرَفَةَ قَبْلَ أَنْ يَطُوفَ بِالْبَيْتِ وَبَيْنَ الصَّفَا وَالْمَرْوَةِ ثُمَّ يَطُوفُ بَعْدَ أَنْ يَرْجِعَ ‏.‏ قَالَ مَالِكٌ وَذَلِكَ وَاسِعٌ إِنْ شَاءَ اللَّهُ ‏.‏ وَسُئِلَ مَالِكٌ هَلْ يَقِفُ الرَّجُلُ فِي الطَّوَافِ بِالْبَيْتِ الْوَاجِبِ عَلَيْهِ يَتَحَدَّثُ مَعَ الرَّجُلِ فَقَالَ لاَ أُحِبُّ ذَلِكَ لَهُ ‏.‏ قَالَ مَالِكٌ لاَ يَطُوفُ أَحَدٌ بِالْبَيْتِ وَلاَ بَيْنَ الصَّفَا وَالْمَرْوَةِ إِلاَّ وَهُوَ طَاهِرٌ ‏.‏

sunnah.com

also referenced under: Book 20, Hadith 829 (In-Book)