Sunan Abi Dawud, Hadith 2015

Usamah bin Sharik said “I went out with the Prophet to perform Hajj, and the people were coming to him. One would say “Apostle of Allaah I ran between Al Safa’ and Al Marwah before going round the Ka’bah or I did something before the its proper time or did something after its proper time. He would reply “No harm will come; no harm will come except to one who defames a Muslim acting wrongfully. That is the one who will be in trouble and will perish.

حَدَّثَنَا عُثْمَانُ بْنُ أَبِي شَيْبَةَ، حَدَّثَنَا جَرِيرٌ، عَنِ الشَّيْبَانِيِّ، عَنْ زِيَادِ بْنِ عِلاَقَةَ، عَنْ أُسَامَةَ بْنِ شَرِيكٍ، قَالَ خَرَجْتُ مَعَ النَّبِيِّ صلى الله عليه وسلم حَاجًّا فَكَانَ النَّاسُ يَأْتُونَهُ فَمَنْ قَالَ يَا رَسُولَ اللَّهِ سَعَيْتُ قَبْلَ أَنْ أَطُوفَ أَوْ قَدَّمْتُ شَيْئًا أَوْ أَخَّرْتُ شَيْئًا ‏.‏ فَكَانَ يَقُولُ ‏ "‏ لاَ حَرَجَ لاَ حَرَجَ إِلاَّ عَلَى رَجُلٍ اقْتَرَضَ عِرْضَ رَجُلٍ مُسْلِمٍ وَهُوَ ظَالِمٌ فَذَلِكَ الَّذِي حَرِجَ وَهَلَكَ ‏" ‏ ‏.‏

sunnah.com

also referenced under: Hadith 2010 (Hasan)