Muwatta Malik, Book 54, Hadith 23 (USC-MSA)

Malik related to me that Yahya ibn Said said, "A woman came to the Messenger of Allah, may Allah bless him and grant him peace, and said, 'Messenger of Allah, we moved into a house when our number was great and our wealth was abundant. Now our number has dwindled and the wealth has gone.' The Messenger of Allah, may Allah bless him and grant him peace, said, 'Leave it as blameworthy.' "

وَحَدَّثَنِي مَالِكٌ، عَنْ يَحْيَى بْنِ سَعِيدٍ، أَنَّهُ قَالَ جَاءَتِ امْرَأَةٌ إِلَى رَسُولِ اللَّهِ صلى الله عليه وسلم فَقَالَتْ يَا رَسُولَ اللَّهِ دَارٌ سَكَنَّاهَا وَالْعَدَدُ كَثِيرٌ وَالْمَالُ وَافِرٌ فَقَلَّ الْعَدَدُ وَذَهَبَ الْمَالُ ‏.‏ فَقَالَ رَسُولُ اللَّهِ صلى الله عليه وسلم ‏ "‏ دَعُوهَا ذَمِيمَةً ‏" ‏ ‏.‏

sunnah.com

also referenced under: Book 54, Hadith 1788 (In-Book)