So any devotee can fall down if he remains prākṛta-bhakta. So he has to raise himself above this in the madhyama-adhikāra. So here it is said that sva-nirmiteṣu nirviṣṭo bhuṅkte bhūteṣu tad-guṇān. So we are not enjoying actually. We are enjoying the interaction of the three modes of material nature. And we are thinking... The same thing, as my Guru Mahārāja used to say, that licking up the bottle of honey. That is not real honey. You have to open the bottle of the honey and lick up the real honey, then you'll get taste. That is advancement of spiritual knowledge.
satāṁ prasaṅgān mama vīrya-saṁvido
bhavanti hṛt-karṇa-rasāyanāḥ kathāḥ...
(S.B.3:25:25)
Therefore, if we do not associate with the advanced devotees, uttama-adhikārī, if we simply want to remain in the lowest stage of devotional service, then we are not making progress. Then we shall simply enjoy the material field, without entering into the spiritual platform.
(Lecture on Srimad Bhagavatam--Vrindavana--12th. November, 1972).

But Śrī Advaita Ācārya Prabhu felt pained to see all the people without Kṛṣṇa consciousness simply merging in material sense enjoyment.
A bona fide devotee of Lord Kṛṣṇa is always pained to see the fallen condition of the whole world. Śrīla Bhaktisiddhānta Sarasvatī Ṭhākura used to say, "There is no scarcity of anything within this world. The only scarcity is of Kṛṣṇa consciousness." That is the vision of all pure devotees. Because of this lack of Kṛṣṇa consciousness in human society, people are suffering terribly, being merged in an ocean of nescience and sense gratification. A devotee onlooker is very much aggrieved to see such a situation in the world.
(Sri Caitanya caritamrta--1:13:67--translation and purport).

So, so long we are not able to come to the platform of thinking the gold and the stone on the equal value, we have to follow these rules and regulation. But that is the highest consideration. Just like Sanatāna Goswāmī, he didn't care for this touchstone. Not for the ordinary man. The ordinary man cannot make that all of a sudden; therefore it is not for him. So what was the purpose of saying that Gītā says sama-loṣṭrāśma-kāñcanaḥ? Why did you raise this question? What is the purpose? We can not raise, ordinary man, but why did you raise this question? What is the purpose?
Guest: I think this is practical for a householder.
Prabhupāda: But I don't think. Then what is the difference? Therefore, household luxury is allowed up to fiftieth year in order to learn, pañcaśordhvaṁ vanaṁ vrajet. That is Vedic system. Not to remain householder until you are fired, you see, or you are taken by death. Just like our big leaders. They won't give up their householder's life unless he is fired to death, or death takes him away. That is not very good proposition. My Guru Mahārāja used to say that this householder life means it is a concession for sense gratification. That's all. But our position is that we should not continue sense gratification for all the life. The sense gratification process is going on by the hogs and dogs throughout the whole life, but we should not be like hogs and dogs. We should cease at a certain time. Pañcaśordhvaṁ vanaṁ vrajet. So far, no more. That should be our model. Not that continue. That, that is Vedic way of life. Pravṛttiṁ-nivṛtti. So long pravṛtti, attraction for household life, and next nivṛtti, "Now I shall be detached." But the asuras, as it is said, pravṛttiṁ ca nivṛttiṁ ca na vidur āsurāḥ janāḥ (B.G.16:7). And if you continue simply pravṛtti-mārga, then you'll remain asura; you don't become deva. The whole process Vedic system is, even if you are asuras, gradually by practice, by good association, by following the principles of śāstra, we can become deva.
(Lecture on Bhagavad-Gita--16:5--Calcutta--23rd. February, 1972).