The genitals and the pleasure of begetting counteract the distresses of family encumbrances. One would cease to generate altogether if there were not, by the grace of the Lord, a coating, a pleasure-giving substance, on the surface of the generative organs. This substance gives a pleasure so intense that it counteracts fully the distress of family encumbrances. A person is so captivated by this pleasure-giving substance that he is not satisfied by begetting a single child, but increases the number of children, with great risk in regard to maintaining them, simply for this pleasure-giving substance. This pleasure-giving substance is not false, however, because it originates from the transcendental body of the Lord. In other words, the pleasure-giving substance is a reality, but it has taken on an aspect of pervertedness on account of material contamination. In the material world, sex life is the cause of many distresses on account of material contact. Therefore, the sex life in the material world should not be encouraged beyond the necessity. There is a necessity for generating progeny even in the material world, but such generation of children must be carried out with full responsibility for spiritual values.
(Srimad Bhagavatam------2:6:8------purport).

The sex demand is inevitable for everyone, but one who has a fixed wife is saved from the onslaught of the sense enemies. A man who possesses a good wife does not create a disturbance in society by corrupting virgin girls. Without a fixed wife, a man becomes a debauchee of the first order and is a nuisance in society—unless he is a trained brahmacārī, vānaprastha or sannyāsī. Unless there is rigid and systematic training of the brahmacārī by the expert spiritual master, and unless the student is obedient, it is sure that the so-called brahmacārī will fall prey to the attack of sex. There are so many instances of falldown, even for great yogīs like Viśvāmitra. A gṛhastha is saved, however, because of his faithful wife.Sex life is the cause of material bondage, and therefore it is prohibited in three āśramas and is allowed only in the gṛhastha-āśrama. The gṛhastha is responsible for producing first-quality brahmacārīs, vānaprasthas and sannyāsīs.
(Srimad Bhagavatam------3:14:20------purport).

An important word in this verse is ūrdhva-retasaḥ, which means brahmacārīs who have never discharged semen. Celibacy is so important that even though one does not undergo any austerities, penances or ritualistic ceremonies prescribed in the Vedas, if one simply keeps himself a pure brahmacārī, not discharging his semen, the result is that after death he goes to the Satyaloka. Generally, sex life is the cause of all miseries in the material world. In the Vedic civilization sex life is restricted in various ways. Out of the whole population of the social structure, only the gṛhasthas are allowed restricted sex life. All others refrain from sex. The people of this age especially do not know the value of not discharging semen. As such, they are variously entangled with material qualities and suffer an existence of struggle only.
(Srimad Bhagavatam------4:11:5------purport).

Then as far as dama (self-control) is concerned, it is not only meant for other orders of religious society, but is especially meant for the householder. Although he has a wife, a householder should not use his senses for sex life unnecessarily. There are restrictions for the householders even in sex life, which should only be engaged in for the propagation of children. If he does not require children, he should not enjoy sex life with his wife. Modern society enjoys sex life with contraceptive methods or more abominable methods to avoid the responsibility of children. This is not in the transcendental quality, but is demoniac. If anyone, even if he is a householder, wants to make progress in spiritual life, he must control his sex life and should not beget a child without the purpose of serving Kṛṣṇa. If he is able to beget children who will be in Kṛṣṇa consciousness, one can produce hundreds of children, but without this capacity one should not indulge only for sense pleasure.
(Bhagavad-Gita-------16:1-3--------purport).

A devotee should observe the vow of celibacy. Celibacy does not necessitate that one be absolutely free from sexlife; satisfaction with one's wife is permitted also under the vow of celibacy. The best policy is to avoid sex life altogether. That is preferable. Otherwise, a devotee can get married under religious principles and live peacefully with a wife.
(Srimad Bhagavatam------3:27:7------purport).

All living entities are part and parcel of the Supreme Lord. Unfortunately, in this present civilization both men and women are allowed to be attracted to one another from the very beginning of life, and because of this they are completely unable to come to the platform of self-realization. They do not know that without self-realization they suffer the greatest loss in the human form of life. Thinking of a woman always within one's heart is tantamount to lying down with a woman on a valuable bedstead. The heart is the bedstead, and it is the most valuable bedstead. When a man thinks of women and money, he lies down and rests on the arms of his beloved woman or wife. In this way he overindulges in sex life and thus becomes unfit for self-realization.
(Srimad Bhagavatam------4:27:4------purport).