The hardest part for a Sotapanna is to overcome kama raga.
– As we know, kama raga and patigha are related and both are lessened at the Sakadagami stage and removed at the Anagami stage.
If you read many suttas in the Digha Nikaya like the Samannaphala Sutta (DN 2) that I mentioned above, they always describe the experience of a person who has become a bhikkhu, i.e., left the family life.
– It is quite difficult to overcome kama raga as a householder.
– But, of course, Dhamma will guide one to the Arahant stage even if that happens over a few lives. And, no rebirths in the apayas until that happens.
P.S. Furthermore, as time goes on, the time in upacara/anuloma “samadhi states” will get longer. One will be get into jhana with time. As I also mentioned above, that time depends on the ability/habit to get into jhana cultivated over past recent lives.
P.P.S. As we also know, suppression/elimination of kama raga is also a requirement for anariya/Ariya jhana. That again is hard to do while being a “householder.”