Although I agree with your sentiment that circumstances, good or bad, reveal the man and that it is all about trusting and abiding in Christ no matter where we are, I think there is a strong biblical precedence for the notion that having more worldly prosperity and comfort presents additional challenges to the believer. Here are some verses to back up my point:
14 Curds from the herd, and milk from the flock,
with fat of lambs,
rams of Bashan and goats,
with the very finest of the wheat—
and you drank foaming wine made from the blood of the grape.
15 “But Jeshurun grew fat, and kicked;
you grew fat, stout, and sleek;
then he forsook God who made him
and scoffed at the Rock of his salvation.
16 They stirred him to jealousy with strange gods;
with abominations they provoked him to anger.
23 And Jesus said to his disciples, “Truly, I say to you, only with difficulty will a rich person enter the kingdom of heaven. 24 Again I tell you, it is easier for a camel to go through the eye of a needle than for a rich person to enter the kingdom of God.”
24 “No one can serve two masters, for either he will hate the one and love the other, or he will be devoted to the one and despise the other. You cannot serve God and money.
9 But those who desire to be rich fall into temptation, into a snare, into many senseless and harmful desires that plunge people into ruin and destruction. 10 For the love of money is a root of all kinds of evils. It is through this craving that some have wandered away from the faith and pierced themselves with many pangs.
1 Timothy 6:9-10
5 Listen, my beloved brothers, has not God chosen those who are poor in the world to be rich in faith and heirs of the kingdom, which he has promised to those who love him?
1 Come now, you rich, weep and howl for the miseries that are coming upon you. 2 Your riches have rotted and your garments are moth-eaten. 3 Your gold and silver have corroded, and their corrosion will be evidence against you and will eat your flesh like fire. You have laid up treasure in the last days. 4 Behold, the wages of the laborers who mowed your fields, which you kept back by fraud, are crying out against you, and the cries of the harvesters have reached the ears of the Lord of hosts. 5 You have lived on the earth in luxury and in self-indulgence. You have fattened your hearts in a day of slaughter. 6 You have condemned and murdered the righteous person. He does not resist you.
9 “‘I know your tribulation and your poverty (but you are rich) and the slander of those who say that they are Jews and are not, but are a synagogue of Satan.
8 “‘I know your works. Behold, I have set before you an open door, which no one is able to shut. I know that you have but little power, and yet you have kept my word and have not denied my name.
15 “‘I know your works: you are neither cold nor hot. Would that you were either cold or hot! 16 So, because you are lukewarm, and neither hot nor cold, I will spit you out of my mouth. 17 For you say, I am rich, I have prospered, and I need nothing, not realizing that you are wretched, pitiable, poor, blind, and naked. 18 I counsel you to buy from me gold refined by fire, so that you may be rich, and white garments so that you may clothe yourself and the shame of your nakedness may not be seen, and salve to anoint your eyes, so that you may see.
This is obviously not an exhaustive list, but the bible is quite clear that having more in this life presents certain difficulties to the believer. This isn't to minimize the hardship and struggle faced by those who are persecuted for their faith and endure through poverty, but that they in a sense have a clearer path laid before them in their walk with the Lord (less distractions to say the least). It is usually those who are in a more humble (poor, difficult, etc) condition that realize and feel a greater need for God.