@Mohit Gurnani maybe it is best to go back to basics to answer your question.
What is your main purpose of off-roading:
1- Dune bashing ?
2- Over-landing ?
3- Adventure truck ?
4- Do you need space to haul in the family into adventures ? with their gear?
To @Gaurav’s point: Is it an ultimate goal for you to reach the fastest or getting to the tallest point?
While I’m aware that none of the above points are answers to your question but sometimes going back to basics might help you find the answer. All in all, you already have the car and it is one of the top off-roading cars. Maybe, @Frederic’s point about balancing your drive levels could be a compromise to keep the “car abuse” concern you have in check.
The point you bring probably goes through the mind of many off-roaders, if not all.
Maybe there is no straight forward answer as there are also other elements in play, at a more personal level, such as your appetite to write-off the invested amount in a new car based on financial aspects and comfort levels, among other points.
One point I have seen and heard from multiple off-roaders is that many started off with an objective for exploration, overlanding or having an adventure truck then slowly found themselves stuck in the loop of dune bashing. This is why I’m suggesting going back to basics as you might find some answers there which might help you in your decision process.
Hope this helps, even slightly.