@steffen phil,
These things operate at completely different levels of explanation. I think the entire tendency to rationalise or explain Deity with reference to 'his marvellous handiwork', which commenced in late medieval period, was fatally mistaken, and we are now reaping its fruits.
To me, the only purpose of any of the spiritual traditions is to bring about a fundamental change in your outlook on life. My 'theory of religion' is not that religion belongs to the childhood of man and should now be replaced by science. That is known as the 'Golden Bough' theory, called after a book on comparative religion by that name, by Sir James Frazer,which situates religion at essentially a primitive stage of human development. It is the implicit paradigm of nearly all scientifically-inclined thinkers when it comes to religion
But I don't believe that religion ever should have been understood as being in the business of literal explanation in the first place. It applies to a much more general, and much deeper, level of understanding. This is why it deals in myth and metaphor, in allegory and legend. It deals with the problems of existence and mortality on a completely different level to scientific theory. So I am completely uninterested in attempts by ID to 'prove' the existence of God.
My reading of the current cultural situation in the West is that Darwinian theory has been interpreted by many as being a replacement for the traditional cosmology, and even was by Darwin himself - there are many allusions to this in the Origin. And such an interpretation really makes sense if you think that the Biblical account was literally true, a view that was widely held in Western society at the time of Darwin's publications. So to put it very crudely, 'we used to believe it was all the work of God, now we understand that there are simply natural processes at work which may one day yield to scientific understanding'. But if the literalist interpretation of scripture is put to one side, then a different perspective on the scientific account may emerge also. In other words, much of the cultural impact of Darwinism itself originates from a particular, historically determined religious attitude, of which this theory appears to be a negation. It is for exactly this reason that I believe many scientifically-oriented thinkers have completely over-reached in the context of this debate. Darwinism, as a philosophy, has very much become defined by what it denies. A considerable amount of its philosophical speculation is based on the
God that is not. It takes much of the preceding philosophical tradition, and tries to methodically eliminate the religious elements, which are now considered outmoded. This is how you end up with the '
protestant atheism' of a Richard Dawkins (whom, incidentally, I most admire as a science writer.) But the resulting hollowed-out and stuffed cadaver does not amount to a coherent philosophy.
Now these are obviously very weighty questions which one tries to summarize at one's peril. There have been many debates on the Forum about this, which is arguably the most significant question in practical philosophy today, in my view. It all comes down, in my mind, to the nature of
intention. And my general view is that the Universe is intentional, so that does put me firmly in the religious (though not Christian) camp. But at the same time, I am agnostic in many of the particulars. I certainly don't subscribe to any kind of creationism and have never been attracted by the 'ID' school, although I don't think that their arguments can be dismissed nearly so easily as many here seem to think. But there are lot of extremely heavyweight books from neither the atheist nor creationist side to consider, for example:
Life's Solution: Inevitable Humans in a Lonely Universe - Simon Conway Morris
Why Us? How Science Re-discovered the Mystery of Ourselves - James le Fanu
Information Theory, Evolution and the Origin of Life - Hubert P. Yockey
The Anthropic Cosmological Principle - Barrow, Tipler, Wheeler
There is also a very interesting essay by Thomas Nagel called '
Evolutionary Naturalism and the Fear of Religion' which is published in a book of his essays called The Last Word.
The Conway Morris book, in particular, specifically addresses the question raised in the OP, in vast detail. He is professor of paleobiology at Cambridge.
I think our understanding of physics was completely revolutionized by relativity and quantum theory. I don't really see why the essentially 19th century outlook that underlies the 'neo-darwinian synthesis' ought not to be subject to a comparable revolution. I think one reason it appears to be so successful is that there is this subconscious awareness of the biblical literalism we think it replaced - it sure is a lot better than that. But I really think the whole paradigm of the Selfish Gene changing through random mutation and subject only to natural selection, is under a lot of strain. The le Fanu book is good on those points.
Anyway there's a lot of material the think about and consider. You're obviously a highly intelligent and very careful thinker. At this point in time, all I would say is 'keep an open mind'.