You pretty much nailed it. Accepting the Bible as inerrant just leads to the kind of hateful self righteous bigotry we see too often today in the fundamentalist churches. There are certain portions that we can all agree seem to be divinely inspired, almost perfectly reflecting a divine standard. John 3:16, John 13:34–35, Galatians 5:22-23. I could go on. In each case these are verses that point to love and unity between people and God. These are the parts of the Bible which are so compelling they draw us to seek more for ourselves and our fellow man.
They truly give meaning to life and fill us with joy and peace, love and goodwill for all. That is where our focus should be.