Reading this reminds me of the Dane Cook routine about the one friend that reads really esoteric stuff, like the history of the copy machine. His friend is fascinated by it, and its implications for modern life while Dane despises it with a passion.
Those books that you hate have three vital components that you must grasp in order to make reading them relevant.
1. Use of the English language. Literature, at it's most basic level, in an exercise in artistic expression. If you leave out the metaphors and themes and everything else, the basic linguistic structure is the same as a sonata, or an oil painting, or a marble sculpture. Therefore one purpose of literature is as example of language use, and the admiration thereof. This creates people who value language, and will utilize it properly for communication, or mere expression. This increases our efficiency, enjoyment, and compatibility.
2. Shared experience. A culture (rather a school, state, nation, or planet) is made up of shared experiences and understandings. Take the Star Trek episode Darmok where they encounter a race that speaks only in metaphor. The words are all English, but because they lack a shared experience there can be no communication. A more modern example would be nom nom. Because you share in certain cultural aspects if someone asks you to go nom, you can make an accurate reply. While culture is somewhat temporal (existing in the moment differently than all other moments), it is also cumulative (building on all previous cultures). For example, you cannot share a common experience about current race relations in America without understanding race relations in the 60s, but also just after the civil war, before the civil war, etc. Taking any one of those cultures alone cannot explain the current situation. This is what books do: they provide a common shared experience that the members of a culture share, and use to function in society as well as build understanding and evolve to greater accomplishments.
3. Metaphor. Many (probably most) books are making a point. They're arguing something, or reflecting something. There is nothing new in the universe. Every thought you have has been thought before, everything you've experienced has been experienced before, etc. We understand what goes on inside ourselves, and in the world around us, by studying the same feelings and events in others. In a recent thread here there was discussion about increasing requirements for citizenship. Pretty much everything said in that thread was covered in Starship Troopers in one way or another. Reading that book causes a person to wrestle with citizenship and duty and identity in a way that's enjoyable and manageable. Read a few more and you being to develop a broad picture of how different thought patterns about a subject relate. That enables a person to cast a meaningful vote at the polls because they have an understanding, and an opinion, about the issue.