You would also say I touched the book.
Although it's a strange thing to say, because what does it matter?
Books exist to be touched, after all, and especially to be read.
If it matters to you that it's accidental, say I touched the book accidentally.
Touch is a Sense Verb, and they have special syntactic affordances.
You're talking about the Volitional versus the Non-volitional varieties of sense verbs.
Volitional means something you do on purpose. Non-volitional means you did it accidentally.
It's the difference between spill and pour. English doesn't usually distinguish volitionality
in its active verbs. In some cases one can tell, and in others it doesn't matter.
But sense verbs are special. The long-distance senses, sight and hearing, both use different verbs
for volitional (listen, look) versus non-volitional (hear, see). They're all active verbs, and the non-volitional ones are transitive (He saw/heard her), but the volitional ones are intransitive, and require a preposition (He looked at/listened to her). The other senses are less distinctive.