Some U.S. style guides recommend hyphenating a "more [adjective]" phrase when the writer's intention is to express more in its qualitative (rather than quantitative) sense. The first step in enforcing this distinction is to see whether the phrase without hyphenation could be read as using more in a quantitative sense. In the poster's example, the phrase
viewers can watch more realistic 3D scenes and interact
can indeed be interpreted as using more qualitatively to convey the meaning
viewers can watch additional realistic 3D scenes and interact
or it can be interpreted as using more quantitatively to convey the meaning
viewers can watch relatively realistic 3D scenes and interact
If you consistently hyphenate the "more-[adjective]" term when you mean it qualitatively—and you consistently leave the "more [adjective]" term open when mean it quantitatively—in constructions that are ambiguous as written, you give readers a clear signal of how you want them to interpret the phrase. This result is the goal that The Chicago Manual of Style, fifteenth edition (2003) promotes in its discussion of hyphens and readability:
7.85 Hyphens and readability. A hyphen can make for easier reading by showing structure and, often, pronunciation. Words that might otherwise be misread, such as re-creation, should be hyphenated. Hyphens can also eliminate ambiguity. ... Similarly, the hyphen in much-needed clothing shows that the clothing is badly needed rather than abundant and needed. Where no ambiguity could result, as in public welfare administration or graduate student housing, hyphenation is not mandatory, though it is quite acceptable and preferred by many writers and editors.
In Chicago's presentation, "much-needed clothing" (qualitative much) and "much needed clothing" (quantitative much) correspond to "more-realistic 3D scenes" (qualitative more) and "more realistic 3D scenes" (quantitative more) in the poster's example.
Obviously, Chicago's approach isn't the only way to deal with hyphenating (or not) compound modifiers that start with more; but if done consistently, it offers readers the tangible benefit of reducing the number of ambiguous constructions in a text.