"...We weren't asking."
Riley truly did try to move away as the portal that Navi summoned suddenly flew toward him. It was not even moving particularly fast, and yet for some reason, the only thing he could do was just look at Aerith, and Hannah, who slightly stretched her hand toward him but not completely.
Riley was going to reach for her hand, but his finger only moved an inch before he saw his sister's face. All of this happened in a single second, and yet for Riley, he had thought of a thousand outcomes that could happen if he reached for her hand. And so, in the end, Riley just continued to stare at both Aerith and Hannah's faces, almost as if cherishing the look of worry on their faces before he was completely swallowed up by the portal.
And there, Riley saw a scenery he couldn't quite explain — but still, he did.