The　emerging　haptic　technology　has　introduced　new　media　perceptions　and　also　increased　the　immersive　experiences　of　end-users.　To　date,　novel　haptic-audio-visual　environments　and　their　Quality　of　Experience　(QoE)　assessments　are　still　challenging　issues.　In　this　work,　we　investigate　the　haptic-visual　interaction　QoE　in　virtual　as　well　as　real-world　environments.　First,　we　establish　a　haptic-visual　interaction　platform　based　on　a　balance　ball　Virtual　Reality　(VR)　game　scene　and　a　haptic-visual　interaction　platform　with　data-glove-assisted　remote　control.　Second,　we　conduct　subjective　tests　to　qualitatively　and　quantitatively　analyze　the　impacts　of　system-related,　user-related　and　task-related　factors　on　QoE　evaluation.　Third,　we　propose　learning-based　QoE　models　to　effectively　evaluate　the　user-perceived　QoE　in　haptic-visual　interaction.　In　the　future　work,　we　aim　to　focus　on　the　improvement　of　the　two　established　platforms,　with　the　addition　of　audio-related　influencing　factors　and　more　haptic　feedback,　and　optimizing　the　proposed　QoE　model　for　further　improvement　of　haptic-audio-visual　interaction　applications.